[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:17:48.524875 23879 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.81.254:38629
I20260709 12:17:48.526497 23879 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:17:48.527598 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:48.544689 23886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:48.547205 23879 server_base.cc:1061] running on GCE node
W20260709 12:17:48.544705 23888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:48.544710 23885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:49.741806 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:49.742132 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:49.742348 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599469742327 us; error 0 us; skew 500 ppm
I20260709 12:17:49.743196 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:49.749643 23879 webserver.cc:533] Webserver started at http://127.23.81.254:37583/ using document root <none> and password file <none>
I20260709 12:17:49.750605 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:49.750851 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:49.751314 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:49.757280 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/master-0-root/instance:
uuid: "be40def9aaa64ab48f400c79e6a31210"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-mprf"
I20260709 12:17:49.765232 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:49.770929 23894 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.772158 23879 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:17:49.772536 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/master-0-root
uuid: "be40def9aaa64ab48f400c79e6a31210"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-mprf"
I20260709 12:17:49.772912 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:49.833032 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:49.835417 23879 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:17:49.836036 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:49.915863 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.254:38629
I20260709 12:17:49.915951 23945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.254:38629 every 8 connection(s)
I20260709 12:17:49.923882 23946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.945762 23946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210: Bootstrap starting.
I20260709 12:17:49.951845 23946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.953752 23946 log.cc:826] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210: Log is configured to *not* fsync() on all Append() calls
I20260709 12:17:49.958458 23946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210: No bootstrap required, opened a new log
I20260709 12:17:49.979166 23946 raft_consensus.cc:359] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be40def9aaa64ab48f400c79e6a31210" member_type: VOTER }
I20260709 12:17:49.979758 23946 raft_consensus.cc:385] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.980023 23946 raft_consensus.cc:740] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be40def9aaa64ab48f400c79e6a31210, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.981040 23946 consensus_queue.cc:260] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be40def9aaa64ab48f400c79e6a31210" member_type: VOTER }
I20260709 12:17:49.981575 23946 raft_consensus.cc:399] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:17:49.981869 23946 raft_consensus.cc:493] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:17:49.982244 23946 raft_consensus.cc:3060] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.986328 23946 raft_consensus.cc:515] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be40def9aaa64ab48f400c79e6a31210" member_type: VOTER }
I20260709 12:17:49.987071 23946 leader_election.cc:304] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be40def9aaa64ab48f400c79e6a31210; no voters: 
I20260709 12:17:49.988838 23946 leader_election.cc:290] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:17:49.989223 23949 raft_consensus.cc:2804] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:49.991482 23949 raft_consensus.cc:697] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [term 1 LEADER]: Becoming Leader. State: Replica: be40def9aaa64ab48f400c79e6a31210, State: Running, Role: LEADER
I20260709 12:17:49.992462 23949 consensus_queue.cc:237] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be40def9aaa64ab48f400c79e6a31210" member_type: VOTER }
I20260709 12:17:49.993468 23946 sys_catalog.cc:565] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:17:50.003151 23950 sys_catalog.cc:455] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be40def9aaa64ab48f400c79e6a31210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be40def9aaa64ab48f400c79e6a31210" member_type: VOTER } }
I20260709 12:17:50.003444 23951 sys_catalog.cc:455] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be40def9aaa64ab48f400c79e6a31210. Latest consensus state: current_term: 1 leader_uuid: "be40def9aaa64ab48f400c79e6a31210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be40def9aaa64ab48f400c79e6a31210" member_type: VOTER } }
I20260709 12:17:50.003908 23950 sys_catalog.cc:458] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:50.003930 23951 sys_catalog.cc:458] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:50.007349 23958 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:17:50.020526 23958 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:17:50.022809 23879 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:17:50.037555 23958 catalog_manager.cc:1383] Generated new cluster ID: fd884028131e46f899d4b0cb97b523ff
I20260709 12:17:50.037878 23958 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:17:50.061697 23958 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:17:50.063287 23958 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:17:50.076462 23958 catalog_manager.cc:6070] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210: Generated new TSK 0
I20260709 12:17:50.077466 23958 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:17:50.089408 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:50.099038 23968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:50.100706 23969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:50.103891 23971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:50.103957 23879 server_base.cc:1061] running on GCE node
I20260709 12:17:50.105103 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:50.105391 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:50.105602 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599470105580 us; error 0 us; skew 500 ppm
I20260709 12:17:50.106446 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:50.110749 23879 webserver.cc:533] Webserver started at http://127.23.81.193:41833/ using document root <none> and password file <none>
I20260709 12:17:50.111490 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:50.111765 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:50.112128 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:50.113744 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-0-root/instance:
uuid: "ead760b489bd46d991f3eb780b97345b"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-mprf"
I20260709 12:17:50.121641 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:17:50.127156 23976 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.128046 23879 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 12:17:50.128398 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-0-root
uuid: "ead760b489bd46d991f3eb780b97345b"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-mprf"
I20260709 12:17:50.128839 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:50.151372 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:50.153209 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:50.156059 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:50.161655 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:50.161976 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.162324 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:50.162562 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.254884 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.193:45775
I20260709 12:17:50.254937 24038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.193:45775 every 8 connection(s)
I20260709 12:17:50.262768 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:50.273188 24043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:50.274258 24044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:50.281335 24046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:50.283363 23879 server_base.cc:1061] running on GCE node
I20260709 12:17:50.284502 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:50.284782 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:50.285028 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599470285007 us; error 0 us; skew 500 ppm
I20260709 12:17:50.285818 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:50.287462 24039 heartbeater.cc:344] Connected to a master server at 127.23.81.254:38629
I20260709 12:17:50.287947 24039 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:50.289067 23879 webserver.cc:533] Webserver started at http://127.23.81.194:39877/ using document root <none> and password file <none>
I20260709 12:17:50.289263 24039 heartbeater.cc:507] Master 127.23.81.254:38629 requested a full tablet report, sending...
I20260709 12:17:50.289783 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:50.290064 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:50.290406 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:50.291805 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-1-root/instance:
uuid: "8aa459763c974a75896438500c34ce67"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-mprf"
I20260709 12:17:50.292933 23911 ts_manager.cc:194] Registered new tserver with Master: ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775)
I20260709 12:17:50.296052 23911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50466
I20260709 12:17:50.298112 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:17:50.303190 24051 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.304055 23879 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 12:17:50.304339 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-1-root
uuid: "8aa459763c974a75896438500c34ce67"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-mprf"
I20260709 12:17:50.304633 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:50.337777 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:50.339139 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:50.341269 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:50.344609 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:50.344897 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.345146 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:50.345316 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.445401 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.194:41929
I20260709 12:17:50.445523 24113 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.194:41929 every 8 connection(s)
I20260709 12:17:50.451876 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:50.461606 24117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:50.462589 24118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:50.469616 24114 heartbeater.cc:344] Connected to a master server at 127.23.81.254:38629
I20260709 12:17:50.470072 24114 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:50.471132 24114 heartbeater.cc:507] Master 127.23.81.254:38629 requested a full tablet report, sending...
W20260709 12:17:50.472702 24120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:50.473569 23911 ts_manager.cc:194] Registered new tserver with Master: 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:50.474685 23879 server_base.cc:1061] running on GCE node
I20260709 12:17:50.475436 23911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50478
I20260709 12:17:50.475620 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:50.475924 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:50.476118 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599470476097 us; error 0 us; skew 500 ppm
I20260709 12:17:50.476838 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:50.479698 23879 webserver.cc:533] Webserver started at http://127.23.81.195:45467/ using document root <none> and password file <none>
I20260709 12:17:50.480262 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:50.480465 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:50.480762 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:50.481904 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-2-root/instance:
uuid: "a5f0eb2faea242d589bdb266ff6573b1"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-mprf"
I20260709 12:17:50.486704 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:17:50.490175 24125 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.491063 23879 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:17:50.491382 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-2-root
uuid: "a5f0eb2faea242d589bdb266ff6573b1"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-mprf"
I20260709 12:17:50.491734 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599468354575-23879-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:50.505290 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:50.506726 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:50.508232 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:50.510608 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:50.510900 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.511235 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:50.511453 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.613339 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.195:43177
I20260709 12:17:50.613453 24187 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.195:43177 every 8 connection(s)
I20260709 12:17:50.630792 24188 heartbeater.cc:344] Connected to a master server at 127.23.81.254:38629
I20260709 12:17:50.631263 24188 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:50.631996 24188 heartbeater.cc:507] Master 127.23.81.254:38629 requested a full tablet report, sending...
I20260709 12:17:50.634199 23911 ts_manager.cc:194] Registered new tserver with Master: a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:50.634653 23879 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014473517s
I20260709 12:17:50.636045 23911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50482
I20260709 12:17:50.697131 23911 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50492:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:50.702211 23911 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:50.812222 24004 tablet_service.cc:1511] Processing CreateTablet for tablet ab3ad53a278446ffa35de80a3976d9dc (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:50.813988 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab3ad53a278446ffa35de80a3976d9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.815256 24003 tablet_service.cc:1511] Processing CreateTablet for tablet 55047b7f58b34a8688521e13af751d64 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:50.821734 23999 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7940128775462b9e0cbf12922e1d59 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:50.816282 24002 tablet_service.cc:1511] Processing CreateTablet for tablet ac0da620915d42a58dc2ed27add8d7e7 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:50.817374 24001 tablet_service.cc:1511] Processing CreateTablet for tablet b335fe11d3a242e783176b78a64ed172 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:50.832290 24003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55047b7f58b34a8688521e13af751d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.820102 24000 tablet_service.cc:1511] Processing CreateTablet for tablet ac162ff0242e42f58a32f5eb1c6d610b (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:50.838428 23998 tablet_service.cc:1511] Processing CreateTablet for tablet ff20bc77f4a74f67b1141010b27d5af5 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:50.845939 24075 tablet_service.cc:1511] Processing CreateTablet for tablet ac162ff0242e42f58a32f5eb1c6d610b (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:50.831513 24077 tablet_service.cc:1511] Processing CreateTablet for tablet ac0da620915d42a58dc2ed27add8d7e7 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:50.847764 24075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac162ff0242e42f58a32f5eb1c6d610b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.845098 24076 tablet_service.cc:1511] Processing CreateTablet for tablet b335fe11d3a242e783176b78a64ed172 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:50.849732 24001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b335fe11d3a242e783176b78a64ed172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.847684 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 55047b7f58b34a8688521e13af751d64 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:50.839541 24079 tablet_service.cc:1511] Processing CreateTablet for tablet ab3ad53a278446ffa35de80a3976d9dc (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:50.860605 24073 tablet_service.cc:1511] Processing CreateTablet for tablet ff20bc77f4a74f67b1141010b27d5af5 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:50.857589 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0da620915d42a58dc2ed27add8d7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.862990 23998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff20bc77f4a74f67b1141010b27d5af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.857991 24074 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7940128775462b9e0cbf12922e1d59 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:50.870944 24002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0da620915d42a58dc2ed27add8d7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.875751 24150 tablet_service.cc:1511] Processing CreateTablet for tablet b335fe11d3a242e783176b78a64ed172 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:50.863544 23997 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0a7c0d8f9b46eba04dece7ec4c2cc3 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:50.887445 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b335fe11d3a242e783176b78a64ed172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.888232 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55047b7f58b34a8688521e13af751d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.891261 24151 tablet_service.cc:1511] Processing CreateTablet for tablet ac0da620915d42a58dc2ed27add8d7e7 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:50.895936 24000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac162ff0242e42f58a32f5eb1c6d610b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.902341 23999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7940128775462b9e0cbf12922e1d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.900379 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b335fe11d3a242e783176b78a64ed172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.895660 24152 tablet_service.cc:1511] Processing CreateTablet for tablet 55047b7f58b34a8688521e13af751d64 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:50.897953 24071 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0444e3934247099f34249c78f82ec0 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:50.905164 24148 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7940128775462b9e0cbf12922e1d59 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:50.910593 23997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0a7c0d8f9b46eba04dece7ec4c2cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.900888 24153 tablet_service.cc:1511] Processing CreateTablet for tablet ab3ad53a278446ffa35de80a3976d9dc (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:50.910763 24151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0da620915d42a58dc2ed27add8d7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.908366 24147 tablet_service.cc:1511] Processing CreateTablet for tablet ff20bc77f4a74f67b1141010b27d5af5 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:50.908540 24072 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0a7c0d8f9b46eba04dece7ec4c2cc3 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:50.919230 24073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff20bc77f4a74f67b1141010b27d5af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.922588 24149 tablet_service.cc:1511] Processing CreateTablet for tablet ac162ff0242e42f58a32f5eb1c6d610b (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:50.930780 24146 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0a7c0d8f9b46eba04dece7ec4c2cc3 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:50.911005 23996 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0444e3934247099f34249c78f82ec0 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:50.934755 24145 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0444e3934247099f34249c78f82ec0 (DEFAULT_TABLE table=test-workload [id=75d1ddf196424e49b21eee6088c157f2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:50.937799 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab3ad53a278446ffa35de80a3976d9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.938083 23996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0444e3934247099f34249c78f82ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.942832 24145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0444e3934247099f34249c78f82ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.947840 24146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0a7c0d8f9b46eba04dece7ec4c2cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.947275 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab3ad53a278446ffa35de80a3976d9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.955838 24147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff20bc77f4a74f67b1141010b27d5af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.960786 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac162ff0242e42f58a32f5eb1c6d610b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.967410 24072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0a7c0d8f9b46eba04dece7ec4c2cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.968497 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55047b7f58b34a8688521e13af751d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.969601 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7940128775462b9e0cbf12922e1d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.988919 24071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0444e3934247099f34249c78f82ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.005252 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7940128775462b9e0cbf12922e1d59. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:51.042691 23959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:51.180778 24206 tablet_bootstrap.cc:492] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b: Bootstrap starting.
I20260709 12:17:51.191722 24207 tablet_bootstrap.cc:492] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67: Bootstrap starting.
I20260709 12:17:51.231256 24208 tablet_bootstrap.cc:492] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1: Bootstrap starting.
I20260709 12:17:51.233518 24206 tablet_bootstrap.cc:654] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.235580 24207 tablet_bootstrap.cc:654] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.241641 24208 tablet_bootstrap.cc:654] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.248322 24206 tablet_bootstrap.cc:492] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b: No bootstrap required, opened a new log
I20260709 12:17:51.248999 24206 ts_tablet_manager.cc:1403] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.005s
I20260709 12:17:51.252373 24207 tablet_bootstrap.cc:492] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67: No bootstrap required, opened a new log
I20260709 12:17:51.252279 24206 raft_consensus.cc:359] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.252933 24207 ts_tablet_manager.cc:1403] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.010s
I20260709 12:17:51.253137 24206 raft_consensus.cc:385] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.253463 24206 raft_consensus.cc:740] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.254334 24206 consensus_queue.cc:260] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.256656 24207 raft_consensus.cc:359] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.259380 24207 raft_consensus.cc:385] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.259871 24207 raft_consensus.cc:740] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.261009 24207 consensus_queue.cc:260] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.263224 24039 heartbeater.cc:499] Master 127.23.81.254:38629 was elected leader, sending a full tablet report...
I20260709 12:17:51.264614 24206 ts_tablet_manager.cc:1434] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.005s
I20260709 12:17:51.265940 24206 tablet_bootstrap.cc:492] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b: Bootstrap starting.
I20260709 12:17:51.270780 24114 heartbeater.cc:499] Master 127.23.81.254:38629 was elected leader, sending a full tablet report...
I20260709 12:17:51.271217 24207 ts_tablet_manager.cc:1434] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.005s
I20260709 12:17:51.272171 24207 tablet_bootstrap.cc:492] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67: Bootstrap starting.
I20260709 12:17:51.274816 24208 tablet_bootstrap.cc:492] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1: No bootstrap required, opened a new log
I20260709 12:17:51.275389 24208 ts_tablet_manager.cc:1403] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.008s
W20260709 12:17:51.276700 24040 tablet.cc:2406] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:17:51.279356 24208 raft_consensus.cc:359] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.280208 24208 raft_consensus.cc:385] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.280581 24208 raft_consensus.cc:740] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.281453 24208 consensus_queue.cc:260] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.284092 24207 tablet_bootstrap.cc:654] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.285219 24206 tablet_bootstrap.cc:654] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.295293 24188 heartbeater.cc:499] Master 127.23.81.254:38629 was elected leader, sending a full tablet report...
I20260709 12:17:51.296448 24208 ts_tablet_manager.cc:1434] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.014s
I20260709 12:17:51.297528 24208 tablet_bootstrap.cc:492] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1: Bootstrap starting.
I20260709 12:17:51.312141 24208 tablet_bootstrap.cc:654] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.313802 24207 tablet_bootstrap.cc:492] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67: No bootstrap required, opened a new log
I20260709 12:17:51.314404 24207 ts_tablet_manager.cc:1403] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67: Time spent bootstrapping tablet: real 0.042s	user 0.003s	sys 0.013s
I20260709 12:17:51.317399 24207 raft_consensus.cc:359] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.318356 24207 raft_consensus.cc:385] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.318728 24207 raft_consensus.cc:740] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.319574 24207 consensus_queue.cc:260] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.322084 24207 ts_tablet_manager.cc:1434] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:17:51.323172 24207 tablet_bootstrap.cc:492] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67: Bootstrap starting.
I20260709 12:17:51.330399 24207 tablet_bootstrap.cc:654] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.342005 24207 tablet_bootstrap.cc:492] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67: No bootstrap required, opened a new log
I20260709 12:17:51.342624 24207 ts_tablet_manager.cc:1403] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 12:17:51.344841 24214 raft_consensus.cc:493] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.345366 24214 raft_consensus.cc:515] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.345723 24207 raft_consensus.cc:359] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.346663 24207 raft_consensus.cc:385] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.347066 24207 raft_consensus.cc:740] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.349052 24214 leader_election.cc:290] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:51.349130 24207 consensus_queue.cc:260] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.366755 24207 ts_tablet_manager.cc:1434] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:17:51.369484 24207 tablet_bootstrap.cc:492] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67: Bootstrap starting.
I20260709 12:17:51.397568 24207 tablet_bootstrap.cc:654] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.409987 24208 tablet_bootstrap.cc:492] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1: No bootstrap required, opened a new log
I20260709 12:17:51.410115 24206 tablet_bootstrap.cc:492] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b: No bootstrap required, opened a new log
I20260709 12:17:51.410553 24208 ts_tablet_manager.cc:1403] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.033s
I20260709 12:17:51.410749 24206 ts_tablet_manager.cc:1403] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b: Time spent bootstrapping tablet: real 0.145s	user 0.014s	sys 0.041s
I20260709 12:17:51.413710 24208 raft_consensus.cc:359] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.414538 24208 raft_consensus.cc:385] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.414836 24208 raft_consensus.cc:740] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.415563 24208 consensus_queue.cc:260] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.418007 24208 ts_tablet_manager.cc:1434] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:17:51.419342 24206 raft_consensus.cc:359] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:17:51.420279 24206 raft_consensus.cc:385] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.420720 24206 raft_consensus.cc:740] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.421420 24206 consensus_queue.cc:260] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:17:51.424824 24213 raft_consensus.cc:493] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.425381 24213 raft_consensus.cc:515] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.426551 24206 ts_tablet_manager.cc:1434] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:17:51.428685 24213 leader_election.cc:290] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.427554 24206 tablet_bootstrap.cc:492] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b: Bootstrap starting.
I20260709 12:17:51.418972 24208 tablet_bootstrap.cc:492] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1: Bootstrap starting.
I20260709 12:17:51.436198 24207 tablet_bootstrap.cc:492] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67: No bootstrap required, opened a new log
I20260709 12:17:51.436723 24207 ts_tablet_manager.cc:1403] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67: Time spent bootstrapping tablet: real 0.067s	user 0.004s	sys 0.007s
I20260709 12:17:51.436529 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b" is_pre_election: true
I20260709 12:17:51.437359 24014 raft_consensus.cc:2468] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 0.
I20260709 12:17:51.439383 24126 leader_election.cc:304] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:51.439869 24207 raft_consensus.cc:359] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.440333 24214 raft_consensus.cc:2804] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.440614 24207 raft_consensus.cc:385] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.440732 24214 raft_consensus.cc:493] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.440980 24207 raft_consensus.cc:740] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.441185 24214 raft_consensus.cc:3060] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.441850 24207 consensus_queue.cc:260] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.444245 24207 ts_tablet_manager.cc:1434] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:17:51.448024 24208 tablet_bootstrap.cc:654] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.454443 24207 tablet_bootstrap.cc:492] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67: Bootstrap starting.
I20260709 12:17:51.461205 24207 tablet_bootstrap.cc:654] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.461903 24206 tablet_bootstrap.cc:654] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.450914 24214 raft_consensus.cc:515] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.468859 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67" is_pre_election: true
W20260709 12:17:51.475189 24126 leader_election.cc:343] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.478780 24214 leader_election.cc:290] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:51.482331 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:17:51.483085 24014 raft_consensus.cc:3060] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.485651 24208 tablet_bootstrap.cc:492] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1: No bootstrap required, opened a new log
I20260709 12:17:51.486315 24208 ts_tablet_manager.cc:1403] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.013s
I20260709 12:17:51.490694 24208 raft_consensus.cc:359] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:17:51.491394 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:17:51.491752 24208 raft_consensus.cc:385] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.492187 24208 raft_consensus.cc:740] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Initialized, Role: FOLLOWER
W20260709 12:17:51.493393 24126 leader_election.cc:343] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.496125 24213 raft_consensus.cc:493] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.496680 24213 raft_consensus.cc:515] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.497380 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b" is_pre_election: true
I20260709 12:17:51.498924 24213 leader_election.cc:290] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.499562 24208 consensus_queue.cc:260] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:17:51.501466 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b" is_pre_election: true
I20260709 12:17:51.502187 24208 ts_tablet_manager.cc:1434] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 12:17:51.503209 24208 tablet_bootstrap.cc:492] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1: Bootstrap starting.
I20260709 12:17:51.505079 24207 tablet_bootstrap.cc:492] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67: No bootstrap required, opened a new log
I20260709 12:17:51.505647 24207 ts_tablet_manager.cc:1403] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.005s
I20260709 12:17:51.506932 24014 raft_consensus.cc:2468] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 1.
I20260709 12:17:51.508196 24126 leader_election.cc:304] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 8aa459763c974a75896438500c34ce67
I20260709 12:17:51.509366 24214 raft_consensus.cc:2804] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.509045 24207 raft_consensus.cc:359] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:17:51.510044 24207 raft_consensus.cc:385] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.510211 24208 tablet_bootstrap.cc:654] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:51.510450 24052 leader_election.cc:343] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.510973 24207 raft_consensus.cc:740] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.513100 24207 consensus_queue.cc:260] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
W20260709 12:17:51.511911 24052 leader_election.cc:343] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.517062 24206 tablet_bootstrap.cc:492] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b: No bootstrap required, opened a new log
I20260709 12:17:51.517570 24206 ts_tablet_manager.cc:1403] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b: Time spent bootstrapping tablet: real 0.090s	user 0.010s	sys 0.002s
I20260709 12:17:51.517776 24207 ts_tablet_manager.cc:1434] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:17:51.519312 24207 tablet_bootstrap.cc:492] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67: Bootstrap starting.
I20260709 12:17:51.521040 24206 raft_consensus.cc:359] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.521801 24206 raft_consensus.cc:385] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.522121 24206 raft_consensus.cc:740] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.522856 24206 consensus_queue.cc:260] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.533077 24206 ts_tablet_manager.cc:1434] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:17:51.535985 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1" is_pre_election: true
I20260709 12:17:51.535902 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1" is_pre_election: true
I20260709 12:17:51.537420 24207 tablet_bootstrap.cc:654] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:51.537868 24052 leader_election.cc:343] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.538357 24052 leader_election.cc:304] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aa459763c974a75896438500c34ce67; no voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b
I20260709 12:17:51.539179 24213 raft_consensus.cc:2749] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:51.539597 24052 leader_election.cc:343] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.540004 24052 leader_election.cc:304] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aa459763c974a75896438500c34ce67; no voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b
I20260709 12:17:51.540704 24213 raft_consensus.cc:2749] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.535332 24214 raft_consensus.cc:697] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Becoming Leader. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:17:51.541939 24214 consensus_queue.cc:237] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.544256 24206 tablet_bootstrap.cc:492] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b: Bootstrap starting.
I20260709 12:17:51.544720 24208 tablet_bootstrap.cc:492] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1: No bootstrap required, opened a new log
I20260709 12:17:51.545172 24208 ts_tablet_manager.cc:1403] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.012s
I20260709 12:17:51.548182 24208 raft_consensus.cc:359] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.548969 24208 raft_consensus.cc:385] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.549325 24208 raft_consensus.cc:740] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.550071 24208 consensus_queue.cc:260] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.551317 24206 tablet_bootstrap.cc:654] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.552582 24207 tablet_bootstrap.cc:492] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67: No bootstrap required, opened a new log
I20260709 12:17:51.553045 24207 ts_tablet_manager.cc:1403] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 12:17:51.555047 24208 ts_tablet_manager.cc:1434] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:17:51.555838 24208 tablet_bootstrap.cc:492] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1: Bootstrap starting.
I20260709 12:17:51.565702 24208 tablet_bootstrap.cc:654] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.565548 23909 catalog_manager.cc:5697] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "a5f0eb2faea242d589bdb266ff6573b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.570271 24207 raft_consensus.cc:359] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.571074 24207 raft_consensus.cc:385] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.571405 24207 raft_consensus.cc:740] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.572289 24206 tablet_bootstrap.cc:492] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b: No bootstrap required, opened a new log
I20260709 12:17:51.572180 24207 consensus_queue.cc:260] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.572813 24206 ts_tablet_manager.cc:1403] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 12:17:51.574484 24207 ts_tablet_manager.cc:1434] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:17:51.575961 24207 tablet_bootstrap.cc:492] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67: Bootstrap starting.
I20260709 12:17:51.575986 24213 raft_consensus.cc:493] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.576539 24213 raft_consensus.cc:515] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:17:51.578708 24213 leader_election.cc:290] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.579957 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ad53a278446ffa35de80a3976d9dc" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b" is_pre_election: true
I20260709 12:17:51.580634 24014 raft_consensus.cc:2468] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 0.
I20260709 12:17:51.579974 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ad53a278446ffa35de80a3976d9dc" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1" is_pre_election: true
I20260709 12:17:51.581246 24206 raft_consensus.cc:359] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.582191 24206 raft_consensus.cc:385] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.582513 24206 raft_consensus.cc:740] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.582947 24052 leader_election.cc:304] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:51.583220 24206 consensus_queue.cc:260] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.582188 24163 raft_consensus.cc:2468] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 0.
I20260709 12:17:51.584578 24207 tablet_bootstrap.cc:654] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.584841 24213 raft_consensus.cc:2804] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.585242 24213 raft_consensus.cc:493] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.585692 24213 raft_consensus.cc:3060] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.595434 24206 ts_tablet_manager.cc:1434] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:17:51.596125 24212 raft_consensus.cc:493] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.596989 24208 tablet_bootstrap.cc:492] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1: No bootstrap required, opened a new log
I20260709 12:17:51.596649 24212 raft_consensus.cc:515] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.597486 24208 ts_tablet_manager.cc:1403] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1: Time spent bootstrapping tablet: real 0.042s	user 0.003s	sys 0.008s
I20260709 12:17:51.599586 24212 leader_election.cc:290] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.600551 24208 raft_consensus.cc:359] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.601321 24208 raft_consensus.cc:385] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.601600 24208 raft_consensus.cc:740] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.605203 24206 tablet_bootstrap.cc:492] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b: Bootstrap starting.
I20260709 12:17:51.605430 24208 consensus_queue.cc:260] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.608110 24208 ts_tablet_manager.cc:1434] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:17:51.610441 24208 tablet_bootstrap.cc:492] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1: Bootstrap starting.
I20260709 12:17:51.609845 24213 raft_consensus.cc:515] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:17:51.617304 24213 leader_election.cc:290] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.618305 24208 tablet_bootstrap.cc:654] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.618410 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ad53a278446ffa35de80a3976d9dc" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:17:51.620697 24206 tablet_bootstrap.cc:654] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.627980 24163 raft_consensus.cc:3060] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.632333 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ad53a278446ffa35de80a3976d9dc" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:17:51.632968 24014 raft_consensus.cc:3060] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.627393 24207 tablet_bootstrap.cc:492] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67: No bootstrap required, opened a new log
I20260709 12:17:51.636224 24207 ts_tablet_manager.cc:1403] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67: Time spent bootstrapping tablet: real 0.060s	user 0.026s	sys 0.019s
I20260709 12:17:51.635409 24163 raft_consensus.cc:2468] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 1.
I20260709 12:17:51.637534 24214 raft_consensus.cc:493] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.637833 24052 leader_election.cc:304] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, a5f0eb2faea242d589bdb266ff6573b1; no voters: 
I20260709 12:17:51.638192 24213 raft_consensus.cc:493] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.638041 24214 raft_consensus.cc:515] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.638682 24213 raft_consensus.cc:515] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.640450 24214 leader_election.cc:290] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:51.641037 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55047b7f58b34a8688521e13af751d64" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b" is_pre_election: true
I20260709 12:17:51.641534 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55047b7f58b34a8688521e13af751d64" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67" is_pre_election: true
I20260709 12:17:51.642073 24213 leader_election.cc:290] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.642583 24213 raft_consensus.cc:2804] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:17:51.642763 24126 leader_election.cc:343] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.643023 24213 raft_consensus.cc:697] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 1 LEADER]: Becoming Leader. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
W20260709 12:17:51.643473 24126 leader_election.cc:343] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.643563 24014 raft_consensus.cc:2468] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 1.
I20260709 12:17:51.644037 24126 leader_election.cc:304] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1; no voters: 8aa459763c974a75896438500c34ce67, ead760b489bd46d991f3eb780b97345b
I20260709 12:17:51.643895 24213 consensus_queue.cc:237] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:17:51.645121 24214 raft_consensus.cc:2749] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.646608 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0444e3934247099f34249c78f82ec0" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67" is_pre_election: true
W20260709 12:17:51.648329 23977 leader_election.cc:343] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.648478 24207 raft_consensus.cc:359] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.649361 24207 raft_consensus.cc:385] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.649678 24207 raft_consensus.cc:740] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.651495 24208 tablet_bootstrap.cc:492] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1: No bootstrap required, opened a new log
I20260709 12:17:51.651247 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b" is_pre_election: true
I20260709 12:17:51.651999 24208 ts_tablet_manager.cc:1403] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.004s
I20260709 12:17:51.652298 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1" is_pre_election: true
I20260709 12:17:51.652741 24207 consensus_queue.cc:260] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
W20260709 12:17:51.653039 24052 leader_election.cc:343] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:51.654528 24052 leader_election.cc:343] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.655151 24207 ts_tablet_manager.cc:1434] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 12:17:51.655071 24208 raft_consensus.cc:359] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.656368 24208 raft_consensus.cc:385] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.656651 24208 raft_consensus.cc:740] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.655040 24052 leader_election.cc:304] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aa459763c974a75896438500c34ce67; no voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b
I20260709 12:17:51.657428 24208 consensus_queue.cc:260] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.659045 24206 tablet_bootstrap.cc:492] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b: No bootstrap required, opened a new log
I20260709 12:17:51.659168 24243 raft_consensus.cc:2749] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.659626 24206 ts_tablet_manager.cc:1403] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b: Time spent bootstrapping tablet: real 0.055s	user 0.005s	sys 0.009s
I20260709 12:17:51.659966 24208 ts_tablet_manager.cc:1434] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 12:17:51.660943 24208 tablet_bootstrap.cc:492] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1: Bootstrap starting.
I20260709 12:17:51.662675 24206 raft_consensus.cc:359] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.663379 24206 raft_consensus.cc:385] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.663662 24206 raft_consensus.cc:740] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.664326 24206 consensus_queue.cc:260] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.664739 24214 raft_consensus.cc:493] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.665227 24214 raft_consensus.cc:515] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.667321 24214 leader_election.cc:290] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:51.667550 24208 tablet_bootstrap.cc:654] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.668146 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0444e3934247099f34249c78f82ec0" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b" is_pre_election: true
I20260709 12:17:51.668972 24014 raft_consensus.cc:2468] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 0.
I20260709 12:17:51.656666 24207 tablet_bootstrap.cc:492] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67: Bootstrap starting.
I20260709 12:17:51.670970 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0444e3934247099f34249c78f82ec0" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67" is_pre_election: true
I20260709 12:17:51.673671 24206 ts_tablet_manager.cc:1434] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:17:51.674666 24206 tablet_bootstrap.cc:492] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b: Bootstrap starting.
W20260709 12:17:51.675339 24126 leader_election.cc:343] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.676033 24126 leader_election.cc:304] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 8aa459763c974a75896438500c34ce67
I20260709 12:17:51.677134 24214 raft_consensus.cc:2804] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.677489 24214 raft_consensus.cc:493] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.677958 24214 raft_consensus.cc:3060] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.677539 23910 catalog_manager.cc:5697] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aa459763c974a75896438500c34ce67 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "8aa459763c974a75896438500c34ce67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.679618 24207 tablet_bootstrap.cc:654] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.681169 24206 tablet_bootstrap.cc:654] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.685295 24214 raft_consensus.cc:515] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.689831 24213 raft_consensus.cc:493] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.690498 24213 raft_consensus.cc:515] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.692611 24213 leader_election.cc:290] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.693374 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0444e3934247099f34249c78f82ec0" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:17:51.694173 24014 raft_consensus.cc:3060] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.697274 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0444e3934247099f34249c78f82ec0" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67"
W20260709 12:17:51.699126 24126 leader_election.cc:343] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.699874 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20bc77f4a74f67b1141010b27d5af5" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b" is_pre_election: true
I20260709 12:17:51.700757 24214 leader_election.cc:290] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:51.700693 24013 raft_consensus.cc:2468] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 0.
I20260709 12:17:51.707819 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0444e3934247099f34249c78f82ec0" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1" is_pre_election: true
I20260709 12:17:51.694167 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20bc77f4a74f67b1141010b27d5af5" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1" is_pre_election: true
I20260709 12:17:51.709256 24162 raft_consensus.cc:2393] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ead760b489bd46d991f3eb780b97345b in current term 1: Already voted for candidate a5f0eb2faea242d589bdb266ff6573b1 in this term.
I20260709 12:17:51.711202 24052 leader_election.cc:304] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:51.711983 24213 raft_consensus.cc:2804] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.714401 24213 raft_consensus.cc:493] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.714452 23977 leader_election.cc:304] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ead760b489bd46d991f3eb780b97345b; no voters: 8aa459763c974a75896438500c34ce67, a5f0eb2faea242d589bdb266ff6573b1
I20260709 12:17:51.714838 24213 raft_consensus.cc:3060] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.714526 24163 raft_consensus.cc:2468] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 0.
I20260709 12:17:51.718587 24206 tablet_bootstrap.cc:492] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b: No bootstrap required, opened a new log
I20260709 12:17:51.718822 24208 tablet_bootstrap.cc:492] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1: No bootstrap required, opened a new log
I20260709 12:17:51.719074 24206 ts_tablet_manager.cc:1403] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b: Time spent bootstrapping tablet: real 0.045s	user 0.002s	sys 0.020s
I20260709 12:17:51.719457 24208 ts_tablet_manager.cc:1403] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.013s
I20260709 12:17:51.722910 24213 raft_consensus.cc:515] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.725375 24213 leader_election.cc:290] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.726445 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20bc77f4a74f67b1141010b27d5af5" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:17:51.727456 24208 raft_consensus.cc:359] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.727217 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20bc77f4a74f67b1141010b27d5af5" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:17:51.728188 24208 raft_consensus.cc:385] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.728430 24013 raft_consensus.cc:3060] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.727828 24163 raft_consensus.cc:3060] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.728513 24208 raft_consensus.cc:740] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.724844 24206 raft_consensus.cc:359] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.731000 24206 raft_consensus.cc:385] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.731487 24207 tablet_bootstrap.cc:492] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67: No bootstrap required, opened a new log
I20260709 12:17:51.731891 24207 ts_tablet_manager.cc:1403] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.012s
I20260709 12:17:51.733592 24208 consensus_queue.cc:260] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.733417 24206 raft_consensus.cc:740] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.736073 24208 ts_tablet_manager.cc:1434] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:17:51.737203 24207 raft_consensus.cc:359] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.737884 24208 tablet_bootstrap.cc:492] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1: Bootstrap starting.
I20260709 12:17:51.735709 24206 consensus_queue.cc:260] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.740720 24214 raft_consensus.cc:493] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.741184 24214 raft_consensus.cc:515] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.743129 24214 leader_election.cc:290] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:51.745240 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b" is_pre_election: true
I20260709 12:17:51.745234 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67" is_pre_election: true
I20260709 12:17:51.746948 24089 raft_consensus.cc:2468] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 0.
I20260709 12:17:51.748726 24126 leader_election.cc:304] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, a5f0eb2faea242d589bdb266ff6573b1; no voters: 
I20260709 12:17:51.750710 24014 raft_consensus.cc:2468] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 1.
I20260709 12:17:51.751304 24208 tablet_bootstrap.cc:654] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.753453 24212 raft_consensus.cc:2749] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:51.751274 24126 leader_election.cc:343] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.751942 24214 raft_consensus.cc:2804] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.754995 24214 raft_consensus.cc:493] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.755379 24214 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.765863 24206 ts_tablet_manager.cc:1434] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.015s
I20260709 12:17:51.767069 24206 tablet_bootstrap.cc:492] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b: Bootstrap starting.
I20260709 12:17:51.768891 24214 raft_consensus.cc:515] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.773769 24206 tablet_bootstrap.cc:654] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.773815 24126 leader_election.cc:304] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 8aa459763c974a75896438500c34ce67
I20260709 12:17:51.774924 24163 raft_consensus.cc:2468] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 1.
I20260709 12:17:51.737818 24207 raft_consensus.cc:385] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.775199 24230 raft_consensus.cc:2804] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.777149 24207 raft_consensus.cc:740] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.778121 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:17:51.778714 24089 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.778297 24207 consensus_queue.cc:260] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.781240 24207 ts_tablet_manager.cc:1434] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:17:51.782462 24207 tablet_bootstrap.cc:492] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67: Bootstrap starting.
I20260709 12:17:51.785458 24089 raft_consensus.cc:2468] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 1.
I20260709 12:17:51.775996 24208 tablet_bootstrap.cc:492] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1: No bootstrap required, opened a new log
I20260709 12:17:51.779001 24013 raft_consensus.cc:2468] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 1.
I20260709 12:17:51.787469 24052 leader_election.cc:304] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:51.788269 24213 raft_consensus.cc:2804] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.788812 24213 raft_consensus.cc:697] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 1 LEADER]: Becoming Leader. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:17:51.786784 24208 ts_tablet_manager.cc:1403] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.008s
I20260709 12:17:51.789664 24213 consensus_queue.cc:237] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.795203 24208 raft_consensus.cc:359] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.790609 24230 raft_consensus.cc:697] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Becoming Leader. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:17:51.798558 24230 consensus_queue.cc:237] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.797132 24206 tablet_bootstrap.cc:492] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b: No bootstrap required, opened a new log
I20260709 12:17:51.797636 24207 tablet_bootstrap.cc:654] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.800091 24206 ts_tablet_manager.cc:1403] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.008s
I20260709 12:17:51.802711 24208 raft_consensus.cc:385] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.803061 24208 raft_consensus.cc:740] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.803838 24126 leader_election.cc:304] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, a5f0eb2faea242d589bdb266ff6573b1; no voters: 
I20260709 12:17:51.805037 24208 consensus_queue.cc:260] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.804152 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:17:51.805517 24252 raft_consensus.cc:2804] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.803532 24206 raft_consensus.cc:359] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.807771 24206 raft_consensus.cc:385] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.776587 24214 leader_election.cc:290] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:51.808997 24206 raft_consensus.cc:740] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.809173 24243 raft_consensus.cc:493] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.809701 24243 raft_consensus.cc:515] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.809933 24206 consensus_queue.cc:260] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.812765 24014 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.812619 24243 leader_election.cc:290] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.815958 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b" is_pre_election: true
I20260709 12:17:51.824787 24013 raft_consensus.cc:2393] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aa459763c974a75896438500c34ce67 in current term 1: Already voted for candidate a5f0eb2faea242d589bdb266ff6573b1 in this term.
I20260709 12:17:51.810578 24207 tablet_bootstrap.cc:492] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67: No bootstrap required, opened a new log
I20260709 12:17:51.820096 24206 ts_tablet_manager.cc:1434] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:17:51.814939 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1" is_pre_election: true
I20260709 12:17:51.826623 24207 ts_tablet_manager.cc:1403] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.001s
I20260709 12:17:51.827204 24206 tablet_bootstrap.cc:492] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b: Bootstrap starting.
I20260709 12:17:51.827708 24052 leader_election.cc:304] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aa459763c974a75896438500c34ce67; no voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b
I20260709 12:17:51.828878 24243 raft_consensus.cc:3060] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.817692 24208 ts_tablet_manager.cc:1434] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 12:17:51.831084 24208 tablet_bootstrap.cc:492] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1: Bootstrap starting.
I20260709 12:17:51.830598 23911 catalog_manager.cc:5697] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aa459763c974a75896438500c34ce67 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "8aa459763c974a75896438500c34ce67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.831753 24252 raft_consensus.cc:697] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Becoming Leader. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:17:51.829790 24207 raft_consensus.cc:359] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.832715 24252 consensus_queue.cc:237] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.834642 24207 raft_consensus.cc:385] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.834985 24207 raft_consensus.cc:740] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.835758 24207 consensus_queue.cc:260] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.829784 24014 raft_consensus.cc:2468] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 1.
I20260709 12:17:51.843729 24207 ts_tablet_manager.cc:1434] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:17:51.837759 24208 tablet_bootstrap.cc:654] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.846357 23909 catalog_manager.cc:5697] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "a5f0eb2faea242d589bdb266ff6573b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.838521 24243 raft_consensus.cc:2749] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.839645 24206 tablet_bootstrap.cc:654] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.851749 24249 raft_consensus.cc:493] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.852339 24249 raft_consensus.cc:515] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.855208 24249 leader_election.cc:290] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.856104 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55047b7f58b34a8688521e13af751d64" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67" is_pre_election: true
I20260709 12:17:51.856714 24089 raft_consensus.cc:2468] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 0.
I20260709 12:17:51.857553 24208 tablet_bootstrap.cc:492] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1: No bootstrap required, opened a new log
I20260709 12:17:51.857996 24208 ts_tablet_manager.cc:1403] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.002s
I20260709 12:17:51.859844 23977 leader_election.cc:304] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:51.858220 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55047b7f58b34a8688521e13af751d64" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1" is_pre_election: true
I20260709 12:17:51.860572 24249 raft_consensus.cc:2804] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.860937 24249 raft_consensus.cc:493] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.861270 24249 raft_consensus.cc:3060] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.862735 24208 raft_consensus.cc:359] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.863440 24208 raft_consensus.cc:385] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.863735 24208 raft_consensus.cc:740] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.864456 24208 consensus_queue.cc:260] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.860947 24163 raft_consensus.cc:2468] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 0.
I20260709 12:17:51.867287 24208 ts_tablet_manager.cc:1434] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 12:17:51.869711 24249 raft_consensus.cc:515] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.871680 24249 leader_election.cc:290] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 election: Requested vote from peers 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.872700 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55047b7f58b34a8688521e13af751d64" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:17:51.873231 24089 raft_consensus.cc:3060] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.874397 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55047b7f58b34a8688521e13af751d64" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:17:51.873811 23909 catalog_manager.cc:5697] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "a5f0eb2faea242d589bdb266ff6573b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.874903 24163 raft_consensus.cc:3060] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.881321 24163 raft_consensus.cc:2468] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 1.
I20260709 12:17:51.882467 23977 leader_election.cc:304] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:51.883566 24249 raft_consensus.cc:2804] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.884179 24249 raft_consensus.cc:697] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Becoming Leader. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:17:51.885437 24249 consensus_queue.cc:237] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.889849 24206 tablet_bootstrap.cc:492] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b: No bootstrap required, opened a new log
I20260709 12:17:51.890202 24089 raft_consensus.cc:2468] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 1.
I20260709 12:17:51.890367 24206 ts_tablet_manager.cc:1403] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.010s
I20260709 12:17:51.894699 24206 raft_consensus.cc:359] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.895483 24206 raft_consensus.cc:385] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.895834 24206 raft_consensus.cc:740] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.896512 24206 consensus_queue.cc:260] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.898933 24206 ts_tablet_manager.cc:1434] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:17:51.900110 24206 tablet_bootstrap.cc:492] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b: Bootstrap starting.
I20260709 12:17:51.900543 23911 catalog_manager.cc:5697] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b reported cstate change: term changed from 0 to 1, leader changed from <none> to ead760b489bd46d991f3eb780b97345b (127.23.81.193). New cstate: current_term: 1 leader_uuid: "ead760b489bd46d991f3eb780b97345b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.905014 24206 tablet_bootstrap.cc:654] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.909675 24206 tablet_bootstrap.cc:492] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b: No bootstrap required, opened a new log
I20260709 12:17:51.910106 24206 ts_tablet_manager.cc:1403] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 12:17:51.910570 24249 raft_consensus.cc:493] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.911091 24249 raft_consensus.cc:515] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.912740 24249 leader_election.cc:290] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.912812 24206 raft_consensus.cc:359] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.913566 24206 raft_consensus.cc:385] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.913842 24206 raft_consensus.cc:740] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.914253 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac162ff0242e42f58a32f5eb1c6d610b" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67" is_pre_election: true
I20260709 12:17:51.914470 24206 consensus_queue.cc:260] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.914882 24089 raft_consensus.cc:2468] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 0.
I20260709 12:17:51.915850 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac162ff0242e42f58a32f5eb1c6d610b" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1" is_pre_election: true
I20260709 12:17:51.916407 24206 ts_tablet_manager.cc:1434] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:17:51.917200 23977 leader_election.cc:304] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:51.916436 24163 raft_consensus.cc:2468] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 0.
I20260709 12:17:51.918259 24212 raft_consensus.cc:2804] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.918648 24212 raft_consensus.cc:493] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.918970 24212 raft_consensus.cc:3060] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.925735 24212 raft_consensus.cc:515] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.927790 24212 leader_election.cc:290] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 election: Requested vote from peers 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:51.928432 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac162ff0242e42f58a32f5eb1c6d610b" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:17:51.928867 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac162ff0242e42f58a32f5eb1c6d610b" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:17:51.929041 24089 raft_consensus.cc:3060] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.929397 24163 raft_consensus.cc:3060] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.935714 24089 raft_consensus.cc:2468] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 1.
I20260709 12:17:51.936072 24163 raft_consensus.cc:2468] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 1.
I20260709 12:17:51.936872 23977 leader_election.cc:304] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:51.937604 24212 raft_consensus.cc:2804] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.938066 24212 raft_consensus.cc:697] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Becoming Leader. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:17:51.938771 24212 consensus_queue.cc:237] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.946741 23911 catalog_manager.cc:5697] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b reported cstate change: term changed from 0 to 1, leader changed from <none> to ead760b489bd46d991f3eb780b97345b (127.23.81.193). New cstate: current_term: 1 leader_uuid: "ead760b489bd46d991f3eb780b97345b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.969121 24252 consensus_queue.cc:1048] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:51.982985 24252 consensus_queue.cc:1048] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:51.992692 24252 raft_consensus.cc:493] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.993158 24252 raft_consensus.cc:515] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:51.995237 24252 leader_election.cc:290] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:51.997624 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67" is_pre_election: true
I20260709 12:17:51.998368 24088 raft_consensus.cc:2468] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 0.
I20260709 12:17:51.999867 24126 leader_election.cc:304] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, a5f0eb2faea242d589bdb266ff6573b1; no voters: 
I20260709 12:17:52.000288 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b" is_pre_election: true
I20260709 12:17:52.002537 24014 raft_consensus.cc:2468] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 0.
I20260709 12:17:52.002641 24252 raft_consensus.cc:2804] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.003189 24252 raft_consensus.cc:493] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.003917 24252 raft_consensus.cc:3060] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.011360 24252 raft_consensus.cc:515] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.013345 24252 leader_election.cc:290] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:52.014129 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:17:52.014357 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:17:52.014657 24014 raft_consensus.cc:3060] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.014935 24089 raft_consensus.cc:3060] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.019332 24014 raft_consensus.cc:2468] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 1.
I20260709 12:17:52.020695 24126 leader_election.cc:304] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:52.021392 24252 raft_consensus.cc:2804] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.021943 24252 raft_consensus.cc:697] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Becoming Leader. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:17:52.021843 24089 raft_consensus.cc:2468] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 1.
I20260709 12:17:52.022723 24252 consensus_queue.cc:237] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.031038 23911 catalog_manager.cc:5697] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "a5f0eb2faea242d589bdb266ff6573b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:52.047626 23959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:52.075389 24213 raft_consensus.cc:493] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.075994 24213 raft_consensus.cc:515] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.078258 24213 leader_election.cc:290] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:52.078999 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0444e3934247099f34249c78f82ec0" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead760b489bd46d991f3eb780b97345b" is_pre_election: true
I20260709 12:17:52.079336 24243 consensus_queue.cc:1048] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.079569 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0444e3934247099f34249c78f82ec0" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1" is_pre_election: true
I20260709 12:17:52.079831 24014 raft_consensus.cc:2393] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aa459763c974a75896438500c34ce67 in current term 1: Already voted for candidate a5f0eb2faea242d589bdb266ff6573b1 in this term.
I20260709 12:17:52.081561 24052 leader_election.cc:304] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aa459763c974a75896438500c34ce67; no voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b
I20260709 12:17:52.082708 24243 raft_consensus.cc:3060] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.090845 24243 raft_consensus.cc:2749] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.102314 24272 consensus_queue.cc:1048] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:52.111169 24212 raft_consensus.cc:493] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.111673 24212 raft_consensus.cc:515] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.113767 24212 leader_election.cc:290] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:52.114913 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67" is_pre_election: true
I20260709 12:17:52.115365 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1" is_pre_election: true
I20260709 12:17:52.115545 24089 raft_consensus.cc:2468] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 0.
I20260709 12:17:52.116832 23977 leader_election.cc:304] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:52.116037 24163 raft_consensus.cc:2468] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 0.
I20260709 12:17:52.117674 24212 raft_consensus.cc:2804] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.118209 24212 raft_consensus.cc:493] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.118619 24212 raft_consensus.cc:3060] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.125478 24212 raft_consensus.cc:515] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.127478 24212 leader_election.cc:290] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 election: Requested vote from peers 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:52.129024 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:17:52.129308 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:17:52.129624 24089 raft_consensus.cc:3060] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.129885 24163 raft_consensus.cc:3060] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.136147 24163 raft_consensus.cc:2468] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 1.
I20260709 12:17:52.136951 24089 raft_consensus.cc:2468] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 1.
I20260709 12:17:52.137169 23977 leader_election.cc:304] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:52.137980 24212 raft_consensus.cc:2804] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.138556 24212 raft_consensus.cc:697] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Becoming Leader. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:17:52.139793 24212 consensus_queue.cc:237] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.148209 23911 catalog_manager.cc:5697] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b reported cstate change: term changed from 0 to 1, leader changed from <none> to ead760b489bd46d991f3eb780b97345b (127.23.81.193). New cstate: current_term: 1 leader_uuid: "ead760b489bd46d991f3eb780b97345b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.183068 24252 consensus_queue.cc:1048] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.195516 24252 consensus_queue.cc:1048] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.275946 24212 consensus_queue.cc:1048] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.301229 24249 consensus_queue.cc:1048] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.316939 24089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab3ad53a278446ffa35de80a3976d9dc"
dest_uuid: "8aa459763c974a75896438500c34ce67"
mode: GRACEFUL
new_leader_uuid: "ead760b489bd46d991f3eb780b97345b"
 from {username='slave'} at 127.0.0.1:39914
I20260709 12:17:52.317669 24089 raft_consensus.cc:606] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 1 LEADER]: Received request to transfer leadership to TS ead760b489bd46d991f3eb780b97345b
I20260709 12:17:52.335768 24163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7"
dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
mode: GRACEFUL
new_leader_uuid: "ead760b489bd46d991f3eb780b97345b"
 from {username='slave'} at 127.0.0.1:52648
I20260709 12:17:52.336302 24163 raft_consensus.cc:606] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Received request to transfer leadership to TS ead760b489bd46d991f3eb780b97345b
I20260709 12:17:52.341313 24163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172"
dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
mode: GRACEFUL
new_leader_uuid: "ead760b489bd46d991f3eb780b97345b"
 from {username='slave'} at 127.0.0.1:52648
I20260709 12:17:52.341802 24163 raft_consensus.cc:606] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Received request to transfer leadership to TS ead760b489bd46d991f3eb780b97345b
I20260709 12:17:52.356187 24014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac162ff0242e42f58a32f5eb1c6d610b"
dest_uuid: "ead760b489bd46d991f3eb780b97345b"
mode: GRACEFUL
new_leader_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:42092
I20260709 12:17:52.356856 24014 raft_consensus.cc:606] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Received request to transfer leadership to TS 8aa459763c974a75896438500c34ce67
I20260709 12:17:52.362185 24014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59"
dest_uuid: "ead760b489bd46d991f3eb780b97345b"
mode: GRACEFUL
new_leader_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:42092
I20260709 12:17:52.362782 24014 raft_consensus.cc:606] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Received request to transfer leadership to TS 8aa459763c974a75896438500c34ce67
I20260709 12:17:52.370620 24163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3"
dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
mode: GRACEFUL
new_leader_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:52648
I20260709 12:17:52.371172 24163 raft_consensus.cc:606] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Received request to transfer leadership to TS 8aa459763c974a75896438500c34ce67
I20260709 12:17:52.394014 24273 consensus_queue.cc:1048] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.405077 24273 consensus_queue.cc:1048] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.412406 24252 consensus_queue.cc:1048] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.430006 24230 consensus_queue.cc:1048] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.438360 24256 raft_consensus.cc:993] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1: : Instructing follower 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:17:52.438930 24256 raft_consensus.cc:1081] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Signalling peer 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:17:52.441658 24088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3"
dest_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:39890
I20260709 12:17:52.443526 24088 raft_consensus.cc:493] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:52.443941 24088 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.450659 24088 raft_consensus.cc:515] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.452251 24088 leader_election.cc:290] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 2 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:52.453135 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:17:52.453403 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:17:52.453739 24013 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.454003 24163 raft_consensus.cc:3055] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:52.454396 24163 raft_consensus.cc:740] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:17:52.455196 24163 consensus_queue.cc:260] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.456571 24163 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.459793 24230 consensus_queue.cc:1048] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.460402 24013 raft_consensus.cc:2468] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 2.
I20260709 12:17:52.461512 24052 leader_election.cc:304] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:52.462380 24273 raft_consensus.cc:2804] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:52.462841 24273 raft_consensus.cc:697] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Becoming Leader. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:17:52.463661 24273 consensus_queue.cc:237] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.464289 24163 raft_consensus.cc:2468] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 2.
I20260709 12:17:52.470634 24230 raft_consensus.cc:993] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1: : Instructing follower ead760b489bd46d991f3eb780b97345b to start an election
I20260709 12:17:52.471092 24230 raft_consensus.cc:1081] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Signalling peer ead760b489bd46d991f3eb780b97345b to start an election
I20260709 12:17:52.473071 23911 catalog_manager.cc:5697] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 reported cstate change: term changed from 1 to 2, leader changed from a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195) to 8aa459763c974a75896438500c34ce67 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "8aa459763c974a75896438500c34ce67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.479385 24014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7"
dest_uuid: "ead760b489bd46d991f3eb780b97345b"
 from {username='slave'} at 127.0.0.1:42076
I20260709 12:17:52.479990 24014 raft_consensus.cc:493] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:52.480376 24014 raft_consensus.cc:3060] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.486536 24249 consensus_queue.cc:1048] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.487337 24014 raft_consensus.cc:515] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.489466 24214 consensus_queue.cc:1048] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.493064 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:17:52.497424 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:17:52.498193 24163 raft_consensus.cc:3055] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:52.498588 24163 raft_consensus.cc:740] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:17:52.499862 24163 consensus_queue.cc:260] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.501610 24163 raft_consensus.cc:3060] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.506420 24014 leader_election.cc:290] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 2 election: Requested vote from peers 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:52.511971 24212 raft_consensus.cc:993] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b: : Instructing follower 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:17:52.512745 24249 raft_consensus.cc:1081] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Signalling peer 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:17:52.514533 24089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac162ff0242e42f58a32f5eb1c6d610b"
dest_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:17:52.515213 24089 raft_consensus.cc:493] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:52.515754 24089 raft_consensus.cc:3060] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.515138 24163 raft_consensus.cc:2468] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 2.
I20260709 12:17:52.525667 24089 raft_consensus.cc:515] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.527221 23977 leader_election.cc:304] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 8aa459763c974a75896438500c34ce67
I20260709 12:17:52.527525 24088 raft_consensus.cc:1240] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Rejecting Update request from peer ead760b489bd46d991f3eb780b97345b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:52.530066 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac162ff0242e42f58a32f5eb1c6d610b" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:17:52.530663 24162 raft_consensus.cc:3060] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.534054 24249 raft_consensus.cc:2804] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:52.534214 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac162ff0242e42f58a32f5eb1c6d610b" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:17:52.534795 24014 raft_consensus.cc:3055] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:52.535140 24014 raft_consensus.cc:740] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:17:52.535957 24014 consensus_queue.cc:260] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.537161 24014 raft_consensus.cc:3060] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.539673 24162 raft_consensus.cc:2468] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 2.
W20260709 12:17:52.538271 24212 consensus_queue.cc:1175] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8aa459763c974a75896438500c34ce67" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ead760b489bd46d991f3eb780b97345b for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:52.544688 24052 leader_election.cc:304] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, a5f0eb2faea242d589bdb266ff6573b1; no voters: 
I20260709 12:17:52.545655 24273 raft_consensus.cc:2804] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:52.546177 24273 raft_consensus.cc:697] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Becoming Leader. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:17:52.547194 24089 leader_election.cc:290] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 2 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:52.547017 24273 consensus_queue.cc:237] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.553900 24014 raft_consensus.cc:2468] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 2.
I20260709 12:17:52.555186 23911 catalog_manager.cc:5697] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 reported cstate change: term changed from 1 to 2, leader changed from ead760b489bd46d991f3eb780b97345b (127.23.81.193) to 8aa459763c974a75896438500c34ce67 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "8aa459763c974a75896438500c34ce67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.554359 24249 raft_consensus.cc:697] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Becoming Leader. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:17:52.558210 24214 raft_consensus.cc:993] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1: : Instructing follower ead760b489bd46d991f3eb780b97345b to start an election
I20260709 12:17:52.558688 24252 raft_consensus.cc:1081] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Signalling peer ead760b489bd46d991f3eb780b97345b to start an election
I20260709 12:17:52.559029 24249 consensus_queue.cc:237] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.560305 24013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172"
dest_uuid: "ead760b489bd46d991f3eb780b97345b"
 from {username='slave'} at 127.0.0.1:42076
I20260709 12:17:52.560853 24013 raft_consensus.cc:493] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:52.561230 24013 raft_consensus.cc:3060] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.566606 24013 raft_consensus.cc:515] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.568424 24013 leader_election.cc:290] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 2 election: Requested vote from peers 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:52.569188 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:17:52.569433 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:17:52.570669 24089 raft_consensus.cc:3060] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.571247 24162 raft_consensus.cc:3055] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:52.571607 24162 raft_consensus.cc:740] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:17:52.572400 24162 consensus_queue.cc:260] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.573657 24162 raft_consensus.cc:3060] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.579912 23911 catalog_manager.cc:5697] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b reported cstate change: term changed from 1 to 2, leader changed from a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195) to ead760b489bd46d991f3eb780b97345b (127.23.81.193). New cstate: current_term: 2 leader_uuid: "ead760b489bd46d991f3eb780b97345b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.581414 24162 raft_consensus.cc:2468] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 2.
I20260709 12:17:52.582726 23977 leader_election.cc:304] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:52.583197 24089 raft_consensus.cc:2468] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 2.
I20260709 12:17:52.583923 24249 raft_consensus.cc:2804] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:52.584959 24249 raft_consensus.cc:697] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Becoming Leader. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:17:52.585695 24249 consensus_queue.cc:237] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.593138 23911 catalog_manager.cc:5697] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b reported cstate change: term changed from 1 to 2, leader changed from a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195) to ead760b489bd46d991f3eb780b97345b (127.23.81.193). New cstate: current_term: 2 leader_uuid: "ead760b489bd46d991f3eb780b97345b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.618669 24249 consensus_queue.cc:1048] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.625829 24292 raft_consensus.cc:993] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b: : Instructing follower 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:17:52.626389 24292 raft_consensus.cc:1081] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Signalling peer 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:17:52.628396 24088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59"
dest_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:17:52.628979 24088 raft_consensus.cc:493] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:52.629331 24088 raft_consensus.cc:3060] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.632366 24212 consensus_queue.cc:1048] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.638131 24088 raft_consensus.cc:515] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.639520 24089 raft_consensus.cc:1240] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Rejecting Update request from peer ead760b489bd46d991f3eb780b97345b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:52.642231 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:17:52.642812 24013 raft_consensus.cc:3055] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:52.643115 24013 raft_consensus.cc:740] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:17:52.643364 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:17:52.643874 24013 consensus_queue.cc:260] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.644807 24013 raft_consensus.cc:3060] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.645973 24088 leader_election.cc:290] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 2 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:17:52.652537 24271 raft_consensus.cc:993] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67: : Instructing follower ead760b489bd46d991f3eb780b97345b to start an election
I20260709 12:17:52.652993 24243 raft_consensus.cc:1081] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 1 LEADER]: Signalling peer ead760b489bd46d991f3eb780b97345b to start an election
I20260709 12:17:52.654749 24014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab3ad53a278446ffa35de80a3976d9dc"
dest_uuid: "ead760b489bd46d991f3eb780b97345b"
 from {username='slave'} at 127.0.0.1:42080
I20260709 12:17:52.655290 24014 raft_consensus.cc:493] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:52.655663 24014 raft_consensus.cc:3060] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.662345 24013 raft_consensus.cc:2468] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 2.
I20260709 12:17:52.662209 24014 raft_consensus.cc:515] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:17:52.663456 24052 leader_election.cc:304] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aa459763c974a75896438500c34ce67, ead760b489bd46d991f3eb780b97345b; no voters: a5f0eb2faea242d589bdb266ff6573b1
I20260709 12:17:52.664527 24243 raft_consensus.cc:2804] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:52.664999 24243 raft_consensus.cc:697] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Becoming Leader. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:17:52.665663 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ad53a278446ffa35de80a3976d9dc" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:17:52.665798 24243 consensus_queue.cc:237] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:52.666523 24162 raft_consensus.cc:3060] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.668227 24014 leader_election.cc:290] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 2 election: Requested vote from peers a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:52.670051 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ad53a278446ffa35de80a3976d9dc" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:17:52.670660 24089 raft_consensus.cc:3055] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:52.671007 24089 raft_consensus.cc:740] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:17:52.671873 24089 consensus_queue.cc:260] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:17:52.673062 24162 raft_consensus.cc:2468] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 2.
I20260709 12:17:52.673055 24089 raft_consensus.cc:3060] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.674602 23977 leader_election.cc:304] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:52.675449 24212 raft_consensus.cc:2804] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:52.675911 24212 raft_consensus.cc:697] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Becoming Leader. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:17:52.675808 23911 catalog_manager.cc:5697] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 reported cstate change: term changed from 1 to 2, leader changed from ead760b489bd46d991f3eb780b97345b (127.23.81.193) to 8aa459763c974a75896438500c34ce67 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "8aa459763c974a75896438500c34ce67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.676748 24212 consensus_queue.cc:237] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:17:52.680110 24089 raft_consensus.cc:2468] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 2.
I20260709 12:17:52.686239 23910 catalog_manager.cc:5697] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b reported cstate change: term changed from 1 to 2, leader changed from 8aa459763c974a75896438500c34ce67 (127.23.81.194) to ead760b489bd46d991f3eb780b97345b (127.23.81.193). New cstate: current_term: 2 leader_uuid: "ead760b489bd46d991f3eb780b97345b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.967911 24014 raft_consensus.cc:1275] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:52.969312 24243 consensus_queue.cc:1048] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.982779 24162 raft_consensus.cc:1275] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:52.984341 24243 consensus_queue.cc:1048] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:53.002045 24162 raft_consensus.cc:1275] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Refusing update from remote peer ead760b489bd46d991f3eb780b97345b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:53.002274 24163 raft_consensus.cc:1275] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Refusing update from remote peer ead760b489bd46d991f3eb780b97345b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:53.003486 24249 consensus_queue.cc:1048] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:53.003768 24292 consensus_queue.cc:1048] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:53.018733 24162 raft_consensus.cc:1275] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:53.020258 24243 consensus_queue.cc:1048] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.020587 24089 raft_consensus.cc:3060] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.027297 24089 raft_consensus.cc:1275] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Refusing update from remote peer ead760b489bd46d991f3eb780b97345b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:53.030825 24088 raft_consensus.cc:1275] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Refusing update from remote peer ead760b489bd46d991f3eb780b97345b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:53.033452 24291 consensus_queue.cc:1048] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:53.035770 24291 consensus_queue.cc:1048] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:53.050325 24014 raft_consensus.cc:1275] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:53.053020 24243 consensus_queue.cc:1048] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:53.082353 24014 raft_consensus.cc:1275] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:53.083487 24271 consensus_queue.cc:1048] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:53.091672 24162 raft_consensus.cc:3060] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.099957 24162 raft_consensus.cc:1275] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:53.101608 24298 consensus_queue.cc:1048] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:53.129468 24162 raft_consensus.cc:1275] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Refusing update from remote peer ead760b489bd46d991f3eb780b97345b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:53.131145 24291 consensus_queue.cc:1048] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:53.140439 24088 raft_consensus.cc:1275] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Refusing update from remote peer ead760b489bd46d991f3eb780b97345b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:53.142447 24292 consensus_queue.cc:1048] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:55.402292 23879 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:17:55.403014 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:55.424315 24088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3"
dest_uuid: "8aa459763c974a75896438500c34ce67"
mode: GRACEFUL
new_leader_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
 from {username='slave'} at 127.0.0.1:39920
I20260709 12:17:55.424866 24088 raft_consensus.cc:606] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Received request to transfer leadership to TS a5f0eb2faea242d589bdb266ff6573b1
I20260709 12:17:55.435169 24014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7"
dest_uuid: "ead760b489bd46d991f3eb780b97345b"
mode: GRACEFUL
new_leader_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
 from {username='slave'} at 127.0.0.1:42098
I20260709 12:17:55.435694 24014 raft_consensus.cc:606] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Received request to transfer leadership to TS a5f0eb2faea242d589bdb266ff6573b1
I20260709 12:17:55.436751 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:55.437215 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:55.487217 24301 raft_consensus.cc:993] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b: : Instructing follower a5f0eb2faea242d589bdb266ff6573b1 to start an election
I20260709 12:17:55.487655 24305 raft_consensus.cc:1081] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Signalling peer a5f0eb2faea242d589bdb266ff6573b1 to start an election
I20260709 12:17:55.489045 24163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7"
dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:17:55.489521 24163 raft_consensus.cc:493] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:55.489777 24163 raft_consensus.cc:3060] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.494316 24163 raft_consensus.cc:515] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:55.495993 24163 leader_election.cc:290] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 3 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:55.496796 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:17:55.496981 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:17:55.497357 24014 raft_consensus.cc:3055] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:55.497586 24088 raft_consensus.cc:3060] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.497720 24014 raft_consensus.cc:740] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:17:55.498622 24014 consensus_queue.cc:260] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:55.499792 24014 raft_consensus.cc:3060] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.504767 24088 raft_consensus.cc:2468] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 3.
I20260709 12:17:55.506407 24126 leader_election.cc:304] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, a5f0eb2faea242d589bdb266ff6573b1; no voters: 
I20260709 12:17:55.507311 24307 raft_consensus.cc:993] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67: : Instructing follower a5f0eb2faea242d589bdb266ff6573b1 to start an election
I20260709 12:17:55.507282 24252 raft_consensus.cc:2804] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:55.507614 24014 raft_consensus.cc:2468] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 3.
I20260709 12:17:55.507905 24306 raft_consensus.cc:1081] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Signalling peer a5f0eb2faea242d589bdb266ff6573b1 to start an election
I20260709 12:17:55.509559 24252 raft_consensus.cc:697] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 LEADER]: Becoming Leader. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:17:55.509611 24163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3"
dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
 from {username='slave'} at 127.0.0.1:52644
I20260709 12:17:55.510268 24163 raft_consensus.cc:493] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:55.510576 24163 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.510449 24252 consensus_queue.cc:237] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:55.515686 24163 raft_consensus.cc:515] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:55.517319 24163 leader_election.cc:290] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 3 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:17:55.518170 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:17:55.518172 23911 catalog_manager.cc:5697] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 reported cstate change: term changed from 2 to 3, leader changed from ead760b489bd46d991f3eb780b97345b (127.23.81.193) to a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "a5f0eb2faea242d589bdb266ff6573b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:55.518852 24014 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.518860 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:17:55.519513 24088 raft_consensus.cc:3055] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:55.519788 24088 raft_consensus.cc:740] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:17:55.520478 24088 consensus_queue.cc:260] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:55.521353 24088 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.524434 24014 raft_consensus.cc:2468] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 3.
I20260709 12:17:55.525458 24126 leader_election.cc:304] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:17:55.526399 24252 raft_consensus.cc:2804] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:55.526954 24252 raft_consensus.cc:697] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 LEADER]: Becoming Leader. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:17:55.527721 24252 consensus_queue.cc:237] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:17:55.528316 24088 raft_consensus.cc:2468] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 3.
I20260709 12:17:55.787668 23909 catalog_manager.cc:5697] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 reported cstate change: term changed from 2 to 3, leader changed from 8aa459763c974a75896438500c34ce67 (127.23.81.194) to a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "a5f0eb2faea242d589bdb266ff6573b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:55.940212 24014 raft_consensus.cc:1275] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Refusing update from remote peer a5f0eb2faea242d589bdb266ff6573b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:55.941416 24252 consensus_queue.cc:1048] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:55.950838 24088 raft_consensus.cc:1275] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Refusing update from remote peer a5f0eb2faea242d589bdb266ff6573b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:55.952286 24252 consensus_queue.cc:1048] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:56.039254 24014 raft_consensus.cc:1275] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Refusing update from remote peer a5f0eb2faea242d589bdb266ff6573b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:56.040374 24252 consensus_queue.cc:1048] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:56.048856 24088 raft_consensus.cc:1275] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Refusing update from remote peer a5f0eb2faea242d589bdb266ff6573b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:56.050364 24322 consensus_queue.cc:1048] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:56.484342 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:56.489388 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:56.489724 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:17:56.661124 24110 debug-util.cc:398] Leaking SignalData structure 0x7b080012e060 after lost signal to thread 23882
W20260709 12:17:56.661890 24110 debug-util.cc:398] Leaking SignalData structure 0x7b080012e740 after lost signal to thread 23945
W20260709 12:17:56.662796 24110 debug-util.cc:398] Leaking SignalData structure 0x7b08000f1240 after lost signal to thread 24038
W20260709 12:17:56.663617 24110 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca9e0 after lost signal to thread 24113
W20260709 12:17:56.664371 24110 debug-util.cc:398] Leaking SignalData structure 0x7b08000cec60 after lost signal to thread 24187
I20260709 12:17:57.490633 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:57.496390 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:57.496829 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:58.497862 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:58.502825 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:58.503285 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:59.504356 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:59.510613 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:59.511053 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:00.512203 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:00.517174 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:00.517638 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:01.518594 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:01.523440 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:01.523893 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:02.524838 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:02.529585 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:02.530047 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:03.530957 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:03.535799 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:03.536270 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:04.537164 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:04.542217 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:04.542641 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:05.570163 23879 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:18:05.574954 24013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab3ad53a278446ffa35de80a3976d9dc"
dest_uuid: "ead760b489bd46d991f3eb780b97345b"
mode: GRACEFUL
new_leader_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:42092
I20260709 12:18:05.575565 24013 raft_consensus.cc:606] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Received request to transfer leadership to TS 8aa459763c974a75896438500c34ce67
I20260709 12:18:05.580549 24013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55047b7f58b34a8688521e13af751d64"
dest_uuid: "ead760b489bd46d991f3eb780b97345b"
mode: GRACEFUL
new_leader_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:42092
I20260709 12:18:05.580957 24013 raft_consensus.cc:606] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Received request to transfer leadership to TS 8aa459763c974a75896438500c34ce67
I20260709 12:18:05.585496 24162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7"
dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
mode: GRACEFUL
new_leader_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:52648
I20260709 12:18:05.585903 24162 raft_consensus.cc:606] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 LEADER]: Received request to transfer leadership to TS 8aa459763c974a75896438500c34ce67
I20260709 12:18:05.590647 24013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172"
dest_uuid: "ead760b489bd46d991f3eb780b97345b"
mode: GRACEFUL
new_leader_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:42092
I20260709 12:18:05.591092 24013 raft_consensus.cc:606] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Received request to transfer leadership to TS 8aa459763c974a75896438500c34ce67
I20260709 12:18:05.602451 24162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3"
dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
mode: GRACEFUL
new_leader_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:52648
I20260709 12:18:05.602929 24162 raft_consensus.cc:606] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 LEADER]: Received request to transfer leadership to TS 8aa459763c974a75896438500c34ce67
I20260709 12:18:05.633965 24325 raft_consensus.cc:993] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b: : Instructing follower 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:18:05.634531 24331 raft_consensus.cc:1081] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Signalling peer 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:18:05.636104 24088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172"
dest_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:18:05.636600 24088 raft_consensus.cc:493] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:05.636967 24088 raft_consensus.cc:3060] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:05.642100 24088 raft_consensus.cc:515] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:05.643659 24088 leader_election.cc:290] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 3 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:18:05.644484 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:18:05.644694 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:18:05.645166 24013 raft_consensus.cc:3055] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:05.645285 24162 raft_consensus.cc:3060] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:05.645440 24013 raft_consensus.cc:740] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:18:05.646227 24013 consensus_queue.cc:260] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:05.647102 24013 raft_consensus.cc:3060] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:05.650368 24162 raft_consensus.cc:2468] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 3.
I20260709 12:18:05.651772 24325 raft_consensus.cc:993] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b: : Instructing follower 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:18:05.651698 24052 leader_election.cc:304] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, a5f0eb2faea242d589bdb266ff6573b1; no voters: 
I20260709 12:18:05.652298 24331 raft_consensus.cc:1081] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Signalling peer 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:18:05.652381 24013 raft_consensus.cc:2468] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 3.
I20260709 12:18:05.652689 24306 raft_consensus.cc:2804] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:05.653884 24306 raft_consensus.cc:697] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 3 LEADER]: Becoming Leader. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:18:05.654632 24088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55047b7f58b34a8688521e13af751d64"
dest_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:18:05.654762 24306 consensus_queue.cc:237] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:05.655205 24088 raft_consensus.cc:493] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:05.655576 24088 raft_consensus.cc:3060] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:05.660799 24088 raft_consensus.cc:515] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:05.662312 24088 leader_election.cc:290] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 2 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:18:05.663278 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55047b7f58b34a8688521e13af751d64" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:18:05.663240 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55047b7f58b34a8688521e13af751d64" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:18:05.663931 24013 raft_consensus.cc:3055] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:05.664048 24162 raft_consensus.cc:3060] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:05.664229 24013 raft_consensus.cc:740] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:18:05.665024 24013 consensus_queue.cc:260] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:05.665127 23911 catalog_manager.cc:5697] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 reported cstate change: term changed from 2 to 3, leader changed from ead760b489bd46d991f3eb780b97345b (127.23.81.193) to 8aa459763c974a75896438500c34ce67 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "8aa459763c974a75896438500c34ce67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:05.665879 24013 raft_consensus.cc:3060] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:05.670208 24162 raft_consensus.cc:2468] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 2.
I20260709 12:18:05.671132 24013 raft_consensus.cc:2468] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 2.
I20260709 12:18:05.671232 24052 leader_election.cc:304] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, a5f0eb2faea242d589bdb266ff6573b1; no voters: 
I20260709 12:18:05.671947 24306 raft_consensus.cc:2804] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:05.672421 24306 raft_consensus.cc:697] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Becoming Leader. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:18:05.673348 24306 consensus_queue.cc:237] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:05.683642 23911 catalog_manager.cc:5697] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 reported cstate change: term changed from 1 to 2, leader changed from ead760b489bd46d991f3eb780b97345b (127.23.81.193) to 8aa459763c974a75896438500c34ce67 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "8aa459763c974a75896438500c34ce67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:05.714202 24324 raft_consensus.cc:993] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1: : Instructing follower 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:18:05.714694 24339 raft_consensus.cc:1081] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 LEADER]: Signalling peer 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:18:05.716199 24088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7"
dest_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:39890
I20260709 12:18:05.716642 24088 raft_consensus.cc:493] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:05.716912 24088 raft_consensus.cc:3060] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.720968 24088 raft_consensus.cc:515] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:05.722478 24088 leader_election.cc:290] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 4 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:18:05.723165 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:18:05.723505 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0da620915d42a58dc2ed27add8d7e7" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:18:05.723721 24013 raft_consensus.cc:3060] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.724011 24162 raft_consensus.cc:3055] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:05.724313 24162 raft_consensus.cc:740] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:18:05.724864 24162 consensus_queue.cc:260] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:05.725694 24162 raft_consensus.cc:3060] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.727973 24013 raft_consensus.cc:2468] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 4.
I20260709 12:18:05.728905 24052 leader_election.cc:304] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:18:05.729609 24306 raft_consensus.cc:2804] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:05.729993 24306 raft_consensus.cc:697] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 4 LEADER]: Becoming Leader. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:18:05.729990 24162 raft_consensus.cc:2468] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 4.
I20260709 12:18:05.731009 24306 consensus_queue.cc:237] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:05.737802 23911 catalog_manager.cc:5697] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 reported cstate change: term changed from 3 to 4, leader changed from a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195) to 8aa459763c974a75896438500c34ce67 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "8aa459763c974a75896438500c34ce67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:05.821254 24325 raft_consensus.cc:993] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b: : Instructing follower 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:18:05.821724 24331 raft_consensus.cc:1081] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Signalling peer 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:18:05.823235 24088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab3ad53a278446ffa35de80a3976d9dc"
dest_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:18:05.823660 24088 raft_consensus.cc:493] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:05.823900 24088 raft_consensus.cc:3060] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:05.828197 24088 raft_consensus.cc:515] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:18:05.829622 24088 leader_election.cc:290] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 3 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:18:05.830559 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ad53a278446ffa35de80a3976d9dc" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:18:05.830721 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ad53a278446ffa35de80a3976d9dc" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:18:05.831067 24013 raft_consensus.cc:3055] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:05.831225 24162 raft_consensus.cc:3060] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:05.831470 24013 raft_consensus.cc:740] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:18:05.832252 24013 consensus_queue.cc:260] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:18:05.833146 24013 raft_consensus.cc:3060] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:05.835595 24162 raft_consensus.cc:2468] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 3.
I20260709 12:18:05.836544 24052 leader_election.cc:304] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, a5f0eb2faea242d589bdb266ff6573b1; no voters: 
I20260709 12:18:05.837174 24306 raft_consensus.cc:2804] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:05.837430 24013 raft_consensus.cc:2468] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 3.
I20260709 12:18:05.837523 24306 raft_consensus.cc:697] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 3 LEADER]: Becoming Leader. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:18:05.838532 24306 consensus_queue.cc:237] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } }
I20260709 12:18:05.844835 23911 catalog_manager.cc:5697] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 reported cstate change: term changed from 2 to 3, leader changed from ead760b489bd46d991f3eb780b97345b (127.23.81.193) to 8aa459763c974a75896438500c34ce67 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "8aa459763c974a75896438500c34ce67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:06.128253 24013 raft_consensus.cc:1275] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:06.129541 24306 consensus_queue.cc:1048] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:06.133713 24162 raft_consensus.cc:1275] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 4 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:06.134987 24306 consensus_queue.cc:1048] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:06.147936 24013 raft_consensus.cc:1275] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:06.148077 24324 raft_consensus.cc:993] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1: : Instructing follower 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:18:06.148732 24339 raft_consensus.cc:1081] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 LEADER]: Signalling peer 8aa459763c974a75896438500c34ce67 to start an election
I20260709 12:18:06.152200 24162 raft_consensus.cc:1275] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:06.153442 24163 raft_consensus.cc:1275] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:06.154274 24344 consensus_queue.cc:1048] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:06.155227 24088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3"
dest_uuid: "8aa459763c974a75896438500c34ce67"
 from {username='slave'} at 127.0.0.1:39890
I20260709 12:18:06.155754 24088 raft_consensus.cc:493] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:06.156133 24088 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.155586 24344 consensus_queue.cc:1048] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:06.162789 24088 raft_consensus.cc:515] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:06.163158 24012 raft_consensus.cc:1275] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 4 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:06.164220 24344 consensus_queue.cc:1048] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:06.164885 24088 leader_election.cc:290] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 4 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:18:06.166178 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:18:06.166836 24162 raft_consensus.cc:3055] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:06.166920 24344 consensus_queue.cc:1048] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:06.168071 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "8aa459763c974a75896438500c34ce67" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:18:06.170873 24012 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.175964 24162 raft_consensus.cc:740] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:18:06.177270 24162 consensus_queue.cc:260] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:06.178498 24162 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.188416 24162 raft_consensus.cc:2468] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 4.
I20260709 12:18:06.190816 24052 leader_election.cc:304] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa459763c974a75896438500c34ce67, a5f0eb2faea242d589bdb266ff6573b1; no voters: 
I20260709 12:18:06.191609 24306 raft_consensus.cc:2804] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:06.192226 24306 raft_consensus.cc:697] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 4 LEADER]: Becoming Leader. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:18:06.193862 24306 consensus_queue.cc:237] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:06.200498 24012 raft_consensus.cc:2468] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa459763c974a75896438500c34ce67 in term 4.
I20260709 12:18:06.211681 23909 catalog_manager.cc:5697] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 reported cstate change: term changed from 3 to 4, leader changed from a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195) to 8aa459763c974a75896438500c34ce67 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "8aa459763c974a75896438500c34ce67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.279311 24014 raft_consensus.cc:1275] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:06.280454 24332 consensus_queue.cc:1048] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:06.290583 24161 raft_consensus.cc:1275] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:06.291971 24306 consensus_queue.cc:1048] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:06.737524 24161 raft_consensus.cc:1275] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 4 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:06.738700 24344 consensus_queue.cc:1048] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:06.747889 24014 raft_consensus.cc:1275] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 4 FOLLOWER]: Refusing update from remote peer 8aa459763c974a75896438500c34ce67: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:06.749689 24332 consensus_queue.cc:1048] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:08.638118 23879 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:18:08.639003 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:08.647720 24088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59"
dest_uuid: "8aa459763c974a75896438500c34ce67"
mode: GRACEFUL
new_leader_uuid: "ead760b489bd46d991f3eb780b97345b"
 from {username='slave'} at 127.0.0.1:39920
I20260709 12:18:08.648406 24088 raft_consensus.cc:606] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Received request to transfer leadership to TS ead760b489bd46d991f3eb780b97345b
I20260709 12:18:08.650878 24088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3"
dest_uuid: "8aa459763c974a75896438500c34ce67"
mode: GRACEFUL
new_leader_uuid: "ead760b489bd46d991f3eb780b97345b"
 from {username='slave'} at 127.0.0.1:39920
I20260709 12:18:08.651331 24088 raft_consensus.cc:606] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 4 LEADER]: Received request to transfer leadership to TS ead760b489bd46d991f3eb780b97345b
I20260709 12:18:08.653412 24088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac162ff0242e42f58a32f5eb1c6d610b"
dest_uuid: "8aa459763c974a75896438500c34ce67"
mode: GRACEFUL
new_leader_uuid: "ead760b489bd46d991f3eb780b97345b"
 from {username='slave'} at 127.0.0.1:39920
I20260709 12:18:08.653865 24088 raft_consensus.cc:606] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Received request to transfer leadership to TS ead760b489bd46d991f3eb780b97345b
I20260709 12:18:08.655938 24088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172"
dest_uuid: "8aa459763c974a75896438500c34ce67"
mode: GRACEFUL
new_leader_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
 from {username='slave'} at 127.0.0.1:39920
I20260709 12:18:08.656355 24088 raft_consensus.cc:606] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 3 LEADER]: Received request to transfer leadership to TS a5f0eb2faea242d589bdb266ff6573b1
I20260709 12:18:08.658366 24088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff20bc77f4a74f67b1141010b27d5af5"
dest_uuid: "8aa459763c974a75896438500c34ce67"
mode: GRACEFUL
new_leader_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
 from {username='slave'} at 127.0.0.1:39920
I20260709 12:18:08.658802 24088 raft_consensus.cc:606] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 1 LEADER]: Received request to transfer leadership to TS a5f0eb2faea242d589bdb266ff6573b1
I20260709 12:18:08.659715 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:08.660099 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:08.674537 24359 raft_consensus.cc:993] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67: : Instructing follower ead760b489bd46d991f3eb780b97345b to start an election
I20260709 12:18:08.675077 24362 raft_consensus.cc:1081] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Signalling peer ead760b489bd46d991f3eb780b97345b to start an election
I20260709 12:18:08.676659 24012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59"
dest_uuid: "ead760b489bd46d991f3eb780b97345b"
 from {username='slave'} at 127.0.0.1:42080
I20260709 12:18:08.677160 24012 raft_consensus.cc:493] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:08.677503 24012 raft_consensus.cc:3060] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:08.682868 24012 raft_consensus.cc:515] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:08.685945 24012 leader_election.cc:290] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 3 election: Requested vote from peers 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:18:08.686810 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:18:08.687523 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7940128775462b9e0cbf12922e1d59" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:18:08.688329 24088 raft_consensus.cc:3055] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:08.688546 24162 raft_consensus.cc:3060] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:08.688751 24088 raft_consensus.cc:740] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:18:08.689651 24088 consensus_queue.cc:260] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:08.690811 24088 raft_consensus.cc:3060] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:08.693766 24162 raft_consensus.cc:2468] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 3.
I20260709 12:18:08.695142 23977 leader_election.cc:304] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:18:08.696146 24088 raft_consensus.cc:2468] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 3.
I20260709 12:18:08.696868 24364 raft_consensus.cc:2804] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:08.697849 24364 raft_consensus.cc:697] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 3 LEADER]: Becoming Leader. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:18:08.698768 24364 consensus_queue.cc:237] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:08.707260 23911 catalog_manager.cc:5697] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b reported cstate change: term changed from 2 to 3, leader changed from 8aa459763c974a75896438500c34ce67 (127.23.81.194) to ead760b489bd46d991f3eb780b97345b (127.23.81.193). New cstate: current_term: 3 leader_uuid: "ead760b489bd46d991f3eb780b97345b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:08.802135 24359 raft_consensus.cc:993] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67: : Instructing follower ead760b489bd46d991f3eb780b97345b to start an election
I20260709 12:18:08.802528 24362 raft_consensus.cc:1081] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 4 LEADER]: Signalling peer ead760b489bd46d991f3eb780b97345b to start an election
I20260709 12:18:08.803987 24012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3"
dest_uuid: "ead760b489bd46d991f3eb780b97345b"
 from {username='slave'} at 127.0.0.1:42080
I20260709 12:18:08.804493 24012 raft_consensus.cc:493] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:08.804805 24012 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:08.809886 24012 raft_consensus.cc:515] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:08.811890 24012 leader_election.cc:290] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 5 election: Requested vote from peers 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:18:08.812655 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:18:08.813273 24088 raft_consensus.cc:3055] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:08.813561 24088 raft_consensus.cc:740] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:18:08.813560 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0a7c0d8f9b46eba04dece7ec4c2cc3" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:18:08.814352 24162 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:08.814594 24088 consensus_queue.cc:260] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:08.816092 24088 raft_consensus.cc:3060] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:08.820801 24162 raft_consensus.cc:2468] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 5.
I20260709 12:18:08.821609 24088 raft_consensus.cc:2468] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 5.
I20260709 12:18:08.821640 23977 leader_election.cc:304] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:18:08.822501 24364 raft_consensus.cc:2804] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:08.822957 24364 raft_consensus.cc:697] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 5 LEADER]: Becoming Leader. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:18:08.823704 24364 consensus_queue.cc:237] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:08.830631 23911 catalog_manager.cc:5697] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b reported cstate change: term changed from 4 to 5, leader changed from 8aa459763c974a75896438500c34ce67 (127.23.81.194) to ead760b489bd46d991f3eb780b97345b (127.23.81.193). New cstate: current_term: 5 leader_uuid: "ead760b489bd46d991f3eb780b97345b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:08.846299 24359 raft_consensus.cc:993] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67: : Instructing follower ead760b489bd46d991f3eb780b97345b to start an election
I20260709 12:18:08.846742 24362 raft_consensus.cc:1081] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Signalling peer ead760b489bd46d991f3eb780b97345b to start an election
I20260709 12:18:08.848049 24012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac162ff0242e42f58a32f5eb1c6d610b"
dest_uuid: "ead760b489bd46d991f3eb780b97345b"
 from {username='slave'} at 127.0.0.1:42080
I20260709 12:18:08.848485 24012 raft_consensus.cc:493] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:08.848752 24012 raft_consensus.cc:3060] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:08.853271 24012 raft_consensus.cc:515] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:08.854851 24012 leader_election.cc:290] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 3 election: Requested vote from peers 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929), a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195:43177)
I20260709 12:18:08.855755 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac162ff0242e42f58a32f5eb1c6d610b" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:18:08.855974 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac162ff0242e42f58a32f5eb1c6d610b" candidate_uuid: "ead760b489bd46d991f3eb780b97345b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
I20260709 12:18:08.856271 24088 raft_consensus.cc:3055] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:08.856541 24162 raft_consensus.cc:3060] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:08.856599 24088 raft_consensus.cc:740] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:18:08.857407 24088 consensus_queue.cc:260] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:08.858323 24088 raft_consensus.cc:3060] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:08.860801 24162 raft_consensus.cc:2468] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 3.
I20260709 12:18:08.861693 23977 leader_election.cc:304] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:18:08.862347 24364 raft_consensus.cc:2804] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:08.862838 24364 raft_consensus.cc:697] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 3 LEADER]: Becoming Leader. State: Replica: ead760b489bd46d991f3eb780b97345b, State: Running, Role: LEADER
I20260709 12:18:08.863061 24088 raft_consensus.cc:2468] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead760b489bd46d991f3eb780b97345b in term 3.
I20260709 12:18:08.863816 24364 consensus_queue.cc:237] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:08.871201 23911 catalog_manager.cc:5697] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b reported cstate change: term changed from 2 to 3, leader changed from 8aa459763c974a75896438500c34ce67 (127.23.81.194) to ead760b489bd46d991f3eb780b97345b (127.23.81.193). New cstate: current_term: 3 leader_uuid: "ead760b489bd46d991f3eb780b97345b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:08.998543 24359 raft_consensus.cc:993] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67: : Instructing follower a5f0eb2faea242d589bdb266ff6573b1 to start an election
I20260709 12:18:08.998978 24362 raft_consensus.cc:1081] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 1 LEADER]: Signalling peer a5f0eb2faea242d589bdb266ff6573b1 to start an election
I20260709 12:18:09.000440 24162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff20bc77f4a74f67b1141010b27d5af5"
dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
 from {username='slave'} at 127.0.0.1:52644
I20260709 12:18:09.000883 24162 raft_consensus.cc:493] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:09.001158 24162 raft_consensus.cc:3060] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:09.005115 24162 raft_consensus.cc:515] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:09.007051 24162 leader_election.cc:290] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 2 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:18:09.008016 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20bc77f4a74f67b1141010b27d5af5" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:18:09.008127 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20bc77f4a74f67b1141010b27d5af5" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:18:09.008584 24012 raft_consensus.cc:3060] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:09.008680 24088 raft_consensus.cc:3055] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:09.009018 24088 raft_consensus.cc:740] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:18:09.009886 24088 consensus_queue.cc:260] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:09.011304 24088 raft_consensus.cc:3060] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:09.013839 24012 raft_consensus.cc:2468] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 2.
I20260709 12:18:09.015211 24126 leader_election.cc:304] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:18:09.015524 24088 raft_consensus.cc:2468] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 2.
I20260709 12:18:09.016083 24360 raft_consensus.cc:2804] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:09.017531 24360 raft_consensus.cc:697] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 LEADER]: Becoming Leader. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:18:09.018523 24360 consensus_queue.cc:237] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:09.025071 23911 catalog_manager.cc:5697] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 reported cstate change: term changed from 1 to 2, leader changed from 8aa459763c974a75896438500c34ce67 (127.23.81.194) to a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "a5f0eb2faea242d589bdb266ff6573b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.056878 24359 raft_consensus.cc:993] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67: : Instructing follower a5f0eb2faea242d589bdb266ff6573b1 to start an election
I20260709 12:18:09.057365 24362 raft_consensus.cc:1081] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 3 LEADER]: Signalling peer a5f0eb2faea242d589bdb266ff6573b1 to start an election
I20260709 12:18:09.058815 24162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172"
dest_uuid: "a5f0eb2faea242d589bdb266ff6573b1"
 from {username='slave'} at 127.0.0.1:52644
I20260709 12:18:09.059288 24162 raft_consensus.cc:493] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:09.059579 24162 raft_consensus.cc:3060] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.063678 24162 raft_consensus.cc:515] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:09.065026 24162 leader_election.cc:290] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 4 election: Requested vote from peers ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775), 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929)
I20260709 12:18:09.065937 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ead760b489bd46d991f3eb780b97345b"
I20260709 12:18:09.066159 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335fe11d3a242e783176b78a64ed172" candidate_uuid: "a5f0eb2faea242d589bdb266ff6573b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8aa459763c974a75896438500c34ce67"
I20260709 12:18:09.066570 24012 raft_consensus.cc:3060] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.066620 24088 raft_consensus.cc:3055] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:09.067087 24088 raft_consensus.cc:740] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8aa459763c974a75896438500c34ce67, State: Running, Role: LEADER
I20260709 12:18:09.067821 24088 consensus_queue.cc:260] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:09.068928 24088 raft_consensus.cc:3060] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.073285 24012 raft_consensus.cc:2468] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 4.
I20260709 12:18:09.074482 24126 leader_election.cc:304] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f0eb2faea242d589bdb266ff6573b1, ead760b489bd46d991f3eb780b97345b; no voters: 
I20260709 12:18:09.074923 24088 raft_consensus.cc:2468] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5f0eb2faea242d589bdb266ff6573b1 in term 4.
I20260709 12:18:09.075138 24360 raft_consensus.cc:2804] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:09.075605 24360 raft_consensus.cc:697] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 4 LEADER]: Becoming Leader. State: Replica: a5f0eb2faea242d589bdb266ff6573b1, State: Running, Role: LEADER
I20260709 12:18:09.076486 24360 consensus_queue.cc:237] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } }
I20260709 12:18:09.082706 23911 catalog_manager.cc:5697] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 reported cstate change: term changed from 3 to 4, leader changed from 8aa459763c974a75896438500c34ce67 (127.23.81.194) to a5f0eb2faea242d589bdb266ff6573b1 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "a5f0eb2faea242d589bdb266ff6573b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.111929 24088 raft_consensus.cc:1275] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Refusing update from remote peer ead760b489bd46d991f3eb780b97345b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:09.113157 24364 consensus_queue.cc:1048] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:09.123760 24162 raft_consensus.cc:1275] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Refusing update from remote peer ead760b489bd46d991f3eb780b97345b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:09.125324 24364 consensus_queue.cc:1048] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:09.252557 24088 raft_consensus.cc:1275] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Refusing update from remote peer ead760b489bd46d991f3eb780b97345b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:09.253700 24364 consensus_queue.cc:1048] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:09.261909 24162 raft_consensus.cc:1275] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Refusing update from remote peer ead760b489bd46d991f3eb780b97345b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:09.263348 24364 consensus_queue.cc:1048] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:09.306972 24162 raft_consensus.cc:1275] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 5 FOLLOWER]: Refusing update from remote peer ead760b489bd46d991f3eb780b97345b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:09.308025 24364 consensus_queue.cc:1048] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f0eb2faea242d589bdb266ff6573b1" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:09.316978 24088 raft_consensus.cc:1275] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 5 FOLLOWER]: Refusing update from remote peer ead760b489bd46d991f3eb780b97345b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:09.318439 24364 consensus_queue.cc:1048] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:09.459546 24088 raft_consensus.cc:1275] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Refusing update from remote peer a5f0eb2faea242d589bdb266ff6573b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:09.460609 24360 consensus_queue.cc:1048] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:09.469467 24012 raft_consensus.cc:1275] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Refusing update from remote peer a5f0eb2faea242d589bdb266ff6573b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:09.471069 24387 consensus_queue.cc:1048] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:09.555332 24012 raft_consensus.cc:1275] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 4 FOLLOWER]: Refusing update from remote peer a5f0eb2faea242d589bdb266ff6573b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:09.556432 24387 consensus_queue.cc:1048] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead760b489bd46d991f3eb780b97345b" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 45775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:09.564877 24088 raft_consensus.cc:1275] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 4 FOLLOWER]: Refusing update from remote peer a5f0eb2faea242d589bdb266ff6573b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:09.566255 24387 consensus_queue.cc:1048] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa459763c974a75896438500c34ce67" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:09.661211 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:09.666117 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:09.666550 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:10.667538 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:10.672312 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:10.672760 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:11.673841 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:11.679976 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:11.680385 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:12.681298 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:12.685966 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:12.686401 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:13.687470 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:13.692414 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:13.692843 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:14.693863 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:14.699800 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:14.700338 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:15.701503 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:15.706528 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:15.706987 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:16.707931 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:16.713044 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:16.713474 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:17.714478 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:17.719161 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:17.719568 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:18.748838 23879 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:18:18.749500 23879 tablet_server.cc:179] TabletServer@127.23.81.193:0 shutting down...
I20260709 12:18:18.776927 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:18.777861 23879 tablet_replica.cc:333] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b: stopping tablet replica
I20260709 12:18:18.779088 23879 raft_consensus.cc:2243] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.780228 23879 raft_consensus.cc:2272] T 7f7940128775462b9e0cbf12922e1d59 P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.782740 23879 tablet_replica.cc:333] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b: stopping tablet replica
I20260709 12:18:18.783334 23879 raft_consensus.cc:2243] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.784281 23879 raft_consensus.cc:2272] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P ead760b489bd46d991f3eb780b97345b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.786127 23879 tablet_replica.cc:333] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b: stopping tablet replica
I20260709 12:18:18.786616 23879 raft_consensus.cc:2243] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.787096 23879 raft_consensus.cc:2272] T ac0da620915d42a58dc2ed27add8d7e7 P ead760b489bd46d991f3eb780b97345b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.789395 23879 tablet_replica.cc:333] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b: stopping tablet replica
I20260709 12:18:18.789971 23879 raft_consensus.cc:2243] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.790727 23879 raft_consensus.cc:2272] T 55047b7f58b34a8688521e13af751d64 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.792544 23879 tablet_replica.cc:333] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b: stopping tablet replica
I20260709 12:18:18.793063 23879 raft_consensus.cc:2243] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.793471 23879 raft_consensus.cc:2272] T ff20bc77f4a74f67b1141010b27d5af5 P ead760b489bd46d991f3eb780b97345b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.795372 23879 tablet_replica.cc:333] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b: stopping tablet replica
I20260709 12:18:18.795825 23879 raft_consensus.cc:2243] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.796743 23879 raft_consensus.cc:2272] T ac162ff0242e42f58a32f5eb1c6d610b P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.798434 23879 tablet_replica.cc:333] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b: stopping tablet replica
I20260709 12:18:18.798909 23879 raft_consensus.cc:2243] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.799367 23879 raft_consensus.cc:2272] T 3d0444e3934247099f34249c78f82ec0 P ead760b489bd46d991f3eb780b97345b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.801023 23879 tablet_replica.cc:333] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b: stopping tablet replica
I20260709 12:18:18.801494 23879 raft_consensus.cc:2243] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.801994 23879 raft_consensus.cc:2272] T ab3ad53a278446ffa35de80a3976d9dc P ead760b489bd46d991f3eb780b97345b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.803700 23879 tablet_replica.cc:333] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b: stopping tablet replica
I20260709 12:18:18.804149 23879 raft_consensus.cc:2243] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.804639 23879 raft_consensus.cc:2272] T b335fe11d3a242e783176b78a64ed172 P ead760b489bd46d991f3eb780b97345b [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:18.813796 24126 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:18.817520 24126 consensus_peers.cc:597] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 -> Peer ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775): Couldn't send request to peer ead760b489bd46d991f3eb780b97345b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:18.896816 23879 tablet_server.cc:196] TabletServer@127.23.81.193:0 shutdown complete.
W20260709 12:18:18.897325 24126 consensus_peers.cc:597] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 -> Peer ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775): Couldn't send request to peer ead760b489bd46d991f3eb780b97345b. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:45775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:18.917227 23879 tablet_server.cc:179] TabletServer@127.23.81.194:0 shutting down...
W20260709 12:18:18.923858 24052 consensus_peers.cc:597] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 -> Peer ead760b489bd46d991f3eb780b97345b (127.23.81.193:45775): Couldn't send request to peer ead760b489bd46d991f3eb780b97345b. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:45775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:18.946698 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:18.947751 23879 tablet_replica.cc:333] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67: stopping tablet replica
I20260709 12:18:18.948644 23879 raft_consensus.cc:2243] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.949209 23879 raft_consensus.cc:2272] T b335fe11d3a242e783176b78a64ed172 P 8aa459763c974a75896438500c34ce67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.951182 23879 tablet_replica.cc:333] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67: stopping tablet replica
W20260709 12:18:18.951429 24126 consensus_peers.cc:597] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 -> Peer 8aa459763c974a75896438500c34ce67 (127.23.81.194:41929): Couldn't send request to peer 8aa459763c974a75896438500c34ce67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:18.951810 23879 raft_consensus.cc:2243] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.952327 23879 raft_consensus.cc:2272] T 3d0444e3934247099f34249c78f82ec0 P 8aa459763c974a75896438500c34ce67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.954265 23879 tablet_replica.cc:333] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67: stopping tablet replica
I20260709 12:18:18.954758 23879 raft_consensus.cc:2243] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.955255 23879 raft_consensus.cc:2272] T ac162ff0242e42f58a32f5eb1c6d610b P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.956907 23879 tablet_replica.cc:333] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67: stopping tablet replica
I20260709 12:18:18.957417 23879 raft_consensus.cc:2243] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.957908 23879 raft_consensus.cc:2272] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P 8aa459763c974a75896438500c34ce67 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.959649 23879 tablet_replica.cc:333] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67: stopping tablet replica
I20260709 12:18:18.960150 23879 raft_consensus.cc:2243] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.960961 23879 raft_consensus.cc:2272] T 55047b7f58b34a8688521e13af751d64 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.962677 23879 tablet_replica.cc:333] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67: stopping tablet replica
I20260709 12:18:18.963173 23879 raft_consensus.cc:2243] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.964232 23879 raft_consensus.cc:2272] T ac0da620915d42a58dc2ed27add8d7e7 P 8aa459763c974a75896438500c34ce67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.965867 23879 tablet_replica.cc:333] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67: stopping tablet replica
I20260709 12:18:18.966367 23879 raft_consensus.cc:2243] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.966825 23879 raft_consensus.cc:2272] T ff20bc77f4a74f67b1141010b27d5af5 P 8aa459763c974a75896438500c34ce67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.968729 23879 tablet_replica.cc:333] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67: stopping tablet replica
I20260709 12:18:18.969276 23879 raft_consensus.cc:2243] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.970088 23879 raft_consensus.cc:2272] T ab3ad53a278446ffa35de80a3976d9dc P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.971632 23879 tablet_replica.cc:333] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67: stopping tablet replica
I20260709 12:18:18.972041 23879 raft_consensus.cc:2243] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.972411 23879 raft_consensus.cc:2272] T 7f7940128775462b9e0cbf12922e1d59 P 8aa459763c974a75896438500c34ce67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:19.020216 23879 tablet_server.cc:196] TabletServer@127.23.81.194:0 shutdown complete.
I20260709 12:18:19.040272 23879 tablet_server.cc:179] TabletServer@127.23.81.195:0 shutting down...
I20260709 12:18:19.066740 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:19.067380 23879 tablet_replica.cc:333] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1: stopping tablet replica
I20260709 12:18:19.068059 23879 raft_consensus.cc:2243] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:19.068603 23879 raft_consensus.cc:2272] T 7f7940128775462b9e0cbf12922e1d59 P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:19.070429 23879 tablet_replica.cc:333] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1: stopping tablet replica
I20260709 12:18:19.070958 23879 raft_consensus.cc:2243] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:19.071522 23879 raft_consensus.cc:2272] T ab3ad53a278446ffa35de80a3976d9dc P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:19.073364 23879 tablet_replica.cc:333] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1: stopping tablet replica
I20260709 12:18:19.073812 23879 raft_consensus.cc:2243] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:19.074329 23879 raft_consensus.cc:2272] T ac0da620915d42a58dc2ed27add8d7e7 P a5f0eb2faea242d589bdb266ff6573b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:19.076007 23879 tablet_replica.cc:333] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1: stopping tablet replica
I20260709 12:18:19.076483 23879 raft_consensus.cc:2243] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:19.077227 23879 raft_consensus.cc:2272] T ff20bc77f4a74f67b1141010b27d5af5 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:19.078830 23879 tablet_replica.cc:333] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1: stopping tablet replica
I20260709 12:18:19.079257 23879 raft_consensus.cc:2243] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:19.079582 23879 raft_consensus.cc:2272] T 55047b7f58b34a8688521e13af751d64 P a5f0eb2faea242d589bdb266ff6573b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:19.081038 23879 tablet_replica.cc:333] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1: stopping tablet replica
I20260709 12:18:19.081465 23879 raft_consensus.cc:2243] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:19.081878 23879 raft_consensus.cc:2272] T ac162ff0242e42f58a32f5eb1c6d610b P a5f0eb2faea242d589bdb266ff6573b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:19.083348 23879 tablet_replica.cc:333] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1: stopping tablet replica
I20260709 12:18:19.083740 23879 raft_consensus.cc:2243] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:19.084452 23879 raft_consensus.cc:2272] T 3d0444e3934247099f34249c78f82ec0 P a5f0eb2faea242d589bdb266ff6573b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:19.085999 23879 tablet_replica.cc:333] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1: stopping tablet replica
I20260709 12:18:19.086491 23879 raft_consensus.cc:2243] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:19.086908 23879 raft_consensus.cc:2272] T 8d0a7c0d8f9b46eba04dece7ec4c2cc3 P a5f0eb2faea242d589bdb266ff6573b1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:19.088476 23879 tablet_replica.cc:333] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1: stopping tablet replica
I20260709 12:18:19.088877 23879 raft_consensus.cc:2243] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:19.089599 23879 raft_consensus.cc:2272] T b335fe11d3a242e783176b78a64ed172 P a5f0eb2faea242d589bdb266ff6573b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:19.117079 23879 tablet_server.cc:196] TabletServer@127.23.81.195:0 shutdown complete.
I20260709 12:18:19.134991 23879 master.cc:562] Master@127.23.81.254:38629 shutting down...
I20260709 12:18:19.286813 23879 raft_consensus.cc:2243] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:19.287582 23879 raft_consensus.cc:2272] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:19.287969 23879 tablet_replica.cc:333] T 00000000000000000000000000000000 P be40def9aaa64ab48f400c79e6a31210: stopping tablet replica
I20260709 12:18:19.307726 23879 master.cc:584] Master@127.23.81.254:38629 shutdown complete.
8aa459763c974a75896438500c34ce67  4
a5f0eb2faea242d589bdb266ff6573b1  1
ead760b489bd46d991f3eb780b97345b  4
8aa459763c974a75896438500c34ce67  3
a5f0eb2faea242d589bdb266ff6573b1  3
ead760b489bd46d991f3eb780b97345b  3
8aa459763c974a75896438500c34ce67  8
a5f0eb2faea242d589bdb266ff6573b1  1
ead760b489bd46d991f3eb780b97345b  0
8aa459763c974a75896438500c34ce67  3
a5f0eb2faea242d589bdb266ff6573b1  3
ead760b489bd46d991f3eb780b97345b  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (30826 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:18:19.348578 23879 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.81.254:36037
I20260709 12:18:19.349678 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:19.355443 24403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:19.355628 24402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:19.356184 24405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:19.357391 23879 server_base.cc:1061] running on GCE node
I20260709 12:18:19.358449 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:19.358626 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:19.358780 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599499358764 us; error 0 us; skew 500 ppm
I20260709 12:18:19.359248 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:19.361469 23879 webserver.cc:533] Webserver started at http://127.23.81.254:38301/ using document root <none> and password file <none>
I20260709 12:18:19.361919 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:19.362145 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:19.362373 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:19.363446 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/master-0-root/instance:
uuid: "e5f4cf008279476aacb155c22b267be4"
format_stamp: "Formatted at 2026-07-09 12:18:19 on dist-test-slave-mprf"
I20260709 12:18:19.368067 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:18:19.371336 24410 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:19.372054 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:18:19.372298 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/master-0-root
uuid: "e5f4cf008279476aacb155c22b267be4"
format_stamp: "Formatted at 2026-07-09 12:18:19 on dist-test-slave-mprf"
I20260709 12:18:19.372529 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:19.403259 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:19.404474 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:19.443499 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.254:36037
I20260709 12:18:19.443591 24461 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.254:36037 every 8 connection(s)
I20260709 12:18:19.447315 24462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.456720 24462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4: Bootstrap starting.
I20260709 12:18:19.461305 24462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:19.465415 24462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4: No bootstrap required, opened a new log
I20260709 12:18:19.467590 24462 raft_consensus.cc:359] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5f4cf008279476aacb155c22b267be4" member_type: VOTER }
I20260709 12:18:19.468006 24462 raft_consensus.cc:385] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:19.468289 24462 raft_consensus.cc:740] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f4cf008279476aacb155c22b267be4, State: Initialized, Role: FOLLOWER
I20260709 12:18:19.468855 24462 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5f4cf008279476aacb155c22b267be4" member_type: VOTER }
I20260709 12:18:19.469321 24462 raft_consensus.cc:399] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:19.469540 24462 raft_consensus.cc:493] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:19.469823 24462 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:19.473682 24462 raft_consensus.cc:515] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5f4cf008279476aacb155c22b267be4" member_type: VOTER }
I20260709 12:18:19.474313 24462 leader_election.cc:304] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5f4cf008279476aacb155c22b267be4; no voters: 
I20260709 12:18:19.475430 24462 leader_election.cc:290] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:19.475826 24465 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:19.477121 24465 raft_consensus.cc:697] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [term 1 LEADER]: Becoming Leader. State: Replica: e5f4cf008279476aacb155c22b267be4, State: Running, Role: LEADER
I20260709 12:18:19.477723 24465 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5f4cf008279476aacb155c22b267be4" member_type: VOTER }
I20260709 12:18:19.478317 24462 sys_catalog.cc:565] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:19.482394 24466 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5f4cf008279476aacb155c22b267be4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5f4cf008279476aacb155c22b267be4" member_type: VOTER } }
I20260709 12:18:19.482352 24467 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5f4cf008279476aacb155c22b267be4. Latest consensus state: current_term: 1 leader_uuid: "e5f4cf008279476aacb155c22b267be4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5f4cf008279476aacb155c22b267be4" member_type: VOTER } }
I20260709 12:18:19.483038 24466 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:19.483161 24467 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:19.485322 24471 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:19.490662 24471 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:19.495154 23879 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:19.499955 24471 catalog_manager.cc:1383] Generated new cluster ID: fc917ec455464abb949538630c2714d4
I20260709 12:18:19.500192 24471 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:19.525810 24471 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:19.527061 24471 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:19.539902 24471 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4: Generated new TSK 0
I20260709 12:18:19.540504 24471 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:19.561257 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:19.567049 24483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:19.568070 24484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:19.569818 24486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:19.570142 23879 server_base.cc:1061] running on GCE node
I20260709 12:18:19.570981 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:19.571205 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:19.571374 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599499571358 us; error 0 us; skew 500 ppm
I20260709 12:18:19.571880 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:19.574018 23879 webserver.cc:533] Webserver started at http://127.23.81.193:42757/ using document root <none> and password file <none>
I20260709 12:18:19.574564 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:19.574796 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:19.575057 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:19.576095 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-0-root/instance:
uuid: "a640b2d5518848bd858c4584a193862e"
format_stamp: "Formatted at 2026-07-09 12:18:19 on dist-test-slave-mprf"
I20260709 12:18:19.580639 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:18:19.583840 24491 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:19.584550 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:18:19.584830 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-0-root
uuid: "a640b2d5518848bd858c4584a193862e"
format_stamp: "Formatted at 2026-07-09 12:18:19 on dist-test-slave-mprf"
I20260709 12:18:19.585130 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:19.607918 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:19.609229 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:19.610666 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:19.612910 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:19.613134 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:19.613368 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:19.613564 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:19.652562 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.193:40293
I20260709 12:18:19.652670 24553 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.193:40293 every 8 connection(s)
I20260709 12:18:19.657521 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:19.664716 24558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:19.667023 24559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:19.667922 24561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:19.668653 23879 server_base.cc:1061] running on GCE node
I20260709 12:18:19.669546 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:19.669765 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:19.669929 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599499669910 us; error 0 us; skew 500 ppm
I20260709 12:18:19.670511 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:19.673034 23879 webserver.cc:533] Webserver started at http://127.23.81.194:37459/ using document root <none> and password file <none>
I20260709 12:18:19.673565 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:19.673790 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:19.674150 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:19.675262 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-1-root/instance:
uuid: "bdf86ba745e44d7abf73548b4955ca62"
format_stamp: "Formatted at 2026-07-09 12:18:19 on dist-test-slave-mprf"
I20260709 12:18:19.675587 24554 heartbeater.cc:344] Connected to a master server at 127.23.81.254:36037
I20260709 12:18:19.675943 24554 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:19.676662 24554 heartbeater.cc:507] Master 127.23.81.254:36037 requested a full tablet report, sending...
I20260709 12:18:19.678799 24427 ts_manager.cc:194] Registered new tserver with Master: a640b2d5518848bd858c4584a193862e (127.23.81.193:40293)
I20260709 12:18:19.680447 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:18:19.680658 24427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33004
I20260709 12:18:19.684041 24566 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:19.684795 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:18:19.685078 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-1-root
uuid: "bdf86ba745e44d7abf73548b4955ca62"
format_stamp: "Formatted at 2026-07-09 12:18:19 on dist-test-slave-mprf"
I20260709 12:18:19.685369 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:19.701339 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:19.702617 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:19.704092 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:19.706264 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:19.706482 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:19.706714 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:19.706880 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:19.744768 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.194:36869
I20260709 12:18:19.744872 24628 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.194:36869 every 8 connection(s)
I20260709 12:18:19.749430 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:19.756506 24632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:19.756855 24633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:19.758737 24635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:19.759948 23879 server_base.cc:1061] running on GCE node
I20260709 12:18:19.760913 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:19.761093 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:19.761317 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599499761299 us; error 0 us; skew 500 ppm
I20260709 12:18:19.761863 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:19.761912 24629 heartbeater.cc:344] Connected to a master server at 127.23.81.254:36037
I20260709 12:18:19.762347 24629 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:19.763267 24629 heartbeater.cc:507] Master 127.23.81.254:36037 requested a full tablet report, sending...
I20260709 12:18:19.764853 23879 webserver.cc:533] Webserver started at http://127.23.81.195:42463/ using document root <none> and password file <none>
I20260709 12:18:19.765365 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:19.765360 24427 ts_manager.cc:194] Registered new tserver with Master: bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:19.765765 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:19.766126 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:19.766974 24427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33014
I20260709 12:18:19.767259 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-2-root/instance:
uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
format_stamp: "Formatted at 2026-07-09 12:18:19 on dist-test-slave-mprf"
I20260709 12:18:19.771975 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:18:19.775085 24640 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:19.775768 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:18:19.776054 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-2-root
uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
format_stamp: "Formatted at 2026-07-09 12:18:19 on dist-test-slave-mprf"
I20260709 12:18:19.776343 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599468354575-23879-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:19.793159 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:19.794435 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:19.795858 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:19.797971 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:19.798247 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:19.798484 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:19.798656 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:19.839893 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.195:36065
I20260709 12:18:19.840051 24702 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.195:36065 every 8 connection(s)
I20260709 12:18:19.853976 24703 heartbeater.cc:344] Connected to a master server at 127.23.81.254:36037
I20260709 12:18:19.854327 24703 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:19.855186 24703 heartbeater.cc:507] Master 127.23.81.254:36037 requested a full tablet report, sending...
I20260709 12:18:19.857124 24427 ts_manager.cc:194] Registered new tserver with Master: 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:19.858208 23879 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014490122s
I20260709 12:18:19.858769 24427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33024
I20260709 12:18:19.884665 24427 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33040:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:19.887691 24427 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:19.960732 24667 tablet_service.cc:1511] Processing CreateTablet for tablet 95666664078d4d3daf8f40058f52a17d (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:18:19.961131 24668 tablet_service.cc:1511] Processing CreateTablet for tablet b8fa1716867e478088f8ee3543db2c32 (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:18:19.962318 24667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95666664078d4d3daf8f40058f52a17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.963434 24666 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3727545181403bb8b6103f1c0f6bca (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:18:19.966969 24666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3727545181403bb8b6103f1c0f6bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.966565 24665 tablet_service.cc:1511] Processing CreateTablet for tablet 151a17f95d47472daa858f74ee3b6ff0 (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:18:19.968079 24665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151a17f95d47472daa858f74ee3b6ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.968713 24668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fa1716867e478088f8ee3543db2c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.969710 24594 tablet_service.cc:1511] Processing CreateTablet for tablet b8fa1716867e478088f8ee3543db2c32 (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:18:19.971043 24594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fa1716867e478088f8ee3543db2c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.975250 24593 tablet_service.cc:1511] Processing CreateTablet for tablet 95666664078d4d3daf8f40058f52a17d (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:18:19.976564 24593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95666664078d4d3daf8f40058f52a17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.979236 24591 tablet_service.cc:1511] Processing CreateTablet for tablet 151a17f95d47472daa858f74ee3b6ff0 (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:18:19.980571 24591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151a17f95d47472daa858f74ee3b6ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.980788 24515 tablet_service.cc:1511] Processing CreateTablet for tablet 887341ce0eda47f8a6f1376347b761ed (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:18:19.982110 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 887341ce0eda47f8a6f1376347b761ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.983223 24519 tablet_service.cc:1511] Processing CreateTablet for tablet b8fa1716867e478088f8ee3543db2c32 (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:18:19.984519 24519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fa1716867e478088f8ee3543db2c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.987219 24518 tablet_service.cc:1511] Processing CreateTablet for tablet 95666664078d4d3daf8f40058f52a17d (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:18:19.988561 24518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95666664078d4d3daf8f40058f52a17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.991104 24517 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3727545181403bb8b6103f1c0f6bca (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:18:19.992435 24517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3727545181403bb8b6103f1c0f6bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.995128 24516 tablet_service.cc:1511] Processing CreateTablet for tablet 151a17f95d47472daa858f74ee3b6ff0 (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:18:19.996727 24516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151a17f95d47472daa858f74ee3b6ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:19.996742 24592 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3727545181403bb8b6103f1c0f6bca (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:18:20.000026 24592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3727545181403bb8b6103f1c0f6bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.030316 24590 tablet_service.cc:1511] Processing CreateTablet for tablet 887341ce0eda47f8a6f1376347b761ed (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:18:20.031795 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 887341ce0eda47f8a6f1376347b761ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.062950 24719 tablet_bootstrap.cc:492] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e: Bootstrap starting.
I20260709 12:18:20.069136 24515 tablet_service.cc:1511] Processing CreateTablet for tablet 95ffb171ca624908b3c089b13ad3ca1e (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:18:20.070356 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ffb171ca624908b3c089b13ad3ca1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.077410 24718 tablet_bootstrap.cc:492] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705: Bootstrap starting.
I20260709 12:18:20.066715 24668 tablet_service.cc:1511] Processing CreateTablet for tablet 887341ce0eda47f8a6f1376347b761ed (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:18:20.078835 24668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 887341ce0eda47f8a6f1376347b761ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.081475 24719 tablet_bootstrap.cc:654] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.082947 24720 tablet_bootstrap.cc:492] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62: Bootstrap starting.
I20260709 12:18:20.087148 24719 tablet_bootstrap.cc:492] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e: No bootstrap required, opened a new log
I20260709 12:18:20.087634 24719 ts_tablet_manager.cc:1403] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.002s
I20260709 12:18:20.090735 24592 tablet_service.cc:1511] Processing CreateTablet for tablet 95ffb171ca624908b3c089b13ad3ca1e (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:18:20.092195 24592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ffb171ca624908b3c089b13ad3ca1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.094954 24719 raft_consensus.cc:359] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.095724 24719 raft_consensus.cc:385] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.096064 24719 raft_consensus.cc:740] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.098302 24719 consensus_queue.cc:260] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.099017 24666 tablet_service.cc:1511] Processing CreateTablet for tablet 95ffb171ca624908b3c089b13ad3ca1e (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:18:20.100288 24666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ffb171ca624908b3c089b13ad3ca1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.101416 24515 tablet_service.cc:1511] Processing CreateTablet for tablet a94e3f3b9c3f4c139c6c74c47f9f2949 (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:18:20.102746 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94e3f3b9c3f4c139c6c74c47f9f2949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.103269 24590 tablet_service.cc:1511] Processing CreateTablet for tablet a94e3f3b9c3f4c139c6c74c47f9f2949 (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:18:20.104496 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94e3f3b9c3f4c139c6c74c47f9f2949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.099787 24720 tablet_bootstrap.cc:654] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.107100 24665 tablet_service.cc:1511] Processing CreateTablet for tablet a94e3f3b9c3f4c139c6c74c47f9f2949 (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:18:20.108321 24665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94e3f3b9c3f4c139c6c74c47f9f2949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.116879 24554 heartbeater.cc:499] Master 127.23.81.254:36037 was elected leader, sending a full tablet report...
I20260709 12:18:20.118016 24719 ts_tablet_manager.cc:1434] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.003s
I20260709 12:18:20.129352 24719 tablet_bootstrap.cc:492] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e: Bootstrap starting.
I20260709 12:18:20.130442 24718 tablet_bootstrap.cc:654] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.140321 24719 tablet_bootstrap.cc:654] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.139984 24590 tablet_service.cc:1511] Processing CreateTablet for tablet b0db4e02c8904685aa784e7422c1e1ac (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:18:20.141949 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0db4e02c8904685aa784e7422c1e1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.141749 24515 tablet_service.cc:1511] Processing CreateTablet for tablet b0db4e02c8904685aa784e7422c1e1ac (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:18:20.144347 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0db4e02c8904685aa784e7422c1e1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.147326 24720 tablet_bootstrap.cc:492] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62: No bootstrap required, opened a new log
I20260709 12:18:20.147795 24720 ts_tablet_manager.cc:1403] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.020s
I20260709 12:18:20.150730 24720 raft_consensus.cc:359] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.151446 24720 raft_consensus.cc:385] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.151750 24720 raft_consensus.cc:740] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.152511 24720 consensus_queue.cc:260] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.160583 24718 tablet_bootstrap.cc:492] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705: No bootstrap required, opened a new log
I20260709 12:18:20.161371 24718 ts_tablet_manager.cc:1403] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.000s
I20260709 12:18:20.163574 24665 tablet_service.cc:1511] Processing CreateTablet for tablet b0db4e02c8904685aa784e7422c1e1ac (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:18:20.165555 24665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0db4e02c8904685aa784e7422c1e1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.165643 24718 raft_consensus.cc:359] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:20.170238 24718 raft_consensus.cc:385] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.170573 24718 raft_consensus.cc:740] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.167681 24720 ts_tablet_manager.cc:1434] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62: Time spent starting tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 12:18:20.167714 24629 heartbeater.cc:499] Master 127.23.81.254:36037 was elected leader, sending a full tablet report...
I20260709 12:18:20.172066 24720 tablet_bootstrap.cc:492] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62: Bootstrap starting.
I20260709 12:18:20.178841 24516 tablet_service.cc:1511] Processing CreateTablet for tablet e1a4ceb8bdc7477bb602cc692110978a (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:18:20.179502 24718 consensus_queue.cc:260] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:20.180128 24516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a4ceb8bdc7477bb602cc692110978a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.181246 24719 tablet_bootstrap.cc:492] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e: No bootstrap required, opened a new log
I20260709 12:18:20.181823 24719 ts_tablet_manager.cc:1403] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e: Time spent bootstrapping tablet: real 0.053s	user 0.000s	sys 0.044s
I20260709 12:18:20.182422 24720 tablet_bootstrap.cc:654] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.185036 24719 raft_consensus.cc:359] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.185846 24719 raft_consensus.cc:385] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.186237 24719 raft_consensus.cc:740] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.187150 24719 consensus_queue.cc:260] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.189908 24719 ts_tablet_manager.cc:1434] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:18:20.190941 24719 tablet_bootstrap.cc:492] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e: Bootstrap starting.
I20260709 12:18:20.195140 24703 heartbeater.cc:499] Master 127.23.81.254:36037 was elected leader, sending a full tablet report...
I20260709 12:18:20.195581 24718 ts_tablet_manager.cc:1434] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.009s
I20260709 12:18:20.196480 24718 tablet_bootstrap.cc:492] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705: Bootstrap starting.
I20260709 12:18:20.198009 24719 tablet_bootstrap.cc:654] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.200779 24666 tablet_service.cc:1511] Processing CreateTablet for tablet e1a4ceb8bdc7477bb602cc692110978a (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:18:20.202100 24666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a4ceb8bdc7477bb602cc692110978a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.210005 24719 tablet_bootstrap.cc:492] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e: No bootstrap required, opened a new log
I20260709 12:18:20.210649 24719 ts_tablet_manager.cc:1403] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.010s
I20260709 12:18:20.213790 24719 raft_consensus.cc:359] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.214762 24719 raft_consensus.cc:385] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.215142 24719 raft_consensus.cc:740] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.216069 24719 consensus_queue.cc:260] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.217206 24718 tablet_bootstrap.cc:654] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.220423 24719 ts_tablet_manager.cc:1434] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:18:20.221549 24719 tablet_bootstrap.cc:492] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e: Bootstrap starting.
I20260709 12:18:20.221848 24519 tablet_service.cc:1511] Processing CreateTablet for tablet ebead0c6f5b34bb8bb1b8cbfdf696b29 (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:18:20.223222 24519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebead0c6f5b34bb8bb1b8cbfdf696b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.223019 24590 tablet_service.cc:1511] Processing CreateTablet for tablet e1a4ceb8bdc7477bb602cc692110978a (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:18:20.224591 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a4ceb8bdc7477bb602cc692110978a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.226296 24722 raft_consensus.cc:493] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.226814 24722 raft_consensus.cc:515] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.228766 24719 tablet_bootstrap.cc:654] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.234318 24722 leader_election.cc:290] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.234630 24720 tablet_bootstrap.cc:492] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62: No bootstrap required, opened a new log
I20260709 12:18:20.235129 24720 ts_tablet_manager.cc:1403] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.008s
I20260709 12:18:20.240147 24718 tablet_bootstrap.cc:492] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705: No bootstrap required, opened a new log
I20260709 12:18:20.240648 24718 ts_tablet_manager.cc:1403] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent bootstrapping tablet: real 0.044s	user 0.005s	sys 0.007s
I20260709 12:18:20.241019 24719 tablet_bootstrap.cc:492] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e: No bootstrap required, opened a new log
I20260709 12:18:20.241703 24719 ts_tablet_manager.cc:1403] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 12:18:20.243582 24718 raft_consensus.cc:359] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.244300 24718 raft_consensus.cc:385] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.244596 24718 raft_consensus.cc:740] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.245328 24720 raft_consensus.cc:359] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.246101 24720 raft_consensus.cc:385] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.245636 24719 raft_consensus.cc:359] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.246433 24720 raft_consensus.cc:740] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.246621 24719 raft_consensus.cc:385] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.247072 24719 raft_consensus.cc:740] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.247251 24720 consensus_queue.cc:260] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.247900 24719 consensus_queue.cc:260] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.249397 24720 ts_tablet_manager.cc:1434] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:18:20.251333 24720 tablet_bootstrap.cc:492] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62: Bootstrap starting.
I20260709 12:18:20.251263 24719 ts_tablet_manager.cc:1434] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:18:20.252838 24719 tablet_bootstrap.cc:492] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e: Bootstrap starting.
I20260709 12:18:20.254304 24718 consensus_queue.cc:260] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.256469 24718 ts_tablet_manager.cc:1434] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:18:20.257364 24718 tablet_bootstrap.cc:492] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705: Bootstrap starting.
I20260709 12:18:20.267002 24666 tablet_service.cc:1511] Processing CreateTablet for tablet ebead0c6f5b34bb8bb1b8cbfdf696b29 (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:18:20.268347 24666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebead0c6f5b34bb8bb1b8cbfdf696b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.269102 24592 tablet_service.cc:1511] Processing CreateTablet for tablet ebead0c6f5b34bb8bb1b8cbfdf696b29 (DEFAULT_TABLE table=test-workload [id=c39517140c13467e8f8190e01645b9e7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:18:20.270637 24592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebead0c6f5b34bb8bb1b8cbfdf696b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:20.280324 24718 tablet_bootstrap.cc:654] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.268325 24719 tablet_bootstrap.cc:654] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.288795 24720 tablet_bootstrap.cc:654] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.294354 24727 raft_consensus.cc:493] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.294931 24727 raft_consensus.cc:515] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.299800 24726 raft_consensus.cc:493] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.302160 24726 raft_consensus.cc:515] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.304826 24726 leader_election.cc:290] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.309326 24727 leader_election.cc:290] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:20.314155 24722 raft_consensus.cc:493] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.314888 24722 raft_consensus.cc:515] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.331787 24722 leader_election.cc:290] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.333056 24719 tablet_bootstrap.cc:492] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e: No bootstrap required, opened a new log
I20260709 12:18:20.333541 24719 ts_tablet_manager.cc:1403] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.010s
I20260709 12:18:20.336490 24719 raft_consensus.cc:359] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:20.338323 24719 raft_consensus.cc:385] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.346362 24719 raft_consensus.cc:740] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.347219 24719 consensus_queue.cc:260] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:20.348199 24720 tablet_bootstrap.cc:492] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62: No bootstrap required, opened a new log
I20260709 12:18:20.341912 24718 tablet_bootstrap.cc:492] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705: No bootstrap required, opened a new log
I20260709 12:18:20.351895 24718 ts_tablet_manager.cc:1403] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.003s
I20260709 12:18:20.350543 24722 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.351001 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:20.351244 24720 ts_tablet_manager.cc:1403] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.012s
I20260709 12:18:20.342643 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:20.360857 24678 raft_consensus.cc:2468] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 0.
I20260709 12:18:20.360744 24722 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.362512 24493 leader_election.cc:304] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: 
I20260709 12:18:20.363126 24722 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.369395 24720 raft_consensus.cc:359] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.370200 24720 raft_consensus.cc:385] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.370545 24720 raft_consensus.cc:740] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.367251 24722 raft_consensus.cc:493] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.371634 24722 raft_consensus.cc:515] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.373329 24722 leader_election.cc:290] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.374017 24722 raft_consensus.cc:2804] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:20.376511 24722 raft_consensus.cc:493] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.379312 24604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:20.379437 24718 raft_consensus.cc:359] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.380049 24604 raft_consensus.cc:2468] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 0.
I20260709 12:18:20.380283 24718 raft_consensus.cc:385] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.380577 24718 raft_consensus.cc:740] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.381337 24718 consensus_queue.cc:260] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.381950 24604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:20.383522 24718 ts_tablet_manager.cc:1434] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:18:20.376994 24722 raft_consensus.cc:3060] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.384476 24718 tablet_bootstrap.cc:492] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705: Bootstrap starting.
I20260709 12:18:20.387768 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:20.390383 24720 consensus_queue.cc:260] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.403395 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:20.404114 24529 raft_consensus.cc:2468] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 0.
I20260709 12:18:20.403452 24604 raft_consensus.cc:2468] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 0.
I20260709 12:18:20.404894 24720 ts_tablet_manager.cc:1434] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:18:20.405902 24568 leader_election.cc:304] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:20.407406 24718 tablet_bootstrap.cc:654] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.410939 24719 ts_tablet_manager.cc:1434] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e: Time spent starting tablet: real 0.077s	user 0.002s	sys 0.011s
I20260709 12:18:20.412027 24719 tablet_bootstrap.cc:492] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e: Bootstrap starting.
I20260709 12:18:20.411913 24722 raft_consensus.cc:515] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.414206 24722 leader_election.cc:290] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.407894 24720 tablet_bootstrap.cc:492] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62: Bootstrap starting.
W20260709 12:18:20.422600 24493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:36065, user_credentials={real_user=slave}} blocked reactor thread for 60340.9us
I20260709 12:18:20.422958 24726 raft_consensus.cc:2804] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:20.424121 24726 raft_consensus.cc:493] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.424522 24726 raft_consensus.cc:3060] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.426445 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:20.426563 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:20.423130 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
W20260709 12:18:20.428133 24492 leader_election.cc:343] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:20.430900 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:20.433722 24529 raft_consensus.cc:2393] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ae1aa47c53141beb47c32d8cc9bf705 in current term 1: Already voted for candidate a640b2d5518848bd858c4584a193862e in this term.
I20260709 12:18:20.433772 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:20.431825 24726 raft_consensus.cc:515] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.422241 24719 tablet_bootstrap.cc:654] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.434496 24720 tablet_bootstrap.cc:654] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:20.435407 24493 leader_election.cc:343] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:20.435880 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
W20260709 12:18:20.436081 24493 leader_election.cc:343] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:20.436453 24493 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a640b2d5518848bd858c4584a193862e; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:20.436646 24727 raft_consensus.cc:493] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.437415 24677 raft_consensus.cc:3060] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.438901 24726 leader_election.cc:290] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
W20260709 12:18:20.439015 24493 leader_election.cc:343] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:20.438669 24727 raft_consensus.cc:515] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:20.440752 24727 leader_election.cc:290] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:20.441743 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:20.442298 24529 raft_consensus.cc:2468] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 0.
I20260709 12:18:20.442377 24603 raft_consensus.cc:2393] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a640b2d5518848bd858c4584a193862e in current term 1: Already voted for candidate bdf86ba745e44d7abf73548b4955ca62 in this term.
I20260709 12:18:20.438661 24744 raft_consensus.cc:2749] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:20.443614 24642 leader_election.cc:304] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: 
W20260709 12:18:20.444469 24568 leader_election.cc:343] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:20.444898 24727 raft_consensus.cc:2804] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:20.445308 24727 raft_consensus.cc:493] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.445597 24727 raft_consensus.cc:3060] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.450448 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:20.451073 24529 raft_consensus.cc:3060] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.451687 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:20.452145 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:20.452952 24492 leader_election.cc:304] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:20.454335 24492 leader_election.cc:304] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a640b2d5518848bd858c4584a193862e; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:20.455314 24745 raft_consensus.cc:2804] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:20.455783 24745 raft_consensus.cc:493] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.456144 24727 raft_consensus.cc:515] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:20.452435 24603 raft_consensus.cc:3060] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.456133 24745 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.463119 24677 raft_consensus.cc:2468] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 1.
I20260709 12:18:20.464386 24493 leader_election.cc:304] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: 
I20260709 12:18:20.465240 24722 raft_consensus.cc:2804] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:20.465713 24722 raft_consensus.cc:697] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:20.472539 24528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:20.473183 24528 raft_consensus.cc:3060] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.473366 24745 raft_consensus.cc:515] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.476773 24745 leader_election.cc:290] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.476686 24604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:20.477659 24604 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.477998 24727 leader_election.cc:290] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:20.480094 24528 raft_consensus.cc:2468] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 1.
I20260709 12:18:20.481295 24642 leader_election.cc:304] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: 
I20260709 12:18:20.482141 24727 raft_consensus.cc:2804] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:20.485149 24602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:20.486974 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:20.487275 24641 leader_election.cc:304] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705; no voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:20.489732 24720 tablet_bootstrap.cc:492] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62: No bootstrap required, opened a new log
I20260709 12:18:20.489979 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
W20260709 12:18:20.492944 24475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:20.490433 24720 ts_tablet_manager.cc:1403] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62: Time spent bootstrapping tablet: real 0.085s	user 0.023s	sys 0.007s
I20260709 12:18:20.493495 24718 tablet_bootstrap.cc:492] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705: No bootstrap required, opened a new log
I20260709 12:18:20.493985 24718 ts_tablet_manager.cc:1403] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.014s
I20260709 12:18:20.496833 24720 raft_consensus.cc:359] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:20.500279 24720 raft_consensus.cc:385] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.501080 24720 raft_consensus.cc:740] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.502149 24749 raft_consensus.cc:493] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.496865 24718 raft_consensus.cc:359] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.502704 24749 raft_consensus.cc:515] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.502807 24718 raft_consensus.cc:385] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.502344 24720 consensus_queue.cc:260] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:20.499189 24603 raft_consensus.cc:2468] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 1.
I20260709 12:18:20.504146 24718 raft_consensus.cc:740] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Initialized, Role: FOLLOWER
W20260709 12:18:20.461891 24568 leader_election.cc:343] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:20.506071 24528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
W20260709 12:18:20.506395 24568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:36065, user_credentials={real_user=slave}} blocked reactor thread for 45092us
I20260709 12:18:20.506222 24718 consensus_queue.cc:260] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.466480 24722 consensus_queue.cc:237] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.508097 24727 raft_consensus.cc:697] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:20.508543 24718 ts_tablet_manager.cc:1434] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.005s
I20260709 12:18:20.509500 24718 tablet_bootstrap.cc:492] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705: Bootstrap starting.
I20260709 12:18:20.509056 24727 consensus_queue.cc:237] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:20.510867 24720 ts_tablet_manager.cc:1434] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:18:20.512356 24720 tablet_bootstrap.cc:492] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62: Bootstrap starting.
I20260709 12:18:20.509804 24748 raft_consensus.cc:2749] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:20.513903 24749 leader_election.cc:290] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:20.521797 24720 tablet_bootstrap.cc:654] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.506842 24528 raft_consensus.cc:2393] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ae1aa47c53141beb47c32d8cc9bf705 in current term 1: Already voted for candidate a640b2d5518848bd858c4584a193862e in this term.
I20260709 12:18:20.476694 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:20.524049 24677 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.528702 24718 tablet_bootstrap.cc:654] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.530764 24604 raft_consensus.cc:2468] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 1.
I20260709 12:18:20.531965 24492 leader_election.cc:304] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:20.532886 24745 raft_consensus.cc:2804] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:20.533351 24745 raft_consensus.cc:697] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:20.533560 24677 raft_consensus.cc:2468] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 1.
I20260709 12:18:20.504851 24529 raft_consensus.cc:2468] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 1.
I20260709 12:18:20.534246 24745 consensus_queue.cc:237] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.534978 24568 leader_election.cc:304] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:20.535231 24720 tablet_bootstrap.cc:492] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62: No bootstrap required, opened a new log
I20260709 12:18:20.535800 24726 raft_consensus.cc:2804] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:20.536365 24744 raft_consensus.cc:2749] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:20.540795 24726 raft_consensus.cc:697] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Becoming Leader. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:20.541731 24726 consensus_queue.cc:237] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.544183 24719 tablet_bootstrap.cc:492] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e: No bootstrap required, opened a new log
I20260709 12:18:20.544675 24719 ts_tablet_manager.cc:1403] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e: Time spent bootstrapping tablet: real 0.133s	user 0.026s	sys 0.011s
I20260709 12:18:20.535844 24720 ts_tablet_manager.cc:1403] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 12:18:20.548349 24719 raft_consensus.cc:359] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.549311 24719 raft_consensus.cc:385] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.549669 24719 raft_consensus.cc:740] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.551157 24720 raft_consensus.cc:359] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.551898 24720 raft_consensus.cc:385] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.551484 24719 consensus_queue.cc:260] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.552217 24720 raft_consensus.cc:740] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.552462 24425 catalog_manager.cc:5697] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 0 to 1, leader changed from <none> to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 1 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:20.554492 24719 ts_tablet_manager.cc:1434] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 12:18:20.555660 24719 tablet_bootstrap.cc:492] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e: Bootstrap starting.
I20260709 12:18:20.553062 24720 consensus_queue.cc:260] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.557464 24755 raft_consensus.cc:493] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.557950 24755 raft_consensus.cc:515] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:20.559728 24720 ts_tablet_manager.cc:1434] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 12:18:20.561384 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:20.561777 24720 tablet_bootstrap.cc:492] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62: Bootstrap starting.
I20260709 12:18:20.566720 24755 leader_election.cc:290] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065), a640b2d5518848bd858c4584a193862e (127.23.81.193:40293)
I20260709 12:18:20.567430 24719 tablet_bootstrap.cc:654] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.565447 24427 catalog_manager.cc:5697] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "bdf86ba745e44d7abf73548b4955ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:20.561406 24718 tablet_bootstrap.cc:492] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705: No bootstrap required, opened a new log
I20260709 12:18:20.572499 24718 ts_tablet_manager.cc:1403] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.006s
I20260709 12:18:20.575321 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:20.576421 24529 raft_consensus.cc:2393] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdf86ba745e44d7abf73548b4955ca62 in current term 1: Already voted for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in this term.
I20260709 12:18:20.576169 24718 raft_consensus.cc:359] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.577180 24720 tablet_bootstrap.cc:654] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.577910 24568 leader_election.cc:304] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e
I20260709 12:18:20.577090 24718 raft_consensus.cc:385] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.579284 24726 raft_consensus.cc:3060] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:20.578222 24641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:36869, user_credentials={real_user=slave}} blocked reactor thread for 91176.2us
I20260709 12:18:20.578573 24718 raft_consensus.cc:740] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.581633 24604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:20.583598 24604 raft_consensus.cc:2393] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ae1aa47c53141beb47c32d8cc9bf705 in current term 1: Already voted for candidate a640b2d5518848bd858c4584a193862e in this term.
I20260709 12:18:20.583770 24718 consensus_queue.cc:260] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.587735 24718 ts_tablet_manager.cc:1434] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
W20260709 12:18:20.588222 24641 leader_election.cc:343] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:20.588771 24718 tablet_bootstrap.cc:492] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705: Bootstrap starting.
I20260709 12:18:20.589387 24424 catalog_manager.cc:5697] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:20.590755 24641 leader_election.cc:343] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:20.589001 24726 raft_consensus.cc:2749] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:20.592383 24641 leader_election.cc:304] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705; no voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:20.593986 24751 raft_consensus.cc:2749] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:20.595363 24719 tablet_bootstrap.cc:492] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e: No bootstrap required, opened a new log
I20260709 12:18:20.595856 24719 ts_tablet_manager.cc:1403] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.000s
I20260709 12:18:20.598264 24719 raft_consensus.cc:359] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.598963 24719 raft_consensus.cc:385] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.599247 24719 raft_consensus.cc:740] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.599990 24719 consensus_queue.cc:260] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.600399 24718 tablet_bootstrap.cc:654] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.601810 24719 ts_tablet_manager.cc:1434] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:20.602880 24719 tablet_bootstrap.cc:492] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e: Bootstrap starting.
I20260709 12:18:20.608212 24720 tablet_bootstrap.cc:492] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62: No bootstrap required, opened a new log
I20260709 12:18:20.608722 24720 ts_tablet_manager.cc:1403] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.005s
I20260709 12:18:20.611671 24720 raft_consensus.cc:359] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.613065 24720 raft_consensus.cc:385] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.613350 24720 raft_consensus.cc:740] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.614120 24720 consensus_queue.cc:260] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.616235 24720 ts_tablet_manager.cc:1434] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:18:20.616997 24720 tablet_bootstrap.cc:492] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62: Bootstrap starting.
I20260709 12:18:20.618242 24427 catalog_manager.cc:5697] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 0 to 1, leader changed from <none> to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 1 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:20.621129 24719 tablet_bootstrap.cc:654] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.623170 24720 tablet_bootstrap.cc:654] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.624325 24718 tablet_bootstrap.cc:492] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705: No bootstrap required, opened a new log
I20260709 12:18:20.624794 24718 ts_tablet_manager.cc:1403] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.004s
I20260709 12:18:20.627925 24718 raft_consensus.cc:359] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.628676 24718 raft_consensus.cc:385] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.629022 24718 raft_consensus.cc:740] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.629917 24718 consensus_queue.cc:260] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.634047 24722 raft_consensus.cc:493] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.634548 24722 raft_consensus.cc:515] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.636646 24722 leader_election.cc:290] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.638772 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
W20260709 12:18:20.640293 24493 leader_election.cc:343] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:20.641158 24604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:20.641765 24604 raft_consensus.cc:2468] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 0.
I20260709 12:18:20.642643 24718 ts_tablet_manager.cc:1434] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:18:20.643153 24492 leader_election.cc:304] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:20.644047 24718 tablet_bootstrap.cc:492] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705: Bootstrap starting.
I20260709 12:18:20.647639 24719 tablet_bootstrap.cc:492] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e: No bootstrap required, opened a new log
I20260709 12:18:20.648088 24719 ts_tablet_manager.cc:1403] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.012s
I20260709 12:18:20.648777 24722 raft_consensus.cc:2804] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:20.649137 24722 raft_consensus.cc:493] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.649471 24722 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.650679 24719 raft_consensus.cc:359] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.651358 24719 raft_consensus.cc:385] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.651623 24719 raft_consensus.cc:740] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.652269 24719 consensus_queue.cc:260] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.654178 24719 ts_tablet_manager.cc:1434] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:18:20.654754 24720 tablet_bootstrap.cc:492] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62: No bootstrap required, opened a new log
I20260709 12:18:20.655205 24719 tablet_bootstrap.cc:492] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e: Bootstrap starting.
I20260709 12:18:20.655224 24720 ts_tablet_manager.cc:1403] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.016s
I20260709 12:18:20.655704 24718 tablet_bootstrap.cc:654] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.658413 24720 raft_consensus.cc:359] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.659409 24720 raft_consensus.cc:385] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.659863 24720 raft_consensus.cc:740] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.660837 24720 consensus_queue.cc:260] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.662009 24719 tablet_bootstrap.cc:654] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.663371 24720 ts_tablet_manager.cc:1434] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:20.664323 24720 tablet_bootstrap.cc:492] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62: Bootstrap starting.
I20260709 12:18:20.671234 24720 tablet_bootstrap.cc:654] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.672827 24718 tablet_bootstrap.cc:492] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705: No bootstrap required, opened a new log
I20260709 12:18:20.673350 24718 ts_tablet_manager.cc:1403] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.008s
I20260709 12:18:20.677096 24718 raft_consensus.cc:359] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.679714 24718 raft_consensus.cc:385] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.680171 24718 raft_consensus.cc:740] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.680815 24719 tablet_bootstrap.cc:492] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e: No bootstrap required, opened a new log
I20260709 12:18:20.681306 24719 ts_tablet_manager.cc:1403] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.016s
I20260709 12:18:20.681092 24718 consensus_queue.cc:260] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.682539 24720 tablet_bootstrap.cc:492] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62: No bootstrap required, opened a new log
I20260709 12:18:20.682956 24720 ts_tablet_manager.cc:1403] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:18:20.683843 24719 raft_consensus.cc:359] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.684517 24719 raft_consensus.cc:385] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.684170 24722 raft_consensus.cc:515] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.684801 24719 raft_consensus.cc:740] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.685460 24719 consensus_queue.cc:260] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.687178 24604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:20.687573 24719 ts_tablet_manager.cc:1434] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:18:20.687717 24604 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.688436 24719 tablet_bootstrap.cc:492] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e: Bootstrap starting.
I20260709 12:18:20.685949 24718 ts_tablet_manager.cc:1434] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.007s
I20260709 12:18:20.690083 24720 raft_consensus.cc:359] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.690739 24720 raft_consensus.cc:385] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.691004 24720 raft_consensus.cc:740] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.691682 24720 consensus_queue.cc:260] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.692811 24718 tablet_bootstrap.cc:492] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705: Bootstrap starting.
I20260709 12:18:20.694458 24719 tablet_bootstrap.cc:654] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.695966 24720 ts_tablet_manager.cc:1434] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:18:20.696954 24720 tablet_bootstrap.cc:492] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62: Bootstrap starting.
I20260709 12:18:20.699815 24718 tablet_bootstrap.cc:654] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.702637 24720 tablet_bootstrap.cc:654] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.716784 24718 tablet_bootstrap.cc:492] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705: No bootstrap required, opened a new log
I20260709 12:18:20.716961 24720 tablet_bootstrap.cc:492] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62: No bootstrap required, opened a new log
I20260709 12:18:20.717393 24718 ts_tablet_manager.cc:1403] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 12:18:20.717577 24720 ts_tablet_manager.cc:1403] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.004s
I20260709 12:18:20.719484 24745 raft_consensus.cc:493] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.719974 24745 raft_consensus.cc:515] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.721071 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:20.721812 24677 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.722112 24745 leader_election.cc:290] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.722143 24604 raft_consensus.cc:2468] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 1.
I20260709 12:18:20.723336 24492 leader_election.cc:304] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:20.723613 24720 raft_consensus.cc:359] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.724123 24745 raft_consensus.cc:2804] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:20.724457 24720 raft_consensus.cc:385] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.724403 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:20.724879 24720 raft_consensus.cc:740] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.725072 24603 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 0.
I20260709 12:18:20.725486 24745 raft_consensus.cc:697] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:20.726046 24720 consensus_queue.cc:260] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.726749 24492 leader_election.cc:304] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:20.727154 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:20.727537 24744 raft_consensus.cc:2804] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:20.727746 24678 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 0.
I20260709 12:18:20.727912 24744 raft_consensus.cc:493] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.728016 24720 ts_tablet_manager.cc:1434] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:18:20.728276 24744 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.726415 24745 consensus_queue.cc:237] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.732868 24677 raft_consensus.cc:2468] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 1.
I20260709 12:18:20.734476 24722 leader_election.cc:290] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.735790 24719 tablet_bootstrap.cc:492] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e: No bootstrap required, opened a new log
I20260709 12:18:20.736132 24719 ts_tablet_manager.cc:1403] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.023s
I20260709 12:18:20.736820 24720 tablet_bootstrap.cc:492] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62: Bootstrap starting.
I20260709 12:18:20.737902 24719 raft_consensus.cc:359] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.738453 24719 raft_consensus.cc:385] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.738683 24719 raft_consensus.cc:740] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.739339 24719 consensus_queue.cc:260] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.741191 24719 ts_tablet_manager.cc:1434] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:18:20.744892 24720 tablet_bootstrap.cc:654] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.749239 24744 raft_consensus.cc:515] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.752761 24720 tablet_bootstrap.cc:492] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62: No bootstrap required, opened a new log
I20260709 12:18:20.753273 24720 ts_tablet_manager.cc:1403] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:18:20.753710 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:20.754609 24603 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.755935 24718 raft_consensus.cc:359] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.756161 24720 raft_consensus.cc:359] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.756650 24718 raft_consensus.cc:385] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.756943 24720 raft_consensus.cc:385] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.757459 24720 raft_consensus.cc:740] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.756964 24718 raft_consensus.cc:740] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.758293 24720 consensus_queue.cc:260] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.759145 24718 consensus_queue.cc:260] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.760731 24720 ts_tablet_manager.cc:1434] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:18:20.760977 24718 ts_tablet_manager.cc:1434] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent starting tablet: real 0.043s	user 0.000s	sys 0.004s
I20260709 12:18:20.765043 24603 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 1.
I20260709 12:18:20.766250 24492 leader_election.cc:304] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:20.765509 24424 catalog_manager.cc:5697] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 0 to 1, leader changed from <none> to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 1 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:20.767423 24745 raft_consensus.cc:2804] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:20.767442 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:20.767930 24718 tablet_bootstrap.cc:492] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705: Bootstrap starting.
I20260709 12:18:20.768162 24677 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.768266 24745 raft_consensus.cc:697] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:20.772555 24726 raft_consensus.cc:493] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.773075 24726 raft_consensus.cc:515] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.774564 24718 tablet_bootstrap.cc:654] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.774789 24677 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 1.
I20260709 12:18:20.775301 24726 leader_election.cc:290] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.772562 24744 leader_election.cc:290] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.772162 24745 consensus_queue.cc:237] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.777403 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:20.777311 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:20.778231 24529 raft_consensus.cc:2468] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 0.
W20260709 12:18:20.779608 24568 leader_election.cc:343] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:20.780930 24568 leader_election.cc:304] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:20.781787 24726 raft_consensus.cc:2804] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:20.782256 24726 raft_consensus.cc:493] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.782641 24726 raft_consensus.cc:3060] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.790539 24718 tablet_bootstrap.cc:492] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705: No bootstrap required, opened a new log
I20260709 12:18:20.790356 24726 raft_consensus.cc:515] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.791023 24718 ts_tablet_manager.cc:1403] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 12:18:20.793462 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:20.794126 24529 raft_consensus.cc:3060] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.794834 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:20.794153 24718 raft_consensus.cc:359] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.796314 24718 raft_consensus.cc:385] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:18:20.796484 24568 leader_election.cc:343] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:20.796586 24718 raft_consensus.cc:740] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.797235 24755 raft_consensus.cc:493] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.797659 24718 consensus_queue.cc:260] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.797742 24755 raft_consensus.cc:515] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.798552 24726 leader_election.cc:290] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.800065 24755 leader_election.cc:290] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.801401 24529 raft_consensus.cc:2468] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 1.
I20260709 12:18:20.802863 24718 ts_tablet_manager.cc:1434] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:18:20.802722 24424 catalog_manager.cc:5697] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 0 to 1, leader changed from <none> to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 1 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:20.803567 24718 tablet_bootstrap.cc:492] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705: Bootstrap starting.
I20260709 12:18:20.806595 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:20.807003 24568 leader_election.cc:304] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:20.807312 24677 raft_consensus.cc:2468] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 0.
I20260709 12:18:20.808223 24755 raft_consensus.cc:2804] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:20.808753 24755 raft_consensus.cc:697] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Becoming Leader. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:20.809393 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:20.810106 24529 raft_consensus.cc:2468] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 0.
I20260709 12:18:20.810427 24718 tablet_bootstrap.cc:654] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:20.809633 24755 consensus_queue.cc:237] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.808599 24568 leader_election.cc:304] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:20.813839 24726 raft_consensus.cc:2804] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:20.816763 24726 raft_consensus.cc:493] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.817253 24726 raft_consensus.cc:3060] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.826309 24718 tablet_bootstrap.cc:492] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705: No bootstrap required, opened a new log
I20260709 12:18:20.826073 24726 raft_consensus.cc:515] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.826833 24718 ts_tablet_manager.cc:1403] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.001s
I20260709 12:18:20.829114 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:20.829792 24529 raft_consensus.cc:3060] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.829818 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:20.830441 24726 leader_election.cc:290] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.830649 24677 raft_consensus.cc:3060] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.830940 24424 catalog_manager.cc:5697] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "bdf86ba745e44d7abf73548b4955ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:20.829722 24718 raft_consensus.cc:359] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.833978 24718 raft_consensus.cc:385] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:20.834295 24718 raft_consensus.cc:740] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Initialized, Role: FOLLOWER
I20260709 12:18:20.834947 24718 consensus_queue.cc:260] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.836882 24718 ts_tablet_manager.cc:1434] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:18:20.837392 24529 raft_consensus.cc:2468] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 1.
I20260709 12:18:20.837425 24677 raft_consensus.cc:2468] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 1.
I20260709 12:18:20.838652 24568 leader_election.cc:304] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:20.839435 24726 raft_consensus.cc:2804] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:20.839984 24726 raft_consensus.cc:697] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Becoming Leader. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:20.840870 24726 consensus_queue.cc:237] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.849509 24424 catalog_manager.cc:5697] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "bdf86ba745e44d7abf73548b4955ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:20.864323 24751 raft_consensus.cc:493] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.864768 24751 raft_consensus.cc:515] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.866580 24751 leader_election.cc:290] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:20.867451 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:20.867660 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:20.868273 24529 raft_consensus.cc:2393] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ae1aa47c53141beb47c32d8cc9bf705 in current term 1: Already voted for candidate bdf86ba745e44d7abf73548b4955ca62 in this term.
I20260709 12:18:20.869256 24642 leader_election.cc:304] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705; no voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:20.869897 24751 raft_consensus.cc:3060] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.874750 24751 raft_consensus.cc:2749] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:20.948768 24726 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.949298 24726 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.951188 24726 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.952039 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:20.952292 24726 raft_consensus.cc:493] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.952708 24529 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 0.
I20260709 12:18:20.952744 24726 raft_consensus.cc:515] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.953487 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:20.953996 24755 consensus_queue.cc:1048] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:20.954125 24568 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:20.954206 24677 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 0.
I20260709 12:18:20.955003 24745 raft_consensus.cc:493] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.955783 24755 raft_consensus.cc:2804] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:20.955619 24745 raft_consensus.cc:515] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.956043 24726 leader_election.cc:290] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.956192 24755 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.957044 24755 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.958010 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:20.958660 24677 raft_consensus.cc:2468] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 0.
I20260709 12:18:20.960175 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:20.960780 24529 raft_consensus.cc:2468] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 0.
I20260709 12:18:20.961719 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:20.962054 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:20.962378 24603 raft_consensus.cc:2468] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 0.
I20260709 12:18:20.962641 24677 raft_consensus.cc:2468] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 0.
I20260709 12:18:20.957792 24745 leader_election.cc:290] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.963608 24492 leader_election.cc:304] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:20.963730 24568 leader_election.cc:304] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:20.964452 24745 raft_consensus.cc:2804] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:20.964877 24745 raft_consensus.cc:493] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.964820 24727 consensus_queue.cc:1048] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:20.965237 24726 raft_consensus.cc:2804] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:20.965756 24726 raft_consensus.cc:493] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.966144 24726 raft_consensus.cc:3060] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.965294 24745 raft_consensus.cc:3060] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.966466 24755 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.968642 24755 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.969000 24727 consensus_queue.cc:1048] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:20.976141 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:20.976912 24677 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.981055 24726 raft_consensus.cc:515] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.982172 24745 raft_consensus.cc:515] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:20.984143 24526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:20.984810 24745 leader_election.cc:290] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.984922 24526 raft_consensus.cc:2393] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdf86ba745e44d7abf73548b4955ca62 in current term 1: Already voted for candidate a640b2d5518848bd858c4584a193862e in this term.
I20260709 12:18:20.986172 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:20.986944 24678 raft_consensus.cc:3060] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.988397 24726 leader_election.cc:290] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:20.989554 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:20.989997 24676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:20.992609 24603 raft_consensus.cc:2393] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a640b2d5518848bd858c4584a193862e in current term 1: Already voted for candidate bdf86ba745e44d7abf73548b4955ca62 in this term.
I20260709 12:18:20.995579 24678 raft_consensus.cc:2468] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 1.
I20260709 12:18:20.996740 24493 leader_election.cc:304] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:20.998050 24745 raft_consensus.cc:2804] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:20.976092 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:20.998759 24529 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:20.998857 24745 raft_consensus.cc:697] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:20.999778 24745 consensus_queue.cc:237] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.011350 24744 consensus_queue.cc:1048] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:20.996536 24568 leader_election.cc:304] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e
I20260709 12:18:21.013185 24755 raft_consensus.cc:2749] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:21.015406 24780 consensus_queue.cc:1048] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:21.016571 24677 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 1.
I20260709 12:18:21.022910 24568 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:21.023880 24780 raft_consensus.cc:2804] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:21.024397 24780 raft_consensus.cc:697] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Becoming Leader. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:21.025311 24780 consensus_queue.cc:237] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.029577 24529 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 1.
I20260709 12:18:21.032536 24427 catalog_manager.cc:5697] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 0 to 1, leader changed from <none> to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 1 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.040242 24424 catalog_manager.cc:5697] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "bdf86ba745e44d7abf73548b4955ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.045238 24745 consensus_queue.cc:1048] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:21.114660 24678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
mode: GRACEFUL
new_leader_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40866
I20260709 12:18:21.115228 24678 raft_consensus.cc:606] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 LEADER]: Received request to transfer leadership to TS a640b2d5518848bd858c4584a193862e
I20260709 12:18:21.130172 24603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
mode: GRACEFUL
new_leader_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:42236
I20260709 12:18:21.130657 24603 raft_consensus.cc:606] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Received request to transfer leadership to TS a640b2d5518848bd858c4584a193862e
I20260709 12:18:21.137012 24745 consensus_queue.cc:1048] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.139084 24603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
mode: GRACEFUL
new_leader_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:42236
I20260709 12:18:21.139597 24603 raft_consensus.cc:606] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Received request to transfer leadership to TS a640b2d5518848bd858c4584a193862e
I20260709 12:18:21.151346 24722 consensus_queue.cc:1048] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.155215 24722 consensus_queue.cc:1048] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.165939 24745 consensus_queue.cc:1048] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.170823 24722 consensus_queue.cc:1048] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.171265 24529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
mode: GRACEFUL
new_leader_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:40044
I20260709 12:18:21.171859 24529 raft_consensus.cc:606] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Received request to transfer leadership to TS bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:21.178299 24745 raft_consensus.cc:993] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e: : Instructing follower bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:21.178928 24744 raft_consensus.cc:1081] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Signalling peer bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:21.182143 24529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
mode: GRACEFUL
new_leader_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:40044
I20260709 12:18:21.182962 24529 raft_consensus.cc:606] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Received request to transfer leadership to TS bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:21.191730 24529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
mode: GRACEFUL
new_leader_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:40044
I20260709 12:18:21.192344 24529 raft_consensus.cc:606] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Received request to transfer leadership to TS bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:21.205849 24604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
mode: GRACEFUL
new_leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
 from {username='slave'} at 127.0.0.1:42236
I20260709 12:18:21.206744 24604 raft_consensus.cc:606] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Received request to transfer leadership to TS 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:21.213397 24604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:42220
I20260709 12:18:21.214118 24604 raft_consensus.cc:493] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:21.214509 24604 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.217289 24802 consensus_queue.cc:1048] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.220376 24604 raft_consensus.cc:515] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.221853 24603 raft_consensus.cc:1240] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Rejecting Update request from peer a640b2d5518848bd858c4584a193862e for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:21.222378 24604 leader_election.cc:290] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 2 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:21.223609 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:21.224217 24529 raft_consensus.cc:3055] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:21.224524 24529 raft_consensus.cc:740] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:21.225329 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:21.225914 24678 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.225324 24529 consensus_queue.cc:260] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.227744 24529 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.228868 24780 consensus_queue.cc:1048] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.235116 24678 raft_consensus.cc:2468] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 2.
I20260709 12:18:21.237244 24568 leader_election.cc:304] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:21.237996 24780 raft_consensus.cc:2804] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:21.238936 24780 raft_consensus.cc:697] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Becoming Leader. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:21.239866 24780 consensus_queue.cc:237] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.240490 24529 raft_consensus.cc:2468] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 2.
I20260709 12:18:21.246465 24727 raft_consensus.cc:493] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.246992 24727 raft_consensus.cc:515] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.249133 24727 leader_election.cc:290] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:21.249689 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:21.250700 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:21.251734 24802 raft_consensus.cc:993] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e: : Instructing follower bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:21.252244 24744 raft_consensus.cc:1081] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Signalling peer bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:21.252053 24641 leader_election.cc:304] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705; no voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:21.254421 24727 raft_consensus.cc:2749] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:21.254961 24600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:42220
I20260709 12:18:21.255620 24600 raft_consensus.cc:493] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:21.256057 24600 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.256316 24678 raft_consensus.cc:3060] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:21.262848 24600 raft_consensus.cc:515] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.264873 24600 leader_election.cc:290] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 2 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:21.266220 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:21.266855 24677 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.266626 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:21.267584 24529 raft_consensus.cc:3055] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:21.267932 24529 raft_consensus.cc:740] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:21.268775 24529 consensus_queue.cc:260] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.270085 24529 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.266851 24780 consensus_queue.cc:1048] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:18:21.270251 24424 catalog_manager.cc:5697] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 reported cstate change: term changed from 1 to 2, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "bdf86ba745e44d7abf73548b4955ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.273102 24677 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 2.
I20260709 12:18:21.274220 24568 leader_election.cc:304] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:21.275316 24780 raft_consensus.cc:2804] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:21.275929 24780 raft_consensus.cc:697] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Becoming Leader. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:21.277006 24780 consensus_queue.cc:237] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.277891 24529 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 2.
I20260709 12:18:21.286422 24726 raft_consensus.cc:993] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62: : Instructing follower 4ae1aa47c53141beb47c32d8cc9bf705 to start an election
I20260709 12:18:21.289839 24726 raft_consensus.cc:1081] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Signalling peer 4ae1aa47c53141beb47c32d8cc9bf705 to start an election
I20260709 12:18:21.291714 24678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
 from {username='slave'} at 127.0.0.1:40858
I20260709 12:18:21.292284 24678 raft_consensus.cc:493] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:21.292649 24678 raft_consensus.cc:3060] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.293469 24424 catalog_manager.cc:5697] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 reported cstate change: term changed from 1 to 2, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "bdf86ba745e44d7abf73548b4955ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.298902 24678 raft_consensus.cc:515] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.302474 24678 leader_election.cc:290] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 2 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:21.303184 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:21.303790 24529 raft_consensus.cc:3060] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.304177 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:21.304747 24600 raft_consensus.cc:3055] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:21.305056 24600 raft_consensus.cc:740] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:21.305874 24600 consensus_queue.cc:260] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.307130 24600 raft_consensus.cc:3060] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.310725 24529 raft_consensus.cc:2468] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 2.
I20260709 12:18:21.311810 24642 leader_election.cc:304] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: 
I20260709 12:18:21.312476 24727 raft_consensus.cc:2804] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:21.312959 24727 raft_consensus.cc:697] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:21.313558 24600 raft_consensus.cc:2468] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 2.
I20260709 12:18:21.313791 24727 consensus_queue.cc:237] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.320286 24424 catalog_manager.cc:5697] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 1 to 2, leader changed from bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194) to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:21.373584 24726 consensus_queue.cc:1048] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.384534 24780 consensus_queue.cc:1048] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.414191 24751 raft_consensus.cc:993] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705: : Instructing follower a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:21.414736 24727 raft_consensus.cc:1081] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 LEADER]: Signalling peer a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:21.416623 24529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40040
I20260709 12:18:21.417197 24529 raft_consensus.cc:493] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:21.417598 24529 raft_consensus.cc:3060] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.424379 24529 raft_consensus.cc:515] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:21.427032 24529 leader_election.cc:290] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 2 election: Requested vote from peers 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:21.427505 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:21.427729 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:21.428146 24678 raft_consensus.cc:3055] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:21.428341 24600 raft_consensus.cc:3060] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.428517 24678 raft_consensus.cc:740] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:21.429364 24678 consensus_queue.cc:260] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:21.430320 24678 raft_consensus.cc:3060] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.433069 24600 raft_consensus.cc:2468] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 2.
I20260709 12:18:21.434224 24492 leader_election.cc:304] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:21.435006 24744 raft_consensus.cc:2804] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:21.435191 24678 raft_consensus.cc:2468] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 2.
I20260709 12:18:21.435449 24744 raft_consensus.cc:697] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:21.436273 24744 consensus_queue.cc:237] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:21.442662 24427 catalog_manager.cc:5697] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 1 to 2, leader changed from 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 2 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.477773 24744 consensus_queue.cc:1048] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.488394 24801 consensus_queue.cc:1048] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.492169 24755 consensus_queue.cc:1048] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.500082 24801 raft_consensus.cc:993] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e: : Instructing follower bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:21.500561 24801 raft_consensus.cc:1081] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Signalling peer bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:21.502238 24604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:42220
I20260709 12:18:21.502915 24604 raft_consensus.cc:493] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:21.503427 24604 raft_consensus.cc:3060] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.504314 24780 raft_consensus.cc:993] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62: : Instructing follower a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:21.504740 24780 raft_consensus.cc:1081] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Signalling peer a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:21.508245 24528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40028
I20260709 12:18:21.508812 24528 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:21.509205 24528 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.510859 24604 raft_consensus.cc:515] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.511051 24726 consensus_queue.cc:1048] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:21.515797 24528 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.518087 24528 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 2 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:21.520092 24604 leader_election.cc:290] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 2 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:21.521517 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:21.522118 24677 raft_consensus.cc:3060] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.522229 24528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:21.525031 24528 raft_consensus.cc:3055] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:21.525388 24528 raft_consensus.cc:740] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:21.523962 24676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:21.526170 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:21.527622 24600 raft_consensus.cc:3055] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:21.529721 24600 raft_consensus.cc:740] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:21.528133 24528 consensus_queue.cc:260] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.531311 24528 raft_consensus.cc:3060] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.531126 24600 consensus_queue.cc:260] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.531991 24677 raft_consensus.cc:2468] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 2.
I20260709 12:18:21.532305 24600 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.533347 24568 leader_election.cc:304] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:21.534133 24726 raft_consensus.cc:2804] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:21.534574 24726 raft_consensus.cc:697] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Becoming Leader. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:21.535347 24726 consensus_queue.cc:237] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.539093 24528 raft_consensus.cc:2468] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 2.
I20260709 12:18:21.539551 24600 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 2.
I20260709 12:18:21.540738 24492 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:21.541540 24801 raft_consensus.cc:2804] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:21.541992 24801 raft_consensus.cc:697] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:21.542815 24801 consensus_queue.cc:237] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.545303 24424 catalog_manager.cc:5697] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 reported cstate change: term changed from 1 to 2, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "bdf86ba745e44d7abf73548b4955ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.550741 24425 catalog_manager.cc:5697] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 1 to 2, leader changed from bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 2 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.574301 24755 raft_consensus.cc:993] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62: : Instructing follower a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:21.574745 24726 raft_consensus.cc:1081] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Signalling peer a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:21.576157 24528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40028
I20260709 12:18:21.576586 24528 raft_consensus.cc:493] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:21.576835 24528 raft_consensus.cc:3060] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.581809 24528 raft_consensus.cc:515] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.583498 24528 leader_election.cc:290] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 2 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:21.584506 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:21.584448 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:21.585150 24678 raft_consensus.cc:3060] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.585204 24600 raft_consensus.cc:3055] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:21.585661 24600 raft_consensus.cc:740] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:21.586536 24600 consensus_queue.cc:260] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.587791 24600 raft_consensus.cc:3060] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.592410 24678 raft_consensus.cc:2468] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 2.
I20260709 12:18:21.593658 24493 leader_election.cc:304] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: 
I20260709 12:18:21.594457 24801 raft_consensus.cc:2804] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:21.594547 24600 raft_consensus.cc:2468] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 2.
I20260709 12:18:21.595005 24801 raft_consensus.cc:697] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:21.595819 24801 consensus_queue.cc:237] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:21.601979 24425 catalog_manager.cc:5697] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 1 to 2, leader changed from bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 2 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.703743 24528 raft_consensus.cc:1275] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.705037 24726 consensus_queue.cc:1048] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.712448 24678 raft_consensus.cc:1275] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.713827 24755 consensus_queue.cc:1048] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.743391 24678 raft_consensus.cc:1275] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.744639 24755 consensus_queue.cc:1048] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.752467 24528 raft_consensus.cc:1275] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.755364 24780 consensus_queue.cc:1048] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.766264 24528 raft_consensus.cc:1275] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.767586 24727 consensus_queue.cc:1048] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.775053 24600 raft_consensus.cc:1275] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.777048 24813 consensus_queue.cc:1048] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.834628 24600 raft_consensus.cc:1275] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.835932 24801 consensus_queue.cc:1048] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.843335 24678 raft_consensus.cc:1275] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.844990 24802 consensus_queue.cc:1048] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.941525 24600 raft_consensus.cc:1275] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.943034 24678 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.942982 24802 consensus_queue.cc:1048] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.949849 24678 raft_consensus.cc:1275] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.951297 24744 consensus_queue.cc:1048] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:22.002979 24528 raft_consensus.cc:1275] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:22.004516 24755 consensus_queue.cc:1048] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:22.012390 24678 raft_consensus.cc:1275] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:22.013797 24780 consensus_queue.cc:1048] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:22.149209 24678 raft_consensus.cc:1275] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:22.150424 24744 consensus_queue.cc:1048] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:22.158682 24600 raft_consensus.cc:1275] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:22.160300 24801 consensus_queue.cc:1048] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:24.237833 23879 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:18:24.238716 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:24.256820 24528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
mode: GRACEFUL
new_leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
 from {username='slave'} at 127.0.0.1:40060
I20260709 12:18:24.257350 24528 raft_consensus.cc:606] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Received request to transfer leadership to TS 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:24.259642 24528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
mode: GRACEFUL
new_leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
 from {username='slave'} at 127.0.0.1:40060
I20260709 12:18:24.260154 24528 raft_consensus.cc:606] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Received request to transfer leadership to TS 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:24.261086 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:24.261474 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:24.400468 24801 raft_consensus.cc:993] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e: : Instructing follower 4ae1aa47c53141beb47c32d8cc9bf705 to start an election
I20260709 12:18:24.400925 24820 raft_consensus.cc:1081] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Signalling peer 4ae1aa47c53141beb47c32d8cc9bf705 to start an election
I20260709 12:18:24.402386 24678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
 from {username='slave'} at 127.0.0.1:40852
I20260709 12:18:24.402846 24678 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:24.403151 24678 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:24.407269 24678 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:24.408874 24678 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 3 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:24.409718 24528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:24.409997 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:24.410302 24528 raft_consensus.cc:3055] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:24.410638 24600 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:24.410655 24528 raft_consensus.cc:740] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:24.411571 24528 consensus_queue.cc:260] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:24.412482 24528 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:24.415573 24600 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 3.
I20260709 12:18:24.416739 24641 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:24.417459 24817 raft_consensus.cc:2804] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:24.417399 24528 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 3.
I20260709 12:18:24.418664 24817 raft_consensus.cc:697] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:24.419402 24817 consensus_queue.cc:237] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:24.426342 24424 catalog_manager.cc:5697] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 2 to 3, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:24.734087 24801 raft_consensus.cc:993] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e: : Instructing follower 4ae1aa47c53141beb47c32d8cc9bf705 to start an election
I20260709 12:18:24.734582 24820 raft_consensus.cc:1081] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Signalling peer 4ae1aa47c53141beb47c32d8cc9bf705 to start an election
I20260709 12:18:24.736040 24678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
 from {username='slave'} at 127.0.0.1:40852
I20260709 12:18:24.736496 24678 raft_consensus.cc:493] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:24.736778 24678 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:24.740979 24678 raft_consensus.cc:515] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:24.742594 24678 leader_election.cc:290] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 2 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:24.743657 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:24.743775 24528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:24.744259 24600 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:24.744352 24528 raft_consensus.cc:3055] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:24.744738 24528 raft_consensus.cc:740] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:24.745396 24528 consensus_queue.cc:260] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:24.746387 24528 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:24.749302 24600 raft_consensus.cc:2468] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 2.
I20260709 12:18:24.750385 24641 leader_election.cc:304] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:24.751085 24817 raft_consensus.cc:2804] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:24.751459 24528 raft_consensus.cc:2468] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 2.
I20260709 12:18:24.751623 24817 raft_consensus.cc:697] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:24.752502 24817 consensus_queue.cc:237] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:24.761363 24424 catalog_manager.cc:5697] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 1 to 2, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:24.973286 24528 raft_consensus.cc:1275] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:24.974553 24817 consensus_queue.cc:1048] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:24.984975 24600 raft_consensus.cc:1275] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:24.989779 24821 consensus_queue.cc:1048] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:25.218961 24528 raft_consensus.cc:1275] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:25.220211 24831 consensus_queue.cc:1048] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:25.229694 24600 raft_consensus.cc:1275] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:25.231068 24817 consensus_queue.cc:1048] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:25.262468 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:25.268494 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:25.268951 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:26.269884 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:26.276539 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:26.276945 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:27.277911 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:27.283746 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:27.284257 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:28.285290 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:28.290953 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:28.291383 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:29.404624 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:29.582144 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:29.583043 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:30.339044 24625 debug-util.cc:398] Leaking SignalData structure 0x7b08001021a0 after lost signal to thread 23882
W20260709 12:18:30.339829 24625 debug-util.cc:398] Leaking SignalData structure 0x7b0800102880 after lost signal to thread 24461
W20260709 12:18:30.340624 24625 debug-util.cc:398] Leaking SignalData structure 0x7b08000b02c0 after lost signal to thread 24553
W20260709 12:18:30.341411 24625 debug-util.cc:398] Leaking SignalData structure 0x7b08000b1e60 after lost signal to thread 24628
W20260709 12:18:30.342139 24625 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4e60 after lost signal to thread 24702
I20260709 12:18:30.612632 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:30.619170 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:30.619726 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:30.950110 24458 debug-util.cc:398] Leaking SignalData structure 0x7b08000500c0 after lost signal to thread 23882
W20260709 12:18:30.951159 24458 debug-util.cc:398] Leaking SignalData structure 0x7b08000507a0 after lost signal to thread 24461
W20260709 12:18:30.952334 24458 debug-util.cc:398] Leaking SignalData structure 0x7b0800137ac0 after lost signal to thread 24553
W20260709 12:18:30.953428 24458 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0cc0 after lost signal to thread 24628
W20260709 12:18:30.954541 24458 debug-util.cc:398] Leaking SignalData structure 0x7b08000d0440 after lost signal to thread 24702
I20260709 12:18:31.621465 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:31.627738 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:31.628186 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:32.629271 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:32.637949 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:32.638531 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:33.639724 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:33.648846 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:33.649423 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:34.680557 23879 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:18:34.693423 24677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
mode: GRACEFUL
new_leader_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40866
I20260709 12:18:34.694164 24677 raft_consensus.cc:606] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Received request to transfer leadership to TS a640b2d5518848bd858c4584a193862e
I20260709 12:18:34.698944 24677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
mode: GRACEFUL
new_leader_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40866
I20260709 12:18:34.699479 24677 raft_consensus.cc:606] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Received request to transfer leadership to TS a640b2d5518848bd858c4584a193862e
I20260709 12:18:34.704339 24600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
mode: GRACEFUL
new_leader_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:42236
I20260709 12:18:34.704815 24600 raft_consensus.cc:606] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Received request to transfer leadership to TS a640b2d5518848bd858c4584a193862e
I20260709 12:18:34.709332 24600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
mode: GRACEFUL
new_leader_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:42236
I20260709 12:18:34.709787 24600 raft_consensus.cc:606] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Received request to transfer leadership to TS a640b2d5518848bd858c4584a193862e
I20260709 12:18:34.714214 24600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
mode: GRACEFUL
new_leader_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:42236
I20260709 12:18:34.714753 24600 raft_consensus.cc:606] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Received request to transfer leadership to TS a640b2d5518848bd858c4584a193862e
I20260709 12:18:34.764474 24852 raft_consensus.cc:993] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62: : Instructing follower a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:34.765004 24853 raft_consensus.cc:1081] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Signalling peer a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:34.766534 24529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40028
I20260709 12:18:34.766993 24529 raft_consensus.cc:493] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:34.767285 24529 raft_consensus.cc:3060] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:34.772637 24529 raft_consensus.cc:515] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:34.774554 24529 leader_election.cc:290] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 3 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:34.775435 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:34.775679 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:34.776216 24600 raft_consensus.cc:3055] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:34.776288 24677 raft_consensus.cc:3060] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:34.776505 24600 raft_consensus.cc:740] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:34.777424 24600 consensus_queue.cc:260] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:34.778370 24600 raft_consensus.cc:3060] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:34.781476 24677 raft_consensus.cc:2468] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 3.
I20260709 12:18:34.782786 24493 leader_election.cc:304] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: 
I20260709 12:18:34.783217 24600 raft_consensus.cc:2468] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 3.
I20260709 12:18:34.783619 24820 raft_consensus.cc:2804] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:34.784624 24820 raft_consensus.cc:697] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:34.785534 24820 consensus_queue.cc:237] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:34.795270 24424 catalog_manager.cc:5697] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 2 to 3, leader changed from bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 3 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:34.923708 24852 raft_consensus.cc:993] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62: : Instructing follower a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:34.924226 24853 raft_consensus.cc:1081] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Signalling peer a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:34.925508 24529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40028
I20260709 12:18:34.925985 24529 raft_consensus.cc:493] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:34.926411 24529 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:34.931540 24529 raft_consensus.cc:515] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:34.933274 24529 leader_election.cc:290] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 3 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:34.933936 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:34.934355 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:34.934486 24600 raft_consensus.cc:3055] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:34.934871 24600 raft_consensus.cc:740] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:34.934859 24677 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:34.935775 24600 consensus_queue.cc:260] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:34.936968 24600 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:34.941479 24677 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 3.
I20260709 12:18:34.942605 24493 leader_election.cc:304] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: 
I20260709 12:18:34.943296 24600 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 3.
I20260709 12:18:34.943397 24820 raft_consensus.cc:2804] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:34.943887 24820 raft_consensus.cc:697] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:34.944650 24820 consensus_queue.cc:237] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:34.951241 24424 catalog_manager.cc:5697] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 2 to 3, leader changed from bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 3 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.039747 24852 raft_consensus.cc:993] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62: : Instructing follower a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:35.040177 24853 raft_consensus.cc:1081] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Signalling peer a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:35.041738 24529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40028
I20260709 12:18:35.042155 24529 raft_consensus.cc:493] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:35.042398 24529 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.046561 24529 raft_consensus.cc:515] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:35.048203 24529 leader_election.cc:290] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 3 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:35.049307 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:35.049322 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:35.049835 24677 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.050248 24600 raft_consensus.cc:3055] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:35.050549 24600 raft_consensus.cc:740] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:35.051275 24600 consensus_queue.cc:260] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:35.052366 24600 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.056027 24677 raft_consensus.cc:2468] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 3.
I20260709 12:18:35.057017 24493 leader_election.cc:304] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: 
I20260709 12:18:35.057760 24820 raft_consensus.cc:2804] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:35.058195 24820 raft_consensus.cc:697] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:35.058261 24600 raft_consensus.cc:2468] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 3.
I20260709 12:18:35.058969 24820 consensus_queue.cc:237] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:35.064924 24424 catalog_manager.cc:5697] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 2 to 3, leader changed from bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 3 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.082491 24848 raft_consensus.cc:993] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705: : Instructing follower a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:35.083026 24862 raft_consensus.cc:1081] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Signalling peer a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:35.084401 24529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40040
I20260709 12:18:35.084841 24529 raft_consensus.cc:493] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:35.085126 24529 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.089257 24529 raft_consensus.cc:515] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:35.090696 24529 leader_election.cc:290] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 3 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:35.091439 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:35.091781 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:35.092016 24600 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.092275 24677 raft_consensus.cc:3055] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:35.092555 24677 raft_consensus.cc:740] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:35.093329 24677 consensus_queue.cc:260] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:35.094508 24677 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.098079 24600 raft_consensus.cc:2468] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 3.
I20260709 12:18:35.099170 24492 leader_election.cc:304] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:35.099802 24820 raft_consensus.cc:2804] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:35.100255 24820 raft_consensus.cc:697] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:35.100423 24677 raft_consensus.cc:2468] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 3.
I20260709 12:18:35.101055 24820 consensus_queue.cc:237] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:35.107564 24424 catalog_manager.cc:5697] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 2 to 3, leader changed from 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 3 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.204434 24600 raft_consensus.cc:1275] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:35.205699 24820 consensus_queue.cc:1048] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:35.215662 24677 raft_consensus.cc:1275] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:35.217278 24854 consensus_queue.cc:1048] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:35.292487 24848 raft_consensus.cc:993] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705: : Instructing follower a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:35.292937 24848 raft_consensus.cc:1081] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Signalling peer a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:35.294340 24529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40040
I20260709 12:18:35.294817 24529 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:35.295106 24529 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:35.299948 24529 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:35.301891 24529 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 4 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:35.302767 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:35.303253 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:35.303287 24600 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:35.303807 24677 raft_consensus.cc:3055] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:35.304072 24677 raft_consensus.cc:740] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:35.304683 24677 consensus_queue.cc:260] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:35.305615 24677 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:35.308911 24600 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 4.
I20260709 12:18:35.309783 24492 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:35.310441 24854 raft_consensus.cc:2804] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:35.310832 24854 raft_consensus.cc:697] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 4 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:35.310997 24677 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 4.
I20260709 12:18:35.311712 24854 consensus_queue.cc:237] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:35.319047 24425 catalog_manager.cc:5697] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 3 to 4, leader changed from 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 4 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.323873 24600 raft_consensus.cc:1275] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:35.325107 24854 consensus_queue.cc:1048] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:35.333303 24677 raft_consensus.cc:1275] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:35.334777 24854 consensus_queue.cc:1048] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:35.485179 24600 raft_consensus.cc:1275] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:35.486443 24871 consensus_queue.cc:1048] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:35.495713 24674 raft_consensus.cc:1275] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:35.497362 24820 consensus_queue.cc:1048] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:35.502810 24677 raft_consensus.cc:1275] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:35.504248 24820 consensus_queue.cc:1048] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:35.515693 24600 raft_consensus.cc:1275] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:35.517045 24871 consensus_queue.cc:1048] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:35.853220 24600 raft_consensus.cc:1275] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:35.854378 24871 consensus_queue.cc:1048] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:35.864133 24674 raft_consensus.cc:1275] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:35.866544 24871 consensus_queue.cc:1048] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:37.752910 23879 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:18:37.753577 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:37.760493 24529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
mode: GRACEFUL
new_leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
 from {username='slave'} at 127.0.0.1:40060
I20260709 12:18:37.760998 24529 raft_consensus.cc:606] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Received request to transfer leadership to TS 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:37.763410 24529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
mode: GRACEFUL
new_leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
 from {username='slave'} at 127.0.0.1:40060
I20260709 12:18:37.763840 24529 raft_consensus.cc:606] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Received request to transfer leadership to TS 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:37.765946 24529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
mode: GRACEFUL
new_leader_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:40060
I20260709 12:18:37.766425 24529 raft_consensus.cc:606] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 4 LEADER]: Received request to transfer leadership to TS bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:37.768573 24529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
mode: GRACEFUL
new_leader_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:40060
I20260709 12:18:37.768988 24529 raft_consensus.cc:606] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Received request to transfer leadership to TS bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:37.769929 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:37.770475 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:37.836582 24854 raft_consensus.cc:993] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e: : Instructing follower bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:37.837030 24879 raft_consensus.cc:1081] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Signalling peer bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:37.838562 24604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:42220
I20260709 12:18:37.839042 24604 raft_consensus.cc:493] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:37.839352 24604 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:37.844349 24604 raft_consensus.cc:515] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:37.846450 24604 leader_election.cc:290] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 4 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:37.847265 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:37.847545 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:37.847795 24529 raft_consensus.cc:3055] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:37.848114 24674 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:37.848124 24529 raft_consensus.cc:740] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:37.848883 24529 consensus_queue.cc:260] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:37.849720 24529 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:37.853113 24674 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 4.
I20260709 12:18:37.853797 24529 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 4.
I20260709 12:18:37.854367 24568 leader_election.cc:304] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:37.855131 24853 raft_consensus.cc:2804] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:37.855952 24853 raft_consensus.cc:697] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 4 LEADER]: Becoming Leader. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:37.856618 24853 consensus_queue.cc:237] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:37.862495 24424 catalog_manager.cc:5697] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 reported cstate change: term changed from 3 to 4, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "bdf86ba745e44d7abf73548b4955ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:38.049032 24854 raft_consensus.cc:993] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e: : Instructing follower 4ae1aa47c53141beb47c32d8cc9bf705 to start an election
I20260709 12:18:38.049533 24879 raft_consensus.cc:1081] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Signalling peer 4ae1aa47c53141beb47c32d8cc9bf705 to start an election
I20260709 12:18:38.051066 24674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
 from {username='slave'} at 127.0.0.1:40852
I20260709 12:18:38.051664 24674 raft_consensus.cc:493] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:38.052018 24674 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:38.057312 24674 raft_consensus.cc:515] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:38.059958 24674 leader_election.cc:290] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 4 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:38.060755 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:38.061089 24604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:38.061481 24529 raft_consensus.cc:3055] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:38.061652 24604 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:38.061846 24529 raft_consensus.cc:740] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:38.062717 24529 consensus_queue.cc:260] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:38.063640 24529 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:38.067267 24604 raft_consensus.cc:2468] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 4.
I20260709 12:18:38.068256 24529 raft_consensus.cc:2468] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 4.
I20260709 12:18:38.068578 24641 leader_election.cc:304] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:38.069388 24862 raft_consensus.cc:2804] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:38.070520 24862 raft_consensus.cc:697] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:38.071772 24862 consensus_queue.cc:237] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:38.079808 24424 catalog_manager.cc:5697] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 3 to 4, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:38.174965 24854 raft_consensus.cc:993] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e: : Instructing follower bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:38.175426 24879 raft_consensus.cc:1081] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 4 LEADER]: Signalling peer bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:38.176775 24604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:42220
I20260709 12:18:38.177259 24604 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:38.177560 24604 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:38.182191 24604 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:38.183718 24604 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 5 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:38.184427 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:38.184806 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:38.184918 24529 raft_consensus.cc:3055] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:38.185292 24529 raft_consensus.cc:740] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:38.185317 24674 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:38.186268 24529 consensus_queue.cc:260] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:38.187341 24529 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:38.192305 24674 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 5.
I20260709 12:18:38.192961 24677 raft_consensus.cc:1240] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Rejecting Update request from peer a640b2d5518848bd858c4584a193862e for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:38.193658 24529 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 5.
I20260709 12:18:38.194195 24568 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:38.194991 24853 raft_consensus.cc:2804] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:38.195122 24854 raft_consensus.cc:993] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e: : Instructing follower 4ae1aa47c53141beb47c32d8cc9bf705 to start an election
I20260709 12:18:38.195533 24853 raft_consensus.cc:697] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 5 LEADER]: Becoming Leader. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:38.195654 24854 raft_consensus.cc:1081] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Signalling peer 4ae1aa47c53141beb47c32d8cc9bf705 to start an election
I20260709 12:18:38.196376 24853 consensus_queue.cc:237] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:38.197118 24677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
 from {username='slave'} at 127.0.0.1:40852
I20260709 12:18:38.197606 24677 raft_consensus.cc:493] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:38.197942 24677 raft_consensus.cc:3060] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.203080 24677 raft_consensus.cc:515] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:38.203933 24424 catalog_manager.cc:5697] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 reported cstate change: term changed from 4 to 5, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194). New cstate: current_term: 5 leader_uuid: "bdf86ba745e44d7abf73548b4955ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:38.205090 24677 leader_election.cc:290] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 3 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:38.205231 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:38.205919 24529 raft_consensus.cc:3055] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:38.206259 24604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:38.206272 24529 raft_consensus.cc:740] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:38.206920 24604 raft_consensus.cc:3060] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.207358 24529 consensus_queue.cc:260] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:38.208460 24529 raft_consensus.cc:3060] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.213912 24604 raft_consensus.cc:2468] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 3.
I20260709 12:18:38.215032 24641 leader_election.cc:304] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:38.215130 24529 raft_consensus.cc:2468] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 3.
I20260709 12:18:38.215742 24862 raft_consensus.cc:2804] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:38.216185 24862 raft_consensus.cc:697] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:38.216930 24862 consensus_queue.cc:237] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:38.224134 24424 catalog_manager.cc:5697] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 2 to 3, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:38.285494 24677 raft_consensus.cc:1275] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:38.286885 24853 consensus_queue.cc:1048] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:38.298177 24529 raft_consensus.cc:1275] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:38.299891 24893 consensus_queue.cc:1048] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:38.521276 24529 raft_consensus.cc:1275] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:38.522439 24862 consensus_queue.cc:1048] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:38.530870 24604 raft_consensus.cc:1275] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:38.532234 24887 consensus_queue.cc:1048] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:38.660287 24604 raft_consensus.cc:1275] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:38.661558 24887 consensus_queue.cc:1048] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:38.668081 24529 raft_consensus.cc:1275] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:38.669636 24886 consensus_queue.cc:1048] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:38.676977 24677 raft_consensus.cc:1275] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:38.678737 24880 consensus_queue.cc:1048] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:38.687983 24529 raft_consensus.cc:1275] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:38.690759 24880 consensus_queue.cc:1048] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:38.771706 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:38.777729 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:38.778239 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:39.977922 24906 raft_consensus.cc:493] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:39.978960 24906 raft_consensus.cc:515] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:39.981540 24905 raft_consensus.cc:493] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:39.982013 24906 leader_election.cc:290] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:39.982112 24905 raft_consensus.cc:515] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:39.984998 24905 leader_election.cc:290] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.006143 24906 raft_consensus.cc:493] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:40.047870 24907 raft_consensus.cc:493] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:40.048821 24907 raft_consensus.cc:515] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.059149 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.079342 24907 leader_election.cc:290] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.125589 24907 raft_consensus.cc:493] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:40.126515 24907 raft_consensus.cc:515] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.131330 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.132133 24601 raft_consensus.cc:2468] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 3.
I20260709 12:18:40.134125 24641 leader_election.cc:304] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:40.135177 24905 raft_consensus.cc:2804] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:40.135671 24905 raft_consensus.cc:493] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:40.136101 24905 raft_consensus.cc:3060] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.190788 24904 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:40.191587 24904 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.196478 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.198658 24904 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.135190 24907 leader_election.cc:290] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.252471 24905 raft_consensus.cc:515] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.278455 24905 leader_election.cc:290] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 4 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.280045 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:40.313493 24904 raft_consensus.cc:493] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:40.343158 24601 raft_consensus.cc:3060] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.343200 24904 raft_consensus.cc:515] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.343120 24906 raft_consensus.cc:515] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:40.345788 24904 leader_election.cc:290] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.349349 24602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.347218 24907 raft_consensus.cc:493] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:40.352588 24907 raft_consensus.cc:515] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:40.355647 24907 leader_election.cc:290] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.357577 24604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.358304 24604 raft_consensus.cc:2468] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 2.
I20260709 12:18:40.359251 24906 leader_election.cc:290] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065), a640b2d5518848bd858c4584a193862e (127.23.81.193:40293)
I20260709 12:18:40.360445 24908 raft_consensus.cc:493] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ae1aa47c53141beb47c32d8cc9bf705)
I20260709 12:18:40.360648 24641 leader_election.cc:304] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:40.360778 24906 raft_consensus.cc:493] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:40.361251 24601 raft_consensus.cc:2468] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 4.
I20260709 12:18:40.361064 24908 raft_consensus.cc:515] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.361415 24906 raft_consensus.cc:515] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.362542 24641 leader_election.cc:304] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:40.363277 24905 raft_consensus.cc:2804] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:40.364004 24905 raft_consensus.cc:493] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:40.364223 24906 leader_election.cc:290] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:40.364461 24905 raft_consensus.cc:3060] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.367331 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.369124 24909 raft_consensus.cc:493] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:40.370111 24907 raft_consensus.cc:2804] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:40.369793 24909 raft_consensus.cc:515] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.374867 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:40.375429 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:40.375197 24905 raft_consensus.cc:515] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:40.377769 24676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:40.379774 24910 raft_consensus.cc:493] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ae1aa47c53141beb47c32d8cc9bf705)
I20260709 12:18:40.381146 24904 raft_consensus.cc:493] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:40.383903 24904 raft_consensus.cc:515] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.385895 24674 raft_consensus.cc:2393] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdf86ba745e44d7abf73548b4955ca62 in current term 3: Already voted for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in this term.
I20260709 12:18:40.384598 24909 leader_election.cc:290] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:40.387948 24678 raft_consensus.cc:2468] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 1.
I20260709 12:18:40.386983 24905 leader_election.cc:290] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 3 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.388487 24908 leader_election.cc:290] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:40.402194 24911 raft_consensus.cc:493] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:40.402997 24911 raft_consensus.cc:515] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.404415 24909 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:40.405124 24909 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.402238 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:40.406795 24600 raft_consensus.cc:3060] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.409437 24677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:40.410943 24904 leader_election.cc:290] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.387456 24910 raft_consensus.cc:515] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.405809 24911 leader_election.cc:290] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:40.429394 24914 raft_consensus.cc:493] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4ae1aa47c53141beb47c32d8cc9bf705)
I20260709 12:18:40.429955 24914 raft_consensus.cc:515] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.423574 24600 raft_consensus.cc:2468] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 3.
I20260709 12:18:40.432837 24914 leader_election.cc:290] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:40.432925 24641 leader_election.cc:304] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:40.433380 24914 raft_consensus.cc:493] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4ae1aa47c53141beb47c32d8cc9bf705)
I20260709 12:18:40.433756 24904 raft_consensus.cc:2804] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:40.433835 24914 raft_consensus.cc:515] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.434300 24904 raft_consensus.cc:697] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:40.435312 24904 consensus_queue.cc:237] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:40.435930 24914 leader_election.cc:290] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:40.437161 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:40.437750 24674 raft_consensus.cc:2468] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 3.
I20260709 12:18:40.440847 24907 raft_consensus.cc:697] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:40.451388 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:40.452150 24909 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:40.452271 24568 leader_election.cc:304] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:40.452791 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.453437 24601 raft_consensus.cc:2468] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 1.
I20260709 12:18:40.453507 24911 raft_consensus.cc:2804] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:40.454063 24911 raft_consensus.cc:493] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:40.454427 24911 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.454751 24641 leader_election.cc:304] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:40.454876 24910 leader_election.cc:290] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:40.458016 24526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:40.458475 24568 leader_election.cc:304] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:40.458688 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:40.459298 24525 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 5.
I20260709 12:18:40.459430 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:40.459679 24600 raft_consensus.cc:1240] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Rejecting Update request from peer a640b2d5518848bd858c4584a193862e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:40.459617 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:40.460121 24527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:40.460405 24524 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 4.
I20260709 12:18:40.460405 24912 raft_consensus.cc:2804] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:40.460937 24912 raft_consensus.cc:493] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:40.461323 24912 raft_consensus.cc:3060] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.462340 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:40.461253 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:40.442075 24907 consensus_queue.cc:237] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.467654 24528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:40.470315 24915 raft_consensus.cc:2804] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:40.471562 24915 raft_consensus.cc:493] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:40.479878 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.481431 24600 raft_consensus.cc:1240] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Rejecting Update request from peer a640b2d5518848bd858c4584a193862e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:40.482352 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:40.483057 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0db4e02c8904685aa784e7422c1e1ac" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:40.485495 24528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:40.485769 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:40.485881 24675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:40.486768 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:40.480576 24915 raft_consensus.cc:3060] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.488098 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:40.471586 24911 raft_consensus.cc:515] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.491961 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:40.493180 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:40.494402 24603 raft_consensus.cc:1240] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Rejecting Update request from peer a640b2d5518848bd858c4584a193862e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:40.495177 24917 raft_consensus.cc:493] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:40.495757 24917 raft_consensus.cc:515] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.496515 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.498586 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.500272 24917 leader_election.cc:290] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:40.500653 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.500905 24529 raft_consensus.cc:2468] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 1.
I20260709 12:18:40.501741 24674 raft_consensus.cc:1240] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Rejecting Update request from peer a640b2d5518848bd858c4584a193862e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:40.504261 24911 leader_election.cc:290] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 4 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:40.504642 24604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.505365 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:40.505365 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:40.512562 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:40.510565 24568 leader_election.cc:304] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e
I20260709 12:18:40.513770 24677 raft_consensus.cc:1240] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 LEADER]: Rejecting Update request from peer a640b2d5518848bd858c4584a193862e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:40.514839 24568 leader_election.cc:304] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e
I20260709 12:18:40.515502 24908 raft_consensus.cc:2749] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:40.515646 24917 consensus_queue.cc:1059] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:40.511739 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:40.516726 24917 consensus_queue.cc:1243] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [LEADER]: Peer 4ae1aa47c53141beb47c32d8cc9bf705 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:18:40.516893 24912 raft_consensus.cc:515] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.517423 24916 raft_consensus.cc:3055] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:40.517823 24916 raft_consensus.cc:740] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:40.518005 24600 raft_consensus.cc:1240] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Rejecting Update request from peer a640b2d5518848bd858c4584a193862e for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:40.519032 24642 leader_election.cc:304] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705; no voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.520557 24642 leader_election.cc:304] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.518823 24916 consensus_queue.cc:260] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:40.521541 24904 raft_consensus.cc:2749] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:40.522118 24908 raft_consensus.cc:2749] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:40.524331 24568 leader_election.cc:304] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e
I20260709 12:18:40.525130 24908 raft_consensus.cc:2749] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:40.525506 24568 leader_election.cc:304] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e
I20260709 12:18:40.524294 24492 leader_election.cc:304] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a640b2d5518848bd858c4584a193862e; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.526782 24642 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.527472 24904 raft_consensus.cc:2804] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:40.527417 24908 raft_consensus.cc:2749] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:40.525198 24915 raft_consensus.cc:515] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.528674 24678 raft_consensus.cc:1240] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Rejecting Update request from peer a640b2d5518848bd858c4584a193862e for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:40.528379 24904 raft_consensus.cc:493] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:40.528849 24916 raft_consensus.cc:3060] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.529093 24904 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:40.530740 24917 raft_consensus.cc:2749] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:40.531450 24910 consensus_queue.cc:1059] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:40.531886 24492 leader_election.cc:304] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a640b2d5518848bd858c4584a193862e; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.532425 24905 raft_consensus.cc:2804] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:40.532610 24909 raft_consensus.cc:3055] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:40.532857 24905 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:40.533149 24909 raft_consensus.cc:740] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:40.533346 24905 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:40.533823 24492 leader_election.cc:304] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a640b2d5518848bd858c4584a193862e; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.534134 24909 consensus_queue.cc:260] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.534773 24912 leader_election.cc:290] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 2 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:40.535045 24492 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a640b2d5518848bd858c4584a193862e; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.535235 24909 raft_consensus.cc:3060] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.532450 24910 consensus_queue.cc:1059] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:18:40.538568 24492 leader_election.cc:304] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a640b2d5518848bd858c4584a193862e; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.541116 24915 leader_election.cc:290] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 2 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.542574 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:40.543383 24603 raft_consensus.cc:2393] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ae1aa47c53141beb47c32d8cc9bf705 in current term 2: Already voted for candidate bdf86ba745e44d7abf73548b4955ca62 in this term.
I20260709 12:18:40.543653 24425 catalog_manager.cc:5697] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 3 to 4, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:40.545071 24425 catalog_manager.cc:5697] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 2 to 3, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:40.537396 24913 raft_consensus.cc:2749] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:40.532730 24914 raft_consensus.cc:2749] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:40.545347 24909 raft_consensus.cc:2749] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:40.547843 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:40.548831 24678 raft_consensus.cc:2393] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bdf86ba745e44d7abf73548b4955ca62 in current term 2: Already voted for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in this term.
I20260709 12:18:40.536906 24642 leader_election.cc:304] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.548709 24905 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.547843 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:40.549983 24915 raft_consensus.cc:2804] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:40.550130 24917 raft_consensus.cc:2749] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:40.550387 24915 raft_consensus.cc:493] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:40.550912 24915 raft_consensus.cc:3060] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.552739 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:40.552670 24921 consensus_queue.cc:1059] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:40.553735 24917 raft_consensus.cc:3055] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:40.554157 24917 raft_consensus.cc:740] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:40.555322 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:40.554693 24568 leader_election.cc:304] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e
I20260709 12:18:40.556336 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:40.556627 24912 raft_consensus.cc:2749] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:40.556062 24917 consensus_queue.cc:260] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.556613 24905 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 6 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.550467 24904 raft_consensus.cc:515] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.557979 24917 raft_consensus.cc:3060] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.562080 24915 raft_consensus.cc:515] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
W20260709 12:18:40.575139 24921 consensus_queue.cc:1175] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a640b2d5518848bd858c4584a193862e for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:40.580780 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:40.558802 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:40.581523 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:40.583062 24915 leader_election.cc:290] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 2 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.583017 24642 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705; no voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.571099 24916 raft_consensus.cc:3055] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:40.583192 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:40.583673 24916 raft_consensus.cc:740] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:40.584134 24905 raft_consensus.cc:2749] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:40.584798 24642 leader_election.cc:304] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705; no voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.584506 24916 consensus_queue.cc:260] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.585691 24904 leader_election.cc:290] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 5 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:40.585510 24915 raft_consensus.cc:2749] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:40.586416 24916 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.586759 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:40.588326 24641 leader_election.cc:304] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705; no voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.589329 24915 raft_consensus.cc:2749] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:40.558431 24493 leader_election.cc:304] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a640b2d5518848bd858c4584a193862e; no voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.590217 24921 raft_consensus.cc:2749] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:40.595471 24529 raft_consensus.cc:2468] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 2.
I20260709 12:18:40.597203 24642 leader_election.cc:304] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:40.598090 24915 raft_consensus.cc:2804] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:40.598609 24915 raft_consensus.cc:697] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:40.599602 24915 consensus_queue.cc:237] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.611055 24425 catalog_manager.cc:5697] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 1 to 2, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:40.811107 24678 raft_consensus.cc:1240] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Rejecting Update request from peer bdf86ba745e44d7abf73548b4955ca62 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:40.812600 24912 consensus_queue.cc:1059] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:40.813472 24908 raft_consensus.cc:3055] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:40.813803 24908 raft_consensus.cc:740] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:40.814745 24908 consensus_queue.cc:260] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.815737 24908 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:40.826594 24529 raft_consensus.cc:1275] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:40.827901 24915 consensus_queue.cc:1048] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:40.838227 24603 raft_consensus.cc:1275] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:40.840306 24915 consensus_queue.cc:1048] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:40.861241 24678 raft_consensus.cc:1240] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Rejecting Update request from peer bdf86ba745e44d7abf73548b4955ca62 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:40.862464 24908 consensus_queue.cc:1059] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:40.863242 24912 raft_consensus.cc:3055] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:40.863574 24912 raft_consensus.cc:740] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:40.864156 24912 consensus_queue.cc:260] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.865067 24912 raft_consensus.cc:3060] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.908002 24678 raft_consensus.cc:1240] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Rejecting Update request from peer bdf86ba745e44d7abf73548b4955ca62 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:40.909179 24912 consensus_queue.cc:1059] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:40.909904 24908 raft_consensus.cc:3055] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:40.910228 24908 raft_consensus.cc:740] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:40.911012 24908 consensus_queue.cc:260] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:40.912122 24908 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:40.940616 24523 raft_consensus.cc:1275] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:40.941956 24904 consensus_queue.cc:1048] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:40.952582 24603 raft_consensus.cc:1275] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:40.953913 24904 consensus_queue.cc:1048] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:18:40.980763 24699 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4ec0 after lost signal to thread 23882
W20260709 12:18:40.981570 24699 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9a00 after lost signal to thread 24461
W20260709 12:18:40.982410 24699 debug-util.cc:398] Leaking SignalData structure 0x7b0800129940 after lost signal to thread 24553
W20260709 12:18:40.983155 24699 debug-util.cc:398] Leaking SignalData structure 0x7b08001475e0 after lost signal to thread 24628
W20260709 12:18:40.983871 24699 debug-util.cc:398] Leaking SignalData structure 0x7b080013dfc0 after lost signal to thread 24702
I20260709 12:18:41.135617 24603 raft_consensus.cc:1275] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:41.138638 24904 consensus_queue.cc:1048] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:41.148488 24523 raft_consensus.cc:1275] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:41.150913 24915 consensus_queue.cc:1048] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:41.310428 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:41.338359 24678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
mode: GRACEFUL
new_leader_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:56524
I20260709 12:18:41.339126 24678 raft_consensus.cc:606] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Received request to transfer leadership to TS a640b2d5518848bd858c4584a193862e
I20260709 12:18:41.341816 24678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
mode: GRACEFUL
new_leader_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:56524
I20260709 12:18:41.342447 24678 raft_consensus.cc:606] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Received request to transfer leadership to TS a640b2d5518848bd858c4584a193862e
I20260709 12:18:41.343600 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:41.344208 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:41.349577 24904 raft_consensus.cc:993] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705: : Instructing follower a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:41.350114 24915 raft_consensus.cc:1081] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Signalling peer a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:41.351562 24523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40040
I20260709 12:18:41.352223 24523 raft_consensus.cc:493] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:41.352593 24523 raft_consensus.cc:3060] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:41.360769 24523 raft_consensus.cc:515] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:41.363632 24523 leader_election.cc:290] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 4 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:41.364257 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:41.364835 24678 raft_consensus.cc:3055] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:41.365149 24678 raft_consensus.cc:740] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:41.365278 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3727545181403bb8b6103f1c0f6bca" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:41.365833 24603 raft_consensus.cc:3060] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:41.365953 24678 consensus_queue.cc:260] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:41.367090 24678 raft_consensus.cc:3060] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:41.373538 24678 raft_consensus.cc:2468] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 4.
I20260709 12:18:41.374466 24493 leader_election.cc:304] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: 
I20260709 12:18:41.374627 24603 raft_consensus.cc:2468] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 4.
I20260709 12:18:41.375209 24917 raft_consensus.cc:2804] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:41.376579 24917 raft_consensus.cc:697] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 4 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:41.377450 24917 consensus_queue.cc:237] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:41.385272 24425 catalog_manager.cc:5697] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 3 to 4, leader changed from 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 4 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:41.694937 24915 raft_consensus.cc:993] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705: : Instructing follower a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:41.695399 24904 raft_consensus.cc:1081] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Signalling peer a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:41.696913 24523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40040
I20260709 12:18:41.697381 24523 raft_consensus.cc:493] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:41.697697 24523 raft_consensus.cc:3060] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:41.702453 24523 raft_consensus.cc:515] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:41.704257 24523 leader_election.cc:290] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 3 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:41.704977 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:41.705209 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95666664078d4d3daf8f40058f52a17d" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:41.705606 24603 raft_consensus.cc:3060] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:41.705693 24678 raft_consensus.cc:3055] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:41.706332 24678 raft_consensus.cc:740] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:41.707005 24678 consensus_queue.cc:260] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:41.707736 24678 raft_consensus.cc:3060] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:41.711808 24678 raft_consensus.cc:2468] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 3.
I20260709 12:18:41.712949 24493 leader_election.cc:304] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: 
I20260709 12:18:41.713050 24603 raft_consensus.cc:2468] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 3.
I20260709 12:18:41.713701 24917 raft_consensus.cc:2804] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:41.714172 24917 raft_consensus.cc:697] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:41.714820 24917 consensus_queue.cc:237] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:41.721791 24425 catalog_manager.cc:5697] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 2 to 3, leader changed from 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 3 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:41.813532 24603 raft_consensus.cc:1275] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:41.814821 24938 consensus_queue.cc:1048] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:41.830705 24678 raft_consensus.cc:1275] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:41.832022 24938 consensus_queue.cc:1048] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:42.034724 24915 raft_consensus.cc:493] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:42.035241 24915 raft_consensus.cc:515] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.037094 24915 leader_election.cc:290] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:42.037806 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:42.038121 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:42.038801 24603 raft_consensus.cc:2393] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ae1aa47c53141beb47c32d8cc9bf705 in current term 4: Already voted for candidate bdf86ba745e44d7abf73548b4955ca62 in this term.
I20260709 12:18:42.038626 24523 raft_consensus.cc:2468] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 4.
I20260709 12:18:42.040026 24642 leader_election.cc:304] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:42.040630 24915 raft_consensus.cc:2804] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:42.040980 24915 raft_consensus.cc:493] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a640b2d5518848bd858c4584a193862e)
I20260709 12:18:42.041296 24915 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:42.046006 24915 raft_consensus.cc:515] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.048156 24915 leader_election.cc:290] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 4 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:42.048535 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:42.048753 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:42.049479 24603 raft_consensus.cc:2393] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ae1aa47c53141beb47c32d8cc9bf705 in current term 4: Already voted for candidate bdf86ba745e44d7abf73548b4955ca62 in this term.
I20260709 12:18:42.056530 24523 raft_consensus.cc:2468] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 4.
I20260709 12:18:42.057729 24642 leader_election.cc:304] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:42.058420 24915 raft_consensus.cc:2804] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:42.058899 24915 raft_consensus.cc:697] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:42.059697 24915 consensus_queue.cc:237] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.068517 24425 catalog_manager.cc:5697] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 3 to 4, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.113260 24915 raft_consensus.cc:493] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.113816 24915 raft_consensus.cc:515] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.116658 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:42.116096 24915 leader_election.cc:290] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:42.116557 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:42.117393 24603 raft_consensus.cc:2468] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 2.
I20260709 12:18:42.118654 24641 leader_election.cc:304] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: a640b2d5518848bd858c4584a193862e
I20260709 12:18:42.119477 24915 raft_consensus.cc:2804] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:42.119800 24915 raft_consensus.cc:493] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.120082 24915 raft_consensus.cc:3060] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.125000 24915 raft_consensus.cc:515] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.126856 24915 leader_election.cc:290] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 3 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:42.127696 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:42.127890 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:42.128394 24603 raft_consensus.cc:3060] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.133127 24603 raft_consensus.cc:2468] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 3.
I20260709 12:18:42.134199 24641 leader_election.cc:304] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: a640b2d5518848bd858c4584a193862e
I20260709 12:18:42.135010 24915 raft_consensus.cc:2804] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:42.135408 24915 raft_consensus.cc:697] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:42.136171 24915 consensus_queue.cc:237] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.143420 24425 catalog_manager.cc:5697] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 1 to 3, leader changed from bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194) to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.164237 24678 raft_consensus.cc:1275] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:42.165505 24917 consensus_queue.cc:1048] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.176280 24603 raft_consensus.cc:1275] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:42.178972 24917 consensus_queue.cc:1048] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:42.180485 24943 raft_consensus.cc:493] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.180984 24943 raft_consensus.cc:515] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.183161 24943 leader_election.cc:290] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:42.185151 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:42.193630 24938 raft_consensus.cc:493] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:42.194443 24938 raft_consensus.cc:515] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.197131 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:42.197423 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:42.197715 24600 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 5.
I20260709 12:18:42.198078 24678 raft_consensus.cc:2393] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a640b2d5518848bd858c4584a193862e in current term 5: Already voted for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in this term.
I20260709 12:18:42.199002 24492 leader_election.cc:304] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:42.199206 24938 leader_election.cc:290] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:42.199822 24952 raft_consensus.cc:2804] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:42.190124 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:42.200187 24952 raft_consensus.cc:493] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:42.200620 24952 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:42.202788 24523 raft_consensus.cc:2468] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 4.
I20260709 12:18:42.204082 24568 leader_election.cc:304] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:42.205173 24953 raft_consensus.cc:2804] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:42.205587 24953 raft_consensus.cc:493] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.206007 24953 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:42.207979 24938 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:42.208511 24938 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.211417 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:42.213060 24603 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 6.
I20260709 12:18:42.213608 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:42.213261 24953 raft_consensus.cc:515] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.214380 24678 raft_consensus.cc:2393] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a640b2d5518848bd858c4584a193862e in current term 6: Already voted for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in this term.
I20260709 12:18:42.214315 24492 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:42.215272 24917 raft_consensus.cc:2804] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:42.211232 24952 raft_consensus.cc:515] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.215660 24917 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:42.216085 24917 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.216504 24953 leader_election.cc:290] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 5 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:42.218235 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:42.218652 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:42.219028 24672 raft_consensus.cc:2393] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a640b2d5518848bd858c4584a193862e in current term 5: Already voted for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in this term.
I20260709 12:18:42.219264 24523 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:42.220650 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ffb171ca624908b3c089b13ad3ca1e" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:42.222209 24952 leader_election.cc:290] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 5 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:42.222550 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:42.223451 24917 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.226504 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:42.226692 24915 raft_consensus.cc:493] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.227175 24915 raft_consensus.cc:515] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.229372 24915 leader_election.cc:290] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:42.230926 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:42.231521 24529 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 5.
I20260709 12:18:42.232726 24642 leader_election.cc:304] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, a640b2d5518848bd858c4584a193862e; no voters: 
I20260709 12:18:42.233368 24523 raft_consensus.cc:2468] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 5.
I20260709 12:18:42.212492 24938 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:42.234511 24601 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 6.
I20260709 12:18:42.234728 24604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:42.235522 24600 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 5.
I20260709 12:18:42.235839 24492 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:42.236891 24568 leader_election.cc:304] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:42.237076 24915 raft_consensus.cc:2804] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:42.237449 24917 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 6 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:42.236898 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:42.237509 24915 raft_consensus.cc:493] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.238958 24915 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.238220 24917 raft_consensus.cc:2804] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:42.239089 24678 raft_consensus.cc:2393] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a640b2d5518848bd858c4584a193862e in current term 6: Already voted for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in this term.
I20260709 12:18:42.239975 24492 leader_election.cc:304] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 4ae1aa47c53141beb47c32d8cc9bf705
I20260709 12:18:42.241221 24917 raft_consensus.cc:697] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 6 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:42.242285 24917 consensus_queue.cc:237] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.243410 24952 raft_consensus.cc:2804] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:42.245646 24953 raft_consensus.cc:2804] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:42.246439 24953 raft_consensus.cc:697] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 5 LEADER]: Becoming Leader. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:42.247593 24953 consensus_queue.cc:237] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.249480 24938 raft_consensus.cc:493] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdf86ba745e44d7abf73548b4955ca62)
I20260709 12:18:42.250203 24938 raft_consensus.cc:515] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.253118 24938 leader_election.cc:290] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:42.253906 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:42.254185 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a4ceb8bdc7477bb602cc692110978a" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" is_pre_election: true
I20260709 12:18:42.254962 24601 raft_consensus.cc:2368] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a640b2d5518848bd858c4584a193862e for earlier term 2. Current term is 3.
I20260709 12:18:42.255563 24915 raft_consensus.cc:515] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.256243 24492 leader_election.cc:400] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 2 pre-election: Vote denied by peer bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869) with higher term. Message: Invalid argument: T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a640b2d5518848bd858c4584a193862e for earlier term 2. Current term is 3.
I20260709 12:18:42.256592 24492 leader_election.cc:403] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:42.257923 24938 raft_consensus.cc:3060] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.258757 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:42.260747 24915 leader_election.cc:290] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 6 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:42.260782 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94e3f3b9c3f4c139c6c74c47f9f2949" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:42.262048 24601 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.266319 24952 raft_consensus.cc:697] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 5 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:42.267364 24952 consensus_queue.cc:237] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.272420 24938 raft_consensus.cc:2749] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869) with higher term. Message: Invalid argument: T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a640b2d5518848bd858c4584a193862e for earlier term 2. Current term is 3.
I20260709 12:18:42.279529 24601 raft_consensus.cc:2468] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 6.
I20260709 12:18:42.280793 24641 leader_election.cc:304] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:42.281710 24915 raft_consensus.cc:2804] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:42.282228 24915 raft_consensus.cc:697] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:42.282095 24425 catalog_manager.cc:5697] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 reported cstate change: term changed from 4 to 5, leader changed from 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195) to bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194). New cstate: current_term: 5 leader_uuid: "bdf86ba745e44d7abf73548b4955ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.283156 24915 consensus_queue.cc:237] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.283452 24424 catalog_manager.cc:5697] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 5 to 6, leader changed from bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 6 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.285161 24424 catalog_manager.cc:5697] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 4 to 5, leader changed from bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 5 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.301101 24425 catalog_manager.cc:5697] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 5 to 6, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 6 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.345429 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:42.356855 24678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
mode: GRACEFUL
new_leader_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:56524
I20260709 12:18:42.357409 24678 raft_consensus.cc:606] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Received request to transfer leadership to TS bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:42.357558 24915 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.358161 24915 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.359927 24678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
mode: GRACEFUL
new_leader_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:56524
I20260709 12:18:42.360495 24678 raft_consensus.cc:606] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Received request to transfer leadership to TS bdf86ba745e44d7abf73548b4955ca62
I20260709 12:18:42.361085 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e" is_pre_election: true
I20260709 12:18:42.361713 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62" is_pre_election: true
I20260709 12:18:42.361955 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:42.362426 24601 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 6.
I20260709 12:18:42.362644 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:42.362763 24915 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:42.363653 24641 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: a640b2d5518848bd858c4584a193862e
I20260709 12:18:42.364319 24915 raft_consensus.cc:2804] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:42.364722 24915 raft_consensus.cc:493] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.365017 24915 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:42.369752 24915 raft_consensus.cc:515] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.371353 24915 leader_election.cc:290] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 7 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869)
I20260709 12:18:42.372283 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:42.372442 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887341ce0eda47f8a6f1376347b761ed" candidate_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:42.374220 24601 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:42.379051 24601 raft_consensus.cc:2468] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae1aa47c53141beb47c32d8cc9bf705 in term 7.
I20260709 12:18:42.380092 24641 leader_election.cc:304] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae1aa47c53141beb47c32d8cc9bf705, bdf86ba745e44d7abf73548b4955ca62; no voters: a640b2d5518848bd858c4584a193862e
I20260709 12:18:42.380751 24915 raft_consensus.cc:2804] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:42.381212 24915 raft_consensus.cc:697] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 7 LEADER]: Becoming Leader. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:42.382001 24915 consensus_queue.cc:237] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.392717 24425 catalog_manager.cc:5697] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 reported cstate change: term changed from 6 to 7, leader changed from a640b2d5518848bd858c4584a193862e (127.23.81.193) to 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195). New cstate: current_term: 7 leader_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.608412 24523 raft_consensus.cc:1240] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Rejecting Update request from peer 4ae1aa47c53141beb47c32d8cc9bf705 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:42.609805 24915 consensus_queue.cc:1059] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:42.610695 24904 raft_consensus.cc:3055] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:42.611011 24904 raft_consensus.cc:740] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:42.611723 24904 consensus_queue.cc:260] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.612615 24904 raft_consensus.cc:3060] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:42.630852 24915 raft_consensus.cc:993] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705: : Instructing follower bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:42.631362 24904 raft_consensus.cc:1081] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Signalling peer bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:42.632817 24601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:42232
I20260709 12:18:42.633313 24601 raft_consensus.cc:493] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:42.633715 24601 raft_consensus.cc:3060] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.635215 24678 raft_consensus.cc:1240] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 7 LEADER]: Rejecting Update request from peer a640b2d5518848bd858c4584a193862e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:42.636554 24938 consensus_queue.cc:1059] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:42.637259 24938 consensus_queue.cc:1243] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [LEADER]: Peer 4ae1aa47c53141beb47c32d8cc9bf705 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:42.637676 24955 raft_consensus.cc:3055] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:42.638078 24955 raft_consensus.cc:740] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:42.638993 24955 consensus_queue.cc:260] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.639756 24601 raft_consensus.cc:515] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.640332 24955 raft_consensus.cc:3060] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:42.641695 24601 leader_election.cc:290] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 3 election: Requested vote from peers a640b2d5518848bd858c4584a193862e (127.23.81.193:40293), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:42.642356 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:42.642733 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebead0c6f5b34bb8bb1b8cbfdf696b29" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:42.643040 24523 raft_consensus.cc:3060] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.643375 24678 raft_consensus.cc:3055] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:42.643721 24678 raft_consensus.cc:740] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:42.644624 24678 consensus_queue.cc:260] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.645850 24678 raft_consensus.cc:3060] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.650084 24523 raft_consensus.cc:2468] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 3.
I20260709 12:18:42.651198 24568 leader_election.cc:304] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:42.651850 24953 raft_consensus.cc:2804] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:42.652302 24953 raft_consensus.cc:697] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 3 LEADER]: Becoming Leader. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:42.652959 24678 raft_consensus.cc:2468] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 3.
I20260709 12:18:42.653100 24953 consensus_queue.cc:237] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.661489 24425 catalog_manager.cc:5697] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 reported cstate change: term changed from 2 to 3, leader changed from 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195) to bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "bdf86ba745e44d7abf73548b4955ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.666400 24523 raft_consensus.cc:1275] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:42.667984 24904 consensus_queue.cc:1048] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:42.679250 24601 raft_consensus.cc:1275] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:42.681006 24915 consensus_queue.cc:1048] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:42.687443 24529 raft_consensus.cc:1275] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:42.690268 24953 consensus_queue.cc:1048] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:42.704020 24678 raft_consensus.cc:1275] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:18:42.704598 24678 pending_rounds.cc:85] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705: Aborting all ops after (but not including) 3
I20260709 12:18:42.704877 24678 pending_rounds.cc:107] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:18:42.705168 24678 raft_consensus.cc:2889] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:42.706650 24943 consensus_queue.cc:1048] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:42.740854 24529 raft_consensus.cc:3055] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:42.741201 24529 raft_consensus.cc:740] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:42.741900 24529 consensus_queue.cc:260] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:42.742729 24529 raft_consensus.cc:3060] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.746984 24529 raft_consensus.cc:1275] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 6 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:18:42.747251 24529 pending_rounds.cc:85] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e: Aborting all ops after (but not including) 4
I20260709 12:18:42.747449 24529 pending_rounds.cc:107] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:18:42.747648 24529 raft_consensus.cc:2889] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:42.748862 24915 consensus_queue.cc:1048] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:42.757562 24601 raft_consensus.cc:1275] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 6 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:42.759274 24904 consensus_queue.cc:1048] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:42.813258 24963 raft_consensus.cc:993] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705: : Instructing follower bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:42.813712 24963 raft_consensus.cc:1081] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Signalling peer bdf86ba745e44d7abf73548b4955ca62 to start an election
I20260709 12:18:42.815232 24603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32"
dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
 from {username='slave'} at 127.0.0.1:42232
I20260709 12:18:42.815711 24603 raft_consensus.cc:493] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:42.816007 24603 raft_consensus.cc:3060] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:42.820695 24603 raft_consensus.cc:515] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:42.822490 24603 leader_election.cc:290] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 4 election: Requested vote from peers 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065), a640b2d5518848bd858c4584a193862e (127.23.81.193:40293)
I20260709 12:18:42.823251 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:42.823473 24529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1716867e478088f8ee3543db2c32" candidate_uuid: "bdf86ba745e44d7abf73548b4955ca62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a640b2d5518848bd858c4584a193862e"
I20260709 12:18:42.823848 24678 raft_consensus.cc:3055] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:42.823868 24529 raft_consensus.cc:3060] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:42.824277 24678 raft_consensus.cc:740] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:42.825078 24678 consensus_queue.cc:260] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:42.826314 24678 raft_consensus.cc:3060] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:42.828986 24529 raft_consensus.cc:2468] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 4.
I20260709 12:18:42.830268 24568 leader_election.cc:304] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:42.830927 24953 raft_consensus.cc:2804] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:42.831357 24953 raft_consensus.cc:697] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 4 LEADER]: Becoming Leader. State: Replica: bdf86ba745e44d7abf73548b4955ca62, State: Running, Role: LEADER
I20260709 12:18:42.832093 24953 consensus_queue.cc:237] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } }
I20260709 12:18:42.834138 24678 raft_consensus.cc:2468] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf86ba745e44d7abf73548b4955ca62 in term 4.
I20260709 12:18:42.840684 24424 catalog_manager.cc:5697] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 reported cstate change: term changed from 3 to 4, leader changed from 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195) to bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "bdf86ba745e44d7abf73548b4955ca62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.902925 24603 raft_consensus.cc:1275] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 7 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:42.904194 24963 consensus_queue.cc:1048] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:42.912905 24529 raft_consensus.cc:1275] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 7 FOLLOWER]: Refusing update from remote peer 4ae1aa47c53141beb47c32d8cc9bf705: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:18:42.913282 24529 pending_rounds.cc:85] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e: Aborting all ops after (but not including) 5
I20260709 12:18:42.913497 24529 pending_rounds.cc:107] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:18:42.913702 24529 raft_consensus.cc:2889] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:42.915594 24915 consensus_queue.cc:1048] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:43.060303 24678 raft_consensus.cc:1275] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:43.061537 24953 consensus_queue.cc:1048] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:43.071250 24529 raft_consensus.cc:1275] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:43.072746 24971 consensus_queue.cc:1048] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:43.272424 24678 raft_consensus.cc:1275] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:43.273782 24971 consensus_queue.cc:1048] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:43.283968 24529 raft_consensus.cc:1275] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Refusing update from remote peer bdf86ba745e44d7abf73548b4955ca62: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:43.292639 24943 consensus_queue.cc:1048] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:43.363927 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:43.371297 24678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0"
dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
mode: GRACEFUL
new_leader_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:56524
I20260709 12:18:43.371793 24678 raft_consensus.cc:606] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 LEADER]: Received request to transfer leadership to TS a640b2d5518848bd858c4584a193862e
I20260709 12:18:43.372933 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:18:43.373353 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:43.428351 24975 raft_consensus.cc:993] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705: : Instructing follower a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:43.428877 24975 raft_consensus.cc:1081] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 LEADER]: Signalling peer a640b2d5518848bd858c4584a193862e to start an election
I20260709 12:18:43.430562 24529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0"
dest_uuid: "a640b2d5518848bd858c4584a193862e"
 from {username='slave'} at 127.0.0.1:40040
I20260709 12:18:43.431007 24529 raft_consensus.cc:493] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:43.431296 24529 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:43.436053 24529 raft_consensus.cc:515] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:43.438076 24529 leader_election.cc:290] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 5 election: Requested vote from peers bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869), 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195:36065)
I20260709 12:18:43.438575 24603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bdf86ba745e44d7abf73548b4955ca62"
I20260709 12:18:43.439047 24678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151a17f95d47472daa858f74ee3b6ff0" candidate_uuid: "a640b2d5518848bd858c4584a193862e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4ae1aa47c53141beb47c32d8cc9bf705"
I20260709 12:18:43.439205 24603 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:43.439618 24678 raft_consensus.cc:3055] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:43.439973 24678 raft_consensus.cc:740] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4ae1aa47c53141beb47c32d8cc9bf705, State: Running, Role: LEADER
I20260709 12:18:43.440848 24678 consensus_queue.cc:260] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:43.442268 24678 raft_consensus.cc:3060] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:43.444424 24603 raft_consensus.cc:2468] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 5.
I20260709 12:18:43.445509 24492 leader_election.cc:304] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a640b2d5518848bd858c4584a193862e, bdf86ba745e44d7abf73548b4955ca62; no voters: 
I20260709 12:18:43.446165 24938 raft_consensus.cc:2804] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:43.447296 24938 raft_consensus.cc:697] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 5 LEADER]: Becoming Leader. State: Replica: a640b2d5518848bd858c4584a193862e, State: Running, Role: LEADER
I20260709 12:18:43.448165 24938 consensus_queue.cc:237] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } }
I20260709 12:18:43.449252 24678 raft_consensus.cc:2468] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a640b2d5518848bd858c4584a193862e in term 5.
I20260709 12:18:43.455634 24427 catalog_manager.cc:5697] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e reported cstate change: term changed from 4 to 5, leader changed from 4ae1aa47c53141beb47c32d8cc9bf705 (127.23.81.195) to a640b2d5518848bd858c4584a193862e (127.23.81.193). New cstate: current_term: 5 leader_uuid: "a640b2d5518848bd858c4584a193862e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a640b2d5518848bd858c4584a193862e" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:43.960343 24678 raft_consensus.cc:1275] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:43.961524 24938 consensus_queue.cc:1048] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae1aa47c53141beb47c32d8cc9bf705" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:43.968771 24603 raft_consensus.cc:1275] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Refusing update from remote peer a640b2d5518848bd858c4584a193862e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:43.971899 24938 consensus_queue.cc:1048] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf86ba745e44d7abf73548b4955ca62" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:44.374329 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:44.379786 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:44.380155 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:45.381178 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:45.386875 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:45.387300 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:46.388193 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:46.394407 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:46.394829 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:47.396095 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:47.402506 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:47.402978 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:48.403934 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:48.409328 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:48.409798 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:49.446272 23879 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:18:49.447273 23879 tablet_server.cc:179] TabletServer@127.23.81.193:0 shutting down...
W20260709 12:18:49.455142 24642 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:18:49.459678 24642 consensus_peers.cc:597] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 -> Peer a640b2d5518848bd858c4584a193862e (127.23.81.193:40293): Couldn't send request to peer a640b2d5518848bd858c4584a193862e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:49.485203 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:49.486078 23879 tablet_replica.cc:333] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e: stopping tablet replica
I20260709 12:18:49.486843 23879 raft_consensus.cc:2243] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.487566 23879 raft_consensus.cc:2272] T b0db4e02c8904685aa784e7422c1e1ac P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.489639 23879 tablet_replica.cc:333] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e: stopping tablet replica
I20260709 12:18:49.490275 23879 raft_consensus.cc:2243] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.490790 23879 raft_consensus.cc:2272] T e1a4ceb8bdc7477bb602cc692110978a P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.492767 23879 tablet_replica.cc:333] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e: stopping tablet replica
I20260709 12:18:49.493305 23879 raft_consensus.cc:2243] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.493829 23879 raft_consensus.cc:2272] T a94e3f3b9c3f4c139c6c74c47f9f2949 P a640b2d5518848bd858c4584a193862e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.495688 23879 tablet_replica.cc:333] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e: stopping tablet replica
I20260709 12:18:49.496261 23879 raft_consensus.cc:2243] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.496709 23879 raft_consensus.cc:2272] T 95ffb171ca624908b3c089b13ad3ca1e P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.498652 23879 tablet_replica.cc:333] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e: stopping tablet replica
I20260709 12:18:49.499172 23879 raft_consensus.cc:2243] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.499625 23879 raft_consensus.cc:2272] T b8fa1716867e478088f8ee3543db2c32 P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.501521 23879 tablet_replica.cc:333] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e: stopping tablet replica
I20260709 12:18:49.501952 23879 raft_consensus.cc:2243] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.502575 23879 raft_consensus.cc:2272] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.504331 23879 tablet_replica.cc:333] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e: stopping tablet replica
I20260709 12:18:49.504854 23879 raft_consensus.cc:2243] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.505676 23879 raft_consensus.cc:2272] T 2f3727545181403bb8b6103f1c0f6bca P a640b2d5518848bd858c4584a193862e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.507596 23879 tablet_replica.cc:333] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e: stopping tablet replica
I20260709 12:18:49.508082 23879 raft_consensus.cc:2243] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.508708 23879 raft_consensus.cc:2272] T 887341ce0eda47f8a6f1376347b761ed P a640b2d5518848bd858c4584a193862e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.510810 23879 tablet_replica.cc:333] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e: stopping tablet replica
I20260709 12:18:49.511226 23879 raft_consensus.cc:2243] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.511998 23879 raft_consensus.cc:2272] T 95666664078d4d3daf8f40058f52a17d P a640b2d5518848bd858c4584a193862e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.514295 23879 tablet_replica.cc:333] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e: stopping tablet replica
I20260709 12:18:49.514820 23879 raft_consensus.cc:2243] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.515730 23879 raft_consensus.cc:2272] T 151a17f95d47472daa858f74ee3b6ff0 P a640b2d5518848bd858c4584a193862e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.548527 23879 tablet_server.cc:196] TabletServer@127.23.81.193:0 shutdown complete.
I20260709 12:18:49.573544 23879 tablet_server.cc:179] TabletServer@127.23.81.194:0 shutting down...
I20260709 12:18:49.611662 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:49.612587 23879 tablet_replica.cc:333] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62: stopping tablet replica
I20260709 12:18:49.613260 23879 raft_consensus.cc:2243] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.613801 23879 raft_consensus.cc:2272] T b0db4e02c8904685aa784e7422c1e1ac P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.616271 23879 tablet_replica.cc:333] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62: stopping tablet replica
I20260709 12:18:49.617079 23879 raft_consensus.cc:2243] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.617714 23879 raft_consensus.cc:2272] T e1a4ceb8bdc7477bb602cc692110978a P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:49.619624 24641 consensus_peers.cc:597] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 -> Peer bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869): Couldn't send request to peer bdf86ba745e44d7abf73548b4955ca62. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:49.620548 23879 tablet_replica.cc:333] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62: stopping tablet replica
I20260709 12:18:49.621165 23879 raft_consensus.cc:2243] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.621632 23879 raft_consensus.cc:2272] T a94e3f3b9c3f4c139c6c74c47f9f2949 P bdf86ba745e44d7abf73548b4955ca62 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:49.622661 24642 consensus_peers.cc:597] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 -> Peer a640b2d5518848bd858c4584a193862e (127.23.81.193:40293): Couldn't send request to peer a640b2d5518848bd858c4584a193862e. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:40293: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:49.623785 23879 tablet_replica.cc:333] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62: stopping tablet replica
I20260709 12:18:49.624313 23879 raft_consensus.cc:2243] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.625111 23879 raft_consensus.cc:2272] T 95ffb171ca624908b3c089b13ad3ca1e P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.626951 23879 tablet_replica.cc:333] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62: stopping tablet replica
I20260709 12:18:49.627429 23879 raft_consensus.cc:2243] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.628216 23879 raft_consensus.cc:2272] T b8fa1716867e478088f8ee3543db2c32 P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.629949 23879 tablet_replica.cc:333] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62: stopping tablet replica
I20260709 12:18:49.630550 23879 raft_consensus.cc:2243] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.630966 23879 raft_consensus.cc:2272] T 887341ce0eda47f8a6f1376347b761ed P bdf86ba745e44d7abf73548b4955ca62 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.632755 23879 tablet_replica.cc:333] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62: stopping tablet replica
I20260709 12:18:49.633229 23879 raft_consensus.cc:2243] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.633636 23879 raft_consensus.cc:2272] T 151a17f95d47472daa858f74ee3b6ff0 P bdf86ba745e44d7abf73548b4955ca62 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.635345 23879 tablet_replica.cc:333] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62: stopping tablet replica
I20260709 12:18:49.635829 23879 raft_consensus.cc:2243] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.636284 23879 raft_consensus.cc:2272] T 95666664078d4d3daf8f40058f52a17d P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.637924 23879 tablet_replica.cc:333] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62: stopping tablet replica
I20260709 12:18:49.638383 23879 raft_consensus.cc:2243] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.639122 23879 raft_consensus.cc:2272] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P bdf86ba745e44d7abf73548b4955ca62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.640816 23879 tablet_replica.cc:333] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62: stopping tablet replica
I20260709 12:18:49.641239 23879 raft_consensus.cc:2243] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.641667 23879 raft_consensus.cc:2272] T 2f3727545181403bb8b6103f1c0f6bca P bdf86ba745e44d7abf73548b4955ca62 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:49.679633 24641 consensus_peers.cc:597] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 -> Peer bdf86ba745e44d7abf73548b4955ca62 (127.23.81.194:36869): Couldn't send request to peer bdf86ba745e44d7abf73548b4955ca62. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:36869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:49.690738 23879 tablet_server.cc:196] TabletServer@127.23.81.194:0 shutdown complete.
I20260709 12:18:49.710115 23879 tablet_server.cc:179] TabletServer@127.23.81.195:0 shutting down...
I20260709 12:18:49.743736 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:49.744614 23879 tablet_replica.cc:333] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705: stopping tablet replica
I20260709 12:18:49.745532 23879 raft_consensus.cc:2243] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.746614 23879 raft_consensus.cc:2272] T b0db4e02c8904685aa784e7422c1e1ac P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:49.746904 24642 consensus_peers.cc:597] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 -> Peer a640b2d5518848bd858c4584a193862e (127.23.81.193:40293): Couldn't send request to peer a640b2d5518848bd858c4584a193862e. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:40293: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:49.748890 23879 tablet_replica.cc:333] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705: stopping tablet replica
I20260709 12:18:49.749480 23879 raft_consensus.cc:2243] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.750000 23879 raft_consensus.cc:2272] T 95ffb171ca624908b3c089b13ad3ca1e P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.752053 23879 tablet_replica.cc:333] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705: stopping tablet replica
I20260709 12:18:49.752548 23879 raft_consensus.cc:2243] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.753305 23879 raft_consensus.cc:2272] T e1a4ceb8bdc7477bb602cc692110978a P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.755131 23879 tablet_replica.cc:333] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705: stopping tablet replica
I20260709 12:18:49.755602 23879 raft_consensus.cc:2243] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.756340 23879 raft_consensus.cc:2272] T a94e3f3b9c3f4c139c6c74c47f9f2949 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.758234 23879 tablet_replica.cc:333] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705: stopping tablet replica
I20260709 12:18:49.758708 23879 raft_consensus.cc:2243] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.759460 23879 raft_consensus.cc:2272] T 887341ce0eda47f8a6f1376347b761ed P 4ae1aa47c53141beb47c32d8cc9bf705 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.761394 23879 tablet_replica.cc:333] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705: stopping tablet replica
I20260709 12:18:49.761878 23879 raft_consensus.cc:2243] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.762394 23879 raft_consensus.cc:2272] T ebead0c6f5b34bb8bb1b8cbfdf696b29 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.764221 23879 tablet_replica.cc:333] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705: stopping tablet replica
I20260709 12:18:49.764698 23879 raft_consensus.cc:2243] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.765136 23879 raft_consensus.cc:2272] T 2f3727545181403bb8b6103f1c0f6bca P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.767082 23879 tablet_replica.cc:333] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705: stopping tablet replica
I20260709 12:18:49.767518 23879 raft_consensus.cc:2243] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.767901 23879 raft_consensus.cc:2272] T 151a17f95d47472daa858f74ee3b6ff0 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.769721 23879 tablet_replica.cc:333] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705: stopping tablet replica
I20260709 12:18:49.770265 23879 raft_consensus.cc:2243] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.770663 23879 raft_consensus.cc:2272] T 95666664078d4d3daf8f40058f52a17d P 4ae1aa47c53141beb47c32d8cc9bf705 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.772374 23879 tablet_replica.cc:333] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705: stopping tablet replica
I20260709 12:18:49.772783 23879 raft_consensus.cc:2243] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.773371 23879 raft_consensus.cc:2272] T b8fa1716867e478088f8ee3543db2c32 P 4ae1aa47c53141beb47c32d8cc9bf705 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.821831 23879 tablet_server.cc:196] TabletServer@127.23.81.195:0 shutdown complete.
I20260709 12:18:49.844791 23879 master.cc:562] Master@127.23.81.254:36037 shutting down...
I20260709 12:18:49.867431 23879 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.868064 23879 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.868405 23879 tablet_replica.cc:333] T 00000000000000000000000000000000 P e5f4cf008279476aacb155c22b267be4: stopping tablet replica
I20260709 12:18:49.910342 23879 master.cc:584] Master@127.23.81.254:36037 shutdown complete.
4ae1aa47c53141beb47c32d8cc9bf705  1
a640b2d5518848bd858c4584a193862e  5
bdf86ba745e44d7abf73548b4955ca62  4
4ae1aa47c53141beb47c32d8cc9bf705  3
a640b2d5518848bd858c4584a193862e  3
bdf86ba745e44d7abf73548b4955ca62  4
4ae1aa47c53141beb47c32d8cc9bf705  1
a640b2d5518848bd858c4584a193862e  8
bdf86ba745e44d7abf73548b4955ca62  1
4ae1aa47c53141beb47c32d8cc9bf705  4
a640b2d5518848bd858c4584a193862e  3
bdf86ba745e44d7abf73548b4955ca62  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (30610 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:18:49.959815 23879 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.81.254:44087
I20260709 12:18:49.961035 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:49.967484 25000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:49.968482 25003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:49.969305 25001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:49.969574 23879 server_base.cc:1061] running on GCE node
I20260709 12:18:49.970709 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:49.970932 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:49.971110 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599529971093 us; error 0 us; skew 500 ppm
I20260709 12:18:49.971680 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:49.974440 23879 webserver.cc:533] Webserver started at http://127.23.81.254:34647/ using document root <none> and password file <none>
I20260709 12:18:49.974938 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:49.975152 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:49.975442 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:49.976652 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/master-0-root/instance:
uuid: "2d05ccaaf1604ba0be2f6d54385e7ce3"
format_stamp: "Formatted at 2026-07-09 12:18:49 on dist-test-slave-mprf"
I20260709 12:18:49.981374 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:18:49.984762 25008 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:49.985512 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:18:49.985790 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/master-0-root
uuid: "2d05ccaaf1604ba0be2f6d54385e7ce3"
format_stamp: "Formatted at 2026-07-09 12:18:49 on dist-test-slave-mprf"
I20260709 12:18:49.986127 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:50.001443 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:50.002763 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:50.041988 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.254:44087
I20260709 12:18:50.042301 25059 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.254:44087 every 8 connection(s)
I20260709 12:18:50.046228 25060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.057039 25060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Bootstrap starting.
I20260709 12:18:50.062279 25060 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.066906 25060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: No bootstrap required, opened a new log
I20260709 12:18:50.069372 25060 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d05ccaaf1604ba0be2f6d54385e7ce3" member_type: VOTER }
I20260709 12:18:50.069847 25060 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.070073 25060 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d05ccaaf1604ba0be2f6d54385e7ce3, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.070634 25060 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d05ccaaf1604ba0be2f6d54385e7ce3" member_type: VOTER }
I20260709 12:18:50.071089 25060 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:50.071298 25060 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:50.071547 25060 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.076148 25060 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d05ccaaf1604ba0be2f6d54385e7ce3" member_type: VOTER }
I20260709 12:18:50.076675 25060 leader_election.cc:304] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d05ccaaf1604ba0be2f6d54385e7ce3; no voters: 
I20260709 12:18:50.077852 25060 leader_election.cc:290] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:50.078329 25063 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.079813 25063 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [term 1 LEADER]: Becoming Leader. State: Replica: 2d05ccaaf1604ba0be2f6d54385e7ce3, State: Running, Role: LEADER
I20260709 12:18:50.080576 25063 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d05ccaaf1604ba0be2f6d54385e7ce3" member_type: VOTER }
I20260709 12:18:50.081283 25060 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:50.086279 25065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d05ccaaf1604ba0be2f6d54385e7ce3. Latest consensus state: current_term: 1 leader_uuid: "2d05ccaaf1604ba0be2f6d54385e7ce3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d05ccaaf1604ba0be2f6d54385e7ce3" member_type: VOTER } }
I20260709 12:18:50.086853 25064 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d05ccaaf1604ba0be2f6d54385e7ce3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d05ccaaf1604ba0be2f6d54385e7ce3" member_type: VOTER } }
I20260709 12:18:50.087168 25065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:50.087373 25064 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:50.089349 25070 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:50.094401 25070 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:50.098567 23879 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:50.103665 25070 catalog_manager.cc:1383] Generated new cluster ID: 2da3455e929f4ecbb83acfcb95e5fddf
I20260709 12:18:50.103973 25070 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:50.123669 25070 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:50.125047 25070 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:50.144734 25070 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Generated new TSK 0
I20260709 12:18:50.145361 25070 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:50.165071 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:50.171904 25081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:50.172720 25082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:50.174415 25084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:50.175244 23879 server_base.cc:1061] running on GCE node
I20260709 12:18:50.176447 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:50.176688 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:50.176919 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599530176876 us; error 0 us; skew 500 ppm
I20260709 12:18:50.177556 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:50.180079 23879 webserver.cc:533] Webserver started at http://127.23.81.193:39433/ using document root <none> and password file <none>
I20260709 12:18:50.180616 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:50.180845 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:50.181154 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:50.182490 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/instance:
uuid: "897be935c42e41b995f177155b042be0"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-mprf"
I20260709 12:18:50.187487 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:18:50.191255 25089 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.192165 23879 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:18:50.192493 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root
uuid: "897be935c42e41b995f177155b042be0"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-mprf"
I20260709 12:18:50.192800 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:50.207074 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:50.208464 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:50.210139 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:50.212633 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:50.212832 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.213173 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:50.213349 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.257143 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.193:46409
I20260709 12:18:50.257225 25151 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.193:46409 every 8 connection(s)
I20260709 12:18:50.262526 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:50.270423 25156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:50.273039 25157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:50.274485 23879 server_base.cc:1061] running on GCE node
W20260709 12:18:50.275427 25159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:50.276526 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:50.276798 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:50.276994 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599530276976 us; error 0 us; skew 500 ppm
I20260709 12:18:50.277560 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:50.278220 25152 heartbeater.cc:344] Connected to a master server at 127.23.81.254:44087
I20260709 12:18:50.278676 25152 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:50.279603 25152 heartbeater.cc:507] Master 127.23.81.254:44087 requested a full tablet report, sending...
I20260709 12:18:50.280385 23879 webserver.cc:533] Webserver started at http://127.23.81.194:46361/ using document root <none> and password file <none>
I20260709 12:18:50.280959 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:50.281177 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:50.281481 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:50.282274 25025 ts_manager.cc:194] Registered new tserver with Master: 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:18:50.283074 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/instance:
uuid: "b83c12959b9848b3b7bbc680f5ee6225"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-mprf"
I20260709 12:18:50.284694 25025 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41752
I20260709 12:18:50.289072 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:18:50.292634 25164 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.293419 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:18:50.293746 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root
uuid: "b83c12959b9848b3b7bbc680f5ee6225"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-mprf"
I20260709 12:18:50.294158 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:50.312618 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:50.313978 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:50.315532 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:50.317754 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:50.317996 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.318318 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:50.318495 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.359926 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.194:43905
I20260709 12:18:50.360040 25226 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.194:43905 every 8 connection(s)
I20260709 12:18:50.364614 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:50.371657 25230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:50.373056 25231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:50.376331 25227 heartbeater.cc:344] Connected to a master server at 127.23.81.254:44087
I20260709 12:18:50.376348 23879 server_base.cc:1061] running on GCE node
I20260709 12:18:50.376845 25227 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:50.377741 25227 heartbeater.cc:507] Master 127.23.81.254:44087 requested a full tablet report, sending...
W20260709 12:18:50.378177 25233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:50.379156 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:50.379424 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:50.379629 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599530379610 us; error 0 us; skew 500 ppm
I20260709 12:18:50.379916 25025 ts_manager.cc:194] Registered new tserver with Master: b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:50.380375 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:50.381856 25025 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41756
I20260709 12:18:50.383491 23879 webserver.cc:533] Webserver started at http://127.23.81.195:41801/ using document root <none> and password file <none>
I20260709 12:18:50.384021 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:50.384250 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:50.384521 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:50.385675 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/instance:
uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-mprf"
I20260709 12:18:50.390221 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:18:50.393467 25238 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.394335 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:18:50.394661 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root
uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-mprf"
I20260709 12:18:50.394925 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:50.409401 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:50.410723 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:50.412248 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:50.414577 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:50.414816 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.415078 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:50.415263 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.454941 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.195:44749
I20260709 12:18:50.455039 25300 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.195:44749 every 8 connection(s)
I20260709 12:18:50.468824 25301 heartbeater.cc:344] Connected to a master server at 127.23.81.254:44087
I20260709 12:18:50.469219 25301 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:50.469892 25301 heartbeater.cc:507] Master 127.23.81.254:44087 requested a full tablet report, sending...
I20260709 12:18:50.471937 25025 ts_manager.cc:194] Registered new tserver with Master: 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:50.472564 23879 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014403055s
I20260709 12:18:50.473456 25025 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41770
I20260709 12:18:50.499809 25025 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41778:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:50.505968 25025 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:50.719957 25116 tablet_service.cc:1511] Processing CreateTablet for tablet 6c6268d5c5e547b0b77e42ede61314e1 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:18:50.721511 25116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6268d5c5e547b0b77e42ede61314e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.721131 25113 tablet_service.cc:1511] Processing CreateTablet for tablet 78607220ddf2470a80cefc5d012e7625 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:18:50.722705 25113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78607220ddf2470a80cefc5d012e7625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.723263 25114 tablet_service.cc:1511] Processing CreateTablet for tablet 783cdcb70b0d4499b94b2f51672f6895 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:18:50.724678 25114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783cdcb70b0d4499b94b2f51672f6895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.724432 25266 tablet_service.cc:1511] Processing CreateTablet for tablet 392ec479375b41bbb38793a0c207912d (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:18:50.725739 25266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 392ec479375b41bbb38793a0c207912d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.727245 25265 tablet_service.cc:1511] Processing CreateTablet for tablet 6c6268d5c5e547b0b77e42ede61314e1 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:18:50.728634 25265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6268d5c5e547b0b77e42ede61314e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.728780 25112 tablet_service.cc:1511] Processing CreateTablet for tablet d683b7b361f44f7cb6076cf5ac95611b (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:18:50.730257 25112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d683b7b361f44f7cb6076cf5ac95611b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.731207 25264 tablet_service.cc:1511] Processing CreateTablet for tablet e7e59abaef5845e2bb8f466331bb98c3 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:18:50.732568 25264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e59abaef5845e2bb8f466331bb98c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.735976 25262 tablet_service.cc:1511] Processing CreateTablet for tablet 78607220ddf2470a80cefc5d012e7625 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:18:50.736682 25111 tablet_service.cc:1511] Processing CreateTablet for tablet 951ec28047e64bb7a386c7d66a082fd0 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:18:50.737387 25262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78607220ddf2470a80cefc5d012e7625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.738169 25111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951ec28047e64bb7a386c7d66a082fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.739238 25261 tablet_service.cc:1511] Processing CreateTablet for tablet d683b7b361f44f7cb6076cf5ac95611b (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:18:50.740124 25259 tablet_service.cc:1511] Processing CreateTablet for tablet b0e4085b9c3e4704891292cf0881ea14 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:18:50.740639 25261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d683b7b361f44f7cb6076cf5ac95611b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.741444 25259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e4085b9c3e4704891292cf0881ea14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.742820 25260 tablet_service.cc:1511] Processing CreateTablet for tablet 951ec28047e64bb7a386c7d66a082fd0 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:18:50.744146 25260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951ec28047e64bb7a386c7d66a082fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.745067 25110 tablet_service.cc:1511] Processing CreateTablet for tablet b0e4085b9c3e4704891292cf0881ea14 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:18:50.746745 25110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e4085b9c3e4704891292cf0881ea14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.747725 25117 tablet_service.cc:1511] Processing CreateTablet for tablet 392ec479375b41bbb38793a0c207912d (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:18:50.749053 25117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 392ec479375b41bbb38793a0c207912d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.751016 25115 tablet_service.cc:1511] Processing CreateTablet for tablet e7e59abaef5845e2bb8f466331bb98c3 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:18:50.751410 25109 tablet_service.cc:1511] Processing CreateTablet for tablet 81fec2cd07604cab87091a034eba2f38 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:18:50.752789 25115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e59abaef5845e2bb8f466331bb98c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.753752 25109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81fec2cd07604cab87091a034eba2f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.754671 25263 tablet_service.cc:1511] Processing CreateTablet for tablet 783cdcb70b0d4499b94b2f51672f6895 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:18:50.756520 25263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783cdcb70b0d4499b94b2f51672f6895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.760289 25258 tablet_service.cc:1511] Processing CreateTablet for tablet 81fec2cd07604cab87091a034eba2f38 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:18:50.762847 25258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81fec2cd07604cab87091a034eba2f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.770958 25257 tablet_service.cc:1511] Processing CreateTablet for tablet b1e3b9e5896c4b539daf785219debb12 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:18:50.772481 25257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e3b9e5896c4b539daf785219debb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.778258 25108 tablet_service.cc:1511] Processing CreateTablet for tablet b1e3b9e5896c4b539daf785219debb12 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:18:50.780149 25108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e3b9e5896c4b539daf785219debb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.821612 25266 tablet_service.cc:1511] Processing CreateTablet for tablet 3552726c022345b394b69265b8f3b566 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:18:50.823048 25266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3552726c022345b394b69265b8f3b566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.832818 25192 tablet_service.cc:1511] Processing CreateTablet for tablet 392ec479375b41bbb38793a0c207912d (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:18:50.834187 25192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 392ec479375b41bbb38793a0c207912d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.837301 25191 tablet_service.cc:1511] Processing CreateTablet for tablet 6c6268d5c5e547b0b77e42ede61314e1 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:18:50.838886 25112 tablet_service.cc:1511] Processing CreateTablet for tablet 3552726c022345b394b69265b8f3b566 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:18:50.839120 25190 tablet_service.cc:1511] Processing CreateTablet for tablet e7e59abaef5845e2bb8f466331bb98c3 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:18:50.840171 25112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3552726c022345b394b69265b8f3b566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.840363 25190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e59abaef5845e2bb8f466331bb98c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.842494 25184 tablet_service.cc:1511] Processing CreateTablet for tablet 81fec2cd07604cab87091a034eba2f38 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:18:50.843215 25189 tablet_service.cc:1511] Processing CreateTablet for tablet 783cdcb70b0d4499b94b2f51672f6895 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:18:50.843884 25184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81fec2cd07604cab87091a034eba2f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.844534 25189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783cdcb70b0d4499b94b2f51672f6895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.846992 25185 tablet_service.cc:1511] Processing CreateTablet for tablet b0e4085b9c3e4704891292cf0881ea14 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:18:50.847501 25188 tablet_service.cc:1511] Processing CreateTablet for tablet 78607220ddf2470a80cefc5d012e7625 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:18:50.852087 25183 tablet_service.cc:1511] Processing CreateTablet for tablet b1e3b9e5896c4b539daf785219debb12 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:18:50.848378 25185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e4085b9c3e4704891292cf0881ea14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.861729 25186 tablet_service.cc:1511] Processing CreateTablet for tablet 951ec28047e64bb7a386c7d66a082fd0 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:18:50.863015 25260 tablet_service.cc:1511] Processing CreateTablet for tablet e81b9ed959214538853077eddd8dc8ea (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:18:50.864516 25260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81b9ed959214538853077eddd8dc8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.865072 25187 tablet_service.cc:1511] Processing CreateTablet for tablet d683b7b361f44f7cb6076cf5ac95611b (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:18:50.870512 25191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6268d5c5e547b0b77e42ede61314e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.872468 25117 tablet_service.cc:1511] Processing CreateTablet for tablet e72fd84f77df4beba49c7d81e1b26f8e (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:18:50.874495 25117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72fd84f77df4beba49c7d81e1b26f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.885181 25259 tablet_service.cc:1511] Processing CreateTablet for tablet e72fd84f77df4beba49c7d81e1b26f8e (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:18:50.886881 25259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72fd84f77df4beba49c7d81e1b26f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.889320 25257 tablet_service.cc:1511] Processing CreateTablet for tablet dba87711b0ab4e3394481dfecfeb886e (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:18:50.890807 25257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba87711b0ab4e3394481dfecfeb886e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.891752 25188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78607220ddf2470a80cefc5d012e7625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.891921 25261 tablet_service.cc:1511] Processing CreateTablet for tablet 6e78737bee66450b9a076cc9676331b9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:18:50.896624 25187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d683b7b361f44f7cb6076cf5ac95611b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.899942 25186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951ec28047e64bb7a386c7d66a082fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.926705 25183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e3b9e5896c4b539daf785219debb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.927098 25260 tablet_service.cc:1511] Processing CreateTablet for tablet 724a325f5a004fdab6dc4a9bcba2a3e9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:18:50.846372 25113 tablet_service.cc:1511] Processing CreateTablet for tablet e81b9ed959214538853077eddd8dc8ea (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:18:50.934778 25261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e78737bee66450b9a076cc9676331b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.946291 25260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724a325f5a004fdab6dc4a9bcba2a3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.947901 25114 tablet_service.cc:1511] Processing CreateTablet for tablet 6e78737bee66450b9a076cc9676331b9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:18:50.949236 25114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e78737bee66450b9a076cc9676331b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.950615 25113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81b9ed959214538853077eddd8dc8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.947912 25112 tablet_service.cc:1511] Processing CreateTablet for tablet dba87711b0ab4e3394481dfecfeb886e (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:18:50.959549 25112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba87711b0ab4e3394481dfecfeb886e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.960752 25108 tablet_service.cc:1511] Processing CreateTablet for tablet bddb65a99b5c44038087d76d815e3abf (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:18:50.961982 25108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddb65a99b5c44038087d76d815e3abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.958097 25317 tablet_bootstrap.cc:492] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:50.972369 25115 tablet_service.cc:1511] Processing CreateTablet for tablet b73f31d21bb0468893aa53b0dcaf3e60 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:18:50.972764 25187 tablet_service.cc:1511] Processing CreateTablet for tablet 3552726c022345b394b69265b8f3b566 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:18:50.973685 25115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73f31d21bb0468893aa53b0dcaf3e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.974164 25187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3552726c022345b394b69265b8f3b566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.967578 25111 tablet_service.cc:1511] Processing CreateTablet for tablet 504eece31eb848cc80169ecf5ab51b9a (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:18:50.976588 25317 tablet_bootstrap.cc:654] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.976919 25111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504eece31eb848cc80169ecf5ab51b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.988406 25190 tablet_service.cc:1511] Processing CreateTablet for tablet e81b9ed959214538853077eddd8dc8ea (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:18:50.998912 25316 tablet_bootstrap.cc:492] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:51.002875 25262 tablet_service.cc:1511] Processing CreateTablet for tablet 504eece31eb848cc80169ecf5ab51b9a (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:18:51.006209 25262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504eece31eb848cc80169ecf5ab51b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.005991 25185 tablet_service.cc:1511] Processing CreateTablet for tablet e72fd84f77df4beba49c7d81e1b26f8e (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:18:51.009316 25188 tablet_service.cc:1511] Processing CreateTablet for tablet dba87711b0ab4e3394481dfecfeb886e (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:18:51.013159 25259 tablet_service.cc:1511] Processing CreateTablet for tablet b73f31d21bb0468893aa53b0dcaf3e60 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:18:51.014479 25259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73f31d21bb0468893aa53b0dcaf3e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.020412 25263 tablet_service.cc:1511] Processing CreateTablet for tablet 4fb0b452100949b58ad2bf4a4aed36fa (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:18:51.020970 25110 tablet_service.cc:1511] Processing CreateTablet for tablet 724a325f5a004fdab6dc4a9bcba2a3e9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:18:51.015749 25117 tablet_service.cc:1511] Processing CreateTablet for tablet 4fb0b452100949b58ad2bf4a4aed36fa (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:18:51.028861 25263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fb0b452100949b58ad2bf4a4aed36fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.030616 25258 tablet_service.cc:1511] Processing CreateTablet for tablet bddb65a99b5c44038087d76d815e3abf (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:18:51.033193 25258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddb65a99b5c44038087d76d815e3abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.052693 25186 tablet_service.cc:1511] Processing CreateTablet for tablet 6e78737bee66450b9a076cc9676331b9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:18:51.056427 25110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724a325f5a004fdab6dc4a9bcba2a3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.058756 25117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fb0b452100949b58ad2bf4a4aed36fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.060668 25190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81b9ed959214538853077eddd8dc8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.066802 25115 tablet_service.cc:1511] Processing CreateTablet for tablet 9d246e87571b4365a1d11d98c7455fb9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:18:51.068339 25115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d246e87571b4365a1d11d98c7455fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.074697 25188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba87711b0ab4e3394481dfecfeb886e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.075109 25183 tablet_service.cc:1511] Processing CreateTablet for tablet 724a325f5a004fdab6dc4a9bcba2a3e9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:18:51.075928 25185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72fd84f77df4beba49c7d81e1b26f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.080480 25317 tablet_bootstrap.cc:492] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:51.081333 25317 ts_tablet_manager.cc:1403] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.147s	user 0.016s	sys 0.022s
I20260709 12:18:51.082753 25189 tablet_service.cc:1511] Processing CreateTablet for tablet b73f31d21bb0468893aa53b0dcaf3e60 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:18:51.084815 25187 tablet_service.cc:1511] Processing CreateTablet for tablet 4fb0b452100949b58ad2bf4a4aed36fa (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:18:51.084898 25317 raft_consensus.cc:359] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.085728 25317 raft_consensus.cc:385] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:18:51.093421 25073 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:51.094285 25192 tablet_service.cc:1511] Processing CreateTablet for tablet 504eece31eb848cc80169ecf5ab51b9a (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:18:51.096580 25191 tablet_service.cc:1511] Processing CreateTablet for tablet bddb65a99b5c44038087d76d815e3abf (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:18:51.097982 25316 tablet_bootstrap.cc:654] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.104291 25184 tablet_service.cc:1511] Processing CreateTablet for tablet 9d246e87571b4365a1d11d98c7455fb9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:18:51.110786 25258 tablet_service.cc:1511] Processing CreateTablet for tablet c0821374625d4793801ab3b3f502714e (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:18:51.112162 25258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0821374625d4793801ab3b3f502714e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.110940 25257 tablet_service.cc:1511] Processing CreateTablet for tablet 9d246e87571b4365a1d11d98c7455fb9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:18:51.116752 25257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d246e87571b4365a1d11d98c7455fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.122313 25186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e78737bee66450b9a076cc9676331b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.123131 25183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724a325f5a004fdab6dc4a9bcba2a3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.123155 25108 tablet_service.cc:1511] Processing CreateTablet for tablet c0821374625d4793801ab3b3f502714e (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:18:51.125108 25108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0821374625d4793801ab3b3f502714e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.126796 25318 tablet_bootstrap.cc:492] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:51.127355 25187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fb0b452100949b58ad2bf4a4aed36fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.134502 25189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73f31d21bb0468893aa53b0dcaf3e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.138116 25317 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.139178 25317 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.142347 25191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddb65a99b5c44038087d76d815e3abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.151467 25192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504eece31eb848cc80169ecf5ab51b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.151660 25266 tablet_service.cc:1511] Processing CreateTablet for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:18:51.153369 25266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.153604 25184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d246e87571b4365a1d11d98c7455fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.154495 25111 tablet_service.cc:1511] Processing CreateTablet for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:18:51.155805 25111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.157320 25316 tablet_bootstrap.cc:492] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:51.157812 25316 ts_tablet_manager.cc:1403] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.159s	user 0.006s	sys 0.008s
I20260709 12:18:51.159041 25152 heartbeater.cc:499] Master 127.23.81.254:44087 was elected leader, sending a full tablet report...
I20260709 12:18:51.160110 25317 ts_tablet_manager.cc:1434] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 12:18:51.161141 25317 tablet_bootstrap.cc:492] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:51.175463 25316 raft_consensus.cc:359] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.176299 25316 raft_consensus.cc:385] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.178511 25316 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.179317 25190 tablet_service.cc:1511] Processing CreateTablet for tablet c0821374625d4793801ab3b3f502714e (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:18:51.180218 25115 tablet_service.cc:1511] Processing CreateTablet for tablet b86f3fbaedb441bfa448cef75c5e613f (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:18:51.181272 25190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0821374625d4793801ab3b3f502714e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.181471 25115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86f3fbaedb441bfa448cef75c5e613f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.181699 25318 tablet_bootstrap.cc:654] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.189056 25258 tablet_service.cc:1511] Processing CreateTablet for tablet b86f3fbaedb441bfa448cef75c5e613f (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:18:51.190223 25187 tablet_service.cc:1511] Processing CreateTablet for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:18:51.190970 25113 tablet_service.cc:1511] Processing CreateTablet for tablet 3bde194ca9e544f1befacd3ad39463a2 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:18:51.191077 25183 tablet_service.cc:1511] Processing CreateTablet for tablet b86f3fbaedb441bfa448cef75c5e613f (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:18:51.191814 25317 tablet_bootstrap.cc:654] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.192243 25113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bde194ca9e544f1befacd3ad39463a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.192813 25187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.195182 25183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86f3fbaedb441bfa448cef75c5e613f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.198050 25263 tablet_service.cc:1511] Processing CreateTablet for tablet 3bde194ca9e544f1befacd3ad39463a2 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:18:51.199692 25263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bde194ca9e544f1befacd3ad39463a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.181921 25316 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.225741 25316 ts_tablet_manager.cc:1434] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 12:18:51.226219 25262 tablet_service.cc:1511] Processing CreateTablet for tablet 6b13f2e891f348229e95286682b88911 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:18:51.234472 25301 heartbeater.cc:499] Master 127.23.81.254:44087 was elected leader, sending a full tablet report...
I20260709 12:18:51.223760 25258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86f3fbaedb441bfa448cef75c5e613f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.234300 25110 tablet_service.cc:1511] Processing CreateTablet for tablet 6b13f2e891f348229e95286682b88911 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:18:51.237469 25110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b13f2e891f348229e95286682b88911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.242621 25316 tablet_bootstrap.cc:492] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:51.251669 25117 tablet_service.cc:1511] Processing CreateTablet for tablet a2a57280b61f41a6afa7fea941bb108c (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:18:51.252264 25257 tablet_service.cc:1511] Processing CreateTablet for tablet a2a57280b61f41a6afa7fea941bb108c (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:18:51.253551 25117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a57280b61f41a6afa7fea941bb108c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.255232 25114 tablet_service.cc:1511] Processing CreateTablet for tablet aaeb230a0f814ad1849053d7a19c90d6 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:18:51.256476 25114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaeb230a0f814ad1849053d7a19c90d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.258358 25262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b13f2e891f348229e95286682b88911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.260865 25184 tablet_service.cc:1511] Processing CreateTablet for tablet a2a57280b61f41a6afa7fea941bb108c (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:18:51.261759 25257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a57280b61f41a6afa7fea941bb108c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:51.262274 25153 tablet.cc:2406] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:18:51.266782 25184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a57280b61f41a6afa7fea941bb108c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.276026 25316 tablet_bootstrap.cc:654] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.287189 25185 tablet_service.cc:1511] Processing CreateTablet for tablet 6b13f2e891f348229e95286682b88911 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:18:51.308581 25321 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.309113 25321 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.311762 25321 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:51.274987 25188 tablet_service.cc:1511] Processing CreateTablet for tablet aaeb230a0f814ad1849053d7a19c90d6 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:18:51.344321 25317 tablet_bootstrap.cc:492] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:51.345052 25317 ts_tablet_manager.cc:1403] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.184s	user 0.023s	sys 0.036s
I20260709 12:18:51.348762 25263 tablet_service.cc:1511] Processing CreateTablet for tablet aaeb230a0f814ad1849053d7a19c90d6 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:18:51.350188 25263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaeb230a0f814ad1849053d7a19c90d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.353420 25322 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.355104 25322 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.358408 25318 tablet_bootstrap.cc:492] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:51.349726 25317 raft_consensus.cc:359] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.379727 25318 ts_tablet_manager.cc:1403] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.253s	user 0.011s	sys 0.010s
I20260709 12:18:51.380862 25322 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:51.382154 25260 tablet_service.cc:1511] Processing CreateTablet for tablet 08989457946a4946811751dc96e31276 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:18:51.383149 25183 tablet_service.cc:1511] Processing CreateTablet for tablet 08989457946a4946811751dc96e31276 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:18:51.383941 25259 tablet_service.cc:1511] Processing CreateTablet for tablet 1081a743e5e04f24a0aebd684da3a15d (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:18:51.384917 25227 heartbeater.cc:499] Master 127.23.81.254:44087 was elected leader, sending a full tablet report...
I20260709 12:18:51.385325 25191 tablet_service.cc:1511] Processing CreateTablet for tablet 1081a743e5e04f24a0aebd684da3a15d (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:18:51.394381 25316 tablet_bootstrap.cc:492] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:51.328718 25186 tablet_service.cc:1511] Processing CreateTablet for tablet 3bde194ca9e544f1befacd3ad39463a2 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:18:51.410843 25188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaeb230a0f814ad1849053d7a19c90d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.411445 25183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08989457946a4946811751dc96e31276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.414369 25191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1081a743e5e04f24a0aebd684da3a15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.418499 25316 ts_tablet_manager.cc:1403] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.176s	user 0.022s	sys 0.025s
I20260709 12:18:51.423938 25260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08989457946a4946811751dc96e31276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.424695 25259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1081a743e5e04f24a0aebd684da3a15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.432324 25185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b13f2e891f348229e95286682b88911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.435549 25115 tablet_service.cc:1511] Processing CreateTablet for tablet 08989457946a4946811751dc96e31276 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:18:51.437464 25115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08989457946a4946811751dc96e31276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.438613 25266 tablet_service.cc:1511] Processing CreateTablet for tablet 289cd948a1764490bf11226eedd2c4c7 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:18:51.442971 25186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bde194ca9e544f1befacd3ad39463a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.444219 25187 tablet_service.cc:1511] Processing CreateTablet for tablet 289cd948a1764490bf11226eedd2c4c7 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:18:51.451213 25187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289cd948a1764490bf11226eedd2c4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.445245 25316 raft_consensus.cc:359] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.453985 25316 raft_consensus.cc:385] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.454365 25316 raft_consensus.cc:740] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.455417 25266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289cd948a1764490bf11226eedd2c4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.455173 25316 consensus_queue.cc:260] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.456744 25117 tablet_service.cc:1511] Processing CreateTablet for tablet 289cd948a1764490bf11226eedd2c4c7 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:18:51.458078 25117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289cd948a1764490bf11226eedd2c4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.461660 25316 ts_tablet_manager.cc:1434] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 12:18:51.462673 25316 tablet_bootstrap.cc:492] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:51.396764 25317 raft_consensus.cc:385] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.465541 25317 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.466743 25317 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.475569 25317 ts_tablet_manager.cc:1434] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.130s	user 0.011s	sys 0.000s
I20260709 12:18:51.476945 25317 tablet_bootstrap.cc:492] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:51.481089 25316 tablet_bootstrap.cc:654] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.485450 25111 tablet_service.cc:1511] Processing CreateTablet for tablet b1d4aa6fab2741dda3fcae71491a229a (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:18:51.486763 25111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d4aa6fab2741dda3fcae71491a229a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.492648 25190 tablet_service.cc:1511] Processing CreateTablet for tablet b1d4aa6fab2741dda3fcae71491a229a (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:18:51.433929 25318 raft_consensus.cc:359] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.494504 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:51.495023 25189 tablet_service.cc:1511] Processing CreateTablet for tablet 47f83e7883b540d9907ceefaa443f104 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:18:51.493937 25190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d4aa6fab2741dda3fcae71491a229a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:51.496634 25090 leader_election.cc:343] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:51.498332 25189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f83e7883b540d9907ceefaa443f104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.492540 25262 tablet_service.cc:1511] Processing CreateTablet for tablet 47f83e7883b540d9907ceefaa443f104 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:18:51.507826 25108 tablet_service.cc:1511] Processing CreateTablet for tablet 47f83e7883b540d9907ceefaa443f104 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:18:51.510792 25108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f83e7883b540d9907ceefaa443f104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.511446 25262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f83e7883b540d9907ceefaa443f104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.493964 25318 raft_consensus.cc:385] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.533402 25317 tablet_bootstrap.cc:654] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.534052 25318 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.539196 25318 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.549027 25112 tablet_service.cc:1511] Processing CreateTablet for tablet c880ab05f6e24c9881bbc8954e0d9030 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:18:51.550483 25112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c880ab05f6e24c9881bbc8954e0d9030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.556761 25257 tablet_service.cc:1511] Processing CreateTablet for tablet c880ab05f6e24c9881bbc8954e0d9030 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:18:51.559832 25257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c880ab05f6e24c9881bbc8954e0d9030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.559588 25109 tablet_service.cc:1511] Processing CreateTablet for tablet fd7e49fd52d74821a66c7dbbc770a988 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:18:51.571022 25258 tablet_service.cc:1511] Processing CreateTablet for tablet b1d4aa6fab2741dda3fcae71491a229a (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:18:51.571765 25265 tablet_service.cc:1511] Processing CreateTablet for tablet fd7e49fd52d74821a66c7dbbc770a988 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:18:51.574105 25113 tablet_service.cc:1511] Processing CreateTablet for tablet 1081a743e5e04f24a0aebd684da3a15d (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:18:51.577473 25116 tablet_service.cc:1511] Processing CreateTablet for tablet 6afd466aa7a2455fa2f85263e303ec0f (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:18:51.583876 25322 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.584468 25322 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.586309 25265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7e49fd52d74821a66c7dbbc770a988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.587153 25322 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:51.589821 25317 tablet_bootstrap.cc:492] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:51.590343 25317 ts_tablet_manager.cc:1403] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.004s
I20260709 12:18:51.591123 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:18:51.592940 25093 leader_election.cc:343] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:51.593401 25093 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:51.593477 25317 raft_consensus.cc:359] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.594223 25317 raft_consensus.cc:385] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.594512 25317 raft_consensus.cc:740] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.594662 25321 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:51.595268 25317 consensus_queue.cc:260] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.587779 25258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d4aa6fab2741dda3fcae71491a229a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.588191 25318 ts_tablet_manager.cc:1434] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.190s	user 0.022s	sys 0.004s
I20260709 12:18:51.602878 25318 tablet_bootstrap.cc:492] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:51.609246 25318 tablet_bootstrap.cc:654] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.611083 25183 tablet_service.cc:1511] Processing CreateTablet for tablet fd7e49fd52d74821a66c7dbbc770a988 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:18:51.612407 25183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7e49fd52d74821a66c7dbbc770a988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.614540 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:51.616609 25191 tablet_service.cc:1511] Processing CreateTablet for tablet 6afd466aa7a2455fa2f85263e303ec0f (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:18:51.619300 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:51.617888 25191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afd466aa7a2455fa2f85263e303ec0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.583962 25109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7e49fd52d74821a66c7dbbc770a988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.622627 25113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1081a743e5e04f24a0aebd684da3a15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.622758 25317 ts_tablet_manager.cc:1434] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:18:51.623807 25317 tablet_bootstrap.cc:492] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:51.626343 25116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afd466aa7a2455fa2f85263e303ec0f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:51.628479 25242 leader_election.cc:343] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:51.629375 25242 leader_election.cc:343] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:51.630067 25260 tablet_service.cc:1511] Processing CreateTablet for tablet 6afd466aa7a2455fa2f85263e303ec0f (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:18:51.631772 25260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afd466aa7a2455fa2f85263e303ec0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.642138 25317 tablet_bootstrap.cc:654] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.660837 25318 tablet_bootstrap.cc:492] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:51.661353 25318 ts_tablet_manager.cc:1403] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.004s
I20260709 12:18:51.671505 25318 raft_consensus.cc:359] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.672274 25318 raft_consensus.cc:385] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.672565 25318 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.673310 25318 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.675444 25318 ts_tablet_manager.cc:1434] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:18:51.676347 25318 tablet_bootstrap.cc:492] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:51.676339 25316 tablet_bootstrap.cc:492] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:51.677134 25316 ts_tablet_manager.cc:1403] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.215s	user 0.008s	sys 0.009s
I20260709 12:18:51.680457 25316 raft_consensus.cc:359] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.681309 25316 raft_consensus.cc:385] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.681653 25316 raft_consensus.cc:740] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.682893 25316 consensus_queue.cc:260] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.687000 25318 tablet_bootstrap.cc:654] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.688737 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:18:51.693399 25242 leader_election.cc:343] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:51.693970 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:51.696787 25322 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:51.701380 25316 ts_tablet_manager.cc:1434] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:18:51.702608 25316 tablet_bootstrap.cc:492] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:51.704023 25257 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcb58fb89c744c58d9494a99f2adda8 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:18:51.690693 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:51.708125 25257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcb58fb89c744c58d9494a99f2adda8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.708422 25191 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcb58fb89c744c58d9494a99f2adda8 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:18:51.709705 25191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcb58fb89c744c58d9494a99f2adda8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.718137 25318 tablet_bootstrap.cc:492] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:51.718650 25318 ts_tablet_manager.cc:1403] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.017s
I20260709 12:18:51.719239 25112 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcb58fb89c744c58d9494a99f2adda8 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:18:51.693768 25186 tablet_service.cc:1511] Processing CreateTablet for tablet c880ab05f6e24c9881bbc8954e0d9030 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:18:51.727366 25186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c880ab05f6e24c9881bbc8954e0d9030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.728366 25112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcb58fb89c744c58d9494a99f2adda8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:51.717796 25242 leader_election.cc:343] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:51.734537 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:51.735951 25322 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:51.730363 25316 tablet_bootstrap.cc:654] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.732873 25116 tablet_service.cc:1511] Processing CreateTablet for tablet 6248d848eecd4b799e9233d56f0b5467 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:18:51.721612 25318 raft_consensus.cc:359] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.737942 25116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6248d848eecd4b799e9233d56f0b5467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.738371 25318 raft_consensus.cc:385] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.740010 25265 tablet_service.cc:1511] Processing CreateTablet for tablet 6248d848eecd4b799e9233d56f0b5467 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:18:51.740156 25183 tablet_service.cc:1511] Processing CreateTablet for tablet 6248d848eecd4b799e9233d56f0b5467 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:18:51.746316 25318 raft_consensus.cc:740] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.746933 25183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6248d848eecd4b799e9233d56f0b5467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.747365 25318 consensus_queue.cc:260] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.750116 25318 ts_tablet_manager.cc:1434] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:18:51.751247 25318 tablet_bootstrap.cc:492] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:51.753211 25109 tablet_service.cc:1511] Processing CreateTablet for tablet 7f120f7a3d32426ab1243e87fe0194ac (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:18:51.758705 25109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f120f7a3d32426ab1243e87fe0194ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.746929 25265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6248d848eecd4b799e9233d56f0b5467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.742731 25317 tablet_bootstrap.cc:492] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:51.756611 25316 tablet_bootstrap.cc:492] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:51.762508 25316 ts_tablet_manager.cc:1403] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.003s
I20260709 12:18:51.762508 25317 ts_tablet_manager.cc:1403] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.139s	user 0.021s	sys 0.000s
I20260709 12:18:51.765502 25316 raft_consensus.cc:359] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.766275 25316 raft_consensus.cc:385] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.766589 25316 raft_consensus.cc:740] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.766891 25317 raft_consensus.cc:359] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.767591 25317 raft_consensus.cc:385] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.767884 25317 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.770462 25317 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.772754 25316 consensus_queue.cc:260] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.773800 25318 tablet_bootstrap.cc:654] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.779369 25316 ts_tablet_manager.cc:1434] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:18:51.781232 25317 ts_tablet_manager.cc:1434] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:18:51.782270 25317 tablet_bootstrap.cc:492] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:51.788292 25316 tablet_bootstrap.cc:492] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:51.793974 25183 tablet_service.cc:1511] Processing CreateTablet for tablet 7f120f7a3d32426ab1243e87fe0194ac (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:18:51.795589 25183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f120f7a3d32426ab1243e87fe0194ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.789458 25317 tablet_bootstrap.cc:654] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.799525 25316 tablet_bootstrap.cc:654] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.811580 25262 tablet_service.cc:1511] Processing CreateTablet for tablet 7f120f7a3d32426ab1243e87fe0194ac (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:18:51.813484 25262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f120f7a3d32426ab1243e87fe0194ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.822155 25112 tablet_service.cc:1511] Processing CreateTablet for tablet 450e4351142d43ca91af7ff9ee99c74b (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:18:51.823494 25112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450e4351142d43ca91af7ff9ee99c74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.823769 25186 tablet_service.cc:1511] Processing CreateTablet for tablet 450e4351142d43ca91af7ff9ee99c74b (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:18:51.825438 25186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450e4351142d43ca91af7ff9ee99c74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.843050 25318 tablet_bootstrap.cc:492] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:51.843644 25318 ts_tablet_manager.cc:1403] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.093s	user 0.037s	sys 0.018s
I20260709 12:18:51.846841 25318 raft_consensus.cc:359] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.847618 25318 raft_consensus.cc:385] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.847944 25318 raft_consensus.cc:740] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.848978 25318 consensus_queue.cc:260] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.852640 25183 tablet_service.cc:1511] Processing CreateTablet for tablet 2d4c46d8dc974803aa09fb2a6515ca35 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:18:51.854414 25183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4c46d8dc974803aa09fb2a6515ca35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.855788 25112 tablet_service.cc:1511] Processing CreateTablet for tablet 2d4c46d8dc974803aa09fb2a6515ca35 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:18:51.857961 25112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4c46d8dc974803aa09fb2a6515ca35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.859225 25317 tablet_bootstrap.cc:492] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:51.858835 25257 tablet_service.cc:1511] Processing CreateTablet for tablet 450e4351142d43ca91af7ff9ee99c74b (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:18:51.859041 25260 tablet_service.cc:1511] Processing CreateTablet for tablet 2d4c46d8dc974803aa09fb2a6515ca35 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:18:51.856896 25318 ts_tablet_manager.cc:1434] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:18:51.859696 25317 ts_tablet_manager.cc:1403] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.078s	user 0.033s	sys 0.006s
I20260709 12:18:51.860299 25257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450e4351142d43ca91af7ff9ee99c74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.860467 25335 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.860965 25335 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.862775 25317 raft_consensus.cc:359] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.863716 25317 raft_consensus.cc:385] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.863907 25335 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:51.864032 25317 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.864574 25322 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.865003 25322 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.865088 25317 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.867143 25322 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:51.869923 25316 tablet_bootstrap.cc:492] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:51.870458 25316 ts_tablet_manager.cc:1403] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.029s
I20260709 12:18:51.871325 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:51.871958 25127 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:51.873201 25242 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:51.873456 25316 raft_consensus.cc:359] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.874176 25316 raft_consensus.cc:385] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.874473 25316 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.875198 25318 tablet_bootstrap.cc:492] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:51.876439 25317 ts_tablet_manager.cc:1434] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:18:51.877511 25317 tablet_bootstrap.cc:492] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:51.874188 25322 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:51.877874 25322 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.878265 25322 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.883348 25316 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.886618 25260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4c46d8dc974803aa09fb2a6515ca35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.894797 25317 tablet_bootstrap.cc:654] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.889783 25265 tablet_service.cc:1511] Processing CreateTablet for tablet e42a38bc05c84ba69ac42605a0f627ca (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:18:51.897385 25116 tablet_service.cc:1511] Processing CreateTablet for tablet f698d5eb641d4490aaa13e25382450db (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:18:51.897384 25109 tablet_service.cc:1511] Processing CreateTablet for tablet e42a38bc05c84ba69ac42605a0f627ca (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:18:51.898810 25335 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.909588 25335 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.898409 25321 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.912277 25321 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.908334 25116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f698d5eb641d4490aaa13e25382450db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.908334 25265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42a38bc05c84ba69ac42605a0f627ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.911720 25335 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:51.915195 25321 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:51.905589 25322 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.928954 25262 tablet_service.cc:1511] Processing CreateTablet for tablet f698d5eb641d4490aaa13e25382450db (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:18:51.929142 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:51.935343 25262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f698d5eb641d4490aaa13e25382450db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.935228 25258 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff71ed0aef74f1f963b143876c9b3d6 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:18:51.936745 25258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff71ed0aef74f1f963b143876c9b3d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.936803 25113 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff71ed0aef74f1f963b143876c9b3d6 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:18:51.939657 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:51.940466 25127 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.937039 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:51.944655 25201 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:51.941527 25321 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.942348 25109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42a38bc05c84ba69ac42605a0f627ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.945993 25093 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:18:51.952672 25090 leader_election.cc:343] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:51.953819 25117 tablet_service.cc:1511] Processing CreateTablet for tablet fcbf7458baff481588dabf347ec2112d (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:18:51.953819 25266 tablet_service.cc:1511] Processing CreateTablet for tablet fcbf7458baff481588dabf347ec2112d (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:18:51.955749 25266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbf7458baff481588dabf347ec2112d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.957398 25113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff71ed0aef74f1f963b143876c9b3d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.962430 25117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbf7458baff481588dabf347ec2112d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.945952 25321 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:51.976560 25321 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:51.976404 25111 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3090ce3ca84e6e9649297156feeaef (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:18:51.976907 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:51.977252 25321 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:51.977814 25111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3090ce3ca84e6e9649297156feeaef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:51.978490 25093 leader_election.cc:343] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:51.982787 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:18:51.985211 25090 leader_election.cc:343] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:51.985690 25090 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:51.977761 25321 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.989532 25183 tablet_service.cc:1511] Processing CreateTablet for tablet e42a38bc05c84ba69ac42605a0f627ca (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:18:51.988462 25127 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:51.988117 25186 tablet_service.cc:1511] Processing CreateTablet for tablet f698d5eb641d4490aaa13e25382450db (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:18:51.991354 25318 tablet_bootstrap.cc:654] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.988241 25191 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff71ed0aef74f1f963b143876c9b3d6 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:18:51.991554 25242 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:51.992707 25346 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:51.994895 25183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42a38bc05c84ba69ac42605a0f627ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.996246 25316 ts_tablet_manager.cc:1434] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.125s	user 0.001s	sys 0.015s
I20260709 12:18:51.993530 25321 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.010545 25316 tablet_bootstrap.cc:492] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:52.014631 25191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff71ed0aef74f1f963b143876c9b3d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.018432 25346 raft_consensus.cc:697] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:52.021667 25335 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.034052 25183 tablet_service.cc:1511] Processing CreateTablet for tablet fcbf7458baff481588dabf347ec2112d (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:18:52.034588 25335 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.035943 25317 tablet_bootstrap.cc:492] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:52.036453 25317 ts_tablet_manager.cc:1403] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.159s	user 0.012s	sys 0.008s
I20260709 12:18:52.036723 25335 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.032778 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:52.023932 25186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f698d5eb641d4490aaa13e25382450db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.038635 25184 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3090ce3ca84e6e9649297156feeaef (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:18:52.039906 25184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3090ce3ca84e6e9649297156feeaef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.040406 25188 tablet_service.cc:1511] Processing CreateTablet for tablet 74518b8711d94925993fc2a788e89ccb (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:18:52.041637 25188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74518b8711d94925993fc2a788e89ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.028064 25262 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3090ce3ca84e6e9649297156feeaef (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:18:52.042824 25262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3090ce3ca84e6e9649297156feeaef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.030577 25322 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:52.031064 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:52.031503 25257 tablet_service.cc:1511] Processing CreateTablet for tablet 74518b8711d94925993fc2a788e89ccb (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:18:52.028977 25108 tablet_service.cc:1511] Processing CreateTablet for tablet 74518b8711d94925993fc2a788e89ccb (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:18:52.048836 25257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74518b8711d94925993fc2a788e89ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.049155 25108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74518b8711d94925993fc2a788e89ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.049809 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:52.050936 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:52.052313 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:52.052994 25125 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
W20260709 12:18:52.055095 25168 leader_election.cc:343] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.055168 25112 tablet_service.cc:1511] Processing CreateTablet for tablet 960cba74c5c0438f9a3d8e25d8dec7ad (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:18:52.055907 25168 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:18:52.056699 25242 leader_election.cc:343] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.056866 25335 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.057350 25335 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.056787 25112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960cba74c5c0438f9a3d8e25d8dec7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.057683 25335 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.044050 25183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbf7458baff481588dabf347ec2112d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:52.062760 25242 leader_election.cc:343] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.065295 25335 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.065677 25190 tablet_service.cc:1511] Processing CreateTablet for tablet 960cba74c5c0438f9a3d8e25d8dec7ad (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:18:52.067130 25190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960cba74c5c0438f9a3d8e25d8dec7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.072749 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:52.073390 25125 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.083400 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:52.084800 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:52.085489 25275 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:52.086577 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:18:52.090440 25165 leader_election.cc:343] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.090895 25266 tablet_service.cc:1511] Processing CreateTablet for tablet 960cba74c5c0438f9a3d8e25d8dec7ad (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:18:52.091398 25316 tablet_bootstrap.cc:654] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.091235 25165 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:18:52.092291 25266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960cba74c5c0438f9a3d8e25d8dec7ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:52.095860 25073 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:52.096060 25111 tablet_service.cc:1511] Processing CreateTablet for tablet d606e00420654b22bb1000c1b0aacbbc (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:18:52.098312 25111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d606e00420654b22bb1000c1b0aacbbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.093801 25321 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.099442 25346 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.101600 25348 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.102473 25335 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.103029 25335 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.103374 25335 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.103729 25335 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.108681 25125 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:52.039867 25317 raft_consensus.cc:359] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.109776 25317 raft_consensus.cc:385] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.110152 25317 raft_consensus.cc:740] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.110050 25168 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:52.110643 25127 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:18:52.111023 25317 consensus_queue.cc:260] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.113488 25317 ts_tablet_manager.cc:1434] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.077s	user 0.003s	sys 0.004s
I20260709 12:18:52.117481 25168 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:52.122347 25350 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.127766 25317 tablet_bootstrap.cc:492] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:52.127555 25260 tablet_service.cc:1511] Processing CreateTablet for tablet d606e00420654b22bb1000c1b0aacbbc (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:18:52.129424 25260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d606e00420654b22bb1000c1b0aacbbc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:52.122772 25165 leader_election.cc:343] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.169039 25263 tablet_service.cc:1511] Processing CreateTablet for tablet 258fe130eb914f5b858baf4782663574 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 12:18:52.170147 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 47530.9us
I20260709 12:18:52.170961 25263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 258fe130eb914f5b858baf4782663574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.176024 25191 tablet_service.cc:1511] Processing CreateTablet for tablet 258fe130eb914f5b858baf4782663574 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:18:52.177127 25317 tablet_bootstrap.cc:654] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.177316 25191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 258fe130eb914f5b858baf4782663574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.179893 25259 tablet_service.cc:1511] Processing CreateTablet for tablet dd90d1f02e904a46be6868d71386b83a (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:18:52.180476 25110 tablet_service.cc:1511] Processing CreateTablet for tablet dd90d1f02e904a46be6868d71386b83a (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:18:52.180534 25109 tablet_service.cc:1511] Processing CreateTablet for tablet 258fe130eb914f5b858baf4782663574 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:18:52.181177 25259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd90d1f02e904a46be6868d71386b83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.149533 25258 tablet_service.cc:1511] Processing CreateTablet for tablet 9c305b34a0c54275af750c832f52691f (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:18:52.182017 25110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd90d1f02e904a46be6868d71386b83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.182337 25258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c305b34a0c54275af750c832f52691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.184859 25321 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.189348 25108 tablet_service.cc:1511] Processing CreateTablet for tablet 9c305b34a0c54275af750c832f52691f (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:18:52.204780 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:18:52.199173 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 81791.8us
I20260709 12:18:52.208063 25350 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:52.212704 25350 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.222601 25186 tablet_service.cc:1511] Processing CreateTablet for tablet 9c305b34a0c54275af750c832f52691f (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:18:52.224020 25186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c305b34a0c54275af750c832f52691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.208952 25109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 258fe130eb914f5b858baf4782663574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.236491 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:52.236785 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:52.238610 25316 tablet_bootstrap.cc:492] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:52.239193 25318 tablet_bootstrap.cc:492] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:52.239336 25316 ts_tablet_manager.cc:1403] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.229s	user 0.014s	sys 0.004s
I20260709 12:18:52.239677 25318 ts_tablet_manager.cc:1403] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.365s	user 0.030s	sys 0.012s
I20260709 12:18:52.246610 25355 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.248808 25257 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8512157f7e4dcc8a59428a2ccbd2a8 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:18:52.250771 25257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8512157f7e4dcc8a59428a2ccbd2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.205049 25188 tablet_service.cc:1511] Processing CreateTablet for tablet d606e00420654b22bb1000c1b0aacbbc (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:18:52.255622 25264 tablet_service.cc:1511] Processing CreateTablet for tablet 19982d505db74841b1c47ceaaf269baa (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:18:52.255622 25261 tablet_service.cc:1511] Processing CreateTablet for tablet b9bae455c93a497ca28011bd9cd473ec (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:18:52.257987 25262 tablet_service.cc:1511] Processing CreateTablet for tablet f1f471cfad2348a09c4b699f01f9dfa9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:18:52.266695 25316 raft_consensus.cc:359] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.268051 25116 tablet_service.cc:1511] Processing CreateTablet for tablet f1f471cfad2348a09c4b699f01f9dfa9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:18:52.268513 25112 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8512157f7e4dcc8a59428a2ccbd2a8 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:18:52.268396 25113 tablet_service.cc:1511] Processing CreateTablet for tablet 19982d505db74841b1c47ceaaf269baa (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:18:52.270200 25115 tablet_service.cc:1511] Processing CreateTablet for tablet b9bae455c93a497ca28011bd9cd473ec (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:18:52.232532 25335 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.282850 25346 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.283387 25346 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.284704 25335 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.271718 25108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c305b34a0c54275af750c832f52691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.285521 25346 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:52.285596 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:52.281040 25316 raft_consensus.cc:385] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.286346 25316 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
W20260709 12:18:52.287377 25168 leader_election.cc:343] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.287184 25316 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:52.273381 25090 leader_election.cc:343] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.290990 25113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19982d505db74841b1c47ceaaf269baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.294468 25115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bae455c93a497ca28011bd9cd473ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.296697 25188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d606e00420654b22bb1000c1b0aacbbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.307126 25318 raft_consensus.cc:359] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.307991 25318 raft_consensus.cc:385] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.308329 25318 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.309182 25318 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.311918 25264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19982d505db74841b1c47ceaaf269baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.313005 25112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8512157f7e4dcc8a59428a2ccbd2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.315486 25316 ts_tablet_manager.cc:1434] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.076s	user 0.010s	sys 0.000s
I20260709 12:18:52.315570 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:52.318672 25190 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8512157f7e4dcc8a59428a2ccbd2a8 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:18:52.274174 25350 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.322403 25350 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.324810 25350 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.325030 25259 tablet_service.cc:1511] Processing CreateTablet for tablet 242311f4ad5044b2ada00bc49a50afeb (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:18:52.326821 25183 tablet_service.cc:1511] Processing CreateTablet for tablet f1f471cfad2348a09c4b699f01f9dfa9 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:18:52.331292 25183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f471cfad2348a09c4b699f01f9dfa9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:52.335471 25242 leader_election.cc:343] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.339324 25190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8512157f7e4dcc8a59428a2ccbd2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.349172 25116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f471cfad2348a09c4b699f01f9dfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.350232 25187 tablet_service.cc:1511] Processing CreateTablet for tablet 19982d505db74841b1c47ceaaf269baa (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:18:52.351491 25261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bae455c93a497ca28011bd9cd473ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.351643 25187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19982d505db74841b1c47ceaaf269baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.354489 25259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242311f4ad5044b2ada00bc49a50afeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.349154 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:52.355829 25185 tablet_service.cc:1511] Processing CreateTablet for tablet b9bae455c93a497ca28011bd9cd473ec (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:18:52.357184 25127 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:52.363756 25168 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:52.364807 25185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bae455c93a497ca28011bd9cd473ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:52.364923 25165 leader_election.cc:343] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.365541 25257 tablet_service.cc:1511] Processing CreateTablet for tablet ff47c111f89a444a9c5a1794454f0789 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:18:52.367009 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:52.367039 25350 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.367741 25275 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.367918 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:52.367856 25350 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.369005 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:52.369889 25350 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.370568 25184 tablet_service.cc:1511] Processing CreateTablet for tablet dd90d1f02e904a46be6868d71386b83a (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 12:18:52.371192 25242 leader_election.cc:343] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.371714 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:52.372215 25184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd90d1f02e904a46be6868d71386b83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.372560 25346 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:18:52.373232 25165 leader_election.cc:343] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.375551 25183 tablet_service.cc:1511] Processing CreateTablet for tablet 242311f4ad5044b2ada00bc49a50afeb (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:18:52.376672 25183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242311f4ad5044b2ada00bc49a50afeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.364807 25262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f471cfad2348a09c4b699f01f9dfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.383267 25316 tablet_bootstrap.cc:492] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:52.384346 25112 tablet_service.cc:1511] Processing CreateTablet for tablet ff47c111f89a444a9c5a1794454f0789 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:18:52.385732 25112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff47c111f89a444a9c5a1794454f0789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.390599 25117 tablet_service.cc:1511] Processing CreateTablet for tablet 242311f4ad5044b2ada00bc49a50afeb (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:18:52.391980 25117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242311f4ad5044b2ada00bc49a50afeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.393584 25275 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:52.394866 25165 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:18:52.396412 25335 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.396919 25335 raft_consensus.cc:697] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:52.397790 25335 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.407325 25024 catalog_manager.cc:5697] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.409984 25023 catalog_manager.cc:5697] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.415472 25257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff47c111f89a444a9c5a1794454f0789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.411113 25110 tablet_service.cc:1511] Processing CreateTablet for tablet 155471b361b441c095eae34b64eb0bed (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:18:52.421365 25110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155471b361b441c095eae34b64eb0bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.423142 25355 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.417484 25260 tablet_service.cc:1511] Processing CreateTablet for tablet 155471b361b441c095eae34b64eb0bed (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:18:52.426616 25317 tablet_bootstrap.cc:492] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:52.426990 25260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155471b361b441c095eae34b64eb0bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.427170 25317 ts_tablet_manager.cc:1403] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.300s	user 0.007s	sys 0.023s
I20260709 12:18:52.427865 25189 tablet_service.cc:1511] Processing CreateTablet for tablet 155471b361b441c095eae34b64eb0bed (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:18:52.429231 25189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155471b361b441c095eae34b64eb0bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.430423 25317 raft_consensus.cc:359] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.431249 25317 raft_consensus.cc:385] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.431610 25317 raft_consensus.cc:740] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.430832 25201 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:52.432555 25317 consensus_queue.cc:260] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.435516 25317 ts_tablet_manager.cc:1434] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:18:52.435366 25093 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:18:52.436620 25321 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.437145 25321 raft_consensus.cc:697] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:52.438063 25321 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.411263 25318 ts_tablet_manager.cc:1434] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.171s	user 0.003s	sys 0.006s
I20260709 12:18:52.447453 25318 tablet_bootstrap.cc:492] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:52.459494 25317 tablet_bootstrap.cc:492] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:52.461498 25191 tablet_service.cc:1511] Processing CreateTablet for tablet ff47c111f89a444a9c5a1794454f0789 (DEFAULT_TABLE table=test-workload [id=4687ac69adb14a54936903f246a05431]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:18:52.463102 25191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff47c111f89a444a9c5a1794454f0789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.458019 25316 tablet_bootstrap.cc:654] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.532917 25317 tablet_bootstrap.cc:654] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.541047 25321 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.547080 25321 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.555197 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:18:52.556999 25093 leader_election.cc:343] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.554888 25025 catalog_manager.cc:5697] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.559808 25350 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.560326 25316 tablet_bootstrap.cc:492] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:52.560838 25316 ts_tablet_manager.cc:1403] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.178s	user 0.014s	sys 0.005s
I20260709 12:18:52.567592 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:52.568208 25127 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.572981 25318 tablet_bootstrap.cc:654] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.574263 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:18:52.575834 25165 leader_election.cc:343] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.579043 25350 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.579279 25316 raft_consensus.cc:359] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.580010 25316 raft_consensus.cc:385] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.580305 25316 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.577894 25127 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:52.580938 25023 catalog_manager.cc:5697] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.582703 25321 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.583618 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:52.584265 25275 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:52.585553 25090 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:52.582639 25168 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:18:52.587672 25316 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.589996 25316 ts_tablet_manager.cc:1434] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 12:18:52.595656 25316 tablet_bootstrap.cc:492] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:52.594720 25350 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.598892 25350 raft_consensus.cc:697] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:52.599777 25350 consensus_queue.cc:237] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.594385 25321 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.602387 25321 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.602754 25321 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.604417 25316 tablet_bootstrap.cc:654] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.604748 25346 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:52.609705 25317 tablet_bootstrap.cc:492] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:52.610361 25317 ts_tablet_manager.cc:1403] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.151s	user 0.023s	sys 0.016s
W20260709 12:18:52.613847 25165 consensus_peers.cc:597] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:52.615370 25242 consensus_peers.cc:597] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:52.613813 25317 raft_consensus.cc:359] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.618057 25317 raft_consensus.cc:385] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.618532 25317 raft_consensus.cc:740] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.619746 25317 consensus_queue.cc:260] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.622952 25317 ts_tablet_manager.cc:1434] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:18:52.623449 25321 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.624576 25317 tablet_bootstrap.cc:492] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:52.626674 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:52.627411 25318 tablet_bootstrap.cc:492] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:52.627986 25318 ts_tablet_manager.cc:1403] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.181s	user 0.008s	sys 0.022s
W20260709 12:18:52.628165 25093 leader_election.cc:343] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.631263 25318 raft_consensus.cc:359] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.638453 25316 tablet_bootstrap.cc:492] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:52.641310 25318 raft_consensus.cc:385] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.641546 25316 ts_tablet_manager.cc:1403] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.026s
I20260709 12:18:52.641654 25318 raft_consensus.cc:740] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.642607 25318 consensus_queue.cc:260] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.641000 25317 tablet_bootstrap.cc:654] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.644364 25316 raft_consensus.cc:359] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.645033 25316 raft_consensus.cc:385] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.645292 25316 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.645983 25316 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.647621 25318 ts_tablet_manager.cc:1434] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:18:52.648715 25318 tablet_bootstrap.cc:492] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:52.654927 25316 ts_tablet_manager.cc:1434] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:18:52.655859 25316 tablet_bootstrap.cc:492] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:52.655589 25024 catalog_manager.cc:5697] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.659456 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:52.660059 25275 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.661631 25317 tablet_bootstrap.cc:492] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:52.661830 25316 tablet_bootstrap.cc:654] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.662118 25317 ts_tablet_manager.cc:1403] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.001s
I20260709 12:18:52.664830 25317 raft_consensus.cc:359] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.665735 25317 raft_consensus.cc:385] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.666090 25317 raft_consensus.cc:740] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.668428 25318 tablet_bootstrap.cc:654] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.671250 25275 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:52.671864 25317 consensus_queue.cc:260] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.672585 25090 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:52.673465 25348 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.673779 25317 ts_tablet_manager.cc:1434] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:18:52.673962 25316 tablet_bootstrap.cc:492] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:52.674372 25321 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.674539 25316 ts_tablet_manager.cc:1403] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:18:52.677281 25316 raft_consensus.cc:359] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.677923 25316 raft_consensus.cc:385] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.678206 25316 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.678349 25317 tablet_bootstrap.cc:492] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:52.678961 25316 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.684775 25348 raft_consensus.cc:697] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:52.685982 25317 tablet_bootstrap.cc:654] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.685796 25348 consensus_queue.cc:237] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.685992 25316 ts_tablet_manager.cc:1434] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:18:52.689977 25316 tablet_bootstrap.cc:492] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:52.690724 25318 tablet_bootstrap.cc:492] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:52.691200 25318 ts_tablet_manager.cc:1403] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.000s
I20260709 12:18:52.694006 25318 raft_consensus.cc:359] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.694732 25318 raft_consensus.cc:385] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.694996 25318 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.696270 25316 tablet_bootstrap.cc:654] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.695789 25318 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.698475 25318 ts_tablet_manager.cc:1434] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:18:52.700255 25318 tablet_bootstrap.cc:492] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:52.708132 25318 tablet_bootstrap.cc:654] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.710362 25317 tablet_bootstrap.cc:492] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:52.710896 25317 ts_tablet_manager.cc:1403] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.007s
I20260709 12:18:52.714285 25317 raft_consensus.cc:359] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.715252 25317 raft_consensus.cc:385] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.715607 25317 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.719062 25316 tablet_bootstrap.cc:492] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:52.719724 25316 ts_tablet_manager.cc:1403] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.008s
I20260709 12:18:52.719487 25023 catalog_manager.cc:5697] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.722357 25317 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.725173 25317 ts_tablet_manager.cc:1434] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:18:52.726326 25317 tablet_bootstrap.cc:492] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:52.728012 25381 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.728562 25381 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.729581 25350 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.730050 25350 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.730772 25381 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:52.731300 25316 raft_consensus.cc:359] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.732127 25350 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.732190 25316 raft_consensus.cc:385] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.732753 25316 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.734074 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:52.733675 25316 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.734743 25275 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:52.736091 25165 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:52.736553 25316 ts_tablet_manager.cc:1434] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:18:52.737267 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:52.737486 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:52.738219 25201 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 1: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:18:52.739665 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:52.739850 25242 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:52.740317 25125 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:52.740634 25381 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.742187 25317 tablet_bootstrap.cc:654] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.742710 25318 tablet_bootstrap.cc:492] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:52.743209 25318 ts_tablet_manager.cc:1403] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.024s
I20260709 12:18:52.737809 25316 tablet_bootstrap.cc:492] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:52.745729 25350 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.745680 25318 raft_consensus.cc:359] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.746222 25350 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.746436 25318 raft_consensus.cc:385] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.746606 25350 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.746762 25318 raft_consensus.cc:740] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.747682 25318 consensus_queue.cc:260] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.750451 25316 tablet_bootstrap.cc:654] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.753074 25318 ts_tablet_manager.cc:1434] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:18:52.754329 25318 tablet_bootstrap.cc:492] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:52.759999 25381 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.761049 25335 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:52.763531 25317 tablet_bootstrap.cc:492] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:52.763984 25317 ts_tablet_manager.cc:1403] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.007s
I20260709 12:18:52.765558 25318 tablet_bootstrap.cc:654] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.766634 25317 raft_consensus.cc:359] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.767334 25317 raft_consensus.cc:385] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.767608 25317 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.768496 25317 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.772303 25317 ts_tablet_manager.cc:1434] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:18:52.772547 25350 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.773484 25317 tablet_bootstrap.cc:492] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:52.775774 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:52.776583 25127 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.776641 25348 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.777213 25318 tablet_bootstrap.cc:492] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:52.777199 25348 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.777773 25318 ts_tablet_manager.cc:1403] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.009s
I20260709 12:18:52.779424 25348 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.780212 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:52.780818 25201 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:52.780988 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:52.781613 25275 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:52.782284 25093 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:52.782661 25316 tablet_bootstrap.cc:492] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:52.783196 25316 ts_tablet_manager.cc:1403] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.005s
I20260709 12:18:52.783407 25348 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.783767 25348 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.784112 25348 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.786213 25317 tablet_bootstrap.cc:654] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.785928 25316 raft_consensus.cc:359] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.786680 25316 raft_consensus.cc:385] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.786968 25316 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.787777 25316 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.789356 25316 ts_tablet_manager.cc:1434] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:52.791741 25348 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.794479 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:52.795075 25201 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.800918 25127 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:52.804685 25316 tablet_bootstrap.cc:492] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:52.808249 25168 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:52.809311 25356 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.809819 25356 raft_consensus.cc:697] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:52.810671 25356 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.812177 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:52.812808 25275 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.819103 25201 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:52.820036 25275 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:52.821767 25377 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.821949 25318 raft_consensus.cc:359] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.822698 25318 raft_consensus.cc:385] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.822283 25377 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.811329 25316 tablet_bootstrap.cc:654] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.824609 25377 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.826638 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:52.827555 25274 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:52.827615 25093 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:52.827941 25318 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.828816 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:52.830670 25090 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:52.830750 25318 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.831540 25321 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.828888 25377 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.831887 25321 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.832265 25321 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:52.832966 25093 leader_election.cc:343] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.833837 25377 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:52.835433 25318 ts_tablet_manager.cc:1434] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.000s
I20260709 12:18:52.836349 25318 tablet_bootstrap.cc:492] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:52.835963 25377 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.812227 25350 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.839886 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:52.840468 25274 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.841930 25381 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.842667 25381 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.846416 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:52.848819 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:52.850086 25274 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
W20260709 12:18:52.851369 25242 leader_election.cc:343] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:52.856539 25242 leader_election.cc:343] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.857048 25242 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:52.857888 25372 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.846606 25381 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:52.858362 25317 tablet_bootstrap.cc:492] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:52.858922 25317 ts_tablet_manager.cc:1403] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.086s	user 0.024s	sys 0.024s
I20260709 12:18:52.858300 25024 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.854144 25127 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.861655 25317 raft_consensus.cc:359] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.862339 25317 raft_consensus.cc:385] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.862630 25317 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.863356 25317 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.864670 25318 tablet_bootstrap.cc:654] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.854458 25321 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.865846 25381 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.866376 25381 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.855736 25348 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.868274 25381 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:52.868733 25317 ts_tablet_manager.cc:1434] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:18:52.869091 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:52.869675 25317 tablet_bootstrap.cc:492] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:52.869633 25274 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.870046 25321 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.870783 25025 catalog_manager.cc:5697] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.873862 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:52.876309 25335 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:52.879174 25274 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:52.880102 25316 tablet_bootstrap.cc:492] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:52.880546 25316 ts_tablet_manager.cc:1403] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.004s
I20260709 12:18:52.881186 25090 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:18:52.882256 25093 leader_election.cc:343] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.882407 25348 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.882864 25348 raft_consensus.cc:697] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:52.883690 25348 consensus_queue.cc:237] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.884209 25316 raft_consensus.cc:359] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.884863 25316 raft_consensus.cc:385] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.885176 25316 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.881244 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:52.885953 25317 tablet_bootstrap.cc:654] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.887641 25316 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.888891 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:52.889968 25316 ts_tablet_manager.cc:1434] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 12:18:52.890987 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:52.892422 25381 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.893819 25316 tablet_bootstrap.cc:492] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:52.914995 25316 tablet_bootstrap.cc:654] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.915237 25392 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:52.942564 25335 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.943401 25335 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.944443 25318 tablet_bootstrap.cc:492] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:52.945091 25318 ts_tablet_manager.cc:1403] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.030s
I20260709 12:18:52.947196 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:52.948154 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:52.949203 25392 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.949854 25335 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.949822 25392 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.951224 25024 catalog_manager.cc:5697] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.954133 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:52.948311 25275 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:18:52.955830 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:52.955761 25392 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.957275 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:52.957304 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:52.958536 25335 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.958362 25318 raft_consensus.cc:359] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.959164 25335 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.959311 25318 raft_consensus.cc:385] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.959741 25318 raft_consensus.cc:740] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.960606 25318 consensus_queue.cc:260] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.963567 25318 ts_tablet_manager.cc:1434] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 12:18:52.965085 25348 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.965549 25348 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.966073 25317 tablet_bootstrap.cc:492] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:52.966531 25317 ts_tablet_manager.cc:1403] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.021s
I20260709 12:18:52.967708 25348 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:52.968477 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:52.969230 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:52.969122 25317 raft_consensus.cc:359] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.969170 25202 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:52.969872 25317 raft_consensus.cc:385] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.970207 25317 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
W20260709 12:18:52.970657 25090 leader_election.cc:343] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.971113 25318 tablet_bootstrap.cc:492] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:52.971236 25093 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:18:52.972038 25348 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.972369 25348 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.972707 25348 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.973796 25335 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.977181 25318 tablet_bootstrap.cc:654] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.978283 25317 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.979903 25348 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.980700 25317 ts_tablet_manager.cc:1434] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:18:52.981590 25317 tablet_bootstrap.cc:492] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:52.982852 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:52.983094 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:52.983469 25202 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:52.984421 25090 leader_election.cc:343] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.988013 25317 tablet_bootstrap.cc:654] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.992690 25202 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:52.994691 25093 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:18:52.995822 25321 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.996320 25321 raft_consensus.cc:697] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:52.997212 25316 tablet_bootstrap.cc:492] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:52.997360 25318 tablet_bootstrap.cc:492] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:52.997737 25316 ts_tablet_manager.cc:1403] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.104s	user 0.024s	sys 0.011s
I20260709 12:18:52.997814 25318 ts_tablet_manager.cc:1403] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.027s	user 0.002s	sys 0.009s
I20260709 12:18:52.997148 25321 consensus_queue.cc:237] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:52.999946 25316 raft_consensus.cc:359] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.000522 25316 raft_consensus.cc:385] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.000762 25316 raft_consensus.cc:740] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.000599 25318 raft_consensus.cc:359] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.001353 25318 raft_consensus.cc:385] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.001669 25318 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.001515 25316 consensus_queue.cc:260] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.004050 25317 tablet_bootstrap.cc:492] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:53.002504 25318 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.007983 25316 ts_tablet_manager.cc:1434] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:18:53.008247 25025 catalog_manager.cc:5697] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.009526 25318 ts_tablet_manager.cc:1434] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 12:18:53.010533 25318 tablet_bootstrap.cc:492] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:53.013552 25317 ts_tablet_manager.cc:1403] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.003s
I20260709 12:18:53.016301 25317 raft_consensus.cc:359] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.016993 25317 raft_consensus.cc:385] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.017102 25316 tablet_bootstrap.cc:492] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:53.017277 25317 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.002452 25348 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.018711 25317 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.023721 25316 tablet_bootstrap.cc:654] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.024147 25321 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.016232 25318 tablet_bootstrap.cc:654] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.031529 25317 ts_tablet_manager.cc:1434] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:18:53.033589 25348 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.034260 25348 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.041622 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:53.044029 25316 tablet_bootstrap.cc:492] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:53.044492 25316 ts_tablet_manager.cc:1403] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.006s
I20260709 12:18:53.047123 25316 raft_consensus.cc:359] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:53.047756 25090 leader_election.cc:343] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.048240 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:18:53.049541 25093 leader_election.cc:343] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.049974 25093 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:53.050911 25391 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:53.051451 25348 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.051553 25391 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.053073 25317 tablet_bootstrap.cc:492] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:53.047785 25316 raft_consensus.cc:385] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.057901 25316 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.058789 25316 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.060642 25316 ts_tablet_manager.cc:1434] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:18:53.061605 25316 tablet_bootstrap.cc:492] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:53.063544 25318 tablet_bootstrap.cc:492] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:53.064033 25318 ts_tablet_manager.cc:1403] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.013s
I20260709 12:18:53.065198 25317 tablet_bootstrap.cc:654] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.068697 25316 tablet_bootstrap.cc:654] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.072274 25318 raft_consensus.cc:359] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.072994 25318 raft_consensus.cc:385] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.073273 25318 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.074035 25318 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.074596 25276 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.076004 25318 ts_tablet_manager.cc:1434] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:18:53.079541 25318 tablet_bootstrap.cc:492] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:53.085470 25318 tablet_bootstrap.cc:654] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.086155 25202 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.093272 25316 tablet_bootstrap.cc:492] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:53.093858 25316 ts_tablet_manager.cc:1403] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.015s
I20260709 12:18:53.098974 25317 tablet_bootstrap.cc:492] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:53.099706 25317 ts_tablet_manager.cc:1403] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.047s	user 0.028s	sys 0.004s
I20260709 12:18:53.106999 25321 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.108229 25316 raft_consensus.cc:359] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.109943 25316 raft_consensus.cc:385] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.110371 25316 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.111357 25275 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.111253 25316 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.114118 25316 ts_tablet_manager.cc:1434] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:18:53.114495 25321 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.115260 25316 tablet_bootstrap.cc:492] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:53.116658 25321 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.118637 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:53.119113 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:53.119700 25274 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
W20260709 12:18:53.120096 25093 leader_election.cc:343] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.120008 25392 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.121691 25090 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:18:53.122875 25073 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:53.123656 25321 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.128422 25317 raft_consensus.cc:359] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.129371 25317 raft_consensus.cc:385] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.129737 25317 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.130723 25317 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.135531 25317 ts_tablet_manager.cc:1434] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.001s
I20260709 12:18:53.126485 25321 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.138100 25321 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.144502 25317 tablet_bootstrap.cc:492] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:53.145659 25335 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.166603 25316 tablet_bootstrap.cc:654] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.167189 25318 tablet_bootstrap.cc:492] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:53.185493 25381 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.186231 25381 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.192457 25377 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:53.223318 25318 ts_tablet_manager.cc:1403] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.147s	user 0.033s	sys 0.074s
I20260709 12:18:53.234205 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:53.235157 25127 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:53.236881 25242 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:53.238107 25317 tablet_bootstrap.cc:654] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.238065 25372 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.238749 25372 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.239176 25372 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.224969 25321 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.248132 25391 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.248788 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:53.249495 25377 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.250201 25348 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.250600 25321 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.249517 25202 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:53.252138 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:18:53.253427 25093 leader_election.cc:343] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.248827 25391 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.255088 25350 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:53.256268 25391 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.256196 25318 raft_consensus.cc:359] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.256910 25318 raft_consensus.cc:385] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.256814 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:53.257273 25318 raft_consensus.cc:740] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.257808 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:53.257977 25318 consensus_queue.cc:260] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.258064 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:18:53.262840 25093 leader_election.cc:343] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.263196 25273 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:53.264460 25090 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:53.266170 25348 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.266669 25348 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.267123 25348 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.268566 25377 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.269073 25377 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.258778 25381 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:53.262775 25274 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.279150 25318 ts_tablet_manager.cc:1434] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 12:18:53.280408 25318 tablet_bootstrap.cc:492] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:53.271248 25377 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.289167 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:53.290087 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:18:53.293491 25090 leader_election.cc:343] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:53.296093 25093 leader_election.cc:343] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.296483 25202 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.296545 25093 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:53.298318 25377 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:53.294793 25372 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.304302 25372 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:53.305991 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:53.306689 25125 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.308523 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:53.309223 25200 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.312111 25335 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.312625 25335 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.320258 25391 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:53.321916 25348 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.324225 25348 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.326685 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:53.327373 25276 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.332940 25318 tablet_bootstrap.cc:654] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.335108 25316 tablet_bootstrap.cc:492] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:53.336134 25316 ts_tablet_manager.cc:1403] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.221s	user 0.026s	sys 0.039s
I20260709 12:18:53.337628 25274 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:53.342669 25090 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:53.349110 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:18:53.350664 25093 leader_election.cc:343] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.351167 25348 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.352291 25348 raft_consensus.cc:697] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:53.352069 25200 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
W20260709 12:18:53.359650 25418 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:18:53.362658 25125 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:53.364118 25317 tablet_bootstrap.cc:492] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:53.363256 25348 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.364557 25317 ts_tablet_manager.cc:1403] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.220s	user 0.022s	sys 0.032s
I20260709 12:18:53.367698 25317 raft_consensus.cc:359] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.369158 25317 raft_consensus.cc:385] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.369403 25317 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.369953 25317 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.368685 25242 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:53.371047 25335 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.371688 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:53.372315 25274 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:53.371891 25317 ts_tablet_manager.cc:1434] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:18:53.373632 25165 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:53.375026 25356 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.375363 25356 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.375494 25317 tablet_bootstrap.cc:492] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:53.375741 25356 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.378790 25392 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:53.380777 25276 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:53.378862 25350 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.381912 25350 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.382602 25090 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:53.384568 25391 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.385205 25391 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:53.385587 25350 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.386289 25391 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.389114 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:53.372385 25372 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.390429 25372 raft_consensus.cc:697] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:53.391261 25372 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.394227 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:53.395390 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:18:53.397039 25168 leader_election.cc:343] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.396786 25321 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:53.397140 25316 raft_consensus.cc:359] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.398005 25316 raft_consensus.cc:385] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.398391 25316 raft_consensus.cc:740] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.398494 25168 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:53.401124 25350 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:53.404925 25316 consensus_queue.cc:260] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.406301 25318 tablet_bootstrap.cc:492] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:53.406816 25318 ts_tablet_manager.cc:1403] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.127s	user 0.017s	sys 0.002s
I20260709 12:18:53.407102 25316 ts_tablet_manager.cc:1434] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.071s	user 0.003s	sys 0.005s
I20260709 12:18:53.408177 25316 tablet_bootstrap.cc:492] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:53.389945 25356 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.413776 25318 raft_consensus.cc:359] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.414844 25318 raft_consensus.cc:385] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.415284 25318 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.415601 25356 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.416298 25318 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.418459 25318 ts_tablet_manager.cc:1434] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:18:53.420682 25318 tablet_bootstrap.cc:492] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:53.419024 25317 tablet_bootstrap.cc:654] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.419250 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:53.421885 25276 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.423507 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:53.428318 25321 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:18:53.441315 25168 leader_election.cc:343] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.484103 25416 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.484747 25416 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.567514 25381 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.568279 25381 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.570888 25381 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:53.594858 25316 tablet_bootstrap.cc:654] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.599022 25416 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:53.600482 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:53.601158 25126 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:53.603358 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:18:53.603577 25090 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:53.604022 25126 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:53.606468 25242 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:53.607560 25242 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:53.607941 25428 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.610220 25428 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.613474 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:53.613865 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:53.608816 25372 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.614593 25199 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:53.614823 25372 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.609407 25433 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.615190 25372 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.615386 25433 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.615779 25433 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.617578 25428 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.621402 25276 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:53.624446 25318 tablet_bootstrap.cc:654] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.625013 25165 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:18:53.623304 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:53.629150 25428 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.629874 25428 raft_consensus.cc:697] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:53.632642 25428 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.632885 25321 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:53.625753 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:53.635017 25276 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:53.636853 25317 tablet_bootstrap.cc:492] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:53.637310 25372 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.639355 25372 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:18:53.640305 25168 leader_election.cc:343] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.637287 25317 ts_tablet_manager.cc:1403] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.262s	user 0.023s	sys 0.038s
I20260709 12:18:53.646530 25316 tablet_bootstrap.cc:492] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:53.646940 25316 ts_tablet_manager.cc:1403] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.239s	user 0.011s	sys 0.002s
I20260709 12:18:53.656826 25165 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:18:53.658890 25392 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.659341 25392 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.659700 25392 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.663271 25317 raft_consensus.cc:359] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.664212 25317 raft_consensus.cc:385] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.664564 25317 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.668407 25317 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.672827 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:53.676144 25317 ts_tablet_manager.cc:1434] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:18:53.677148 25317 tablet_bootstrap.cc:492] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0: Bootstrap starting.
W20260709 12:18:53.677935 25242 leader_election.cc:343] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.656226 25433 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.683619 25126 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.684923 25433 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:53.688496 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:53.689136 25202 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.696043 25392 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.669247 25022 catalog_manager.cc:5697] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.700969 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:53.701208 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:53.701658 25127 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.700663 25316 raft_consensus.cc:359] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.703291 25316 raft_consensus.cc:385] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.703576 25316 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
W20260709 12:18:53.704838 25242 leader_election.cc:343] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.707295 25022 catalog_manager.cc:5697] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.708753 25317 tablet_bootstrap.cc:654] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.708376 25316 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.711074 25202 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:53.716295 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:53.716588 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:53.717151 25276 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.718025 25127 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
W20260709 12:18:53.718199 25168 leader_election.cc:343] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.720955 25316 ts_tablet_manager.cc:1434] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.074s	user 0.002s	sys 0.006s
I20260709 12:18:53.721689 25316 tablet_bootstrap.cc:492] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:53.722782 25318 tablet_bootstrap.cc:492] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:53.723150 25318 ts_tablet_manager.cc:1403] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.303s	user 0.030s	sys 0.015s
I20260709 12:18:53.718856 25392 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.717819 25126 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:53.716586 25242 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:53.725224 25436 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.725936 25436 raft_consensus.cc:697] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:53.726926 25242 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:53.727783 25433 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.728294 25433 raft_consensus.cc:697] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:53.728122 25436 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.729233 25433 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.731396 25276 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:53.732702 25165 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:18:53.734159 25392 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.734669 25392 raft_consensus.cc:697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:53.735529 25392 consensus_queue.cc:237] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.736786 25318 raft_consensus.cc:359] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.737649 25318 raft_consensus.cc:385] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.738008 25318 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.742973 25316 tablet_bootstrap.cc:654] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.740262 25317 tablet_bootstrap.cc:492] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:53.743712 25317 ts_tablet_manager.cc:1403] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.004s
I20260709 12:18:53.746809 25318 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.753010 25316 tablet_bootstrap.cc:492] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:53.753659 25316 ts_tablet_manager.cc:1403] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.001s
I20260709 12:18:53.754463 25318 ts_tablet_manager.cc:1434] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.004s
I20260709 12:18:53.755715 25318 tablet_bootstrap.cc:492] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:53.757256 25316 raft_consensus.cc:359] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.758189 25316 raft_consensus.cc:385] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.758527 25316 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.759263 25316 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.761370 25316 ts_tablet_manager.cc:1434] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:53.762313 25316 tablet_bootstrap.cc:492] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:53.762666 25317 raft_consensus.cc:359] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.763567 25317 raft_consensus.cc:385] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.763922 25317 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.765079 25317 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.768544 25316 tablet_bootstrap.cc:654] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.770430 25317 ts_tablet_manager.cc:1434] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:18:53.771551 25317 tablet_bootstrap.cc:492] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:53.772060 25318 tablet_bootstrap.cc:654] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.777379 25317 tablet_bootstrap.cc:654] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.782413 25348 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.782953 25348 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.785053 25348 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.785772 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:53.787029 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:53.787696 25276 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:53.789499 25090 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:18:53.790591 25093 leader_election.cc:343] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.792845 25024 catalog_manager.cc:5697] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.796728 25348 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.797397 25348 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.797842 25348 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.826318 25023 catalog_manager.cc:5697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.829777 25023 catalog_manager.cc:5697] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.840826 25348 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.847517 25391 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.866357 25436 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.867398 25024 catalog_manager.cc:5697] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:53.876434 25093 consensus_peers.cc:597] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:53.876749 25348 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.877928 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:53.877928 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:53.878993 25276 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:53.879837 25093 leader_election.cc:343] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.869267 25024 catalog_manager.cc:5697] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.881770 25316 tablet_bootstrap.cc:492] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:53.882264 25316 ts_tablet_manager.cc:1403] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.120s	user 0.035s	sys 0.057s
I20260709 12:18:53.885078 25316 raft_consensus.cc:359] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.885746 25316 raft_consensus.cc:385] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.886018 25316 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.887055 25316 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.888460 25276 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:53.889463 25316 ts_tablet_manager.cc:1434] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:53.889931 25090 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:53.890422 25316 tablet_bootstrap.cc:492] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:53.891279 25348 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.892427 25348 raft_consensus.cc:697] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:53.892962 25436 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.893424 25436 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.893388 25348 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.895591 25436 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:53.888911 25318 tablet_bootstrap.cc:492] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:53.896329 25318 ts_tablet_manager.cc:1403] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.141s	user 0.019s	sys 0.046s
I20260709 12:18:53.899304 25317 tablet_bootstrap.cc:492] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:53.899722 25317 ts_tablet_manager.cc:1403] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.128s	user 0.022s	sys 0.058s
I20260709 12:18:53.900488 25318 raft_consensus.cc:359] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.901192 25318 raft_consensus.cc:385] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.901480 25318 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.901427 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:53.901746 25317 raft_consensus.cc:359] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.902482 25317 raft_consensus.cc:385] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.902720 25317 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.902304 25318 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.903319 25317 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.905357 25318 ts_tablet_manager.cc:1434] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:18:53.905570 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:53.906399 25126 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:53.907107 25317 ts_tablet_manager.cc:1434] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:53.908008 25317 tablet_bootstrap.cc:492] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:53.910570 25242 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:18:53.911677 25242 leader_election.cc:343] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.912744 25318 tablet_bootstrap.cc:492] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:53.912940 25433 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.913352 25433 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.913653 25317 tablet_bootstrap.cc:654] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.913707 25433 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.919584 25321 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.922216 25436 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.924693 25416 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.925530 25318 tablet_bootstrap.cc:654] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.925182 25416 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.927321 25416 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:53.928798 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:53.929466 25127 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:53.931838 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:53.932895 25436 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.933261 25436 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.933604 25436 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.934784 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:53.933893 25433 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:53.937273 25242 leader_election.cc:343] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.948016 25433 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:53.949656 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:53.950522 25127 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.954322 25335 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.954854 25335 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.957221 25335 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:53.959498 25127 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:53.959935 25200 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.960669 25316 tablet_bootstrap.cc:654] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.961452 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:53.961539 25242 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:18:53.962697 25242 leader_election.cc:343] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.967386 25433 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.968456 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:53.974743 25436 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.977494 25436 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:53.978542 25377 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.978936 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:53.979212 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:53.979812 25125 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.981312 25168 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:53.985510 25317 tablet_bootstrap.cc:492] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:53.985997 25317 ts_tablet_manager.cc:1403] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.013s
I20260709 12:18:53.989173 25433 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:53.989108 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:53.989593 25317 raft_consensus.cc:359] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.990350 25317 raft_consensus.cc:385] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.990658 25317 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
W20260709 12:18:53.991176 25242 leader_election.cc:343] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.991798 25317 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:53.992764 25350 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:53.993865 25317 ts_tablet_manager.cc:1434] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 12:18:53.995255 25022 catalog_manager.cc:5697] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.996646 25125 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:53.997710 25316 tablet_bootstrap.cc:492] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:53.998219 25316 ts_tablet_manager.cc:1403] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.005s
I20260709 12:18:53.991879 25433 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.002399 25317 tablet_bootstrap.cc:492] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:54.001151 25316 raft_consensus.cc:359] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.007850 25316 raft_consensus.cc:385] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.008378 25316 raft_consensus.cc:740] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.009146 25316 consensus_queue.cc:260] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.011075 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:54.012706 25316 ts_tablet_manager.cc:1434] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:18:54.012838 25416 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:54.013489 25416 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:54.013660 25316 tablet_bootstrap.cc:492] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:54.014495 25416 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.019886 25318 tablet_bootstrap.cc:492] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:54.020503 25318 ts_tablet_manager.cc:1403] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.108s	user 0.029s	sys 0.040s
I20260709 12:18:54.028496 25317 tablet_bootstrap.cc:654] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.030222 25318 raft_consensus.cc:359] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.031049 25318 raft_consensus.cc:385] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.031405 25318 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.032132 25318 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.032929 25316 tablet_bootstrap.cc:654] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.034602 25318 ts_tablet_manager.cc:1434] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:18:54.035606 25318 tablet_bootstrap.cc:492] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:54.035908 25350 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.036995 25350 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.039597 25350 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:54.041518 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:54.042172 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:54.042384 25317 tablet_bootstrap.cc:492] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:54.042936 25317 ts_tablet_manager.cc:1403] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.000s
W20260709 12:18:54.044533 25165 leader_election.cc:343] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.044562 25125 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.044516 25350 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:18:54.042181 25126 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:54.048928 25317 raft_consensus.cc:359] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.049619 25317 raft_consensus.cc:385] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.049886 25317 raft_consensus.cc:740] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.050104 25168 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:18:54.050554 25317 consensus_queue.cc:260] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.052719 25317 ts_tablet_manager.cc:1434] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:18:54.053228 25350 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:54.053607 25317 tablet_bootstrap.cc:492] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:54.053450 25335 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.054884 25350 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.055410 25350 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.066475 25022 catalog_manager.cc:5697] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.078305 25318 tablet_bootstrap.cc:654] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.079226 25316 tablet_bootstrap.cc:492] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:54.079728 25316 ts_tablet_manager.cc:1403] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.066s	user 0.007s	sys 0.007s
I20260709 12:18:54.081174 25317 tablet_bootstrap.cc:654] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.086659 25316 raft_consensus.cc:359] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.087623 25316 raft_consensus.cc:385] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.093266 25316 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.093387 25317 tablet_bootstrap.cc:492] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:54.093925 25317 ts_tablet_manager.cc:1403] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.041s	user 0.005s	sys 0.014s
I20260709 12:18:54.095719 25316 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.096609 25317 raft_consensus.cc:359] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.097319 25317 raft_consensus.cc:385] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.097587 25317 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.098006 25316 ts_tablet_manager.cc:1434] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.003s
I20260709 12:18:54.091872 25350 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.104794 25022 catalog_manager.cc:5697] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.113772 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:54.114652 25126 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.119544 25416 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:54.098320 25317 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.126181 25316 tablet_bootstrap.cc:492] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:54.134136 25317 ts_tablet_manager.cc:1434] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 12:18:54.135329 25317 tablet_bootstrap.cc:492] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:54.142305 25416 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.140703 25350 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:54.146166 25416 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.149024 25318 tablet_bootstrap.cc:492] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:54.149130 25416 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:54.149572 25318 ts_tablet_manager.cc:1403] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.114s	user 0.019s	sys 0.006s
I20260709 12:18:54.151022 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:54.151443 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:54.151795 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:54.152237 25318 raft_consensus.cc:359] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.152925 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:18:54.153051 25165 leader_election.cc:343] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.154129 25317 tablet_bootstrap.cc:654] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.154340 25416 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:54.152948 25318 raft_consensus.cc:385] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.158725 25318 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.158788 25126 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:54.159977 25168 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:18:54.163697 25416 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.164248 25416 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.166724 25416 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:54.168180 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:18:54.169915 25242 leader_election.cc:343] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.170835 25350 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:54.171690 25350 raft_consensus.cc:697] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:54.171962 25316 tablet_bootstrap.cc:654] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.170737 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:54.172677 25125 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:54.173854 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:54.172732 25350 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.176380 25318 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.176786 25416 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:54.178808 25416 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.179247 25416 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:54.182439 25073 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:54.187131 25317 tablet_bootstrap.cc:492] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:54.187839 25318 ts_tablet_manager.cc:1434] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.002s
I20260709 12:18:54.188230 25317 ts_tablet_manager.cc:1403] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.002s
I20260709 12:18:54.189054 25318 tablet_bootstrap.cc:492] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:54.191020 25317 raft_consensus.cc:359] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.191696 25317 raft_consensus.cc:385] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.192164 25317 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.192951 25317 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:54.193452 25242 consensus_peers.cc:597] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:54.196409 25317 ts_tablet_manager.cc:1434] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:54.208945 25127 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.208725 25356 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:54.215440 25317 tablet_bootstrap.cc:492] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:54.224022 25317 tablet_bootstrap.cc:654] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.225118 25356 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.225819 25356 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.229560 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:54.229979 25356 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:54.231678 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:54.237939 25125 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:18:54.239763 25168 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:54.242321 25350 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.251312 25316 tablet_bootstrap.cc:492] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:54.251776 25316 ts_tablet_manager.cc:1403] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.126s	user 0.042s	sys 0.024s
I20260709 12:18:54.252429 25318 tablet_bootstrap.cc:654] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.254802 25022 catalog_manager.cc:5697] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.256343 25350 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:54.258713 25317 tablet_bootstrap.cc:492] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:54.262847 25428 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.269451 25317 ts_tablet_manager.cc:1403] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.054s	user 0.028s	sys 0.008s
I20260709 12:18:54.272138 25317 raft_consensus.cc:359] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.272662 25317 raft_consensus.cc:385] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.272884 25317 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.262534 25316 raft_consensus.cc:359] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.273463 25317 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.274036 25316 raft_consensus.cc:385] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.274353 25316 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.275009 25316 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.275570 25317 ts_tablet_manager.cc:1434] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:18:54.276505 25317 tablet_bootstrap.cc:492] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:54.249392 25416 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.277566 25316 ts_tablet_manager.cc:1434] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 12:18:54.278595 25316 tablet_bootstrap.cc:492] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:54.279572 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:54.280269 25126 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.280589 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:18:54.282667 25242 leader_election.cc:343] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.283250 25416 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:54.287672 25433 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.288237 25433 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.290664 25317 tablet_bootstrap.cc:654] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.290328 25433 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:54.291321 25433 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.293241 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:54.294745 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:54.302456 25316 tablet_bootstrap.cc:654] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.302943 25125 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 1: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:18:54.298768 25093 consensus_peers.cc:597] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:54.296597 25126 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:54.306054 25318 tablet_bootstrap.cc:492] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:54.306517 25318 ts_tablet_manager.cc:1403] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.118s	user 0.019s	sys 0.006s
I20260709 12:18:54.308320 25316 tablet_bootstrap.cc:492] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:54.308770 25316 ts_tablet_manager.cc:1403] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:18:54.311247 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:54.314644 25433 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:54.315193 25433 raft_consensus.cc:697] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:54.315827 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:54.316046 25433 consensus_queue.cc:237] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.316620 25416 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.312577 25316 raft_consensus.cc:359] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.309170 25318 raft_consensus.cc:359] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.335824 25316 raft_consensus.cc:385] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.335856 25318 raft_consensus.cc:385] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.336400 25316 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.336442 25318 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.337215 25318 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.337782 25416 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:54.339593 25318 ts_tablet_manager.cc:1434] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:18:54.339959 25316 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.340512 25318 tablet_bootstrap.cc:492] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:54.347288 25318 tablet_bootstrap.cc:654] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.352846 25316 ts_tablet_manager.cc:1434] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 12:18:54.354377 25316 tablet_bootstrap.cc:492] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:54.358136 25318 tablet_bootstrap.cc:492] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:54.358649 25318 ts_tablet_manager.cc:1403] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.001s
I20260709 12:18:54.360666 25316 tablet_bootstrap.cc:654] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.367561 25317 tablet_bootstrap.cc:492] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:54.368055 25317 ts_tablet_manager.cc:1403] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.092s	user 0.035s	sys 0.041s
I20260709 12:18:54.369565 25200 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.374305 25318 raft_consensus.cc:359] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.375083 25318 raft_consensus.cc:385] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.375371 25318 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.376070 25318 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.376240 25317 raft_consensus.cc:359] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.376977 25317 raft_consensus.cc:385] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.377275 25317 raft_consensus.cc:740] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.375428 25416 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:18:54.417331 25317 consensus_queue.cc:260] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.420506 25318 ts_tablet_manager.cc:1434] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 12:18:54.421279 25317 ts_tablet_manager.cc:1434] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.053s	user 0.017s	sys 0.006s
I20260709 12:18:54.421255 25276 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.431252 25318 tablet_bootstrap.cc:492] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:54.439073 25321 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:54.448741 25348 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.448890 25416 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:18:54.456990 25348 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.458633 25316 tablet_bootstrap.cc:492] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:54.459111 25316 ts_tablet_manager.cc:1403] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.034s
I20260709 12:18:54.462229 25316 raft_consensus.cc:359] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.463043 25316 raft_consensus.cc:385] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.463406 25316 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.464104 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:54.464234 25316 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:54.465689 25093 leader_election.cc:343] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.466936 25316 ts_tablet_manager.cc:1434] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:18:54.469599 25348 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:54.470811 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:54.471611 25272 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:54.474401 25090 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:54.475595 25348 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:54.476696 25348 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.477030 25348 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.478838 25316 tablet_bootstrap.cc:492] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:54.483349 25317 tablet_bootstrap.cc:492] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:54.485558 25318 tablet_bootstrap.cc:654] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.485827 25335 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.488461 25335 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.510201 25321 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.510929 25321 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.513674 25321 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:54.520897 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:54.522794 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:54.522861 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:54.520187 25022 catalog_manager.cc:5697] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:54.524242 25090 leader_election.cc:343] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.532349 25416 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.534350 25317 tablet_bootstrap.cc:654] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:54.530347 25093 leader_election.cc:343] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.535825 25093 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:54.537528 25348 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.538792 25321 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:54.539304 25318 tablet_bootstrap.cc:492] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:54.539935 25318 ts_tablet_manager.cc:1403] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.109s	user 0.018s	sys 0.022s
I20260709 12:18:54.541926 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:54.542655 25348 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:54.543402 25316 tablet_bootstrap.cc:654] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.544023 25335 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:54.545387 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:54.546630 25165 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:54.547822 25350 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:18:54.548686 25242 consensus_peers.cc:597] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:54.549727 25093 leader_election.cc:343] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.550649 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:54.551270 25276 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.647675 25372 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.648253 25372 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.656213 25350 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:54.658569 25202 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.661432 25276 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:54.667173 25372 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:54.668962 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:54.669883 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:18:54.673759 25242 leader_election.cc:343] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:54.721596 25485 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.140s	user 0.016s	sys 0.041s
I20260709 12:18:54.721783 25318 raft_consensus.cc:359] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.722689 25318 raft_consensus.cc:385] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.723040 25318 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.723798 25318 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.727469 25316 tablet_bootstrap.cc:492] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:54.727988 25316 ts_tablet_manager.cc:1403] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.260s	user 0.007s	sys 0.006s
I20260709 12:18:54.735678 25317 tablet_bootstrap.cc:492] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:54.736178 25317 ts_tablet_manager.cc:1403] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.253s	user 0.012s	sys 0.025s
I20260709 12:18:54.739149 25318 ts_tablet_manager.cc:1434] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.199s	user 0.007s	sys 0.000s
I20260709 12:18:54.740157 25318 tablet_bootstrap.cc:492] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:54.742986 25090 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:54.744009 25321 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:54.744452 25321 raft_consensus.cc:697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:54.745215 25321 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.753458 25316 raft_consensus.cc:359] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.754235 25316 raft_consensus.cc:385] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.754504 25316 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.756338 25316 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:54.729158 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 55458.6us
I20260709 12:18:54.755595 25317 raft_consensus.cc:359] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.762874 25317 raft_consensus.cc:385] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.763301 25317 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.764132 25317 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.768445 25317 ts_tablet_manager.cc:1434] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 12:18:54.769415 25317 tablet_bootstrap.cc:492] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:54.770329 25350 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.770499 25391 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.770818 25350 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.770995 25391 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.775303 25391 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:54.776583 25350 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:54.779495 25316 ts_tablet_manager.cc:1434] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 12:18:54.780272 25316 tablet_bootstrap.cc:492] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
W20260709 12:18:54.766803 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 111522us
I20260709 12:18:54.783305 25200 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.783794 25318 tablet_bootstrap.cc:654] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:54.784030 25242 leader_election.cc:343] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.784444 25242 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:54.787784 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:54.788715 25273 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:54.789597 25372 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:54.791245 25316 tablet_bootstrap.cc:654] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.796784 25392 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.800529 25317 tablet_bootstrap.cc:654] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.802145 25090 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:54.802670 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:54.803529 25321 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:18:54.803666 25242 consensus_peers.cc:597] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:54.803946 25321 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.804332 25321 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.808985 25436 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.811685 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:54.823621 25318 tablet_bootstrap.cc:492] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:54.826123 25318 ts_tablet_manager.cc:1403] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.086s	user 0.018s	sys 0.001s
I20260709 12:18:54.830482 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:18:54.848297 25093 leader_election.cc:343] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.851661 25168 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:54.853111 25318 raft_consensus.cc:359] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.853806 25318 raft_consensus.cc:385] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.858228 25318 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.827242 25321 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.861142 25316 tablet_bootstrap.cc:492] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:54.861768 25316 ts_tablet_manager.cc:1403] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.011s
I20260709 12:18:54.865130 25350 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:54.865870 25316 raft_consensus.cc:359] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.866920 25316 raft_consensus.cc:385] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.867352 25316 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.868300 25316 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.860441 25318 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.876336 25022 catalog_manager.cc:5697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.879565 25316 ts_tablet_manager.cc:1434] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:18:54.880419 25316 tablet_bootstrap.cc:492] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:54.881394 25318 ts_tablet_manager.cc:1434] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 12:18:54.882154 25318 tablet_bootstrap.cc:492] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:54.885226 25321 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:54.893661 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:54.895278 25372 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:18:54.896193 25093 leader_election.cc:343] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.904727 25317 tablet_bootstrap.cc:492] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:54.905160 25317 ts_tablet_manager.cc:1403] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.009s
I20260709 12:18:54.906136 25392 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.906610 25392 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.908676 25392 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:54.909286 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:54.909911 25124 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:54.911379 25316 tablet_bootstrap.cc:654] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.911427 25168 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:54.912014 25391 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.912571 25392 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:54.912454 25391 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.912930 25392 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.913276 25392 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.905252 25318 tablet_bootstrap.cc:654] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.919132 25372 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.919042 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:54.920073 25273 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.920013 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:54.917883 25391 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:54.919994 25372 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:54.922099 25093 leader_election.cc:343] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.927024 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:18:54.928469 25242 leader_election.cc:343] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.928550 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:54.929379 25273 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:54.923904 25372 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:18:54.929975 25242 leader_election.cc:343] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.930563 25242 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:54.932325 25433 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:54.938795 25317 raft_consensus.cc:359] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.939646 25317 raft_consensus.cc:385] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.939924 25317 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.940542 25317 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.946544 25090 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:54.947363 25317 ts_tablet_manager.cc:1434] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:18:54.948226 25317 tablet_bootstrap.cc:492] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:54.948980 25391 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:54.949657 25391 raft_consensus.cc:697] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:54.950935 25391 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:54.964593 25316 tablet_bootstrap.cc:492] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:54.965119 25316 ts_tablet_manager.cc:1403] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.006s
I20260709 12:18:54.966394 25317 tablet_bootstrap.cc:654] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.955574 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:54.971129 25276 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:54.971441 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:18:54.987798 25090 leader_election.cc:343] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.988488 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:54.989703 25348 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:55.002964 25316 raft_consensus.cc:359] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.003971 25316 raft_consensus.cc:385] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.004326 25316 raft_consensus.cc:740] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.953966 25392 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.012090 25392 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.008381 25316 consensus_queue.cc:260] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.013536 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:55.014112 25272 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.015247 25318 tablet_bootstrap.cc:492] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:55.015837 25318 ts_tablet_manager.cc:1403] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.134s	user 0.008s	sys 0.012s
I20260709 12:18:55.008843 25492 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.023460 25317 tablet_bootstrap.cc:492] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:55.024067 25317 ts_tablet_manager.cc:1403] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.076s	user 0.036s	sys 0.012s
I20260709 12:18:55.025230 25492 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.027472 25492 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.032462 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.033319 25317 raft_consensus.cc:359] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.034094 25317 raft_consensus.cc:385] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.034417 25317 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.035126 25317 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:55.035852 25090 leader_election.cc:343] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.036870 25316 ts_tablet_manager.cc:1434] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.002s
I20260709 12:18:55.039361 25316 tablet_bootstrap.cc:492] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:55.042578 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:55.044371 25317 ts_tablet_manager.cc:1434] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:18:55.045135 25317 tablet_bootstrap.cc:492] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:55.024547 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:18:55.050282 25093 leader_election.cc:343] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.050900 25125 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.050746 25093 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:55.055371 25025 catalog_manager.cc:5697] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.058763 25318 raft_consensus.cc:359] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.059450 25318 raft_consensus.cc:385] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.059718 25318 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.060374 25318 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.063678 25272 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:55.064756 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:55.065017 25318 ts_tablet_manager.cc:1434] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
I20260709 12:18:55.065548 25392 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:55.066124 25392 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:55.066170 25125 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:55.067478 25492 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:55.069327 25392 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.065944 25318 tablet_bootstrap.cc:492] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:55.082633 25317 tablet_bootstrap.cc:654] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.084820 25025 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.088341 25316 tablet_bootstrap.cc:654] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.088560 25318 tablet_bootstrap.cc:654] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.100991 25316 tablet_bootstrap.cc:492] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:55.101472 25316 ts_tablet_manager.cc:1403] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.000s
I20260709 12:18:55.100991 25318 tablet_bootstrap.cc:492] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:55.102440 25317 tablet_bootstrap.cc:492] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:55.102536 25318 ts_tablet_manager.cc:1403] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.009s
I20260709 12:18:55.102900 25317 ts_tablet_manager.cc:1403] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.009s
I20260709 12:18:55.103961 25316 raft_consensus.cc:359] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.104732 25316 raft_consensus.cc:385] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.104740 25317 raft_consensus.cc:359] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.105130 25316 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.105460 25317 raft_consensus.cc:385] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.105760 25317 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.105542 25318 raft_consensus.cc:359] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.106281 25318 raft_consensus.cc:385] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.106009 25316 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.106554 25318 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.106465 25317 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.107503 25318 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.108193 25316 ts_tablet_manager.cc:1434] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:18:55.109264 25316 tablet_bootstrap.cc:492] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:55.109521 25318 ts_tablet_manager.cc:1434] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:18:55.110939 25318 tablet_bootstrap.cc:492] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:55.114912 25317 ts_tablet_manager.cc:1434] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:18:55.115877 25317 tablet_bootstrap.cc:492] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:55.117094 25318 tablet_bootstrap.cc:654] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.120327 25316 tablet_bootstrap.cc:654] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.127388 25317 tablet_bootstrap.cc:654] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.135701 25316 tablet_bootstrap.cc:492] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:55.136163 25316 ts_tablet_manager.cc:1403] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
I20260709 12:18:55.136793 25318 tablet_bootstrap.cc:492] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:55.137225 25318 ts_tablet_manager.cc:1403] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
I20260709 12:18:55.138731 25316 raft_consensus.cc:359] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.139403 25316 raft_consensus.cc:385] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.139671 25316 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.139600 25318 raft_consensus.cc:359] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.140084 25317 tablet_bootstrap.cc:492] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:55.140538 25318 raft_consensus.cc:385] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.140852 25317 ts_tablet_manager.cc:1403] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 12:18:55.140630 25316 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.141017 25318 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.141748 25318 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.144654 25318 ts_tablet_manager.cc:1434] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:55.144411 25317 raft_consensus.cc:359] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.145234 25317 raft_consensus.cc:385] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.145531 25318 tablet_bootstrap.cc:492] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:55.145587 25317 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.146476 25316 ts_tablet_manager.cc:1434] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:18:55.146502 25317 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.147462 25316 tablet_bootstrap.cc:492] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:55.148895 25317 ts_tablet_manager.cc:1434] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:55.150171 25317 tablet_bootstrap.cc:492] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:55.153399 25318 tablet_bootstrap.cc:654] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.154718 25316 tablet_bootstrap.cc:654] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.155892 25317 tablet_bootstrap.cc:654] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.173149 25318 tablet_bootstrap.cc:492] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:55.175984 25318 ts_tablet_manager.cc:1403] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.010s
I20260709 12:18:55.177412 25316 tablet_bootstrap.cc:492] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:55.177870 25316 ts_tablet_manager.cc:1403] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.006s
I20260709 12:18:55.178766 25318 raft_consensus.cc:359] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.179441 25318 raft_consensus.cc:385] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.179709 25318 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.180276 25316 raft_consensus.cc:359] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.180949 25316 raft_consensus.cc:385] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.181253 25316 raft_consensus.cc:740] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.180507 25318 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.181893 25316 consensus_queue.cc:260] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.183461 25318 ts_tablet_manager.cc:1434] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:18:55.184208 25317 tablet_bootstrap.cc:492] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:55.184334 25318 tablet_bootstrap.cc:492] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:55.184219 25316 ts_tablet_manager.cc:1434] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:18:55.186088 25317 ts_tablet_manager.cc:1403] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 12:18:55.189157 25317 raft_consensus.cc:359] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.189759 25317 raft_consensus.cc:385] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.190037 25317 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.191334 25318 tablet_bootstrap.cc:654] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.195124 25317 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.197216 25316 tablet_bootstrap.cc:492] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:55.198381 25317 ts_tablet_manager.cc:1434] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:18:55.199155 25392 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.199391 25317 tablet_bootstrap.cc:492] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:55.199640 25392 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.202803 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.204411 25392 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.205086 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:55.206439 25317 tablet_bootstrap.cc:654] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.207154 25168 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:55.208396 25392 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:55.211890 25316 tablet_bootstrap.cc:654] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.218040 25202 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.236275 25318 tablet_bootstrap.cc:492] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:55.236806 25318 ts_tablet_manager.cc:1403] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.053s	user 0.029s	sys 0.012s
I20260709 12:18:55.239861 25318 raft_consensus.cc:359] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.240564 25318 raft_consensus.cc:385] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.240954 25318 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.241742 25318 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.244481 25318 ts_tablet_manager.cc:1434] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:18:55.245693 25318 tablet_bootstrap.cc:492] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:55.250274 25317 tablet_bootstrap.cc:492] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:55.250765 25317 ts_tablet_manager.cc:1403] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.021s
W20260709 12:18:55.251027 25073 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:55.252197 25318 tablet_bootstrap.cc:654] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.253034 25316 tablet_bootstrap.cc:492] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:55.253502 25316 ts_tablet_manager.cc:1403] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.004s
I20260709 12:18:55.253309 25317 raft_consensus.cc:359] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.254002 25317 raft_consensus.cc:385] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.254318 25317 raft_consensus.cc:740] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.254940 25317 consensus_queue.cc:260] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.256538 25316 raft_consensus.cc:359] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.259878 25316 raft_consensus.cc:385] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.260130 25316 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.260823 25316 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.263341 25317 ts_tablet_manager.cc:1434] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:18:55.263409 25316 ts_tablet_manager.cc:1434] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 12:18:55.264586 25316 tablet_bootstrap.cc:492] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:55.264608 25317 tablet_bootstrap.cc:492] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:55.266744 25318 tablet_bootstrap.cc:492] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:55.267421 25318 ts_tablet_manager.cc:1403] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 12:18:55.269925 25318 raft_consensus.cc:359] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.270748 25318 raft_consensus.cc:385] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.271006 25318 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.271818 25318 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.274813 25317 tablet_bootstrap.cc:654] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.275754 25316 tablet_bootstrap.cc:654] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.281025 25321 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.281517 25321 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.285491 25321 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.285907 25318 ts_tablet_manager.cc:1434] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:18:55.286971 25318 tablet_bootstrap.cc:492] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:55.292887 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.293776 25272 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:55.296437 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:55.296660 25090 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:55.297581 25321 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:55.297931 25321 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.298278 25321 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.301592 25318 tablet_bootstrap.cc:654] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:55.303395 25093 leader_election.cc:343] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.319523 25202 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.320915 25317 tablet_bootstrap.cc:492] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:55.321385 25317 ts_tablet_manager.cc:1403] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.010s
I20260709 12:18:55.324414 25321 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.327322 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:18:55.329111 25093 leader_election.cc:343] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.330183 25492 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:55.330672 25317 raft_consensus.cc:359] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.331317 25317 raft_consensus.cc:385] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.331595 25317 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.332239 25317 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.334373 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:55.334942 25272 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.336288 25316 tablet_bootstrap.cc:492] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:55.337445 25316 ts_tablet_manager.cc:1403] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.019s
I20260709 12:18:55.338497 25321 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.343367 25392 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.345168 25392 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.348380 25392 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.341202 25316 raft_consensus.cc:359] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.351361 25316 raft_consensus.cc:385] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.351281 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:55.351816 25316 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.352339 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.352939 25273 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:55.352774 25316 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.354142 25165 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:18:55.342407 25317 ts_tablet_manager.cc:1434] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 12:18:55.355391 25317 tablet_bootstrap.cc:492] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:55.355587 25372 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.356019 25372 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.342881 25433 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.359488 25433 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.360539 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:55.362309 25127 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:55.362625 25433 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:55.357885 25372 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:55.363726 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:55.364329 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:55.364897 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:55.365403 25372 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:55.365772 25372 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.365716 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:55.366348 25372 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.366911 25127 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:55.369585 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:55.361832 25316 ts_tablet_manager.cc:1434] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.005s
I20260709 12:18:55.372179 25316 tablet_bootstrap.cc:492] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:55.373063 25433 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:55.373468 25433 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.373886 25433 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:55.378369 25242 leader_election.cc:343] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:55.382964 25242 leader_election.cc:343] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.387885 25200 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.388655 25492 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:55.389077 25316 tablet_bootstrap.cc:654] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.388685 25272 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:55.391814 25090 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:55.392985 25335 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.393476 25335 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.394418 25506 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:55.394940 25506 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:55.395241 25318 tablet_bootstrap.cc:492] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:55.395655 25318 ts_tablet_manager.cc:1403] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.024s
I20260709 12:18:55.396014 25317 tablet_bootstrap.cc:654] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.395850 25492 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.394407 25372 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.398523 25392 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:55.395771 25506 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.395644 25335 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.400983 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:55.400995 25492 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.401732 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.409914 25372 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:55.411031 25127 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
W20260709 12:18:55.414072 25165 leader_election.cc:343] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.419212 25392 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:18:55.419797 25392 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.421253 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:55.421856 25127 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.422091 25492 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.419111 25168 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:18:55.426206 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:55.425947 25318 raft_consensus.cc:359] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.426774 25318 raft_consensus.cc:385] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.427071 25318 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.427809 25318 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.429837 25318 ts_tablet_manager.cc:1434] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.001s
I20260709 12:18:55.427567 25335 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:55.430546 25335 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.430830 25318 tablet_bootstrap.cc:492] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:55.431149 25127 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:55.417809 25433 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.430884 25335 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.436501 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:55.439050 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:18:55.439985 25242 leader_election.cc:343] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.442495 25416 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:55.443846 25316 tablet_bootstrap.cc:492] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:55.443742 25416 raft_consensus.cc:697] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:55.444356 25316 ts_tablet_manager.cc:1403] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.013s
I20260709 12:18:55.446835 25391 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.447871 25433 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:55.441884 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.449100 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:18:55.451231 25242 leader_election.cc:343] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.444907 25416 consensus_queue.cc:237] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.451669 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:55.457109 25127 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.448928 25391 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.461717 25392 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.462813 25391 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.463526 25317 tablet_bootstrap.cc:492] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:55.458561 25321 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:18:55.480953 25090 leader_election.cc:343] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.486476 25202 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:55.451624 25335 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.592823 25317 ts_tablet_manager.cc:1403] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.238s	user 0.033s	sys 0.050s
I20260709 12:18:55.496157 25372 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.586747 25433 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.596052 25416 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.617823 25316 raft_consensus.cc:359] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.624003 25316 raft_consensus.cc:385] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.624408 25316 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.613189 25201 raft_consensus.cc:2393] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 1: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:18:55.609831 25350 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.628226 25316 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.631971 25350 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.633620 25348 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.634210 25348 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.635036 25350 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.631358 25392 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.615674 25433 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.617385 25416 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.660861 25317 raft_consensus.cc:359] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.613857 25372 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.663033 25317 raft_consensus.cc:385] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.663378 25317 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.664881 25317 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.662719 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:55.673925 25317 ts_tablet_manager.cc:1434] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.001s
I20260709 12:18:55.676427 25316 ts_tablet_manager.cc:1434] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.232s	user 0.015s	sys 0.008s
I20260709 12:18:55.668376 25348 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.677625 25316 tablet_bootstrap.cc:492] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:55.677129 25022 catalog_manager.cc:5697] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:55.681545 25318 tablet_bootstrap.cc:654] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.681677 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:55.682542 25433 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:55.685273 25317 tablet_bootstrap.cc:492] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:55.696182 25531 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.694886 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:55.689083 25335 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.704650 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:55.697671 25531 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.695598 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:55.703955 25127 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:55.713110 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.708917 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:55.709048 25531 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.716852 25125 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:55.713754 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:55.720538 25025 catalog_manager.cc:5697] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.711611 25201 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.734203 25534 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.734534 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:55.734786 25534 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.736444 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.736960 25534 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.737082 25275 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:55.729182 25391 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:55.738444 25242 leader_election.cc:343] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.738905 25391 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.739508 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:55.739714 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.740279 25272 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:55.740698 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:55.740895 25391 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.714280 25348 consensus_queue.cc:1059] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:18:55.742444 25433 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:55.742913 25433 raft_consensus.cc:697] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:55.744320 25433 consensus_queue.cc:237] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.746198 25198 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:55.711076 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:55.723171 25123 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.741838 25348 raft_consensus.cc:3055] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:18:55.768909 25530 log.cc:927] Time spent T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:18:55.769019 25535 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:55.769618 25535 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.742952 25372 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:55.769960 25535 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.766312 25348 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:55.795614 25348 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.797233 25348 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.799005 25416 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:18:55.754873 25093 leader_election.cc:343] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.816332 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:18:55.806803 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 55007.6us
I20260709 12:18:55.812055 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.824532 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:55.825385 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.813539 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:55.825917 25090 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:55.830581 25125 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:55.831228 25318 tablet_bootstrap.cc:492] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:55.831681 25318 ts_tablet_manager.cc:1403] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.401s	user 0.013s	sys 0.015s
I20260709 12:18:55.834118 25202 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:55.836894 25093 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:55.837579 25317 tablet_bootstrap.cc:654] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.842514 25392 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.844270 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:55.844946 25196 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:55.836261 25318 raft_consensus.cc:359] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.847016 25318 raft_consensus.cc:385] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:55.847270 25318 raft_consensus.cc:740] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:55.840341 25321 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:55.849906 25321 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.850286 25321 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.832036 25276 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:55.857736 25318 consensus_queue.cc:260] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:55.861024 25242 leader_election.cc:343] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.874855 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:55.846572 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:55.849120 25123 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:55.878468 25416 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:55.878221 25165 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:55.884508 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:55.856448 25534 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:18:55.846323 25392 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.891026 25318 ts_tablet_manager.cc:1434] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.059s	user 0.017s	sys 0.005s
I20260709 12:18:55.888346 25416 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.882251 25391 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:55.889168 25492 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:55.896003 25391 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.898906 25391 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:55.898825 25165 leader_election.cc:343] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.899683 25165 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:55.892486 25416 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.917675 25318 tablet_bootstrap.cc:492] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:55.913254 25335 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:55.927650 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:55.917490 25321 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.935770 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.939193 25335 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.946671 25531 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:55.947026 25392 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:55.949321 25335 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:55.944867 25165 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:55.968772 25534 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:55.969926 25316 tablet_bootstrap.cc:654] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:55.971864 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
W20260709 12:18:55.972115 25546 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:18:55.972766 25372 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:55.973116 25372 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.973441 25372 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:55.983466 25090 leader_election.cc:343] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:55.977770 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:55.992233 25535 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:55.993217 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:55.993532 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:55.994457 25275 raft_consensus.cc:2393] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:18:55.995108 25321 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.003949 25550 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.058s
I20260709 12:18:56.002135 25391 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.010759 25391 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.011524 25372 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.014410 25127 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:18:56.015271 25093 leader_election.cc:343] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.015914 25093 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:56.016875 25321 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.021330 25168 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:18:56.022205 25350 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:56.022495 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:56.022799 25350 raft_consensus.cc:697] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:18:56.023141 25168 leader_election.cc:343] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.023739 25350 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.024098 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:56.024736 25271 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.030277 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:56.026002 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:56.033258 25126 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.034438 25202 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.035406 25535 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:56.025955 25551 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:18:56.048117 25372 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:56.051872 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:56.052843 25126 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
W20260709 12:18:56.053526 25242 leader_election.cc:343] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.054563 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:56.056141 25372 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:18:56.058634 25093 leader_election.cc:343] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.061864 25372 raft_consensus.cc:697] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:56.066237 25372 consensus_queue.cc:237] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.066669 25335 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.079555 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:56.073410 25535 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:18:56.080829 25165 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:56.081611 25392 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.073921 25416 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.087013 25335 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.087391 25276 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:18:56.088999 25316 tablet_bootstrap.cc:492] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:56.089471 25316 ts_tablet_manager.cc:1403] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.412s	user 0.021s	sys 0.005s
I20260709 12:18:56.094425 25317 tablet_bootstrap.cc:492] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:56.095099 25317 ts_tablet_manager.cc:1403] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.410s	user 0.017s	sys 0.003s
I20260709 12:18:56.097733 25552 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.098290 25552 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.101289 25271 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:56.102370 25316 raft_consensus.cc:359] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.103253 25316 raft_consensus.cc:385] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.103602 25316 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.104472 25316 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.093474 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:56.108559 25552 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.116171 25316 ts_tablet_manager.cc:1434] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.006s
I20260709 12:18:56.117506 25316 tablet_bootstrap.cc:492] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:56.118573 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:18:56.119830 25093 leader_election.cc:343] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.126632 25492 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:56.128726 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:56.133145 25123 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 1: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:18:56.133011 25317 raft_consensus.cc:359] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.133766 25317 raft_consensus.cc:385] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.134068 25317 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.134680 25317 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.139953 25416 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:56.143313 25416 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.143451 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:56.143782 25416 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:56.145007 25168 leader_election.cc:343] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.149571 25317 ts_tablet_manager.cc:1434] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.004s
I20260709 12:18:56.150174 25318 tablet_bootstrap.cc:654] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.150570 25317 tablet_bootstrap.cc:492] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:56.151657 25025 catalog_manager.cc:5697] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.152648 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:56.153621 25551 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.155156 25551 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.155596 25416 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:56.156448 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:56.157054 25123 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:56.147727 25090 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:56.160287 25348 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:56.160746 25348 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:56.161711 25348 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.162694 25551 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.163427 25202 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:56.165517 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:18:56.165663 25242 consensus_peers.cc:597] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:56.165069 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:18:56.167064 25242 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:56.167841 25433 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:56.168253 25433 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.168581 25433 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.175420 25200 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 1: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:18:56.165843 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:56.179744 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:56.173182 25552 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:56.189708 25123 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:18:56.191625 25090 leader_election.cc:343] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.192132 25090 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:56.166364 25350 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.218173 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:56.194423 25553 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.209944 25392 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.195040 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:56.224177 25201 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 1: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:18:56.222728 25271 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:18:56.229321 25535 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.229799 25535 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.231787 25535 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:56.179970 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:56.242610 25202 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.242728 25492 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:56.195006 25552 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:56.261828 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:56.262732 25123 raft_consensus.cc:2393] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 1: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:18:56.252491 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:18:56.264168 25561 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.098s	user 0.001s	sys 0.002s
I20260709 12:18:56.264866 25316 tablet_bootstrap.cc:654] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.281147 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:56.285148 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:56.288779 25416 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.289314 25552 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.303025 25316 tablet_bootstrap.cc:492] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:56.303506 25316 ts_tablet_manager.cc:1403] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.186s	user 0.020s	sys 0.009s
I20260709 12:18:56.306896 25022 catalog_manager.cc:5697] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.307193 25316 raft_consensus.cc:359] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.308167 25316 raft_consensus.cc:385] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.308444 25316 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.309243 25316 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.309741 25022 catalog_manager.cc:5697] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.313665 25316 ts_tablet_manager.cc:1434] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:18:56.314689 25316 tablet_bootstrap.cc:492] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:56.323100 25318 tablet_bootstrap.cc:492] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:56.323167 25317 tablet_bootstrap.cc:654] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.323575 25316 tablet_bootstrap.cc:654] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.323714 25318 ts_tablet_manager.cc:1403] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.412s	user 0.016s	sys 0.020s
I20260709 12:18:56.336163 25416 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.336699 25416 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.338806 25416 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:56.329439 25540 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:18:56.340579 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:56.341281 25127 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:56.343539 25242 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:56.344434 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:18:56.348474 25242 consensus_peers.cc:597] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:56.348970 25242 leader_election.cc:343] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.352846 25242 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:56.355584 25540 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:18:56.347504 25073 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:56.362859 25202 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:56.333876 25433 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.384491 25433 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:56.368530 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:56.356904 25535 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:56.385277 25317 tablet_bootstrap.cc:492] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:56.375510 25540 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.385179 25535 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.385811 25535 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.385839 25165 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:56.387246 25551 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.373795 25318 raft_consensus.cc:359] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.390851 25318 raft_consensus.cc:385] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.391156 25318 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.391850 25318 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.385360 25350 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.394367 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:56.395090 25126 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.396906 25022 catalog_manager.cc:5697] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.397462 25535 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.398200 25317 ts_tablet_manager.cc:1403] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.248s	user 0.016s	sys 0.001s
I20260709 12:18:56.398411 25318 ts_tablet_manager.cc:1434] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 12:18:56.399338 25318 tablet_bootstrap.cc:492] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:56.400522 25535 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:56.404874 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:56.406483 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:56.407817 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:56.408082 25540 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.409479 25022 catalog_manager.cc:5697] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.400843 25317 raft_consensus.cc:359] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.401914 25126 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:56.412334 25317 raft_consensus.cc:385] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.412643 25317 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.401984 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:56.413760 25123 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.413558 25317 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.417249 25317 ts_tablet_manager.cc:1434] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:18:56.418243 25317 tablet_bootstrap.cc:492] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:56.420790 25318 tablet_bootstrap.cc:654] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.428277 25123 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:56.424302 25316 tablet_bootstrap.cc:492] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:56.432410 25316 ts_tablet_manager.cc:1403] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.023s
I20260709 12:18:56.430088 25242 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:56.434679 25416 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:56.435179 25416 raft_consensus.cc:697] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:56.435979 25416 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.436161 25316 raft_consensus.cc:359] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.437238 25316 raft_consensus.cc:385] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.437506 25316 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.430734 25317 tablet_bootstrap.cc:654] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.442612 25316 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.444171 25316 ts_tablet_manager.cc:1434] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:18:56.445045 25316 tablet_bootstrap.cc:492] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
W20260709 12:18:56.449141 25242 leader_election.cc:343] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:56.450415 25242 leader_election.cc:343] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:56.451282 25242 leader_election.cc:343] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.454355 25242 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:56.455435 25535 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:56.456081 25535 raft_consensus.cc:697] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:56.457175 25535 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.463689 25316 tablet_bootstrap.cc:654] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.467077 25318 tablet_bootstrap.cc:492] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:56.467417 25318 ts_tablet_manager.cc:1403] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.004s
I20260709 12:18:56.469061 25316 tablet_bootstrap.cc:492] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:56.469520 25316 ts_tablet_manager.cc:1403] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.002s
I20260709 12:18:56.469909 25318 raft_consensus.cc:359] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.472132 25318 raft_consensus.cc:385] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.471993 25316 raft_consensus.cc:359] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.472404 25318 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.472662 25316 raft_consensus.cc:385] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.472922 25316 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.473537 25316 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.475523 25316 ts_tablet_manager.cc:1434] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.005s
I20260709 12:18:56.476351 25316 tablet_bootstrap.cc:492] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:56.477454 25025 catalog_manager.cc:5697] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.481287 25318 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.483318 25318 ts_tablet_manager.cc:1434] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:18:56.485464 25318 tablet_bootstrap.cc:492] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:56.488315 25317 tablet_bootstrap.cc:492] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:56.488763 25317 ts_tablet_manager.cc:1403] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.071s	user 0.029s	sys 0.006s
I20260709 12:18:56.491073 25318 tablet_bootstrap.cc:654] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.481961 25316 tablet_bootstrap.cc:654] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.493842 25317 raft_consensus.cc:359] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.494535 25317 raft_consensus.cc:385] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.494858 25317 raft_consensus.cc:740] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.495626 25317 consensus_queue.cc:260] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.498116 25317 ts_tablet_manager.cc:1434] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:18:56.498986 25317 tablet_bootstrap.cc:492] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:56.501022 25534 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.501523 25534 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.504973 25318 tablet_bootstrap.cc:492] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:56.505136 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:56.505445 25318 ts_tablet_manager.cc:1403] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.002s
I20260709 12:18:56.507583 25317 tablet_bootstrap.cc:654] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.509661 25534 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.514484 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:56.516185 25168 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:56.516853 25534 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.516537 25318 raft_consensus.cc:359] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.517542 25318 raft_consensus.cc:385] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.517896 25318 raft_consensus.cc:740] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.519496 25318 consensus_queue.cc:260] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.524645 25023 catalog_manager.cc:5697] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.528247 25318 ts_tablet_manager.cc:1434] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 12:18:56.529234 25318 tablet_bootstrap.cc:492] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:56.538265 25318 tablet_bootstrap.cc:654] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.539824 25317 tablet_bootstrap.cc:492] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:56.540374 25317 ts_tablet_manager.cc:1403] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.003s
I20260709 12:18:56.540724 25316 tablet_bootstrap.cc:492] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:56.541201 25316 ts_tablet_manager.cc:1403] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.003s
I20260709 12:18:56.543668 25317 raft_consensus.cc:359] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.544371 25317 raft_consensus.cc:385] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.544203 25316 raft_consensus.cc:359] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.544648 25317 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.544881 25316 raft_consensus.cc:385] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.545169 25316 raft_consensus.cc:740] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.545441 25317 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.545979 25316 consensus_queue.cc:260] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.551661 25317 ts_tablet_manager.cc:1434] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:18:56.552588 25317 tablet_bootstrap.cc:492] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:56.558992 25506 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.559330 25318 tablet_bootstrap.cc:492] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:56.559510 25506 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.560029 25318 ts_tablet_manager.cc:1403] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.004s
I20260709 12:18:56.561704 25506 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.569485 25316 ts_tablet_manager.cc:1434] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.028s	user 0.000s	sys 0.008s
I20260709 12:18:56.562975 25318 raft_consensus.cc:359] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.570225 25318 raft_consensus.cc:385] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.570511 25318 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.570766 25316 tablet_bootstrap.cc:492] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:56.571143 25318 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.563570 25317 tablet_bootstrap.cc:654] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.563805 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:56.573329 25272 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:18:56.573635 25318 ts_tablet_manager.cc:1434] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.001s
I20260709 12:18:56.563804 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:56.574585 25318 tablet_bootstrap.cc:492] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:56.574658 25202 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 1: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:18:56.575799 25093 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:56.576790 25506 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.580392 25318 tablet_bootstrap.cc:654] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.565515 25535 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:56.583606 25506 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.591758 25318 tablet_bootstrap.cc:492] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:56.592252 25318 ts_tablet_manager.cc:1403] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.009s
I20260709 12:18:56.594851 25318 raft_consensus.cc:359] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.595558 25318 raft_consensus.cc:385] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.595839 25318 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.596787 25316 tablet_bootstrap.cc:654] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.599579 25317 tablet_bootstrap.cc:492] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:56.599164 25318 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.600181 25317 ts_tablet_manager.cc:1403] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.012s
I20260709 12:18:56.601578 25318 ts_tablet_manager.cc:1434] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:18:56.602857 25318 tablet_bootstrap.cc:492] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:56.603971 25317 raft_consensus.cc:359] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.604718 25317 raft_consensus.cc:385] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.605033 25317 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.605818 25317 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.608067 25317 ts_tablet_manager.cc:1434] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:18:56.609256 25317 tablet_bootstrap.cc:492] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:56.609618 25318 tablet_bootstrap.cc:654] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.615278 25317 tablet_bootstrap.cc:654] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.621093 25318 tablet_bootstrap.cc:492] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:56.621606 25318 ts_tablet_manager.cc:1403] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 12:18:56.624104 25318 raft_consensus.cc:359] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.624784 25318 raft_consensus.cc:385] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.625052 25318 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.625845 25318 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.626370 25540 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:56.628145 25318 ts_tablet_manager.cc:1434] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:18:56.628895 25534 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:56.629289 25202 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.629827 25551 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:56.633697 25317 tablet_bootstrap.cc:492] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:56.634311 25317 ts_tablet_manager.cc:1403] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 12:18:56.636972 25317 raft_consensus.cc:359] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.637703 25317 raft_consensus.cc:385] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.638013 25317 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.638728 25317 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.640848 25317 ts_tablet_manager.cc:1434] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:56.641738 25317 tablet_bootstrap.cc:492] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:56.643010 25318 tablet_bootstrap.cc:492] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:56.653473 25316 tablet_bootstrap.cc:492] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:56.653534 25317 tablet_bootstrap.cc:654] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.654145 25316 ts_tablet_manager.cc:1403] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.002s
I20260709 12:18:56.657709 25551 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.658365 25551 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.661792 25318 tablet_bootstrap.cc:654] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.665843 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:56.666746 25272 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:56.673164 25165 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:56.676190 25534 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:56.676702 25534 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.677176 25534 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.687071 25557 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.687743 25557 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.691190 25557 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.691919 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:56.692876 25127 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:56.693662 25335 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.694343 25335 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.694782 25168 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:56.695917 25540 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.696621 25540 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.699223 25540 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:56.699753 25552 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:56.700652 25350 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:56.701112 25350 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.701565 25350 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.703373 25553 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.704051 25553 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.706987 25553 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.708971 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:56.710183 25272 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:56.709019 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:18:56.715960 25093 leader_election.cc:343] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.718180 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:18:56.720001 25090 leader_election.cc:343] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.720465 25090 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:56.722225 25506 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.723275 25392 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.723939 25392 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.725581 25551 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.726666 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:56.726837 25392 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.727540 25272 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:56.728004 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:56.728873 25126 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:56.730481 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:56.731540 25392 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:56.731945 25392 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.732430 25392 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.734314 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:56.738826 25197 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.743418 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:56.696969 25335 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.767625 25552 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:56.769614 25534 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.771571 25202 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:18:56.773377 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:56.774531 25123 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:18:56.775287 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:56.777549 25506 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:56.779469 25168 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:56.781041 25534 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.781792 25534 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.786522 25552 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:56.786923 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:56.787856 25552 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:56.789953 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:56.790729 25552 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.793047 25552 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.794631 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:56.796372 25335 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:56.805143 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:56.806159 25123 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:56.767457 25316 raft_consensus.cc:359] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.807708 25316 raft_consensus.cc:385] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.808015 25316 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.808748 25316 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.809331 25318 tablet_bootstrap.cc:492] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:56.809955 25318 ts_tablet_manager.cc:1403] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.167s	user 0.063s	sys 0.091s
I20260709 12:18:56.811616 25335 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.812105 25335 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.813082 25392 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.814225 25540 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.814697 25540 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.814931 25318 raft_consensus.cc:359] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.815634 25318 raft_consensus.cc:385] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.815918 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:56.817210 25123 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.818090 25534 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.816764 25317 tablet_bootstrap.cc:492] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:56.818761 25317 ts_tablet_manager.cc:1403] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.177s	user 0.074s	sys 0.077s
I20260709 12:18:56.819540 25316 ts_tablet_manager.cc:1434] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.165s	user 0.004s	sys 0.002s
I20260709 12:18:56.822245 25392 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.819949 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:56.823088 25316 tablet_bootstrap.cc:492] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:56.824992 25317 raft_consensus.cc:359] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.825309 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:56.825670 25317 raft_consensus.cc:385] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.825912 25272 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.826017 25317 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.826797 25317 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.828370 25123 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:56.830060 25316 tablet_bootstrap.cc:654] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.820387 25335 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.821040 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:56.831436 25317 ts_tablet_manager.cc:1434] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:18:56.831322 25168 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:56.832458 25317 tablet_bootstrap.cc:492] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:56.832381 25168 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:56.811141 25350 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.833526 25392 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:56.833992 25392 raft_consensus.cc:697] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:56.834702 25534 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.835803 25392 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.816707 25540 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:56.815913 25318 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.840371 25318 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:56.842156 25242 leader_election.cc:343] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.844450 25202 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.844450 25318 ts_tablet_manager.cc:1434] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:18:56.846964 25318 tablet_bootstrap.cc:492] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:56.851830 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:56.852698 25317 tablet_bootstrap.cc:654] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.855784 25272 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:56.865669 25316 tablet_bootstrap.cc:492] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:56.884986 25316 ts_tablet_manager.cc:1403] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.021s
I20260709 12:18:56.863662 25242 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:56.870777 25318 tablet_bootstrap.cc:654] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.867465 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:18:56.895799 25242 leader_election.cc:343] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.904341 25126 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:56.895895 25536 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:56.911629 25536 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.912000 25536 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.895820 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:56.918479 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:56.921332 25123 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.922192 25350 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.927136 25433 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:56.927579 25433 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.927503 25535 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:56.927997 25433 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.928128 25025 catalog_manager.cc:5697] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.934062 25123 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:56.935247 25168 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:56.936144 25534 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:56.936628 25534 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:56.939313 25557 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.922255 25536 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.950551 25317 tablet_bootstrap.cc:492] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:56.951604 25317 ts_tablet_manager.cc:1403] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.119s	user 0.026s	sys 0.031s
I20260709 12:18:56.940659 25540 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:18:56.951128 25557 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.958180 25202 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.959263 25557 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:56.960156 25534 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.960853 25536 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:56.971135 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:56.971933 25126 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:18:56.977207 25552 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:18:56.977489 25316 raft_consensus.cc:359] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.980010 25316 raft_consensus.cc:385] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.980299 25316 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.962296 25535 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:18:56.980914 25316 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.983150 25316 ts_tablet_manager.cc:1434] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.000s
I20260709 12:18:56.983107 25433 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.984385 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:56.984937 25271 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.988444 25506 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.989030 25506 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:56.994340 25316 tablet_bootstrap.cc:492] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:56.998435 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:56.999382 25202 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:18:57.003341 25433 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:18:57.004313 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 59651.2us
I20260709 12:18:57.005607 25093 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:57.006393 25553 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:57.006762 25553 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.007076 25553 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:57.007954 25506 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:57.011615 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:57.014921 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:57.016690 25271 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:57.026602 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:57.027225 25126 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.030905 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:57.031605 25318 tablet_bootstrap.cc:492] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:57.032454 25318 ts_tablet_manager.cc:1403] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.186s	user 0.009s	sys 0.012s
I20260709 12:18:57.032373 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:57.031543 25124 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:57.036106 25242 leader_election.cc:343] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.033550 25165 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:57.038443 25540 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.040424 25552 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.041041 25552 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.042497 25317 raft_consensus.cc:359] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.042225 25023 catalog_manager.cc:5697] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.043144 25317 raft_consensus.cc:385] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.043435 25317 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.044049 25317 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.039165 25350 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:57.050406 25317 ts_tablet_manager.cc:1434] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.002s
I20260709 12:18:57.051599 25317 tablet_bootstrap.cc:492] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:57.053179 25318 raft_consensus.cc:359] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.053701 25318 raft_consensus.cc:385] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.053926 25318 raft_consensus.cc:740] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.036917 25506 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:18:57.058385 25318 consensus_queue.cc:260] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.061807 25318 ts_tablet_manager.cc:1434] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.005s
I20260709 12:18:57.063760 25318 tablet_bootstrap.cc:492] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
W20260709 12:18:57.076037 25242 leader_election.cc:343] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.065280 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:57.064131 25553 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.120646 25126 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:57.125170 25124 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:57.126606 25552 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:57.126950 25553 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:57.128304 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:57.131078 25318 tablet_bootstrap.cc:654] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.133664 25242 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:57.120859 25416 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.136021 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:57.137497 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:57.139063 25433 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:57.139587 25433 raft_consensus.cc:697] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:57.141989 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:57.142650 25202 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:57.138207 25535 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:57.144733 25535 raft_consensus.cc:697] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:18:57.146798 25093 leader_election.cc:343] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.152141 25202 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:18:57.153245 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:57.138650 25416 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.155396 25316 tablet_bootstrap.cc:654] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.156662 25093 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:57.157823 25317 tablet_bootstrap.cc:654] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.159415 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:57.160233 25506 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:57.146580 25535 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.140419 25433 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.155900 25416 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:57.194813 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:18:57.165053 25242 leader_election.cc:343] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.195609 25122 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:57.199465 25316 tablet_bootstrap.cc:492] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
W20260709 12:18:57.177165 25090 leader_election.cc:343] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.199837 25317 tablet_bootstrap.cc:492] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:57.200381 25317 ts_tablet_manager.cc:1403] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.149s	user 0.011s	sys 0.002s
I20260709 12:18:57.200246 25090 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:57.201159 25316 ts_tablet_manager.cc:1403] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.207s	user 0.011s	sys 0.003s
I20260709 12:18:57.165709 25506 raft_consensus.cc:697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:57.202409 25506 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.206250 25316 raft_consensus.cc:359] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.206971 25316 raft_consensus.cc:385] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.207250 25316 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.207880 25316 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.209432 25316 ts_tablet_manager.cc:1434] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 12:18:57.210325 25316 tablet_bootstrap.cc:492] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:57.214553 25317 raft_consensus.cc:359] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.215327 25317 raft_consensus.cc:385] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.215668 25317 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.216300 25317 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.217497 25610 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:57.218180 25317 ts_tablet_manager.cc:1434] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 12:18:57.219841 25317 tablet_bootstrap.cc:492] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:57.220739 25242 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:57.223747 25602 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:57.224143 25602 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.224478 25602 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.230017 25317 tablet_bootstrap.cc:654] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.231969 25602 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.232311 25610 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.232908 25610 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.233523 25023 catalog_manager.cc:5697] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.235131 25610 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:57.235857 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:57.237991 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:57.238601 25125 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.239342 25316 tablet_bootstrap.cc:654] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.242538 25602 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:18:57.242895 25093 leader_election.cc:343] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.243165 25540 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:18:57.243683 25540 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.245617 25540 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:57.246711 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:57.249207 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:57.235414 25023 catalog_manager.cc:5697] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:57.252027 25242 leader_election.cc:343] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.257470 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:57.258648 25198 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:18:57.276077 25242 leader_election.cc:400] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:18:57.276979 25242 leader_election.cc:403] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:57.277333 25318 tablet_bootstrap.cc:492] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:57.277974 25318 ts_tablet_manager.cc:1403] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.215s	user 0.006s	sys 0.016s
I20260709 12:18:57.265977 25125 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:57.279728 25416 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:57.269038 25534 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:18:57.296674 25392 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.297387 25392 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.302224 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:57.303323 25125 raft_consensus.cc:2393] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:18:57.304482 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:18:57.306422 25090 leader_election.cc:343] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.307004 25090 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:57.308386 25506 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:57.309926 25392 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:57.315574 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:57.337009 25165 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:57.311865 25023 catalog_manager.cc:5697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.339445 25534 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.342304 25416 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:18:57.345817 25392 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.349335 25318 raft_consensus.cc:359] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.350407 25318 raft_consensus.cc:385] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.350844 25318 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.351796 25318 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.355006 25242 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:57.359266 25602 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:57.359758 25602 raft_consensus.cc:697] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:57.360634 25602 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.370445 25317 tablet_bootstrap.cc:492] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:57.370946 25317 ts_tablet_manager.cc:1403] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.151s	user 0.043s	sys 0.047s
I20260709 12:18:57.373562 25317 raft_consensus.cc:359] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.374248 25317 raft_consensus.cc:385] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.374518 25317 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.381234 25317 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.384627 25317 ts_tablet_manager.cc:1434] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:18:57.385519 25317 tablet_bootstrap.cc:492] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:57.396263 25318 ts_tablet_manager.cc:1434] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 12:18:57.397176 25318 tablet_bootstrap.cc:492] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:57.412459 25316 tablet_bootstrap.cc:492] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:57.412981 25316 ts_tablet_manager.cc:1403] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.203s	user 0.016s	sys 0.022s
I20260709 12:18:57.415684 25316 raft_consensus.cc:359] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.416356 25316 raft_consensus.cc:385] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.416621 25316 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.417472 25534 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:57.417274 25316 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.428395 25350 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.446295 25316 ts_tablet_manager.cc:1434] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 12:18:57.447348 25316 tablet_bootstrap.cc:492] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
W20260709 12:18:57.454892 25073 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:57.459136 25506 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.464445 25317 tablet_bootstrap.cc:654] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.492331 25316 tablet_bootstrap.cc:654] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.492386 25557 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.511227 25318 tablet_bootstrap.cc:654] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.513387 25610 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.517443 25610 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.459681 25506 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.520359 25610 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:57.518426 25022 catalog_manager.cc:5697] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:57.520392 25624 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:18:57.557513 25506 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:57.560588 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:57.561259 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:57.562747 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:57.563701 25536 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.564251 25536 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.560603 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:57.566298 25536 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:18:57.569255 25090 leader_election.cc:343] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:57.570065 25090 leader_election.cc:343] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.570405 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:18:57.571837 25242 leader_election.cc:343] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.606102 25316 tablet_bootstrap.cc:492] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:57.606622 25316 ts_tablet_manager.cc:1403] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.159s	user 0.006s	sys 0.013s
W20260709 12:18:57.607244 25093 leader_election.cc:343] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.607656 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:57.609861 25610 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:57.600517 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:18:57.612656 25242 leader_election.cc:343] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.613224 25242 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:57.613520 25318 tablet_bootstrap.cc:492] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:57.613968 25318 ts_tablet_manager.cc:1403] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.217s	user 0.017s	sys 0.017s
I20260709 12:18:57.614100 25536 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:18:57.619201 25093 leader_election.cc:343] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.619796 25093 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:57.620685 25602 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.624743 25610 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:57.646536 25350 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.652134 25350 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.668773 25350 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:57.681459 25316 raft_consensus.cc:359] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.681828 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:57.686223 25125 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:18:57.681057 25318 raft_consensus.cc:359] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.687912 25318 raft_consensus.cc:385] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.688196 25318 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.690351 25317 tablet_bootstrap.cc:492] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:57.690801 25317 ts_tablet_manager.cc:1403] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.305s	user 0.064s	sys 0.091s
I20260709 12:18:57.685350 25316 raft_consensus.cc:385] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:18:57.678318 25626 log.cc:927] Time spent T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.055s	user 0.000s	sys 0.009s
I20260709 12:18:57.693558 25316 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.693856 25318 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.696432 25317 raft_consensus.cc:359] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.697592 25535 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.701408 25317 raft_consensus.cc:385] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.701256 25316 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.703231 25318 ts_tablet_manager.cc:1434] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.000s
I20260709 12:18:57.701728 25317 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.706564 25316 ts_tablet_manager.cc:1434] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.000s
I20260709 12:18:57.707647 25316 tablet_bootstrap.cc:492] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:57.711995 25540 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.713090 25318 tablet_bootstrap.cc:492] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:57.715318 25317 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.718600 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:57.712671 25540 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.730947 25540 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:57.731485 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:57.732466 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:18:57.732862 25242 leader_election.cc:343] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:57.733747 25242 leader_election.cc:343] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:57.734172 25242 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:57.735699 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:57.743265 25534 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.744294 25317 ts_tablet_manager.cc:1434] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.003s
I20260709 12:18:57.745373 25317 tablet_bootstrap.cc:492] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:57.747354 25602 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:57.750182 25196 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:57.759228 25318 tablet_bootstrap.cc:654] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.758884 25610 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:18:57.769872 25540 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.775141 25273 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:57.794698 25316 tablet_bootstrap.cc:654] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.789883 25534 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:57.804301 25610 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:18:57.830464 25317 tablet_bootstrap.cc:654] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.831858 25534 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.832333 25534 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.835460 25534 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:57.837004 25202 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.836869 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:57.837718 25125 raft_consensus.cc:2393] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:18:57.838313 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:57.843327 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:57.856233 25318 tablet_bootstrap.cc:492] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:57.856801 25318 ts_tablet_manager.cc:1403] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.000s
I20260709 12:18:57.862609 25318 raft_consensus.cc:359] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.864835 25350 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:57.865527 25318 raft_consensus.cc:385] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.865825 25318 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.866420 25318 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.864306 25536 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.872149 25536 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.874233 25536 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:57.868062 25602 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:18:57.883599 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:57.884359 25124 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:57.887748 25536 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:18:57.897737 25416 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.901410 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:57.908458 25318 ts_tablet_manager.cc:1434] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:18:57.909870 25318 tablet_bootstrap.cc:492] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:57.899829 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:57.912048 25200 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:57.918910 25416 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:57.919534 25416 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.919917 25416 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.952461 25416 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.961568 25317 tablet_bootstrap.cc:492] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:57.962198 25317 ts_tablet_manager.cc:1403] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.217s	user 0.012s	sys 0.006s
I20260709 12:18:57.965276 25317 raft_consensus.cc:359] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.965978 25317 raft_consensus.cc:385] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.966290 25317 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.967061 25317 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.972071 25317 ts_tablet_manager.cc:1434] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:18:57.980248 25317 tablet_bootstrap.cc:492] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:57.983888 25316 tablet_bootstrap.cc:492] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:57.984364 25316 ts_tablet_manager.cc:1403] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.277s	user 0.051s	sys 0.053s
I20260709 12:18:57.986974 25316 raft_consensus.cc:359] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.987684 25316 raft_consensus.cc:385] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.988041 25316 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.988902 25316 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:57.992069 25316 ts_tablet_manager.cc:1434] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:18:57.992938 25316 tablet_bootstrap.cc:492] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:57.987388 25318 tablet_bootstrap.cc:654] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.001103 25316 tablet_bootstrap.cc:654] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.009897 25416 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:58.015874 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:58.016589 25125 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.017604 25318 tablet_bootstrap.cc:492] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:58.017937 25318 ts_tablet_manager.cc:1403] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.003s
I20260709 12:18:58.034600 25611 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.035184 25611 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.036149 25125 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:58.037462 25611 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.037794 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:58.038488 25196 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.038625 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:58.039405 25273 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:58.039920 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:58.040822 25090 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:58.041455 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:58.041759 25506 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:58.042443 25093 leader_election.cc:343] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.042351 25506 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.043453 25611 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.043905 25611 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.044276 25611 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.045349 25506 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.047113 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:58.047514 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:58.048342 25200 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:18:58.049607 25093 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:18:58.050503 25316 tablet_bootstrap.cc:492] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:58.050976 25316 ts_tablet_manager.cc:1403] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.004s
I20260709 12:18:58.018494 25317 tablet_bootstrap.cc:654] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.053123 25318 raft_consensus.cc:359] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.057657 25318 raft_consensus.cc:385] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.058045 25318 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.052894 25536 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.061465 25536 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:58.062470 25316 raft_consensus.cc:359] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.065943 25316 raft_consensus.cc:385] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.066242 25316 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.066848 25316 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.058199 25506 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:58.065181 25318 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.068176 25506 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.068579 25506 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.069743 25318 ts_tablet_manager.cc:1434] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:18:58.062527 25536 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.071070 25316 ts_tablet_manager.cc:1434] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:18:58.071979 25316 tablet_bootstrap.cc:492] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:58.075266 25318 tablet_bootstrap.cc:492] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:58.079536 25506 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.074172 25196 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:58.081629 25506 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.083420 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:58.085274 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:58.086309 25196 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.089329 25611 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.093490 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:58.094113 25273 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.094130 25316 tablet_bootstrap.cc:654] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.099242 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:58.100102 25025 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:58.103210 25093 leader_election.cc:343] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.110072 25273 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:58.110953 25506 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.112327 25506 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.115156 25506 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.116060 25318 tablet_bootstrap.cc:654] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.117031 25536 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.117573 25536 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.117930 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:58.118592 25274 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:58.119668 25317 tablet_bootstrap.cc:492] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:58.120113 25317 ts_tablet_manager.cc:1403] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.140s	user 0.011s	sys 0.000s
I20260709 12:18:58.120045 25090 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:58.121034 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:58.121732 25125 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:58.122085 25090 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:58.122829 25317 raft_consensus.cc:359] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.123193 25633 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.123075 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:58.123498 25317 raft_consensus.cc:385] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.123693 25633 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:58.125119 25416 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:58.125526 25416 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.127246 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:58.128777 25196 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
W20260709 12:18:58.129113 25093 leader_election.cc:343] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.123791 25317 raft_consensus.cc:740] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.111562 25611 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.125890 25416 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:58.130774 25093 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:18:58.131626 25611 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:58.132200 25611 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:58.133049 25611 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.131299 25317 consensus_queue.cc:260] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.124716 25633 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.143616 25317 ts_tablet_manager.cc:1434] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:18:58.144683 25317 tablet_bootstrap.cc:492] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:58.145112 25536 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:58.121066 25506 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.147148 25506 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.147560 25506 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.152721 25318 tablet_bootstrap.cc:492] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:58.153196 25318 ts_tablet_manager.cc:1403] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.000s
I20260709 12:18:58.155563 25316 tablet_bootstrap.cc:492] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:58.156090 25316 ts_tablet_manager.cc:1403] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.084s	user 0.015s	sys 0.007s
I20260709 12:18:58.158303 25506 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.159150 25318 raft_consensus.cc:359] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.159958 25318 raft_consensus.cc:385] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.160225 25318 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.160826 25318 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.162268 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:58.162968 25273 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.165565 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:58.166975 25318 ts_tablet_manager.cc:1434] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:18:58.167805 25318 tablet_bootstrap.cc:492] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:58.161023 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:58.170490 25196 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:58.158655 25416 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.174571 25316 raft_consensus.cc:359] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.174924 25273 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:58.175413 25316 raft_consensus.cc:385] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.175799 25316 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.176504 25316 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:58.179570 25093 leader_election.cc:343] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.188408 25316 ts_tablet_manager.cc:1434] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 12:18:58.188978 25090 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:58.190506 25317 tablet_bootstrap.cc:654] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.190651 25316 tablet_bootstrap.cc:492] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:58.175370 25506 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.186997 25633 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.193507 25416 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:58.193902 25633 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.192565 25611 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.195427 25611 raft_consensus.cc:697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:58.196156 25633 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.196345 25611 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.197520 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:58.197762 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:58.198374 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:58.198949 25122 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:58.198978 25090 leader_election.cc:343] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:58.200644 25093 leader_election.cc:343] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.197831 25023 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.209801 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:58.210491 25196 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:58.213402 25350 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.213847 25350 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.216840 25350 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.226135 25093 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:58.227914 25610 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:58.228161 25196 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:18:58.229415 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:58.230930 25536 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:58.231428 25536 raft_consensus.cc:697] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:58.232968 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:18:58.234179 25168 leader_election.cc:343] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.235312 25122 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
W20260709 12:18:58.225876 25654 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:18:58.240339 25318 tablet_bootstrap.cc:654] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.232321 25536 consensus_queue.cc:237] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.224047 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:58.247226 25602 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.253878 25317 tablet_bootstrap.cc:492] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:58.253494 25602 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.254492 25317 ts_tablet_manager.cc:1403] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.008s
I20260709 12:18:58.255681 25316 tablet_bootstrap.cc:654] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.255627 25602 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:58.256356 25273 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:58.257524 25317 raft_consensus.cc:359] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.258867 25317 raft_consensus.cc:385] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.259196 25317 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.259179 25165 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:18:58.260257 25317 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.260638 25350 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.261144 25350 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.261526 25350 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.262348 25506 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.262148 25025 catalog_manager.cc:5697] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.262802 25506 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.265086 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:58.265718 25122 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:58.265960 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:58.266777 25316 tablet_bootstrap.cc:492] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:58.267078 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:58.267200 25316 ts_tablet_manager.cc:1403] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.005s
I20260709 12:18:58.267947 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:18:58.268854 25093 leader_election.cc:343] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:58.269347 25090 leader_election.cc:343] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:58.269413 25242 leader_election.cc:343] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.269714 25090 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:58.270107 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:58.270470 25610 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:58.270565 25316 raft_consensus.cc:359] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.271149 25602 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:18:58.271235 25316 raft_consensus.cc:385] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.271610 25416 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.271988 25416 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.272003 25536 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.272464 25416 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.272554 25536 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.272679 25350 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.274705 25536 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:58.275420 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:58.276448 25318 tablet_bootstrap.cc:492] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
W20260709 12:18:58.276584 25168 leader_election.cc:343] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.276906 25318 ts_tablet_manager.cc:1403] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.109s	user 0.008s	sys 0.002s
I20260709 12:18:58.276481 25506 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.271690 25602 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.278319 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:58.278951 25122 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:58.279510 25602 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:58.271683 25316 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.279620 25318 raft_consensus.cc:359] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.280581 25316 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.280969 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:58.281255 25318 raft_consensus.cc:385] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.280988 25350 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.281566 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:58.283171 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:58.283576 25273 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.285183 25316 ts_tablet_manager.cc:1434] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:18:58.285281 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:58.286146 25197 raft_consensus.cc:2368] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:18:58.285373 25023 catalog_manager.cc:5697] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 2, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:58.286279 25316 tablet_bootstrap.cc:492] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:58.282460 25416 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:58.287364 25242 leader_election.cc:343] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.288163 25242 leader_election.cc:400] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:18:58.288424 25242 leader_election.cc:403] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:58.289075 25602 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.290396 25317 ts_tablet_manager.cc:1434] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 12:18:58.291370 25317 tablet_bootstrap.cc:492] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:58.293443 25316 tablet_bootstrap.cc:654] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.281635 25318 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.297379 25317 tablet_bootstrap.cc:654] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.297556 25318 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.300746 25318 ts_tablet_manager.cc:1434] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:18:58.300952 25273 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:58.288383 25416 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:58.263787 25025 catalog_manager.cc:5697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.302275 25318 tablet_bootstrap.cc:492] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:58.303839 25165 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:18:58.304936 25392 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.305410 25392 raft_consensus.cc:697] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:58.306273 25392 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.310998 25242 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:58.311782 25416 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.312122 25416 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.312407 25416 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.313510 25318 tablet_bootstrap.cc:654] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.320278 25316 tablet_bootstrap.cc:492] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:58.320884 25316 ts_tablet_manager.cc:1403] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.008s
I20260709 12:18:58.319825 25416 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.322819 25416 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:58.324537 25316 raft_consensus.cc:359] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.324976 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:58.325415 25316 raft_consensus.cc:385] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.325559 25122 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.325798 25316 raft_consensus.cc:740] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.326784 25316 consensus_queue.cc:260] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.329643 25316 ts_tablet_manager.cc:1434] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:18:58.330412 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:58.334059 25316 tablet_bootstrap.cc:492] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:58.331802 25602 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:18:58.340430 25317 tablet_bootstrap.cc:492] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:58.340831 25318 tablet_bootstrap.cc:492] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:58.345222 25318 ts_tablet_manager.cc:1403] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 12:18:58.346822 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:58.347764 25318 raft_consensus.cc:359] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.348420 25318 raft_consensus.cc:385] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.348678 25318 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.349304 25318 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.341869 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:58.350317 25124 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.350682 25317 ts_tablet_manager.cc:1403] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.060s	user 0.004s	sys 0.007s
I20260709 12:18:58.353165 25317 raft_consensus.cc:359] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.353649 25317 raft_consensus.cc:385] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.353902 25317 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
W20260709 12:18:58.354458 25242 leader_election.cc:343] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.355222 25124 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:58.355086 25317 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.342358 25023 catalog_manager.cc:5697] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.356381 25122 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:58.343823 25316 tablet_bootstrap.cc:654] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.357223 25317 ts_tablet_manager.cc:1434] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
W20260709 12:18:58.358779 25242 leader_election.cc:343] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.359299 25318 ts_tablet_manager.cc:1434] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:18:58.362896 25318 tablet_bootstrap.cc:492] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:58.360930 25317 tablet_bootstrap.cc:492] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:58.361748 25316 tablet_bootstrap.cc:492] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:58.366720 25316 ts_tablet_manager.cc:1403] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.006s
I20260709 12:18:58.367820 25318 tablet_bootstrap.cc:654] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.369360 25316 raft_consensus.cc:359] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.370067 25316 raft_consensus.cc:385] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.370342 25316 raft_consensus.cc:740] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.371001 25316 consensus_queue.cc:260] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.374658 25242 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:58.377425 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:58.378122 25416 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.378563 25416 raft_consensus.cc:697] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:58.379268 25416 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.380785 25536 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.381312 25536 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:58.382411 25317 tablet_bootstrap.cc:654] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.382143 25536 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.389076 25318 tablet_bootstrap.cc:492] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:58.389669 25318 ts_tablet_manager.cc:1403] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.002s
I20260709 12:18:58.392457 25318 raft_consensus.cc:359] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.394690 25318 raft_consensus.cc:385] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.399863 25318 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.400928 25316 ts_tablet_manager.cc:1434] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 12:18:58.400574 25318 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.402133 25316 tablet_bootstrap.cc:492] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:58.402758 25318 ts_tablet_manager.cc:1434] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:18:58.410637 25318 tablet_bootstrap.cc:492] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:58.411043 25316 tablet_bootstrap.cc:654] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.411975 25535 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.416498 25318 tablet_bootstrap.cc:654] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.412524 25535 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.416981 25025 catalog_manager.cc:5697] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:58.419014 25535 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:58.418704 25025 catalog_manager.cc:5697] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:58.422580 25317 tablet_bootstrap.cc:492] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:58.423197 25317 ts_tablet_manager.cc:1403] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.008s
I20260709 12:18:58.426775 25317 raft_consensus.cc:359] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.427629 25317 raft_consensus.cc:385] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.427954 25317 raft_consensus.cc:740] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.428856 25317 consensus_queue.cc:260] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.430114 25350 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.431231 25317 ts_tablet_manager.cc:1434] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:18:58.431972 25350 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.419977 25392 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.420107 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:58.434408 25392 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:58.435326 25242 leader_election.cc:343] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.420655 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:58.436283 25350 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.436839 25350 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.437325 25350 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.438613 25317 tablet_bootstrap.cc:492] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:58.439133 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:58.439342 25392 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:18:58.440311 25242 leader_election.cc:343] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.440733 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:58.478309 25416 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:58.537695 25350 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.540172 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:58.540747 25611 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.541021 25276 raft_consensus.cc:2393] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:18:58.541260 25611 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.441006 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:58.442869 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:58.549489 25273 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:18:58.549854 25271 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:58.538880 25602 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:18:58.456000 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:58.551172 25165 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:58.551970 25350 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.552289 25350 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.552567 25350 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.555368 25165 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:58.556258 25392 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.556782 25124 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:58.622632 25350 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.623519 25317 tablet_bootstrap.cc:654] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.638855 25392 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:58.652325 25348 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:58.662915 25611 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.663200 25318 tablet_bootstrap.cc:492] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:58.663677 25318 ts_tablet_manager.cc:1403] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.254s	user 0.027s	sys 0.008s
I20260709 12:18:58.667248 25316 tablet_bootstrap.cc:492] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:58.667745 25316 ts_tablet_manager.cc:1403] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.266s	user 0.020s	sys 0.027s
I20260709 12:18:58.670433 25350 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.680447 25318 raft_consensus.cc:359] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.681399 25318 raft_consensus.cc:385] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.682404 25318 raft_consensus.cc:740] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.684001 25318 consensus_queue.cc:260] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.681869 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:58.691462 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:58.696341 25318 ts_tablet_manager.cc:1434] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:18:58.702072 25318 tablet_bootstrap.cc:492] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:58.701225 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:58.704138 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:58.703248 25272 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:58.715519 25123 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:58.714562 25073 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:58.718859 25090 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:58.719331 25316 raft_consensus.cc:359] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.720284 25316 raft_consensus.cc:385] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.703104 25271 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.719990 25168 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:58.720654 25316 raft_consensus.cc:740] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.724464 25316 consensus_queue.cc:260] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.727176 25677 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.728370 25350 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.728159 25675 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.733491 25675 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.734529 25316 ts_tablet_manager.cc:1434] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.005s
I20260709 12:18:58.735402 25316 tablet_bootstrap.cc:492] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:58.727696 25677 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.743156 25416 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:58.733912 25675 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.739220 25506 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.744300 25633 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:18:58.748656 25350 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:58.759019 25276 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:58.756475 25126 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:18:58.746769 25506 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.762290 25506 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.765640 25674 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:58.766798 25271 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:58.768905 25165 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:58.769724 25676 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.770248 25676 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:58.771231 25677 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.771051 25676 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.781298 25317 tablet_bootstrap.cc:492] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:58.781922 25317 ts_tablet_manager.cc:1403] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.343s	user 0.016s	sys 0.050s
I20260709 12:18:58.783666 25125 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.785244 25535 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:58.786724 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:58.787593 25274 raft_consensus.cc:2393] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 1: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:18:58.779657 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:58.787868 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:58.785279 25198 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.806931 25124 raft_consensus.cc:2393] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:18:58.826231 25199 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:58.798229 25678 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20260709 12:18:58.822830 25123 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:58.879415 25316 tablet_bootstrap.cc:654] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.840910 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:58.887642 25168 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:58.825578 25675 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.910079 25318 tablet_bootstrap.cc:654] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.914384 25317 raft_consensus.cc:359] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.915297 25317 raft_consensus.cc:385] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.915648 25317 raft_consensus.cc:740] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.916388 25317 consensus_queue.cc:260] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:58.918097 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:58.921806 25350 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:58.956815 25675 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:58.980180 25200 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:18:59.006367 25317 ts_tablet_manager.cc:1434] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.223s	user 0.011s	sys 0.000s
W20260709 12:18:59.065269 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 123221us
I20260709 12:18:59.020347 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:59.074533 25316 tablet_bootstrap.cc:492] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:59.075636 25316 ts_tablet_manager.cc:1403] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.340s	user 0.012s	sys 0.005s
W20260709 12:18:59.077287 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 60639.3us
I20260709 12:18:59.073446 25273 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:59.081261 25316 raft_consensus.cc:359] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.082541 25316 raft_consensus.cc:385] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:59.082971 25316 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:59.084052 25316 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.096565 25317 tablet_bootstrap.cc:492] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:59.104271 25348 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:59.106920 25025 catalog_manager.cc:5697] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.109206 25350 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.110306 25416 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:18:59.152169 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 84096.8us
W20260709 12:18:59.158445 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 79363.6us
I20260709 12:18:59.161087 25692 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.162209 25692 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.177418 25350 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.180478 25350 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:59.173602 25610 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:18:59.187013 25093 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:59.197834 25316 ts_tablet_manager.cc:1434] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.122s	user 0.006s	sys 0.021s
I20260709 12:18:59.199538 25316 tablet_bootstrap.cc:492] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:59.206796 25273 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:59.207106 25318 tablet_bootstrap.cc:492] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:59.207921 25318 ts_tablet_manager.cc:1403] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.510s	user 0.018s	sys 0.024s
I20260709 12:18:59.208088 25317 tablet_bootstrap.cc:654] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:59.206140 25700 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:59.213147 25692 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:59.216300 25318 raft_consensus.cc:359] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.218333 25318 raft_consensus.cc:385] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:59.222003 25318 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:59.224927 25318 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.226759 25318 ts_tablet_manager.cc:1434] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 12:18:59.228292 25318 tablet_bootstrap.cc:492] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
W20260709 12:18:59.219708 25093 leader_election.cc:343] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:59.220834 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:59.230774 25275 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:59.233181 25350 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.233578 25350 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.237416 25700 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.237275 25703 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:18:59.238164 25700 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.242082 25317 tablet_bootstrap.cc:492] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:59.242889 25317 ts_tablet_manager.cc:1403] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.147s	user 0.016s	sys 0.003s
I20260709 12:18:59.246352 25700 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:59.246781 25317 raft_consensus.cc:359] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.247581 25317 raft_consensus.cc:385] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:59.247884 25317 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:59.248735 25317 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.250936 25350 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:59.252880 25611 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:59.255415 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:59.279488 25317 ts_tablet_manager.cc:1434] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.002s
I20260709 12:18:59.284919 25316 tablet_bootstrap.cc:654] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:59.289535 25318 tablet_bootstrap.cc:654] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:59.297014 25197 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:59.299166 25676 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:59.299805 25165 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:59.300295 25090 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:59.301744 25611 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:59.301980 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:59.302294 25611 raft_consensus.cc:697] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:59.302342 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:59.303507 25392 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:59.303900 25392 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.304210 25392 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:59.303473 25611 consensus_queue.cc:237] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.308996 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:59.312089 25126 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 0.
I20260709 12:18:59.332239 25317 tablet_bootstrap.cc:492] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:18:59.340354 25392 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.351038 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:59.351900 25121 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:59.374804 25392 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:59.402609 25316 tablet_bootstrap.cc:492] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:59.403239 25316 ts_tablet_manager.cc:1403] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.204s	user 0.015s	sys 0.009s
I20260709 12:18:59.431763 25318 tablet_bootstrap.cc:492] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:59.432312 25318 ts_tablet_manager.cc:1403] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.204s	user 0.014s	sys 0.008s
I20260709 12:18:59.441017 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:18:59.441817 25269 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:18:59.442153 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:59.442342 25318 raft_consensus.cc:359] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.443099 25122 raft_consensus.cc:2393] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:18:59.443156 25318 raft_consensus.cc:385] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:59.443562 25318 raft_consensus.cc:740] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:59.444195 25318 consensus_queue.cc:260] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.452602 25090 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:59.453531 25611 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:59.453913 25611 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.454308 25611 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:59.457813 25317 tablet_bootstrap.cc:654] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:59.459079 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:59.459713 25125 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:59.470481 25318 ts_tablet_manager.cc:1434] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.005s
I20260709 12:18:59.470419 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:59.471383 25201 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 1: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:18:59.471644 25318 tablet_bootstrap.cc:492] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
W20260709 12:18:59.479362 25093 leader_election.cc:343] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:59.483667 25125 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:18:59.485369 25701 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:18:59.486986 25242 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:59.491253 25692 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:59.491698 25692 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.492077 25692 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:59.497946 25433 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:59.503785 25316 raft_consensus.cc:359] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.509788 25316 raft_consensus.cc:385] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:18:59.508066 25093 leader_election.cc:343] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:59.510109 25316 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:59.502471 25711 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:18:59.514425 25316 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.520617 25168 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:18:59.523623 25168 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:18:59.524205 25350 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:59.546006 25611 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.537878 25695 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:59.550200 25695 raft_consensus.cc:697] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:18:59.547343 25316 ts_tablet_manager.cc:1434] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.144s	user 0.015s	sys 0.009s
I20260709 12:18:59.554227 25318 tablet_bootstrap.cc:654] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:59.553292 25695 consensus_queue.cc:237] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.556437 25701 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.556936 25701 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.563081 25701 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:59.563623 25316 tablet_bootstrap.cc:492] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:59.568830 25433 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:59.569199 25692 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.571228 25692 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:59.578344 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:59.579154 25317 tablet_bootstrap.cc:492] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:59.579633 25317 ts_tablet_manager.cc:1403] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.284s	user 0.015s	sys 0.006s
I20260709 12:18:59.579674 25611 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:59.600216 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:59.601202 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:18:59.603747 25093 leader_election.cc:343] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:59.605623 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:18:59.615131 25242 leader_election.cc:343] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:59.623565 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:59.617080 25122 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:59.636965 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:18:59.652860 25273 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:59.654814 25276 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:18:59.667701 25711 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:59.681854 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:59.682848 25125 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 1: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:18:59.699342 25317 raft_consensus.cc:359] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.700013 25317 raft_consensus.cc:385] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:59.700300 25317 raft_consensus.cc:740] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:18:59.708415 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:59.751410 25242 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:59.746330 25702 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:59.759989 25702 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.760352 25702 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:59.729750 25535 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.755872 25317 consensus_queue.cc:260] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.763999 25703 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:59.762867 25535 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:59.776687 25725 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:18:59.786995 25535 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:59.791529 25316 tablet_bootstrap.cc:654] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:59.797219 25273 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:18:59.801946 25317 ts_tablet_manager.cc:1434] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.222s	user 0.009s	sys 0.000s
W20260709 12:18:59.835513 25726 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:18:59.839500 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:18:59.840255 25702 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:18:59.841161 25724 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:18:59.847684 25317 tablet_bootstrap.cc:492] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Bootstrap starting.
W20260709 12:18:59.848820 25242 leader_election.cc:343] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:59.844748 25023 catalog_manager.cc:5697] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.855237 25318 tablet_bootstrap.cc:492] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:18:59.855729 25318 ts_tablet_manager.cc:1403] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.384s	user 0.024s	sys 0.007s
I20260709 12:18:59.870476 25316 tablet_bootstrap.cc:492] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:59.870972 25316 ts_tablet_manager.cc:1403] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.308s	user 0.013s	sys 0.011s
I20260709 12:18:59.860096 25702 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:59.869436 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:18:59.872339 25124 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:59.885684 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:18:59.886498 25126 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:18:59.889006 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:59.891309 25090 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:18:59.891582 25697 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:59.892774 25697 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.894040 25697 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:59.895287 25318 raft_consensus.cc:359] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.899463 25318 raft_consensus.cc:385] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:59.899766 25318 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:18:59.900362 25318 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.907975 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:18:59.902413 25611 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:59.911943 25611 raft_consensus.cc:697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:18:59.905360 25124 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:18:59.912775 25611 consensus_queue.cc:237] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.913436 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:18:59.912778 25316 raft_consensus.cc:359] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.914388 25316 raft_consensus.cc:385] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:59.914690 25316 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
W20260709 12:18:59.917949 25242 leader_election.cc:343] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:59.923585 25316 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.925144 25536 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:59.925681 25536 raft_consensus.cc:697] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:18:59.931660 25536 consensus_queue.cc:237] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.934850 25695 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.937217 25695 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.939468 25695 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:59.940332 25025 catalog_manager.cc:5697] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.944121 25317 tablet_bootstrap.cc:654] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:59.955017 25316 ts_tablet_manager.cc:1434] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.084s	user 0.005s	sys 0.003s
I20260709 12:18:59.956419 25316 tablet_bootstrap.cc:492] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:18:59.960485 25697 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.962155 25316 tablet_bootstrap.cc:654] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:59.964344 25695 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.964802 25695 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.967032 25695 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:18:59.968225 25073 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:59.971150 25316 tablet_bootstrap.cc:492] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:18:59.971608 25316 ts_tablet_manager.cc:1403] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 12:18:59.974607 25734 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:59.976436 25318 ts_tablet_manager.cc:1434] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.000s
I20260709 12:18:59.977638 25318 tablet_bootstrap.cc:492] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:18:59.982661 25318 tablet_bootstrap.cc:654] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:59.985234 25674 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.985713 25674 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.987802 25674 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:18:59.988536 25317 tablet_bootstrap.cc:492] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:18:59.989140 25317 ts_tablet_manager.cc:1403] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.161s	user 0.008s	sys 0.003s
I20260709 12:18:59.992035 25535 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.992501 25535 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.994683 25535 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:18:59.995671 25316 raft_consensus.cc:359] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.996347 25316 raft_consensus.cc:385] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:59.996599 25316 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:18:59.997201 25316 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:18:59.997602 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:00.000730 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:00.002170 25316 ts_tablet_manager.cc:1434] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
W20260709 12:19:00.003154 25242 leader_election.cc:343] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:00.005549 25242 leader_election.cc:343] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.003460 25316 tablet_bootstrap.cc:492] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:19:00.006611 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:00.014355 25242 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:19:00.012326 25093 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.23.81.254:44087, user_credentials={real_user=slave}} blocked reactor thread for 59152.9us
I20260709 12:19:00.006850 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:00.016539 25276 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:19:00.027969 25165 leader_election.cc:343] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.038632 25416 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.039172 25416 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.106765 25318 tablet_bootstrap.cc:492] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:19:00.107904 25318 ts_tablet_manager.cc:1403] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.131s	user 0.016s	sys 0.017s
W20260709 12:19:00.110239 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 80825.3us
W20260709 12:19:00.109934 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 74910.1us
I20260709 12:19:00.027400 25535 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:00.042253 25678 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.089s
I20260709 12:19:00.133328 25416 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:00.138692 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:00.143381 25242 leader_election.cc:343] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.129242 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:19:00.146756 25738 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:19:00.154228 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:00.154873 25196 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:00.145681 25697 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:00.162956 25316 tablet_bootstrap.cc:654] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:00.163620 25318 raft_consensus.cc:359] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.164304 25318 raft_consensus.cc:385] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:19:00.164588 25093 consensus_peers.cc:597] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:00.164551 25318 raft_consensus.cc:740] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.178390 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:00.180205 25318 consensus_queue.cc:260] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.180145 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:00.184362 25127 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:00.172955 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:00.207432 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:00.226930 25317 raft_consensus.cc:359] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.227746 25317 raft_consensus.cc:385] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:00.228036 25317 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.230522 25317 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.232088 25317 ts_tablet_manager.cc:1434] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.243s	user 0.013s	sys 0.003s
I20260709 12:19:00.233235 25317 tablet_bootstrap.cc:492] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:19:00.235296 25318 ts_tablet_manager.cc:1434] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.127s	user 0.005s	sys 0.004s
I20260709 12:19:00.276912 25318 tablet_bootstrap.cc:492] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:19:00.286530 25127 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
W20260709 12:19:00.285624 25242 leader_election.cc:343] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.288475 25242 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:00.293515 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:00.297874 25602 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:00.300753 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:00.304039 25698 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:00.304530 25698 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:00.305347 25698 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.315703 25025 catalog_manager.cc:5697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:00.332430 25090 leader_election.cc:343] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.315366 25197 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
W20260709 12:19:00.360128 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 193633us
W20260709 12:19:00.366671 25168 leader_election.cc:343] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.367142 25168 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:00.372658 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:00.377480 25196 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:19:00.378050 25392 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:00.379138 25317 tablet_bootstrap.cc:654] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:00.449378 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 75354.1us
I20260709 12:19:00.455955 25534 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:00.463882 25316 tablet_bootstrap.cc:492] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:19:00.464375 25316 ts_tablet_manager.cc:1403] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.461s	user 0.002s	sys 0.058s
I20260709 12:19:00.467880 25093 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:00.471477 25318 tablet_bootstrap.cc:654] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:00.477035 25732 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:00.477455 25732 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.477783 25732 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:00.494272 25732 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:00.532302 25242 consensus_peers.cc:597] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:00.553339 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:00.554049 25198 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:00.553498 25348 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.557370 25348 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.561846 25348 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:00.567571 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:19:00.570353 25093 consensus_peers.cc:597] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:00.570725 25090 leader_election.cc:343] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.572487 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:00.575441 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:19:00.577420 25090 leader_election.cc:343] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.579545 25732 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:00.580780 25198 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
W20260709 12:19:00.581991 25093 leader_election.cc:343] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.582518 25093 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:00.583928 25317 tablet_bootstrap.cc:492] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:19:00.584427 25317 ts_tablet_manager.cc:1403] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.351s	user 0.013s	sys 0.014s
I20260709 12:19:00.581815 25023 catalog_manager.cc:5697] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:00.591336 25317 raft_consensus.cc:359] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.592170 25317 raft_consensus.cc:385] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:00.592475 25317 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.593134 25317 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.594630 25317 ts_tablet_manager.cc:1434] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:19:00.583272 25749 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:00.595589 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 50135.7us
I20260709 12:19:00.601383 25695 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:00.603554 25317 tablet_bootstrap.cc:492] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:19:00.605082 25692 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:00.610335 25317 tablet_bootstrap.cc:654] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:00.619951 25316 raft_consensus.cc:359] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.620710 25316 raft_consensus.cc:385] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:00.621006 25316 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.621776 25317 tablet_bootstrap.cc:492] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:19:00.622251 25317 ts_tablet_manager.cc:1403] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 12:19:00.626847 25317 raft_consensus.cc:359] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.628084 25317 raft_consensus.cc:385] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:00.628372 25317 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.628981 25317 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.629840 25093 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:00.631275 25732 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:00.621611 25316 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.632383 25317 ts_tablet_manager.cc:1434] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 12:19:00.636729 25316 ts_tablet_manager.cc:1434] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.172s	user 0.007s	sys 0.000s
I20260709 12:19:00.637257 25317 tablet_bootstrap.cc:492] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:19:00.637428 25316 tablet_bootstrap.cc:492] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:19:00.641402 25749 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:00.641997 25749 raft_consensus.cc:697] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:00.642876 25749 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.644912 25316 tablet_bootstrap.cc:654] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:00.671904 25317 tablet_bootstrap.cc:654] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:00.680303 25023 catalog_manager.cc:5697] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:00.682900 25691 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.690783 25691 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.698527 25318 tablet_bootstrap.cc:492] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:19:00.699014 25318 ts_tablet_manager.cc:1403] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.424s	user 0.018s	sys 0.012s
I20260709 12:19:00.700239 25691 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:00.702665 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:00.705160 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:00.707716 25318 raft_consensus.cc:359] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:00.709081 25242 leader_election.cc:343] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:00.711021 25242 leader_election.cc:343] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.711335 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:00.711870 25698 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:00.714376 25316 tablet_bootstrap.cc:492] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:19:00.714686 25318 raft_consensus.cc:385] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:00.714826 25316 ts_tablet_manager.cc:1403] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.012s
I20260709 12:19:00.715090 25318 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.717939 25316 raft_consensus.cc:359] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.718648 25316 raft_consensus.cc:385] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:00.718889 25316 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.719532 25316 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.721763 25316 ts_tablet_manager.cc:1434] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:00.724215 25318 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.727560 25350 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.728019 25350 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.736133 25350 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:00.735957 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:00.739650 25318 ts_tablet_manager.cc:1434] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 12:19:00.783075 25318 tablet_bootstrap.cc:492] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:19:00.740828 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:00.753921 25749 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.788008 25749 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.789510 25317 tablet_bootstrap.cc:492] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:19:00.789865 25317 ts_tablet_manager.cc:1403] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.153s	user 0.015s	sys 0.063s
I20260709 12:19:00.790979 25749 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:00.791435 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:00.792856 25093 leader_election.cc:343] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.792698 25317 raft_consensus.cc:359] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.793382 25317 raft_consensus.cc:385] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:00.793681 25317 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.794581 25165 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:00.773720 25316 tablet_bootstrap.cc:492] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:19:00.796051 25350 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:00.794945 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:00.797013 25269 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:19:00.794348 25317 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.798363 25090 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:00.799297 25611 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:00.799546 25317 ts_tablet_manager.cc:1434] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:19:00.799676 25611 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.800017 25611 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:00.800565 25317 tablet_bootstrap.cc:492] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:19:00.804734 25318 tablet_bootstrap.cc:654] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:00.807169 25317 tablet_bootstrap.cc:654] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:00.810910 25416 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.811374 25416 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.815212 25416 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:00.819384 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:00.820581 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:00.821213 25126 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:19:00.822158 25316 tablet_bootstrap.cc:654] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:00.822557 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:00.826220 25692 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:00.829847 25242 leader_election.cc:343] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.831832 25743 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:00.832242 25743 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.832574 25743 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:00.833395 25318 tablet_bootstrap.cc:492] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:19:00.833902 25318 ts_tablet_manager.cc:1403] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.002s
I20260709 12:19:00.834175 25611 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.838506 25611 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:00.839362 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:19:00.841019 25093 leader_election.cc:343] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.840210 25318 raft_consensus.cc:359] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.842706 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:00.843274 25269 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:00.842762 25318 raft_consensus.cc:385] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:00.842903 25022 catalog_manager.cc:5697] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:00.844769 25318 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.845778 25318 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.847911 25318 ts_tablet_manager.cc:1434] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:19:00.851173 25316 tablet_bootstrap.cc:492] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:19:00.851651 25316 ts_tablet_manager.cc:1403] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.078s	user 0.007s	sys 0.007s
I20260709 12:19:00.857271 25316 raft_consensus.cc:359] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.858278 25316 raft_consensus.cc:385] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:00.858542 25316 raft_consensus.cc:740] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.859193 25350 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.859148 25316 consensus_queue.cc:260] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.859694 25350 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.861162 25316 ts_tablet_manager.cc:1434] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.001s
I20260709 12:19:00.861483 25269 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:19:00.862202 25316 tablet_bootstrap.cc:492] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:19:00.862803 25090 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:00.863077 25318 tablet_bootstrap.cc:492] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:19:00.863567 25747 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:00.863811 25350 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:00.863951 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:00.864212 25747 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:00.862311 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:00.864737 25275 raft_consensus.cc:2393] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:19:00.865267 25743 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.865211 25747 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.865818 25165 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:00.867054 25350 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:00.872020 25743 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:00.875707 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:00.876762 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:00.875896 25698 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:00.877367 25122 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:00.880470 25316 tablet_bootstrap.cc:654] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:00.880909 25242 leader_election.cc:343] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.882735 25506 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.883188 25506 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.885154 25506 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:00.886389 25318 tablet_bootstrap.cc:654] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:00.891947 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:00.893584 25093 leader_election.cc:343] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:00.902428 25316 tablet_bootstrap.cc:492] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:19:00.902928 25316 ts_tablet_manager.cc:1403] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.001s
I20260709 12:19:00.907064 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:00.907873 25269 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:19:00.909057 25318 tablet_bootstrap.cc:492] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:19:00.909513 25318 ts_tablet_manager.cc:1403] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.002s
I20260709 12:19:00.910637 25090 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:00.911439 25749 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:00.911796 25749 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.912093 25749 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:00.925087 25122 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:19:00.913949 25318 raft_consensus.cc:359] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.930639 25318 raft_consensus.cc:385] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:00.930927 25318 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.934674 25350 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:00.935422 25316 raft_consensus.cc:359] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.936100 25316 raft_consensus.cc:385] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:00.932215 25318 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.936365 25316 raft_consensus.cc:740] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.943068 25318 ts_tablet_manager.cc:1434] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 12:19:00.943466 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:00.946050 25316 consensus_queue.cc:260] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.945607 25743 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:00.951153 25318 tablet_bootstrap.cc:492] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:19:00.955554 25023 catalog_manager.cc:5697] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:00.958082 25317 tablet_bootstrap.cc:492] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
I20260709 12:19:00.958571 25317 ts_tablet_manager.cc:1403] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.158s	user 0.015s	sys 0.002s
I20260709 12:19:00.961637 25317 raft_consensus.cc:359] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.963249 25317 raft_consensus.cc:385] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:00.963512 25317 raft_consensus.cc:740] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:19:00.965031 25317 consensus_queue.cc:260] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.966497 25316 ts_tablet_manager.cc:1434] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 12:19:00.958983 25743 raft_consensus.cc:697] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:00.968111 25743 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.971635 25749 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:00.973765 25749 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:00.977296 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:00.977903 25275 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:00.981206 25316 tablet_bootstrap.cc:492] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: Bootstrap starting.
I20260709 12:19:00.982664 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:00.983283 25195 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:00.987114 25317 ts_tablet_manager.cc:1434] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 12:19:00.993305 25317 tablet_bootstrap.cc:492] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Bootstrap starting.
I20260709 12:19:00.991694 25316 tablet_bootstrap.cc:654] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:01.000128 25275 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:19:01.002784 25318 tablet_bootstrap.cc:654] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:01.002931 25090 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:01.003978 25749 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:01.004523 25749 raft_consensus.cc:697] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:01.005384 25749 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.006672 25196 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.001868 25195 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:19:01.030673 25316 tablet_bootstrap.cc:492] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: No bootstrap required, opened a new log
I20260709 12:19:01.031162 25316 ts_tablet_manager.cc:1403] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.001s
I20260709 12:19:01.036852 25316 raft_consensus.cc:359] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.037539 25316 raft_consensus.cc:385] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:01.037797 25316 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Initialized, Role: FOLLOWER
I20260709 12:19:01.045600 25317 tablet_bootstrap.cc:654] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:01.044239 25316 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.050267 25316 ts_tablet_manager.cc:1434] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:19:01.059011 25611 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.059535 25611 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.079906 25611 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:01.080812 25022 catalog_manager.cc:5697] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:01.086091 25540 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.090260 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:01.091002 25269 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:19:01.091209 25540 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.173782 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:01.175581 25732 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:19:01.177055 25540 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:01.181939 25198 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:19:01.182881 25317 tablet_bootstrap.cc:492] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: No bootstrap required, opened a new log
W20260709 12:19:01.175446 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 65180.7us
W20260709 12:19:01.179997 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 77175us
I20260709 12:19:01.184868 25090 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:01.186985 25749 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:01.187409 25749 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.187426 25318 tablet_bootstrap.cc:492] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:19:01.188720 25318 ts_tablet_manager.cc:1403] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.238s	user 0.006s	sys 0.009s
I20260709 12:19:01.183476 25317 ts_tablet_manager.cc:1403] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Time spent bootstrapping tablet: real 0.190s	user 0.011s	sys 0.000s
I20260709 12:19:01.187829 25749 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.191859 25743 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.191664 25318 raft_consensus.cc:359] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.193186 25318 raft_consensus.cc:385] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:01.193500 25318 raft_consensus.cc:740] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:19:01.194458 25318 consensus_queue.cc:260] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.194967 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:01.195604 25122 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 0.
I20260709 12:19:01.196744 25318 ts_tablet_manager.cc:1434] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:19:01.198709 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:01.200186 25692 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:01.197825 25318 tablet_bootstrap.cc:492] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:19:01.200575 25317 raft_consensus.cc:359] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.208124 25317 raft_consensus.cc:385] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:01.208448 25317 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Initialized, Role: FOLLOWER
I20260709 12:19:01.200552 25692 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.243892 25749 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.248495 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:01.235550 25692 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.250516 25317 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.252166 25198 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.192380 25743 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.256585 25274 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.257138 25743 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:19:01.259341 25242 leader_election.cc:343] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:01.265170 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:01.277956 25073 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:01.289014 25318 tablet_bootstrap.cc:654] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:01.266407 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:01.291483 25022 catalog_manager.cc:5697] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:01.313001 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:01.315606 25193 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.316423 25749 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:01.329525 25692 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.330642 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:01.341419 25743 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:01.344589 25193 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:19:01.344741 25692 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:01.350488 25506 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.350996 25506 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.352873 25506 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:01.357414 25350 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:01.357928 25350 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.362459 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:01.363125 25268 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 0.
I20260709 12:19:01.363849 25093 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:01.364665 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:01.365237 25274 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.366235 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:01.366760 25126 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.367004 25317 ts_tablet_manager.cc:1434] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Time spent starting tablet: real 0.175s	user 0.017s	sys 0.010s
I20260709 12:19:01.367244 25732 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:01.371477 25785 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:01.372032 25785 raft_consensus.cc:697] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:01.372912 25785 consensus_queue.cc:237] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.373436 25350 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:01.373373 25126 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:19:01.376078 25611 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:01.377595 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:01.379674 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:01.376194 25090 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:01.380864 25611 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:01.381229 25611 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.381781 25611 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.386245 25318 tablet_bootstrap.cc:492] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:19:01.386516 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:01.386790 25318 ts_tablet_manager.cc:1403] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.189s	user 0.010s	sys 0.009s
I20260709 12:19:01.387264 25692 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:01.387775 25692 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:01.388582 25692 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:01.392923 25242 leader_election.cc:343] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:01.395386 25318 raft_consensus.cc:359] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.396081 25318 raft_consensus.cc:385] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:01.396338 25318 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:19:01.397013 25318 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.403050 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:01.407846 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:01.408815 25168 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:19:01.411569 25093 leader_election.cc:343] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:01.415010 25318 ts_tablet_manager.cc:1434] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:19:01.411531 25756 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:01.428642 25611 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.437482 25611 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:01.449165 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:01.449820 25269 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.445859 25318 tablet_bootstrap.cc:492] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:19:01.451118 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:19:01.460515 25093 leader_election.cc:343] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:01.462497 25747 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:19:01.465878 25274 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:19:01.463512 25743 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:19:01.465803 25318 tablet_bootstrap.cc:654] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:01.480373 25022 catalog_manager.cc:5697] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:01.482069 25269 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:19:01.497156 25090 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:01.498857 25747 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:01.499349 25747 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:01.500185 25747 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.508011 25785 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:01.509712 25023 catalog_manager.cc:5697] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:01.512998 25318 tablet_bootstrap.cc:492] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:19:01.513514 25318 ts_tablet_manager.cc:1403] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.008s
I20260709 12:19:01.516811 25318 raft_consensus.cc:359] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.520591 25318 raft_consensus.cc:385] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:01.520941 25318 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:19:01.521633 25318 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.528573 25318 ts_tablet_manager.cc:1434] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 12:19:01.529613 25318 tablet_bootstrap.cc:492] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:19:01.536007 25318 tablet_bootstrap.cc:654] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:01.543692 25242 consensus_peers.cc:597] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:01.568442 25025 catalog_manager.cc:5697] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:01.575529 25318 tablet_bootstrap.cc:492] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:19:01.576447 25781 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:01.579816 25318 ts_tablet_manager.cc:1403] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.016s
I20260709 12:19:01.583060 25318 raft_consensus.cc:359] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.583715 25318 raft_consensus.cc:385] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:01.583990 25318 raft_consensus.cc:740] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:19:01.584532 25783 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.584722 25318 consensus_queue.cc:260] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.585011 25783 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.586907 25783 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:01.587775 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:01.588716 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:01.589344 25126 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:19:01.591897 25165 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:01.593225 25784 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.594000 25318 ts_tablet_manager.cc:1434] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:19:01.597470 25318 tablet_bootstrap.cc:492] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Bootstrap starting.
I20260709 12:19:01.603190 25784 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:01.610989 25318 tablet_bootstrap.cc:654] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:01.616777 25318 tablet_bootstrap.cc:492] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: No bootstrap required, opened a new log
I20260709 12:19:01.617206 25318 ts_tablet_manager.cc:1403] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:19:01.620110 25318 raft_consensus.cc:359] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.620697 25318 raft_consensus.cc:385] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:01.620965 25318 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Initialized, Role: FOLLOWER
I20260709 12:19:01.621560 25318 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.623539 25318 ts_tablet_manager.cc:1434] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:01.795789 25784 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.796312 25784 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.798462 25784 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:01.798969 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:01.799335 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:01.800578 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:01.801153 25784 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:01.805706 25784 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.806119 25784 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.807754 25784 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:01.808281 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:01.808688 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:01.809441 25270 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 1: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:19:01.810426 25165 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:01.811158 25784 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.824994 25784 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:01.852844 25536 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:01.853649 25781 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:01.857164 25536 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:01.872668 25747 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:01.889284 25783 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.889843 25783 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:01.891971 25783 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:01.892539 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:01.893905 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:01.895634 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:01.896359 25784 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:01.952364 25785 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:01.964740 25193 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:01.966140 25785 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:02.150707 25195 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:02.713852 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:02.736078 25816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:02.736156 25814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:02.736081 25813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:02.738327 23879 server_base.cc:1061] running on GCE node
I20260709 12:19:02.740056 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:02.740338 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:02.740569 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599542740550 us; error 0 us; skew 500 ppm
I20260709 12:19:02.741243 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:02.744840 23879 webserver.cc:533] Webserver started at http://127.23.81.196:35073/ using document root <none> and password file <none>
I20260709 12:19:02.745306 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:02.745512 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:02.745860 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:02.747071 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-3-root/instance:
uuid: "4456c1069d1541fab5b7cb29df9b6167"
format_stamp: "Formatted at 2026-07-09 12:19:02 on dist-test-slave-mprf"
I20260709 12:19:02.753140 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:19:02.757473 25821 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:02.758433 23879 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:19:02.758770 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-3-root
uuid: "4456c1069d1541fab5b7cb29df9b6167"
format_stamp: "Formatted at 2026-07-09 12:19:02 on dist-test-slave-mprf"
I20260709 12:19:02.759054 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:02.771981 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:02.773851 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:02.775997 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:02.779445 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:02.779695 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:02.779956 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:02.780156 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:02.850891 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.196:45401
I20260709 12:19:02.851056 25884 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.196:45401 every 8 connection(s)
I20260709 12:19:02.856737 23879 auto_leader_rebalancer-test.cc:439] add a tserver: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:02.874221 25885 heartbeater.cc:344] Connected to a master server at 127.23.81.254:44087
I20260709 12:19:02.874679 25885 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:02.875402 25885 heartbeater.cc:507] Master 127.23.81.254:44087 requested a full tablet report, sending...
I20260709 12:19:02.877605 25024 ts_manager.cc:194] Registered new tserver with Master: 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:02.879506 25024 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33480
I20260709 12:19:03.404788 25193 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:03.414500 25268 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:03.418606 25784 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:03.471993 25891 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:19:03.503623 25122 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:03.508766 25167 consensus_peers.cc:597] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fcbf7458baff481588dabf347ec2112d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:03.509045 25895 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:03.517424 25896 raft_consensus.cc:2955] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.521334 25274 raft_consensus.cc:2955] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.539539 25024 catalog_manager.cc:5697] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:03.546520 25125 raft_consensus.cc:2955] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.559275 25268 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:03.568799 25193 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:03.570533 25826 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:03.571157 25125 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:03.575112 25826 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:03.589699 25241 consensus_peers.cc:597] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c880ab05f6e24c9881bbc8954e0d9030. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:03.593127 25788 raft_consensus.cc:2955] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.602079 25125 raft_consensus.cc:2955] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.608687 25193 raft_consensus.cc:2955] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.621330 25024 catalog_manager.cc:5697] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.631341 25125 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:03.658869 25268 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:03.659225 25195 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:03.661134 25901 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:03.662086 25747 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:03.670544 25092 consensus_peers.cc:597] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d683b7b361f44f7cb6076cf5ac95611b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:03.683126 25747 raft_consensus.cc:2955] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.685182 25274 raft_consensus.cc:2955] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.685272 25195 raft_consensus.cc:2955] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.703549 25268 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:03.704085 25024 catalog_manager.cc:5697] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:03.722597 25195 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:03.724704 25241 consensus_peers.cc:597] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d3090ce3ca84e6e9649297156feeaef. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:03.725363 25898 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:03.728245 25122 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:03.730933 25898 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:03.741361 25788 raft_consensus.cc:2955] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.743268 25195 raft_consensus.cc:2955] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.743505 25122 raft_consensus.cc:2955] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.760551 25022 catalog_manager.cc:5697] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:03.840955 25920 ts_tablet_manager.cc:933] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:03.844048 25920 tablet_copy_client.cc:323] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
I20260709 12:19:03.856905 25212 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet fcbf7458baff481588dabf347ec2112d from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:03.857424 25212 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet fcbf7458baff481588dabf347ec2112d from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-fcbf7458baff481588dabf347ec2112d
I20260709 12:19:03.864523 25212 tablet_copy_source_session.cc:215] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:03.868484 25920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbf7458baff481588dabf347ec2112d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:03.883386 25885 heartbeater.cc:499] Master 127.23.81.254:44087 was elected leader, sending a full tablet report...
I20260709 12:19:03.885336 25920 tablet_copy_client.cc:806] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:03.886114 25920 tablet_copy_client.cc:670] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:03.890606 25920 tablet_copy_client.cc:538] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:03.897928 25920 tablet_bootstrap.cc:492] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:03.922649 25920 tablet_bootstrap.cc:492] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:03.923681 25920 tablet_bootstrap.cc:492] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:03.924328 25920 ts_tablet_manager.cc:1403] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.005s
I20260709 12:19:03.927590 25920 raft_consensus.cc:359] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:03.929069 25920 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:03.929786 25920 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:03.935441 25920 ts_tablet_manager.cc:1434] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.003s
I20260709 12:19:03.937250 25212 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-fcbf7458baff481588dabf347ec2112d received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:03.937737 25212 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-fcbf7458baff481588dabf347ec2112d on tablet fcbf7458baff481588dabf347ec2112d with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:04.134119 25920 ts_tablet_manager.cc:933] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:04.143976 25920 tablet_copy_client.cc:323] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:04.158562 25927 ts_tablet_manager.cc:933] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:04.161371 25927 tablet_copy_client.cc:323] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
I20260709 12:19:04.167346 25137 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet d683b7b361f44f7cb6076cf5ac95611b from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:04.167981 25137 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet d683b7b361f44f7cb6076cf5ac95611b from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-d683b7b361f44f7cb6076cf5ac95611b
I20260709 12:19:04.184697 25137 tablet_copy_source_session.cc:215] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:04.189827 25920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d683b7b361f44f7cb6076cf5ac95611b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:04.191504 25929 ts_tablet_manager.cc:933] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:04.195259 25286 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet 7d3090ce3ca84e6e9649297156feeaef from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:04.195868 25286 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet 7d3090ce3ca84e6e9649297156feeaef from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-7d3090ce3ca84e6e9649297156feeaef
I20260709 12:19:04.203145 25286 tablet_copy_source_session.cc:215] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:04.206504 25927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3090ce3ca84e6e9649297156feeaef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:04.221225 25929 tablet_copy_client.cc:323] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
I20260709 12:19:04.221993 25927 tablet_copy_client.cc:806] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:04.223090 25927 tablet_copy_client.cc:670] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:04.223322 25286 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet c880ab05f6e24c9881bbc8954e0d9030 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:04.224004 25286 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet c880ab05f6e24c9881bbc8954e0d9030 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-c880ab05f6e24c9881bbc8954e0d9030
I20260709 12:19:04.224437 25920 tablet_copy_client.cc:806] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:04.225050 25920 tablet_copy_client.cc:670] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:04.227408 25927 tablet_copy_client.cc:538] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:04.228796 25920 tablet_copy_client.cc:538] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:04.231765 25286 tablet_copy_source_session.cc:215] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:04.235015 25929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c880ab05f6e24c9881bbc8954e0d9030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:04.236761 25927 tablet_bootstrap.cc:492] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:04.268196 25929 tablet_copy_client.cc:806] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:04.268844 25929 tablet_copy_client.cc:670] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:04.270613 25927 tablet_bootstrap.cc:492] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:04.271533 25927 tablet_bootstrap.cc:492] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:04.272243 25927 ts_tablet_manager.cc:1403] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.012s
I20260709 12:19:04.273346 25929 tablet_copy_client.cc:538] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:04.275347 25927 raft_consensus.cc:359] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:04.276253 25927 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:04.276916 25927 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:04.285605 25929 tablet_bootstrap.cc:492] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:04.292608 25860 raft_consensus.cc:1217] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:04.295863 25920 tablet_bootstrap.cc:492] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:04.297112 25927 ts_tablet_manager.cc:1434] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:19:04.298832 25286 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-7d3090ce3ca84e6e9649297156feeaef received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:04.299252 25286 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-7d3090ce3ca84e6e9649297156feeaef on tablet 7d3090ce3ca84e6e9649297156feeaef with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:04.334232 25929 tablet_bootstrap.cc:492] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:04.335673 25929 tablet_bootstrap.cc:492] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:04.337275 25929 ts_tablet_manager.cc:1403] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.016s
I20260709 12:19:04.340344 25929 raft_consensus.cc:359] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:04.340983 25920 tablet_bootstrap.cc:492] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:04.341250 25929 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:04.342074 25920 tablet_bootstrap.cc:492] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:04.341991 25929 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:04.343062 25920 ts_tablet_manager.cc:1403] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.004s
I20260709 12:19:04.345432 25929 ts_tablet_manager.cc:1434] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:19:04.347951 25920 raft_consensus.cc:359] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:04.348855 25920 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:04.348994 25286 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-c880ab05f6e24c9881bbc8954e0d9030 received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:04.349483 25286 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-c880ab05f6e24c9881bbc8954e0d9030 on tablet c880ab05f6e24c9881bbc8954e0d9030 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:04.349589 25920 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:04.352030 25920 ts_tablet_manager.cc:1434] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:04.354310 25137 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-d683b7b361f44f7cb6076cf5ac95611b received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:04.354722 25137 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-d683b7b361f44f7cb6076cf5ac95611b on tablet d683b7b361f44f7cb6076cf5ac95611b with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:04.525961 25860 raft_consensus.cc:1217] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:04.547493 25860 raft_consensus.cc:1217] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:04.648916 25860 raft_consensus.cc:1217] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:04.736388 25784 raft_consensus.cc:1064] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:04.739498 25784 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:04.745766 25270 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:04.746973 25860 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:04.747862 25125 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:04.749349 25896 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:04.750167 25784 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:04.753566 25899 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:04.780416 25899 raft_consensus.cc:2955] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:04.789219 25268 raft_consensus.cc:2955] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:04.794461 25125 raft_consensus.cc:2955] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:04.805033 25025 catalog_manager.cc:5697] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:04.811460 25860 raft_consensus.cc:2955] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:04.834836 25195 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:04.841156 25270 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:04.842602 25896 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:04.844475 25860 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:04.850353 25784 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:04.854451 25899 raft_consensus.cc:2955] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:04.855530 25270 raft_consensus.cc:2955] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:04.860734 25860 raft_consensus.cc:2955] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:04.874099 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fcbf7458baff481588dabf347ec2112d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:04.884552 25023 catalog_manager.cc:5697] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.901558 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet fcbf7458baff481588dabf347ec2112d with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:04.906550 25944 tablet_replica.cc:333] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:04.912088 25944 raft_consensus.cc:2243] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:04.912806 25944 raft_consensus.cc:2272] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:04.918674 25944 ts_tablet_manager.cc:1916] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:04.938902 25944 ts_tablet_manager.cc:1929] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:04.939363 25944 log.cc:1199] T fcbf7458baff481588dabf347ec2112d P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/fcbf7458baff481588dabf347ec2112d
I20260709 12:19:04.940896 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet fcbf7458baff481588dabf347ec2112d (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:05.047231 25826 raft_consensus.cc:1064] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:05.049849 25826 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:05.062353 25198 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:05.062853 25860 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:05.063797 25125 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:05.063912 25826 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:05.064920 25788 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:05.067247 25898 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:05.083281 25785 raft_consensus.cc:1064] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:05.085886 25785 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:05.090550 25898 raft_consensus.cc:1064] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:05.097064 25898 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:05.118538 25859 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:05.120065 25747 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:05.120608 25270 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:05.124716 25195 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:05.125151 25859 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:05.125502 25952 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:05.126856 25826 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:05.127079 25901 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:05.146370 25119 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:05.150717 25193 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:05.154102 25933 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:05.175184 25933 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:05.198016 25788 raft_consensus.cc:2955] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.201049 25860 raft_consensus.cc:2955] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.225752 25023 catalog_manager.cc:5697] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.237208 25788 raft_consensus.cc:2955] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.240528 25196 raft_consensus.cc:2955] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.284278 25957 raft_consensus.cc:2955] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.299865 25859 raft_consensus.cc:2955] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.306612 25273 raft_consensus.cc:2955] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.316174 25860 raft_consensus.cc:2955] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.324323 25024 catalog_manager.cc:5697] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.338891 25195 raft_consensus.cc:2955] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.362205 25119 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:05.389904 25859 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:05.391568 25747 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:05.395087 25025 catalog_manager.cc:5697] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.399103 25198 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:05.401623 25952 raft_consensus.cc:2955] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.403538 25859 raft_consensus.cc:2955] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.407233 25957 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:19:05.410657 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 155962us
I20260709 12:19:05.421027 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d683b7b361f44f7cb6076cf5ac95611b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:05.421232 25198 raft_consensus.cc:2955] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.430753 25024 catalog_manager.cc:5697] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.437135 25195 raft_consensus.cc:2955] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.444161 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet d683b7b361f44f7cb6076cf5ac95611b with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:05.461542 25119 raft_consensus.cc:2955] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.466413 25963 tablet_replica.cc:333] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:05.472482 25963 raft_consensus.cc:2243] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:05.473258 25963 raft_consensus.cc:2272] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:05.478971 25963 ts_tablet_manager.cc:1916] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:05.498234 25119 raft_consensus.cc:2955] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.499747 25963 ts_tablet_manager.cc:1929] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:05.521767 25963 log.cc:1199] T d683b7b361f44f7cb6076cf5ac95611b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/d683b7b361f44f7cb6076cf5ac95611b
I20260709 12:19:05.523540 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet d683b7b361f44f7cb6076cf5ac95611b (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:05.538115 25269 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:05.545008 25859 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:05.546806 25933 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:05.555166 25788 raft_consensus.cc:2955] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.556865 25859 raft_consensus.cc:2955] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.558375 25125 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:05.561882 25961 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:05.563812 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d3090ce3ca84e6e9649297156feeaef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:05.566115 25269 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:05.569128 25125 raft_consensus.cc:2955] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.585002 25860 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:05.584779 25024 catalog_manager.cc:5697] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.588019 25962 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:05.593376 25125 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:05.595739 25961 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:05.606360 25962 raft_consensus.cc:2955] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.618230 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d3090ce3ca84e6e9649297156feeaef with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:05.620586 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c880ab05f6e24c9881bbc8954e0d9030 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:05.621682 25859 raft_consensus.cc:2955] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.623723 25125 raft_consensus.cc:2955] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:05.650841 25964 tablet_replica.cc:333] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:05.651986 25964 raft_consensus.cc:2243] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:05.652772 25964 raft_consensus.cc:2272] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:05.655928 25964 ts_tablet_manager.cc:1916] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:05.661520 25024 catalog_manager.cc:5697] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.677819 25964 ts_tablet_manager.cc:1929] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:05.678401 25964 log.cc:1199] T 7d3090ce3ca84e6e9649297156feeaef P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/7d3090ce3ca84e6e9649297156feeaef
I20260709 12:19:05.679977 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet 7d3090ce3ca84e6e9649297156feeaef (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:05.680063 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet c880ab05f6e24c9881bbc8954e0d9030 with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:05.680933 25964 tablet_replica.cc:333] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:05.681895 25964 raft_consensus.cc:2243] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:05.682690 25964 raft_consensus.cc:2272] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:05.685676 25964 ts_tablet_manager.cc:1916] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:05.699566 25964 ts_tablet_manager.cc:1929] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:05.699843 25964 log.cc:1199] T c880ab05f6e24c9881bbc8954e0d9030 P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/c880ab05f6e24c9881bbc8954e0d9030
I20260709 12:19:05.700896 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet c880ab05f6e24c9881bbc8954e0d9030 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:06.742995 25269 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
W20260709 12:19:06.749614 25241 consensus_peers.cc:597] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 450e4351142d43ca91af7ff9ee99c74b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:06.749785 25198 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:06.750349 25119 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:06.751089 25967 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:06.751796 25961 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:06.765971 25119 raft_consensus.cc:2955] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:06.768759 25198 raft_consensus.cc:2955] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:06.785773 25970 raft_consensus.cc:2955] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:06.788852 25025 catalog_manager.cc:5697] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:06.802596 25198 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:06.812500 25269 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:06.814216 25119 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:06.814512 25896 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:06.815456 25167 consensus_peers.cc:597] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd7e49fd52d74821a66c7dbbc770a988. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:06.816725 25965 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:06.896871 25896 raft_consensus.cc:2955] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
W20260709 12:19:06.898265 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 52960.9us
I20260709 12:19:06.906983 25269 raft_consensus.cc:2955] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:06.910925 25125 raft_consensus.cc:2955] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:06.913755 25195 consensus_queue.cc:237] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:06.921919 25024 catalog_manager.cc:5697] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:06.932298 25269 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:06.933632 25945 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:06.933815 25125 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:06.935263 25965 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:06.945544 25167 consensus_peers.cc:597] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 724a325f5a004fdab6dc4a9bcba2a3e9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:06.951750 25945 raft_consensus.cc:2955] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:06.953514 25125 raft_consensus.cc:2955] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:06.956291 25270 raft_consensus.cc:2955] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:06.966925 25198 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:06.979518 25025 catalog_manager.cc:5697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:06.982803 25270 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:06.986301 25167 consensus_peers.cc:597] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e81b9ed959214538853077eddd8dc8ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:06.987334 25125 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:06.986994 25965 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:06.988818 25945 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:07.053440 25896 raft_consensus.cc:2955] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:07.057760 25274 raft_consensus.cc:2955] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:07.057750 25125 raft_consensus.cc:2955] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:07.077310 25023 catalog_manager.cc:5697] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:07.138816 25986 ts_tablet_manager.cc:933] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:07.140517 25986 tablet_copy_client.cc:323] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
I20260709 12:19:07.142057 25286 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet 450e4351142d43ca91af7ff9ee99c74b from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:07.142621 25286 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet 450e4351142d43ca91af7ff9ee99c74b from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-450e4351142d43ca91af7ff9ee99c74b
I20260709 12:19:07.151007 25286 tablet_copy_source_session.cc:215] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:07.156279 25986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450e4351142d43ca91af7ff9ee99c74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:07.171686 25986 tablet_copy_client.cc:806] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:07.172230 25986 tablet_copy_client.cc:670] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:07.175926 25986 tablet_copy_client.cc:538] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:07.183495 25986 tablet_bootstrap.cc:492] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:07.203567 25986 tablet_bootstrap.cc:492] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:07.204438 25986 tablet_bootstrap.cc:492] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:07.205065 25986 ts_tablet_manager.cc:1403] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:19:07.207856 25986 raft_consensus.cc:359] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:07.208525 25986 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:07.209167 25986 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:07.214103 25986 ts_tablet_manager.cc:1434] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:19:07.215794 25286 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-450e4351142d43ca91af7ff9ee99c74b received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:07.216238 25286 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-450e4351142d43ca91af7ff9ee99c74b on tablet 450e4351142d43ca91af7ff9ee99c74b with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:07.244606 25986 ts_tablet_manager.cc:933] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:07.246480 25986 tablet_copy_client.cc:323] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
I20260709 12:19:07.247924 25212 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet fd7e49fd52d74821a66c7dbbc770a988 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:07.248416 25212 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet fd7e49fd52d74821a66c7dbbc770a988 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-fd7e49fd52d74821a66c7dbbc770a988
I20260709 12:19:07.254415 25212 tablet_copy_source_session.cc:215] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:07.257447 25986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7e49fd52d74821a66c7dbbc770a988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:07.270912 25986 tablet_copy_client.cc:806] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:07.271564 25986 tablet_copy_client.cc:670] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:07.276300 25986 tablet_copy_client.cc:538] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:07.286741 25986 tablet_bootstrap.cc:492] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:07.315234 25986 tablet_bootstrap.cc:492] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:07.316223 25986 tablet_bootstrap.cc:492] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:07.316900 25986 ts_tablet_manager.cc:1403] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.009s
I20260709 12:19:07.319849 25986 raft_consensus.cc:359] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:07.320739 25986 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:07.321421 25986 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:07.323786 25986 ts_tablet_manager.cc:1434] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:07.328312 25212 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-fd7e49fd52d74821a66c7dbbc770a988 received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:07.328727 25212 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-fd7e49fd52d74821a66c7dbbc770a988 on tablet fd7e49fd52d74821a66c7dbbc770a988 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:07.376955 25986 ts_tablet_manager.cc:933] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:07.378865 25986 tablet_copy_client.cc:323] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
I20260709 12:19:07.381105 25212 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet e81b9ed959214538853077eddd8dc8ea from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:07.381652 25212 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet e81b9ed959214538853077eddd8dc8ea from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-e81b9ed959214538853077eddd8dc8ea
I20260709 12:19:07.382920 25993 ts_tablet_manager.cc:933] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:07.385146 25993 tablet_copy_client.cc:323] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
I20260709 12:19:07.387868 25211 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet 724a325f5a004fdab6dc4a9bcba2a3e9 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:07.388418 25211 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet 724a325f5a004fdab6dc4a9bcba2a3e9 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-724a325f5a004fdab6dc4a9bcba2a3e9
I20260709 12:19:07.398322 25212 tablet_copy_source_session.cc:215] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:07.399864 25211 tablet_copy_source_session.cc:215] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:07.401419 25986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81b9ed959214538853077eddd8dc8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:07.404335 25993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724a325f5a004fdab6dc4a9bcba2a3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:07.419240 25986 tablet_copy_client.cc:806] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:07.419868 25986 tablet_copy_client.cc:670] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:07.432447 25986 tablet_copy_client.cc:538] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:07.443984 25986 tablet_bootstrap.cc:492] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:07.459510 25993 tablet_copy_client.cc:806] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:07.460420 25993 tablet_copy_client.cc:670] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:07.463788 25986 tablet_bootstrap.cc:492] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:07.465200 25986 tablet_bootstrap.cc:492] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:07.465878 25986 ts_tablet_manager.cc:1403] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.001s
I20260709 12:19:07.468340 25993 tablet_copy_client.cc:538] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:07.468487 25986 raft_consensus.cc:359] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:07.469264 25986 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:07.469779 25986 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:07.474996 25986 ts_tablet_manager.cc:1434] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:19:07.477324 25211 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-e81b9ed959214538853077eddd8dc8ea received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:07.477741 25211 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-e81b9ed959214538853077eddd8dc8ea on tablet e81b9ed959214538853077eddd8dc8ea with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:07.479585 25993 tablet_bootstrap.cc:492] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:07.501340 25993 tablet_bootstrap.cc:492] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:07.502357 25993 tablet_bootstrap.cc:492] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:07.503060 25993 ts_tablet_manager.cc:1403] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 12:19:07.505967 25993 raft_consensus.cc:359] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:07.506861 25993 raft_consensus.cc:740] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:07.508221 25993 consensus_queue.cc:260] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:07.510565 25993 ts_tablet_manager.cc:1434] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:07.513118 25211 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-724a325f5a004fdab6dc4a9bcba2a3e9 received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:07.513537 25211 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-724a325f5a004fdab6dc4a9bcba2a3e9 on tablet 724a325f5a004fdab6dc4a9bcba2a3e9 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:07.733245 25859 raft_consensus.cc:1217] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:07.772500 25859 raft_consensus.cc:1217] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:07.818466 25859 raft_consensus.cc:1217] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:07.868626 25859 raft_consensus.cc:1217] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:08.204007 25999 raft_consensus.cc:1064] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:08.206378 25999 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:08.213949 25274 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:08.214329 25859 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:08.215796 25999 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:08.216557 25125 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:08.217471 25896 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:08.218871 25999 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:08.228533 25896 raft_consensus.cc:2955] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.231045 25274 raft_consensus.cc:2955] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.231217 25125 raft_consensus.cc:2955] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.240341 25859 raft_consensus.cc:2955] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.259519 25024 catalog_manager.cc:5697] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.332110 25998 raft_consensus.cc:1064] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:08.334731 25998 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:08.342484 25198 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:08.349792 25965 raft_consensus.cc:1064] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:08.352494 25965 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:08.354521 25859 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:08.354974 25125 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:08.361104 25896 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:08.364096 25999 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:08.374857 25196 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:08.380076 25860 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:08.381724 25971 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:08.384639 25971 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:08.382367 25999 raft_consensus.cc:2955] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.402853 25125 raft_consensus.cc:2955] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.413154 25121 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:08.415725 25998 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:08.425758 25023 catalog_manager.cc:5697] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.435281 25859 raft_consensus.cc:2955] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.442376 25858 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:08.443537 25119 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:08.443802 25269 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:08.445291 26009 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:08.447322 25896 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:08.446719 25788 raft_consensus.cc:2955] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.448073 26009 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:08.461623 25896 raft_consensus.cc:1064] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:08.452329 25860 raft_consensus.cc:2955] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.468276 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet fd7e49fd52d74821a66c7dbbc770a988 with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:08.466535 25896 consensus_queue.cc:237] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:08.472410 25125 raft_consensus.cc:2955] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.494655 25121 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:08.496295 26014 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:08.500550 25273 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:08.501904 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fd7e49fd52d74821a66c7dbbc770a988 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:08.503947 25858 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:08.508333 26014 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:08.518268 26013 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:08.531841 26011 raft_consensus.cc:2955] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.535552 25023 catalog_manager.cc:5697] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.546326 25196 raft_consensus.cc:2955] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.551982 25269 raft_consensus.cc:2955] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.565387 26019 tablet_replica.cc:333] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:08.576370 26013 raft_consensus.cc:2955] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.580999 25269 raft_consensus.cc:2955] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.636072 25121 raft_consensus.cc:2955] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.643095 25274 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:08.613763 26019 raft_consensus.cc:2243] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.647889 26019 raft_consensus.cc:2272] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.648921 25860 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:08.651929 26023 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:08.655886 25195 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:08.660822 25788 raft_consensus.cc:2955] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.662699 25859 raft_consensus.cc:2955] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.668586 25971 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:08.673058 25022 catalog_manager.cc:5697] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.674280 25860 raft_consensus.cc:2955] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.673453 25195 raft_consensus.cc:2955] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.675117 25022 catalog_manager.cc:5697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.684960 26019 ts_tablet_manager.cc:1916] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:08.694129 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 450e4351142d43ca91af7ff9ee99c74b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:08.694671 25025 catalog_manager.cc:5697] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.699280 25121 raft_consensus.cc:2955] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.706290 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet 450e4351142d43ca91af7ff9ee99c74b with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:08.706967 25859 raft_consensus.cc:2955] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.728571 25195 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:08.737449 25198 consensus_queue.cc:237] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:08.743235 26019 ts_tablet_manager.cc:1929] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:08.752490 26019 log.cc:1199] T fd7e49fd52d74821a66c7dbbc770a988 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/fd7e49fd52d74821a66c7dbbc770a988
I20260709 12:19:08.754141 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet fd7e49fd52d74821a66c7dbbc770a988 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:08.758351 25859 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:08.760386 25121 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:08.760663 25274 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:08.761104 25859 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:08.761883 25999 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:08.763401 25999 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:08.764801 26014 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:08.766768 26011 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:08.773598 26014 raft_consensus.cc:2955] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.780299 25859 raft_consensus.cc:2955] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.785580 25125 raft_consensus.cc:2955] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.789290 25860 raft_consensus.cc:2955] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.791970 25024 catalog_manager.cc:5697] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:08.780934 26011 raft_consensus.cc:2955] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.799185 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e81b9ed959214538853077eddd8dc8ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:08.802160 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet e81b9ed959214538853077eddd8dc8ea with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:08.803051 26019 tablet_replica.cc:333] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:08.804111 26019 raft_consensus.cc:2243] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.804877 26019 raft_consensus.cc:2272] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.804342 25273 raft_consensus.cc:2955] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.811558 26019 ts_tablet_manager.cc:1916] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:08.818954 26028 tablet_replica.cc:333] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:08.823129 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 724a325f5a004fdab6dc4a9bcba2a3e9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:08.823477 26028 raft_consensus.cc:2243] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.824741 26028 raft_consensus.cc:2272] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.831395 26028 ts_tablet_manager.cc:1916] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:08.831600 25024 catalog_manager.cc:5697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:08.846060 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet 724a325f5a004fdab6dc4a9bcba2a3e9 with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:08.850857 26019 ts_tablet_manager.cc:1929] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:08.851402 26019 log.cc:1199] T e81b9ed959214538853077eddd8dc8ea P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/e81b9ed959214538853077eddd8dc8ea
I20260709 12:19:08.853286 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet e81b9ed959214538853077eddd8dc8ea (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:08.856288 26028 ts_tablet_manager.cc:1929] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:08.856868 26028 log.cc:1199] T 450e4351142d43ca91af7ff9ee99c74b P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/450e4351142d43ca91af7ff9ee99c74b
I20260709 12:19:08.859256 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet 450e4351142d43ca91af7ff9ee99c74b (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:08.859827 26028 tablet_replica.cc:333] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:08.862926 26028 raft_consensus.cc:2243] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.865330 26028 raft_consensus.cc:2272] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.868160 26028 ts_tablet_manager.cc:1916] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:08.880086 26028 ts_tablet_manager.cc:1929] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:08.880489 26028 log.cc:1199] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/724a325f5a004fdab6dc4a9bcba2a3e9
I20260709 12:19:08.881795 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet 724a325f5a004fdab6dc4a9bcba2a3e9 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:09.928644 25269 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
W20260709 12:19:09.937425 25241 consensus_peers.cc:597] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6248d848eecd4b799e9233d56f0b5467. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:09.938084 25193 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:09.938112 25121 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:09.939754 25971 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:09.941183 26033 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:09.948865 25971 raft_consensus.cc:2955] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:09.950708 25121 raft_consensus.cc:2955] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:09.951399 25193 raft_consensus.cc:2955] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:09.964754 25269 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:09.970818 25022 catalog_manager.cc:5697] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:09.985674 25198 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:09.988423 26034 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:19:09.991680 25121 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:09.992738 25241 consensus_peers.cc:597] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 783cdcb70b0d4499b94b2f51672f6895. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:09.993557 26039 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:10.014184 26034 raft_consensus.cc:2955] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:10.023379 25121 raft_consensus.cc:2955] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:10.031288 25193 raft_consensus.cc:2955] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:10.034766 25195 consensus_queue.cc:237] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:10.045987 25269 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:10.046452 25121 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:10.046131 25167 consensus_peers.cc:597] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7e59abaef5845e2bb8f466331bb98c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:10.047672 25999 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:10.048655 26035 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:10.053169 25023 catalog_manager.cc:5697] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:10.102258 25999 raft_consensus.cc:2955] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:10.105304 25274 raft_consensus.cc:2955] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:10.106316 25125 raft_consensus.cc:2955] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:10.122231 25023 catalog_manager.cc:5697] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:10.123731 25121 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:10.153020 25274 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:10.153082 25092 consensus_peers.cc:597] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ff71ed0aef74f1f963b143876c9b3d6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:10.154431 26051 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:10.156353 25198 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:10.157873 26030 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:10.163362 26051 raft_consensus.cc:2955] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:10.165400 25274 raft_consensus.cc:2955] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:10.168236 25198 raft_consensus.cc:2955] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:10.188926 25023 catalog_manager.cc:5697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:10.381373 26055 ts_tablet_manager.cc:933] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:10.383322 26055 tablet_copy_client.cc:323] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
I20260709 12:19:10.385185 25286 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet 6248d848eecd4b799e9233d56f0b5467 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:10.385663 25286 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet 6248d848eecd4b799e9233d56f0b5467 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-6248d848eecd4b799e9233d56f0b5467
I20260709 12:19:10.391286 25286 tablet_copy_source_session.cc:215] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:10.394701 26055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6248d848eecd4b799e9233d56f0b5467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:10.410502 26055 tablet_copy_client.cc:806] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:10.411173 26055 tablet_copy_client.cc:670] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:10.417347 26055 tablet_copy_client.cc:538] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:10.427531 26055 tablet_bootstrap.cc:492] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:10.454449 26055 tablet_bootstrap.cc:492] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:10.455466 26055 tablet_bootstrap.cc:492] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:10.456365 26055 ts_tablet_manager.cc:1403] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.013s
I20260709 12:19:10.459649 26057 ts_tablet_manager.cc:933] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:10.459698 26055 raft_consensus.cc:359] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:10.460707 26055 raft_consensus.cc:740] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:10.462599 26055 consensus_queue.cc:260] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:10.467965 26057 tablet_copy_client.cc:323] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
I20260709 12:19:10.468164 26055 ts_tablet_manager.cc:1434] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.007s
I20260709 12:19:10.470295 25286 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-6248d848eecd4b799e9233d56f0b5467 received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:10.470794 25286 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-6248d848eecd4b799e9233d56f0b5467 on tablet 6248d848eecd4b799e9233d56f0b5467 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:10.470711 25211 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet e7e59abaef5845e2bb8f466331bb98c3 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:10.471899 25211 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet e7e59abaef5845e2bb8f466331bb98c3 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-e7e59abaef5845e2bb8f466331bb98c3
I20260709 12:19:10.483287 25211 tablet_copy_source_session.cc:215] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:10.486387 26057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e59abaef5845e2bb8f466331bb98c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:10.505990 26057 tablet_copy_client.cc:806] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:10.506863 26057 tablet_copy_client.cc:670] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:10.513550 26057 tablet_copy_client.cc:538] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:10.520704 26055 ts_tablet_manager.cc:933] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:10.523396 26057 tablet_bootstrap.cc:492] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:10.526605 26055 tablet_copy_client.cc:323] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
I20260709 12:19:10.529313 25286 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet 783cdcb70b0d4499b94b2f51672f6895 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:10.529871 25286 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet 783cdcb70b0d4499b94b2f51672f6895 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-783cdcb70b0d4499b94b2f51672f6895
I20260709 12:19:10.538802 25286 tablet_copy_source_session.cc:215] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:10.541725 26055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783cdcb70b0d4499b94b2f51672f6895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:10.547617 26057 tablet_bootstrap.cc:492] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:10.548787 26057 tablet_bootstrap.cc:492] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:10.549921 26057 ts_tablet_manager.cc:1403] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.027s	user 0.023s	sys 0.000s
I20260709 12:19:10.553027 26057 raft_consensus.cc:359] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:10.553846 26057 raft_consensus.cc:740] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:10.554513 26057 consensus_queue.cc:260] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:10.556933 26057 ts_tablet_manager.cc:1434] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:10.560757 25211 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-e7e59abaef5845e2bb8f466331bb98c3 received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:10.561201 25211 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-e7e59abaef5845e2bb8f466331bb98c3 on tablet e7e59abaef5845e2bb8f466331bb98c3 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:10.562978 26055 tablet_copy_client.cc:806] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:10.563544 26055 tablet_copy_client.cc:670] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:10.567210 26055 tablet_copy_client.cc:538] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:10.574625 26055 tablet_bootstrap.cc:492] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:10.592511 26055 tablet_bootstrap.cc:492] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:10.593369 26055 tablet_bootstrap.cc:492] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:10.594563 26055 ts_tablet_manager.cc:1403] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:19:10.597438 26055 raft_consensus.cc:359] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:10.598043 26055 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:10.598582 26055 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:10.600617 26055 ts_tablet_manager.cc:1434] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:10.602242 25286 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-783cdcb70b0d4499b94b2f51672f6895 received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:10.602690 25286 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-783cdcb70b0d4499b94b2f51672f6895 on tablet 783cdcb70b0d4499b94b2f51672f6895 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:10.652885 26055 ts_tablet_manager.cc:933] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:10.654953 26055 tablet_copy_client.cc:323] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:10.656849 25137 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet 0ff71ed0aef74f1f963b143876c9b3d6 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:10.657323 25137 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet 0ff71ed0aef74f1f963b143876c9b3d6 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-0ff71ed0aef74f1f963b143876c9b3d6
I20260709 12:19:10.664963 25137 tablet_copy_source_session.cc:215] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:10.667678 26055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff71ed0aef74f1f963b143876c9b3d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:10.679836 26055 tablet_copy_client.cc:806] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:10.680369 26055 tablet_copy_client.cc:670] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:10.684684 26055 tablet_copy_client.cc:538] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:10.692703 26055 tablet_bootstrap.cc:492] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:10.708082 26055 tablet_bootstrap.cc:492] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:10.708760 26055 tablet_bootstrap.cc:492] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:10.709705 26055 ts_tablet_manager.cc:1403] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.017s	user 0.018s	sys 0.000s
I20260709 12:19:10.712404 26055 raft_consensus.cc:359] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:10.713145 26055 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:10.713727 26055 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:10.715776 26055 ts_tablet_manager.cc:1434] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:10.722783 25137 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-0ff71ed0aef74f1f963b143876c9b3d6 received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:10.723242 25137 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-0ff71ed0aef74f1f963b143876c9b3d6 on tablet 0ff71ed0aef74f1f963b143876c9b3d6 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:10.839893 25859 raft_consensus.cc:1217] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:10.904875 25859 raft_consensus.cc:1217] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:10.919948 25859 raft_consensus.cc:1217] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:11.069073 25859 raft_consensus.cc:1217] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:11.243216 25971 raft_consensus.cc:1064] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:11.245038 25971 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:11.252516 25198 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:11.253979 25859 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:11.255091 26034 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.256017 26039 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.256969 25125 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:11.260313 25971 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.291334 26039 raft_consensus.cc:2955] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.294356 25125 raft_consensus.cc:2955] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.297196 25198 raft_consensus.cc:2955] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.307823 25859 raft_consensus.cc:2955] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.332005 25022 catalog_manager.cc:5697] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.339159 26034 raft_consensus.cc:1064] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:11.341950 26034 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:11.358546 25198 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:11.360111 25859 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:11.362131 26069 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.364104 26069 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.373669 25121 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:11.377555 26039 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.397241 26072 raft_consensus.cc:2955] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.401305 25198 raft_consensus.cc:2955] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.433607 25859 raft_consensus.cc:2955] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.442457 25121 raft_consensus.cc:2955] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.453007 25024 catalog_manager.cc:5697] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.455462 25274 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:11.458911 26066 raft_consensus.cc:1064] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:11.469815 25859 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:11.471411 26039 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:11.461246 26066 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:11.477797 25121 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:11.479209 26034 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:19:11.491176 25859 raft_consensus.cc:2955] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.488358 26072 raft_consensus.cc:2955] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.501776 25274 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:11.506620 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6248d848eecd4b799e9233d56f0b5467 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:11.511142 25198 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:11.511238 25860 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:11.513696 26030 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.514158 26039 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:11.520594 25121 raft_consensus.cc:2955] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.522462 25193 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:11.521919 26034 raft_consensus.cc:2955] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.524858 25860 raft_consensus.cc:2955] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.529023 26048 raft_consensus.cc:1064] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:11.534798 25971 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:11.535025 25859 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:11.536887 26030 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.548245 25193 raft_consensus.cc:2955] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.549322 25025 catalog_manager.cc:5697] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:11.550307 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 783cdcb70b0d4499b94b2f51672f6895 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:11.562712 26048 consensus_queue.cc:237] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:11.597604 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 89254us
I20260709 12:19:11.602694 25274 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:11.607753 25860 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:11.608841 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet 6248d848eecd4b799e9233d56f0b5467 with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:11.609736 25125 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:11.611692 26011 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:11.614533 26082 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:11.615558 25274 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:11.618116 25999 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.627660 26011 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.626987 26031 raft_consensus.cc:2955] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.615615 25024 catalog_manager.cc:5697] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.639585 25860 raft_consensus.cc:2955] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.641589 25195 raft_consensus.cc:2955] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.701351 26090 tablet_replica.cc:333] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:11.708623 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet 783cdcb70b0d4499b94b2f51672f6895 with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:11.749862 26011 raft_consensus.cc:2955] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.761818 26096 tablet_replica.cc:333] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:11.762951 26096 raft_consensus.cc:2243] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.764365 26096 raft_consensus.cc:2272] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.746596 25024 catalog_manager.cc:5697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:11.746623 26090 raft_consensus.cc:2243] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:11.780828 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 82818.5us
I20260709 12:19:11.758991 25858 raft_consensus.cc:2955] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.782572 25274 raft_consensus.cc:2955] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.809629 26096 ts_tablet_manager.cc:1916] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:11.816663 25125 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:11.786969 26090 raft_consensus.cc:2272] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.816709 25119 raft_consensus.cc:2955] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.822902 26090 ts_tablet_manager.cc:1916] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:11.825773 25860 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:11.827452 26095 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:11.803735 25269 raft_consensus.cc:2955] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.836814 26066 raft_consensus.cc:2955] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.838400 25860 raft_consensus.cc:2955] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.856657 25024 catalog_manager.cc:5697] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.860452 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ff71ed0aef74f1f963b143876c9b3d6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:11.880522 25273 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:11.882011 25196 consensus_queue.cc:237] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:11.884925 25024 catalog_manager.cc:5697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.890493 25860 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:11.891667 25121 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:11.891940 26048 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:11.894009 26048 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:11.894770 26096 ts_tablet_manager.cc:1929] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:11.895212 26096 log.cc:1199] T 783cdcb70b0d4499b94b2f51672f6895 P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/783cdcb70b0d4499b94b2f51672f6895
I20260709 12:19:11.898383 26090 ts_tablet_manager.cc:1929] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:11.898813 26090 log.cc:1199] T 6248d848eecd4b799e9233d56f0b5467 P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/6248d848eecd4b799e9233d56f0b5467
I20260709 12:19:11.900414 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet 6248d848eecd4b799e9233d56f0b5467 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:11.904331 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet 783cdcb70b0d4499b94b2f51672f6895 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:11.906076 25999 raft_consensus.cc:2955] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.910465 26066 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:11.915096 25121 raft_consensus.cc:2955] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.920436 25860 raft_consensus.cc:2955] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:11.922343 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e7e59abaef5845e2bb8f466331bb98c3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:11.988960 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ff71ed0aef74f1f963b143876c9b3d6 with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:11.989941 26090 tablet_replica.cc:333] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:11.991204 26090 raft_consensus.cc:2243] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.991986 26090 raft_consensus.cc:2272] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.995328 26090 ts_tablet_manager.cc:1916] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:12.002503 25024 catalog_manager.cc:5697] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:12.011006 26090 ts_tablet_manager.cc:1929] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:12.011472 26090 log.cc:1199] T 0ff71ed0aef74f1f963b143876c9b3d6 P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/0ff71ed0aef74f1f963b143876c9b3d6
I20260709 12:19:12.013108 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet 0ff71ed0aef74f1f963b143876c9b3d6 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:12.016376 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet e7e59abaef5845e2bb8f466331bb98c3 with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:12.039510 25270 raft_consensus.cc:2955] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:12.044441 26099 tablet_replica.cc:333] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:12.046114 26099 raft_consensus.cc:2243] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:12.055678 26099 raft_consensus.cc:2272] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.060483 26099 ts_tablet_manager.cc:1916] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:12.086138 26099 ts_tablet_manager.cc:1929] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:12.086467 26099 log.cc:1199] T e7e59abaef5845e2bb8f466331bb98c3 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/e7e59abaef5845e2bb8f466331bb98c3
I20260709 12:19:12.087961 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet e7e59abaef5845e2bb8f466331bb98c3 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:13.087101 25121 consensus_queue.cc:237] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:13.093211 25196 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:13.093649 25274 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:13.094000 25092 consensus_peers.cc:597] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd90d1f02e904a46be6868d71386b83a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.095109 26066 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:13.096611 26030 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:13.104986 26066 raft_consensus.cc:2955] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:13.106751 25275 raft_consensus.cc:2955] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:13.113185 25198 raft_consensus.cc:2955] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:13.128615 25195 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:13.131901 25024 catalog_manager.cc:5697] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:13.138731 25275 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:13.141355 26011 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:13.143998 25167 consensus_peers.cc:597] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b86f3fbaedb441bfa448cef75c5e613f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.152113 25121 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:13.157560 26106 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:13.161973 25999 raft_consensus.cc:2955] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:13.215231 25275 raft_consensus.cc:2955] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
W20260709 12:19:13.217841 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 55357.6us
I20260709 12:19:13.227916 25198 consensus_queue.cc:237] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:13.230937 25121 raft_consensus.cc:2955] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:13.241395 25275 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:13.242882 25999 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:13.248657 25023 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:13.252506 25167 consensus_peers.cc:597] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 960cba74c5c0438f9a3d8e25d8dec7ad. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.252852 25121 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:13.254490 26110 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:13.254302 25999 raft_consensus.cc:2955] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:13.262241 25121 raft_consensus.cc:2955] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:13.362758 25121 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:13.369793 25023 catalog_manager.cc:5697] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.373263 25274 raft_consensus.cc:2955] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
W20260709 12:19:13.395994 25092 consensus_peers.cc:597] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e78737bee66450b9a076cc9676331b9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.399922 25198 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:13.401463 25269 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:13.404729 26104 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:13.407987 26107 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:13.414218 26104 raft_consensus.cc:2955] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:13.416779 25198 raft_consensus.cc:2955] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:13.432000 25269 raft_consensus.cc:2955] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:13.434896 25023 catalog_manager.cc:5697] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.612928 26123 ts_tablet_manager.cc:933] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:13.616266 26123 tablet_copy_client.cc:323] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
I20260709 12:19:13.617690 25211 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet b86f3fbaedb441bfa448cef75c5e613f from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:13.618148 25211 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet b86f3fbaedb441bfa448cef75c5e613f from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-b86f3fbaedb441bfa448cef75c5e613f
I20260709 12:19:13.625808 25211 tablet_copy_source_session.cc:215] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:13.632325 26123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86f3fbaedb441bfa448cef75c5e613f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.650234 26123 tablet_copy_client.cc:806] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:13.650872 26123 tablet_copy_client.cc:670] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:13.654981 26125 ts_tablet_manager.cc:933] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:13.656129 26123 tablet_copy_client.cc:538] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:13.658223 26125 tablet_copy_client.cc:323] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:13.659653 25137 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet dd90d1f02e904a46be6868d71386b83a from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:13.660107 25137 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet dd90d1f02e904a46be6868d71386b83a from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-dd90d1f02e904a46be6868d71386b83a
I20260709 12:19:13.666077 25137 tablet_copy_source_session.cc:215] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:13.666420 26123 tablet_bootstrap.cc:492] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:13.668854 26125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd90d1f02e904a46be6868d71386b83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.689921 26125 tablet_copy_client.cc:806] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:13.690614 26125 tablet_copy_client.cc:670] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:13.698777 26125 tablet_copy_client.cc:538] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:13.701400 26128 ts_tablet_manager.cc:933] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:13.709839 26128 tablet_copy_client.cc:323] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
I20260709 12:19:13.709112 26123 tablet_bootstrap.cc:492] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:13.711227 26123 tablet_bootstrap.cc:492] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:13.711673 25211 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet 960cba74c5c0438f9a3d8e25d8dec7ad from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:13.711905 26123 ts_tablet_manager.cc:1403] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.010s
I20260709 12:19:13.712273 25211 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet 960cba74c5c0438f9a3d8e25d8dec7ad from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-960cba74c5c0438f9a3d8e25d8dec7ad
I20260709 12:19:13.717551 26125 tablet_bootstrap.cc:492] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:13.717142 26123 raft_consensus.cc:359] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:13.718994 26123 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:13.719689 26123 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:13.734555 25211 tablet_copy_source_session.cc:215] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:13.738219 26128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960cba74c5c0438f9a3d8e25d8dec7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.738328 26123 ts_tablet_manager.cc:1434] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.026s	user 0.015s	sys 0.005s
I20260709 12:19:13.740068 25211 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-b86f3fbaedb441bfa448cef75c5e613f received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:13.740473 25211 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-b86f3fbaedb441bfa448cef75c5e613f on tablet b86f3fbaedb441bfa448cef75c5e613f with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:13.755091 26128 tablet_copy_client.cc:806] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:13.755761 26128 tablet_copy_client.cc:670] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:13.759586 26128 tablet_copy_client.cc:538] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:13.766449 26125 tablet_bootstrap.cc:492] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:13.767439 26125 tablet_bootstrap.cc:492] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:13.768139 26125 ts_tablet_manager.cc:1403] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.004s
I20260709 12:19:13.769009 26128 tablet_bootstrap.cc:492] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:13.771231 26125 raft_consensus.cc:359] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:13.772161 26125 raft_consensus.cc:740] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:13.774566 26125 consensus_queue.cc:260] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:13.779433 26125 ts_tablet_manager.cc:1434] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.003s
I20260709 12:19:13.781159 25137 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-dd90d1f02e904a46be6868d71386b83a received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:13.781572 25137 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-dd90d1f02e904a46be6868d71386b83a on tablet dd90d1f02e904a46be6868d71386b83a with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:13.800278 26128 tablet_bootstrap.cc:492] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:13.801214 26128 tablet_bootstrap.cc:492] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:13.801944 26128 ts_tablet_manager.cc:1403] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.033s	user 0.024s	sys 0.011s
I20260709 12:19:13.804297 26128 raft_consensus.cc:359] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:13.804857 26128 raft_consensus.cc:740] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:13.805403 26128 consensus_queue.cc:260] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:13.807619 26128 ts_tablet_manager.cc:1434] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:13.809482 25211 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-960cba74c5c0438f9a3d8e25d8dec7ad received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:13.809895 25211 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-960cba74c5c0438f9a3d8e25d8dec7ad on tablet 960cba74c5c0438f9a3d8e25d8dec7ad with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:13.997807 26128 ts_tablet_manager.cc:933] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:14.004633 26128 tablet_copy_client.cc:323] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:14.006058 25137 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet 6e78737bee66450b9a076cc9676331b9 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:14.006558 25137 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet 6e78737bee66450b9a076cc9676331b9 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-6e78737bee66450b9a076cc9676331b9
I20260709 12:19:14.012769 25137 tablet_copy_source_session.cc:215] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:14.015311 26128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e78737bee66450b9a076cc9676331b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.030484 26128 tablet_copy_client.cc:806] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:14.031026 26128 tablet_copy_client.cc:670] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:14.034281 26128 tablet_copy_client.cc:538] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:14.041690 26128 tablet_bootstrap.cc:492] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:14.059643 26128 tablet_bootstrap.cc:492] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:14.060503 26128 tablet_bootstrap.cc:492] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:14.061273 26128 ts_tablet_manager.cc:1403] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.020s	user 0.020s	sys 0.002s
I20260709 12:19:14.063572 26128 raft_consensus.cc:359] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:14.064147 26128 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:14.064672 26128 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:14.066655 26128 ts_tablet_manager.cc:1434] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260709 12:19:14.069167 25137 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-6e78737bee66450b9a076cc9676331b9 received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:14.069569 25137 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-6e78737bee66450b9a076cc9676331b9 on tablet 6e78737bee66450b9a076cc9676331b9 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:14.134073 25859 raft_consensus.cc:1217] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:14.222072 25859 raft_consensus.cc:1217] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:14.270572 25859 raft_consensus.cc:1217] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:14.566133 25999 raft_consensus.cc:1064] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:14.568414 25999 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:14.573958 25860 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:14.574337 25269 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:14.574965 25121 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:14.575788 26110 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:14.576718 25999 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:14.578431 26011 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:14.593438 26011 raft_consensus.cc:2955] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.600996 25274 raft_consensus.cc:2955] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.600996 25119 raft_consensus.cc:2955] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.615079 25859 raft_consensus.cc:2955] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.620803 25023 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:14.631790 25860 raft_consensus.cc:1217] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:14.662621 25198 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:14.669866 25859 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:14.671309 25274 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:14.672991 25999 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:14.676852 26110 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:14.681828 25999 raft_consensus.cc:2955] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.683104 25274 raft_consensus.cc:2955] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.693862 26110 raft_consensus.cc:1064] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:14.696573 26110 consensus_queue.cc:237] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:14.699703 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b86f3fbaedb441bfa448cef75c5e613f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:14.701153 25025 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.713222 25859 raft_consensus.cc:2955] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.729611 26107 raft_consensus.cc:1064] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:14.732131 26107 consensus_queue.cc:237] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:14.732151 25119 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:14.737871 26110 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:14.738214 25274 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:14.742635 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet b86f3fbaedb441bfa448cef75c5e613f with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:14.749985 26110 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:14.756168 25859 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:14.758733 26144 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:14.777165 26147 tablet_replica.cc:333] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:14.781157 26147 raft_consensus.cc:2243] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:14.782420 26144 raft_consensus.cc:2955] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.783794 25860 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:14.785077 26101 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:14.788647 25270 raft_consensus.cc:2955] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.796564 26147 raft_consensus.cc:2272] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:14.803176 26147 ts_tablet_manager.cc:1916] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:14.800626 25860 raft_consensus.cc:2955] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.807296 25198 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:14.810251 25022 catalog_manager.cc:5697] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:14.816849 25274 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:14.819703 26104 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:14.822906 26104 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:14.811743 25119 raft_consensus.cc:2955] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.834414 26147 ts_tablet_manager.cc:1929] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:14.843459 26147 log.cc:1199] T b86f3fbaedb441bfa448cef75c5e613f P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/b86f3fbaedb441bfa448cef75c5e613f
I20260709 12:19:14.846357 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet b86f3fbaedb441bfa448cef75c5e613f (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:14.863842 25195 consensus_queue.cc:237] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:14.863763 26104 raft_consensus.cc:2955] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.876430 25274 raft_consensus.cc:2955] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.878080 25859 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:14.880080 26144 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:14.888411 25119 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:14.892263 25999 raft_consensus.cc:2955] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.895519 26144 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:14.903363 25859 raft_consensus.cc:2955] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.911396 25860 raft_consensus.cc:2955] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.891409 25198 raft_consensus.cc:2955] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.925061 25022 catalog_manager.cc:5697] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.925719 25119 raft_consensus.cc:2955] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:14.926949 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 960cba74c5c0438f9a3d8e25d8dec7ad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:14.944244 25023 catalog_manager.cc:5697] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:14.972961 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet 960cba74c5c0438f9a3d8e25d8dec7ad with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:14.982172 25125 consensus_queue.cc:237] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:14.994910 25859 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:14.995512 25274 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:14.997318 26158 tablet_replica.cc:333] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:14.997545 26107 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:15.002825 26156 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:15.013345 26158 raft_consensus.cc:2243] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.014235 26158 raft_consensus.cc:2272] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.019264 26158 ts_tablet_manager.cc:1916] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:15.021709 25859 raft_consensus.cc:2955] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:15.028570 26155 raft_consensus.cc:2955] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:15.028932 25274 raft_consensus.cc:2955] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:15.031028 26101 raft_consensus.cc:1064] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:15.033440 26101 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:15.050906 26158 ts_tablet_manager.cc:1929] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:15.053367 26158 log.cc:1199] T 960cba74c5c0438f9a3d8e25d8dec7ad P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/960cba74c5c0438f9a3d8e25d8dec7ad
I20260709 12:19:15.055069 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet 960cba74c5c0438f9a3d8e25d8dec7ad (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:15.056042 25023 catalog_manager.cc:5697] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:15.059337 25274 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:15.059628 25860 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:15.060869 26157 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:15.061857 26107 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:15.066319 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd90d1f02e904a46be6868d71386b83a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:15.076313 25195 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:15.084092 26155 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:15.091327 26101 raft_consensus.cc:2955] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:15.092694 25269 raft_consensus.cc:2955] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:15.107293 25860 raft_consensus.cc:2955] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:15.126562 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet dd90d1f02e904a46be6868d71386b83a with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:15.142189 25022 catalog_manager.cc:5697] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:15.144040 25193 raft_consensus.cc:2955] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:15.146544 26163 tablet_replica.cc:333] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:15.147680 26163 raft_consensus.cc:2243] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.154042 26163 raft_consensus.cc:2272] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.162518 26163 ts_tablet_manager.cc:1916] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:15.180377 26163 ts_tablet_manager.cc:1929] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:15.180858 26163 log.cc:1199] T dd90d1f02e904a46be6868d71386b83a P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/dd90d1f02e904a46be6868d71386b83a
I20260709 12:19:15.182328 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet dd90d1f02e904a46be6868d71386b83a (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:15.190060 25119 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:15.194931 25860 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:15.195281 25193 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:15.196302 26156 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:15.197197 26152 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:15.204346 26156 raft_consensus.cc:2955] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:15.207607 25859 raft_consensus.cc:2955] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:15.213024 25193 raft_consensus.cc:2955] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:15.218523 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6e78737bee66450b9a076cc9676331b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:15.227208 25023 catalog_manager.cc:5697] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:15.237752 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e78737bee66450b9a076cc9676331b9 with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:15.238704 26158 tablet_replica.cc:333] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:15.239702 26158 raft_consensus.cc:2243] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.240336 26158 raft_consensus.cc:2272] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.243479 26158 ts_tablet_manager.cc:1916] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:15.257745 26158 ts_tablet_manager.cc:1929] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:15.258174 26158 log.cc:1199] T 6e78737bee66450b9a076cc9676331b9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/6e78737bee66450b9a076cc9676331b9
I20260709 12:19:15.259383 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet 6e78737bee66450b9a076cc9676331b9 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:16.303064 25125 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
W20260709 12:19:16.310472 25092 consensus_peers.cc:597] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bddb65a99b5c44038087d76d815e3abf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:16.311342 25269 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:16.310464 25193 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:16.313982 26156 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:16.316416 26156 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:16.332429 26101 raft_consensus.cc:2955] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.334704 25269 raft_consensus.cc:2955] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.341666 25193 raft_consensus.cc:2955] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.349047 25195 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:16.356307 25022 catalog_manager.cc:5697] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:16.365602 25269 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:16.367219 26164 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:19:16.372347 25167 consensus_peers.cc:597] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8dcb58fb89c744c58d9494a99f2adda8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:16.372411 25125 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:16.374575 26164 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:19:16.394622 25999 raft_consensus.cc:2955] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.398808 25269 raft_consensus.cc:2955] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.412803 25125 raft_consensus.cc:2955] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.426766 25119 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:16.432803 25025 catalog_manager.cc:5697] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.441915 25274 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:16.442880 25092 consensus_peers.cc:597] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c6268d5c5e547b0b77e42ede61314e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:16.444062 25193 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:16.445233 26156 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:16.453465 26156 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:16.465713 26167 raft_consensus.cc:2955] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.467702 25274 raft_consensus.cc:2955] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.478906 25195 raft_consensus.cc:2955] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.488888 25023 catalog_manager.cc:5697] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.488809 25274 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:16.518085 25195 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:16.518359 25125 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:16.519654 26133 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:16.520795 25241 consensus_peers.cc:597] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff47c111f89a444a9c5a1794454f0789. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:16.521003 26186 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:16.531381 26133 raft_consensus.cc:2955] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.533159 25193 raft_consensus.cc:2955] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.533466 25119 raft_consensus.cc:2955] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.553934 25023 catalog_manager.cc:5697] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:16.809930 26189 ts_tablet_manager.cc:933] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:16.812922 26189 tablet_copy_client.cc:323] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:16.814513 25137 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet bddb65a99b5c44038087d76d815e3abf from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:16.815078 25137 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet bddb65a99b5c44038087d76d815e3abf from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-bddb65a99b5c44038087d76d815e3abf
I20260709 12:19:16.822899 25137 tablet_copy_source_session.cc:215] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:16.827099 26189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddb65a99b5c44038087d76d815e3abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:16.842993 26189 tablet_copy_client.cc:806] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:16.843623 26189 tablet_copy_client.cc:670] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:16.857429 26189 tablet_copy_client.cc:538] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:16.862582 26191 ts_tablet_manager.cc:933] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:16.867058 26191 tablet_copy_client.cc:323] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:16.870184 26189 tablet_bootstrap.cc:492] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:16.870162 25137 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet 6c6268d5c5e547b0b77e42ede61314e1 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:16.870831 25137 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet 6c6268d5c5e547b0b77e42ede61314e1 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-6c6268d5c5e547b0b77e42ede61314e1
I20260709 12:19:16.879202 25137 tablet_copy_source_session.cc:215] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:16.882872 26191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6268d5c5e547b0b77e42ede61314e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:16.899937 26191 tablet_copy_client.cc:806] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:16.901260 26191 tablet_copy_client.cc:670] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:16.906675 26191 tablet_copy_client.cc:538] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:16.908262 26189 tablet_bootstrap.cc:492] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:16.909225 26189 tablet_bootstrap.cc:492] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:16.909895 26189 ts_tablet_manager.cc:1403] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.014s
I20260709 12:19:16.912937 26189 raft_consensus.cc:359] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:16.913771 26189 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:16.914474 26189 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:16.917979 26189 ts_tablet_manager.cc:1434] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:19:16.919063 26191 tablet_bootstrap.cc:492] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:16.919705 25137 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-bddb65a99b5c44038087d76d815e3abf received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:16.920171 25137 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-bddb65a99b5c44038087d76d815e3abf on tablet bddb65a99b5c44038087d76d815e3abf with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:16.944936 26191 tablet_bootstrap.cc:492] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:16.945916 26191 tablet_bootstrap.cc:492] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:16.946683 26191 ts_tablet_manager.cc:1403] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.007s
I20260709 12:19:16.949565 26191 raft_consensus.cc:359] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:16.950430 26191 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:16.951076 26191 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:16.952816 26191 ts_tablet_manager.cc:1434] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:16.961211 25137 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-6c6268d5c5e547b0b77e42ede61314e1 received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:16.961691 25137 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-6c6268d5c5e547b0b77e42ede61314e1 on tablet 6c6268d5c5e547b0b77e42ede61314e1 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:16.971407 26191 ts_tablet_manager.cc:933] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:16.981822 26189 ts_tablet_manager.cc:933] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:16.986876 26189 tablet_copy_client.cc:323] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
I20260709 12:19:16.991997 25211 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet 8dcb58fb89c744c58d9494a99f2adda8 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:16.992038 26191 tablet_copy_client.cc:323] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
I20260709 12:19:16.992695 25211 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet 8dcb58fb89c744c58d9494a99f2adda8 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-8dcb58fb89c744c58d9494a99f2adda8
I20260709 12:19:16.993953 25286 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet ff47c111f89a444a9c5a1794454f0789 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:16.994530 25286 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet ff47c111f89a444a9c5a1794454f0789 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-ff47c111f89a444a9c5a1794454f0789
I20260709 12:19:16.998514 25211 tablet_copy_source_session.cc:215] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:17.001166 26189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcb58fb89c744c58d9494a99f2adda8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:17.001963 25286 tablet_copy_source_session.cc:215] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:17.015977 26191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff47c111f89a444a9c5a1794454f0789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:17.019740 26189 tablet_copy_client.cc:806] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:17.020443 26189 tablet_copy_client.cc:670] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:17.024972 26189 tablet_copy_client.cc:538] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:17.034461 26191 tablet_copy_client.cc:806] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:17.035122 26191 tablet_copy_client.cc:670] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:17.035904 26189 tablet_bootstrap.cc:492] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:17.039393 26191 tablet_copy_client.cc:538] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:17.048789 26191 tablet_bootstrap.cc:492] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:17.070650 26189 tablet_bootstrap.cc:492] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:17.071955 26189 tablet_bootstrap.cc:492] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:17.072908 26189 ts_tablet_manager.cc:1403] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.037s	user 0.030s	sys 0.004s
I20260709 12:19:17.076968 26189 raft_consensus.cc:359] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:17.079320 26189 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:17.080032 26189 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:17.082805 26189 ts_tablet_manager.cc:1434] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:19:17.086016 25211 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-8dcb58fb89c744c58d9494a99f2adda8 received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:17.086467 25211 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-8dcb58fb89c744c58d9494a99f2adda8 on tablet 8dcb58fb89c744c58d9494a99f2adda8 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:17.086922 26191 tablet_bootstrap.cc:492] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:17.087822 26191 tablet_bootstrap.cc:492] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:17.088591 26191 ts_tablet_manager.cc:1403] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.040s	user 0.031s	sys 0.004s
I20260709 12:19:17.091620 26191 raft_consensus.cc:359] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:17.092562 26191 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:17.093183 26191 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:17.095425 26191 ts_tablet_manager.cc:1434] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:17.096974 25286 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-ff47c111f89a444a9c5a1794454f0789 received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:17.097357 25286 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-ff47c111f89a444a9c5a1794454f0789 on tablet ff47c111f89a444a9c5a1794454f0789 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:17.192986 25860 raft_consensus.cc:1217] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:17.277837 25859 raft_consensus.cc:1217] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:17.418696 25859 raft_consensus.cc:1217] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:17.460359 25859 raft_consensus.cc:1217] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:17.760043 26167 raft_consensus.cc:1064] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:17.762699 26167 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:17.770293 25274 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:17.770684 25859 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:17.772902 25193 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:17.773039 26101 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:17.774863 26101 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:17.785620 26101 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:17.807400 26101 raft_consensus.cc:2955] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:17.820475 25195 raft_consensus.cc:2955] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:17.823544 25274 raft_consensus.cc:2955] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:17.827270 25859 raft_consensus.cc:2955] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:17.834818 25022 catalog_manager.cc:5697] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:17.869400 26183 raft_consensus.cc:1064] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:17.869774 26101 raft_consensus.cc:1064] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:17.872001 26101 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:17.871949 26183 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:17.877496 25119 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:17.884181 25274 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:17.885356 26167 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:17.891044 25860 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:17.893124 26207 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:17.894398 25860 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:17.895804 26207 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:17.900318 25269 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:17.901515 25195 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:17.905237 26207 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:17.915146 25858 raft_consensus.cc:2955] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:17.916671 25195 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:17.918915 25269 raft_consensus.cc:2955] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:17.921226 26133 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:17.921227 26207 raft_consensus.cc:2955] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:17.931825 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bddb65a99b5c44038087d76d815e3abf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:17.948432 25860 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:17.949021 26167 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:17.950352 26201 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:17.966660 25023 catalog_manager.cc:5697] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:17.970456 25119 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:17.973376 26133 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:17.994364 26156 raft_consensus.cc:2955] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.004911 25856 raft_consensus.cc:2955] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.006974 25269 raft_consensus.cc:2955] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.010139 25195 raft_consensus.cc:2955] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.016796 26183 raft_consensus.cc:2955] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.033267 25022 catalog_manager.cc:5697] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.033671 25119 raft_consensus.cc:2955] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.040969 25860 raft_consensus.cc:2955] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.045374 25999 raft_consensus.cc:1064] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:18.047722 25999 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:18.059520 25195 raft_consensus.cc:2955] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.067560 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet bddb65a99b5c44038087d76d815e3abf with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:18.083613 26221 tablet_replica.cc:333] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:18.084722 26221 raft_consensus.cc:2243] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:18.085491 26221 raft_consensus.cc:2272] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:18.088660 25024 catalog_manager.cc:5697] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.099076 25860 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:18.102656 25270 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:18.101917 26172 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:18.103998 25125 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:18.115785 26221 ts_tablet_manager.cc:1916] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:18.129045 25119 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:18.136183 26223 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:18.137734 25270 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:18.138234 26222 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:18.139200 25859 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:18.141104 26207 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:18.141481 25275 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:18.143009 26101 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:18.145254 25198 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:18.146593 25858 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:18.146726 26183 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:18.148386 26201 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:18.152225 25858 raft_consensus.cc:2955] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.161985 25198 raft_consensus.cc:2955] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.149253 26101 raft_consensus.cc:2955] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.160488 26186 raft_consensus.cc:2955] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.187127 25269 raft_consensus.cc:2955] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.191190 26225 raft_consensus.cc:2955] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.195237 25859 raft_consensus.cc:2955] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.205588 25025 catalog_manager.cc:5697] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.217061 25860 raft_consensus.cc:2955] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.221895 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c6268d5c5e547b0b77e42ede61314e1 with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:18.263203 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff47c111f89a444a9c5a1794454f0789 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:18.272513 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c6268d5c5e547b0b77e42ede61314e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:18.272785 25269 raft_consensus.cc:2955] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.278337 25025 catalog_manager.cc:5697] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:18.284389 26221 ts_tablet_manager.cc:1929] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:18.284890 26221 log.cc:1199] T bddb65a99b5c44038087d76d815e3abf P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/bddb65a99b5c44038087d76d815e3abf
I20260709 12:19:18.286655 26221 tablet_replica.cc:333] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:18.287664 26221 raft_consensus.cc:2243] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:18.288304 26221 raft_consensus.cc:2272] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:18.291999 26221 ts_tablet_manager.cc:1916] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:18.296010 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet bddb65a99b5c44038087d76d815e3abf (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:18.298749 25119 raft_consensus.cc:2955] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.325968 26221 ts_tablet_manager.cc:1929] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:18.326592 26221 log.cc:1199] T 6c6268d5c5e547b0b77e42ede61314e1 P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/6c6268d5c5e547b0b77e42ede61314e1
I20260709 12:19:18.330449 25022 catalog_manager.cc:5697] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:18.331496 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet 6c6268d5c5e547b0b77e42ede61314e1 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:18.333658 25195 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:18.346276 25269 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:18.348564 26225 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:18.351229 25859 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:18.354290 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet ff47c111f89a444a9c5a1794454f0789 with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:18.356731 26229 tablet_replica.cc:333] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:18.356753 26222 raft_consensus.cc:2955] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.359591 26223 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:18.360605 25269 raft_consensus.cc:2955] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.372025 25859 raft_consensus.cc:2955] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:18.376322 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8dcb58fb89c744c58d9494a99f2adda8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:18.391126 25022 catalog_manager.cc:5697] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.400096 26229 raft_consensus.cc:2243] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:18.400905 26229 raft_consensus.cc:2272] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:18.402782 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dcb58fb89c744c58d9494a99f2adda8 with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:18.404145 26229 ts_tablet_manager.cc:1916] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:18.416663 26229 ts_tablet_manager.cc:1929] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:18.417150 26229 log.cc:1199] T ff47c111f89a444a9c5a1794454f0789 P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/ff47c111f89a444a9c5a1794454f0789
I20260709 12:19:18.418957 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet ff47c111f89a444a9c5a1794454f0789 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:18.419037 26229 tablet_replica.cc:333] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:18.420536 26229 raft_consensus.cc:2243] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:18.421150 26229 raft_consensus.cc:2272] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:18.424081 26229 ts_tablet_manager.cc:1916] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:18.436350 26229 ts_tablet_manager.cc:1929] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:18.436736 26229 log.cc:1199] T 8dcb58fb89c744c58d9494a99f2adda8 P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/8dcb58fb89c744c58d9494a99f2adda8
I20260709 12:19:18.437932 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet 8dcb58fb89c744c58d9494a99f2adda8 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:19.507390 25195 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:19.516628 25269 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:19.517127 25167 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1e3b9e5896c4b539daf785219debb12. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:19.518023 25125 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:19.518267 26231 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:19.519531 26225 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:19.530382 26231 raft_consensus.cc:2955] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.535717 25269 raft_consensus.cc:2955] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.538147 25125 raft_consensus.cc:2955] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.555739 25023 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.571445 25195 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:19.580539 25269 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:19.581537 25125 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:19.582535 25167 consensus_peers.cc:597] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9d246e87571b4365a1d11d98c7455fb9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:19.584815 26231 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:19.585870 26242 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:19.602577 25269 raft_consensus.cc:2955] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.602749 25121 raft_consensus.cc:2955] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.602846 26242 raft_consensus.cc:2955] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.619324 25022 catalog_manager.cc:5697] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.632685 25125 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
W20260709 12:19:19.643915 25092 consensus_peers.cc:597] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19982d505db74841b1c47ceaaf269baa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:19.644207 25269 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:19.645741 26167 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:19.646561 25198 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:19.647943 26167 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:19.659279 26235 raft_consensus.cc:2955] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.663359 25275 raft_consensus.cc:2955] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.668819 25198 raft_consensus.cc:2955] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.686120 25024 catalog_manager.cc:5697] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.690573 25125 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:19.704918 25275 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:19.705571 25195 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:19.705755 25092 consensus_peers.cc:597] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e72fd84f77df4beba49c7d81e1b26f8e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:19.706513 26234 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:19.707440 26207 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:19.715798 26207 raft_consensus.cc:2955] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.717492 25269 raft_consensus.cc:2955] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.722363 25195 raft_consensus.cc:2955] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.742902 25022 catalog_manager.cc:5697] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:19.981206 26257 ts_tablet_manager.cc:933] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:19.985453 26257 tablet_copy_client.cc:323] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
I20260709 12:19:19.988893 25211 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet 9d246e87571b4365a1d11d98c7455fb9 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:19.989537 25211 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet 9d246e87571b4365a1d11d98c7455fb9 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-9d246e87571b4365a1d11d98c7455fb9
I20260709 12:19:19.999167 25211 tablet_copy_source_session.cc:215] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:20.002378 26257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d246e87571b4365a1d11d98c7455fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:20.016196 26257 tablet_copy_client.cc:806] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:20.016741 26257 tablet_copy_client.cc:670] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:20.020466 26257 tablet_copy_client.cc:538] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:20.026607 26257 tablet_bootstrap.cc:492] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:20.044725 26257 tablet_bootstrap.cc:492] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:20.045486 26257 tablet_bootstrap.cc:492] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:20.046155 26257 ts_tablet_manager.cc:1403] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.013s
I20260709 12:19:20.048877 26257 raft_consensus.cc:359] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:20.049821 26257 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:20.050711 26260 ts_tablet_manager.cc:933] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:20.050586 26257 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:20.060736 26257 ts_tablet_manager.cc:1434] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.006s
I20260709 12:19:20.064556 26260 tablet_copy_client.cc:323] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
I20260709 12:19:20.066913 25211 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-9d246e87571b4365a1d11d98c7455fb9 received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:20.067394 25211 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-9d246e87571b4365a1d11d98c7455fb9 on tablet 9d246e87571b4365a1d11d98c7455fb9 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:20.067444 25212 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet b1e3b9e5896c4b539daf785219debb12 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:20.068020 25212 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet b1e3b9e5896c4b539daf785219debb12 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-b1e3b9e5896c4b539daf785219debb12
I20260709 12:19:20.076220 25212 tablet_copy_source_session.cc:215] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:20.080144 26260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e3b9e5896c4b539daf785219debb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:20.096992 26260 tablet_copy_client.cc:806] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:20.097579 26260 tablet_copy_client.cc:670] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:20.103031 26260 tablet_copy_client.cc:538] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:20.113021 26260 tablet_bootstrap.cc:492] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:20.132588 26260 tablet_bootstrap.cc:492] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:20.133523 26260 tablet_bootstrap.cc:492] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:20.134223 26260 ts_tablet_manager.cc:1403] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.005s
I20260709 12:19:20.137918 26260 raft_consensus.cc:359] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:20.138736 26260 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:20.139415 26260 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:20.143111 26260 ts_tablet_manager.cc:1434] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:20.145711 25212 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-b1e3b9e5896c4b539daf785219debb12 received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:20.146158 25212 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-b1e3b9e5896c4b539daf785219debb12 on tablet b1e3b9e5896c4b539daf785219debb12 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:20.192911 26260 ts_tablet_manager.cc:933] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:20.194617 26260 tablet_copy_client.cc:323] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:20.196427 25137 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet 19982d505db74841b1c47ceaaf269baa from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:20.196954 25137 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet 19982d505db74841b1c47ceaaf269baa from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-19982d505db74841b1c47ceaaf269baa
I20260709 12:19:20.204267 25137 tablet_copy_source_session.cc:215] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:20.207751 26260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19982d505db74841b1c47ceaaf269baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:20.224481 26260 tablet_copy_client.cc:806] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:20.225167 26260 tablet_copy_client.cc:670] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:20.229086 26260 tablet_copy_client.cc:538] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:20.238907 26260 tablet_bootstrap.cc:492] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:20.246902 26257 ts_tablet_manager.cc:933] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:20.248667 26257 tablet_copy_client.cc:323] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:20.250893 25137 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet e72fd84f77df4beba49c7d81e1b26f8e from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:20.251505 25137 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet e72fd84f77df4beba49c7d81e1b26f8e from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-e72fd84f77df4beba49c7d81e1b26f8e
I20260709 12:19:20.256961 26260 tablet_bootstrap.cc:492] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:20.257957 26260 tablet_bootstrap.cc:492] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:20.258656 26260 ts_tablet_manager.cc:1403] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.004s
I20260709 12:19:20.261788 26260 raft_consensus.cc:359] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:20.261320 25137 tablet_copy_source_session.cc:215] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:20.262661 26260 raft_consensus.cc:740] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:20.263314 26260 consensus_queue.cc:260] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:20.266067 26260 ts_tablet_manager.cc:1434] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:20.266768 26257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72fd84f77df4beba49c7d81e1b26f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:20.271361 25137 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-19982d505db74841b1c47ceaaf269baa received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:20.272751 25137 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-19982d505db74841b1c47ceaaf269baa on tablet 19982d505db74841b1c47ceaaf269baa with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:20.297137 26257 tablet_copy_client.cc:806] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:20.297812 26257 tablet_copy_client.cc:670] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:20.301107 26257 tablet_copy_client.cc:538] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:20.307365 26257 tablet_bootstrap.cc:492] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:20.322634 26257 tablet_bootstrap.cc:492] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:20.323367 26257 tablet_bootstrap.cc:492] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:20.323920 26257 ts_tablet_manager.cc:1403] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.006s
I20260709 12:19:20.326190 26257 raft_consensus.cc:359] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:20.326799 26257 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:20.327380 26257 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:20.330190 26257 ts_tablet_manager.cc:1434] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:19:20.333379 25137 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-e72fd84f77df4beba49c7d81e1b26f8e received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:20.333781 25137 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-e72fd84f77df4beba49c7d81e1b26f8e on tablet e72fd84f77df4beba49c7d81e1b26f8e with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:20.379644 25860 raft_consensus.cc:1217] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:20.542164 25860 raft_consensus.cc:1217] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:20.606429 25860 raft_consensus.cc:1217] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:20.642181 25860 raft_consensus.cc:1217] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:20.861173 26250 raft_consensus.cc:1064] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:20.863818 26250 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:20.870810 25859 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:20.871302 25125 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:20.872618 25269 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:20.874189 26241 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:20.875837 26231 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:20.877666 26231 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:19:20.904858 26231 raft_consensus.cc:2955] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:20.912343 25275 raft_consensus.cc:2955] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:20.910786 25125 raft_consensus.cc:2955] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:20.923712 25859 raft_consensus.cc:2955] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:20.926501 25024 catalog_manager.cc:5697] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:20.970690 25198 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:20.984522 25859 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:20.985755 26250 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:20.986233 25275 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:20.988715 26231 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:20.994668 26241 raft_consensus.cc:2955] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.004657 25859 raft_consensus.cc:2955] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.016685 25275 raft_consensus.cc:2955] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.026525 25023 catalog_manager.cc:5697] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.047907 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d246e87571b4365a1d11d98c7455fb9 with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:21.057112 26279 tablet_replica.cc:333] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:21.061185 26279 raft_consensus.cc:2243] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:21.062983 26279 raft_consensus.cc:2272] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:21.064291 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9d246e87571b4365a1d11d98c7455fb9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:21.070179 26279 ts_tablet_manager.cc:1916] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:21.080394 26207 raft_consensus.cc:1064] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:21.083115 26207 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:21.094679 26279 ts_tablet_manager.cc:1929] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:21.095252 26279 log.cc:1199] T 9d246e87571b4365a1d11d98c7455fb9 P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/9d246e87571b4365a1d11d98c7455fb9
I20260709 12:19:21.097137 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet 9d246e87571b4365a1d11d98c7455fb9 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:21.101217 25859 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:21.104512 25198 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:21.105461 26167 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:21.107831 26167 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:21.135253 25275 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:21.142365 26234 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:21.164793 26241 raft_consensus.cc:1064] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:21.168385 26241 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:21.179066 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 73179.9us
I20260709 12:19:21.181723 26167 raft_consensus.cc:2955] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.190054 25269 raft_consensus.cc:2955] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.232499 25275 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:21.234045 26278 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:21.237146 25860 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:21.237277 25119 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:21.238654 26231 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:21.240142 26277 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:19:21.254393 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 47812.6us
W20260709 12:19:21.264392 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 51830.8us
I20260709 12:19:21.264946 25023 catalog_manager.cc:5697] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.266592 25860 raft_consensus.cc:2955] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.272727 26287 raft_consensus.cc:1064] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:21.279019 26287 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:21.279459 26241 raft_consensus.cc:2955] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.281128 25119 raft_consensus.cc:2955] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.293804 25198 raft_consensus.cc:2955] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.306440 25856 raft_consensus.cc:2955] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.345248 25269 raft_consensus.cc:2955] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.352195 25023 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:21.371796 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 43700.2us
I20260709 12:19:21.377868 25856 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:21.379503 25275 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:21.380955 26234 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:21.384203 26282 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:21.405066 25198 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:21.406419 26282 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:21.429643 26282 raft_consensus.cc:2955] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.435499 25193 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:21.437825 25119 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:21.445371 25860 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:21.445173 25856 raft_consensus.cc:2955] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.447711 26241 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:21.454948 25275 raft_consensus.cc:2955] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.460618 26231 raft_consensus.cc:2955] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.462277 25860 raft_consensus.cc:2955] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.472718 25270 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:21.474617 25859 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:21.478016 26167 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:21.479831 26287 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:21.483019 25022 catalog_manager.cc:5697] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.493196 26288 raft_consensus.cc:2955] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.504423 25119 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:21.504688 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1e3b9e5896c4b539daf785219debb12 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:21.505157 25022 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.513540 25859 raft_consensus.cc:2955] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.524362 25198 raft_consensus.cc:2955] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:21.537016 26277 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:21.657760 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 19982d505db74841b1c47ceaaf269baa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:21.710256 25119 raft_consensus.cc:2955] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:22.129103 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet b1e3b9e5896c4b539daf785219debb12 with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:22.160293 25275 raft_consensus.cc:2955] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:22.161863 26315 tablet_replica.cc:333] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:22.163127 26315 raft_consensus.cc:2243] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:22.166697 26315 raft_consensus.cc:2272] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:22.232121 26315 ts_tablet_manager.cc:1916] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:22.251755 25025 catalog_manager.cc:5697] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:22.258780 26315 ts_tablet_manager.cc:1929] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:22.259335 26315 log.cc:1199] T b1e3b9e5896c4b539daf785219debb12 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/b1e3b9e5896c4b539daf785219debb12
I20260709 12:19:22.261266 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet b1e3b9e5896c4b539daf785219debb12 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:22.272258 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet 19982d505db74841b1c47ceaaf269baa with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:22.275800 26319 tablet_replica.cc:333] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:22.277382 26319 raft_consensus.cc:2243] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:22.278234 26319 raft_consensus.cc:2272] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:22.281678 25127 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:22.282778 26319 ts_tablet_manager.cc:1916] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:22.292500 25859 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:22.293650 25193 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:22.294273 26301 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:22.295197 26207 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:22.300274 26319 ts_tablet_manager.cc:1929] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:22.300791 26319 log.cc:1199] T 19982d505db74841b1c47ceaaf269baa P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/19982d505db74841b1c47ceaaf269baa
I20260709 12:19:22.303663 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet 19982d505db74841b1c47ceaaf269baa (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:22.304840 26234 raft_consensus.cc:2955] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:22.307004 25193 raft_consensus.cc:2955] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:22.312378 25859 raft_consensus.cc:2955] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:22.315503 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e72fd84f77df4beba49c7d81e1b26f8e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:22.323387 25024 catalog_manager.cc:5697] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:22.336261 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet e72fd84f77df4beba49c7d81e1b26f8e with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:22.337097 26315 tablet_replica.cc:333] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:22.337843 26315 raft_consensus.cc:2243] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:22.338510 26315 raft_consensus.cc:2272] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:22.341612 26315 ts_tablet_manager.cc:1916] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:22.353540 26315 ts_tablet_manager.cc:1929] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:22.353830 26315 log.cc:1199] T e72fd84f77df4beba49c7d81e1b26f8e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/e72fd84f77df4beba49c7d81e1b26f8e
I20260709 12:19:22.355391 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet e72fd84f77df4beba49c7d81e1b26f8e (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
W20260709 12:19:22.709991 25223 debug-util.cc:398] Leaking SignalData structure 0x7b08001650e0 after lost signal to thread 23882
W20260709 12:19:22.710923 25223 debug-util.cc:398] Leaking SignalData structure 0x7b08001ec500 after lost signal to thread 25059
W20260709 12:19:22.711969 25223 debug-util.cc:398] Leaking SignalData structure 0x7b080033ed40 after lost signal to thread 25151
W20260709 12:19:22.712939 25223 debug-util.cc:398] Leaking SignalData structure 0x7b0800309bc0 after lost signal to thread 25226
W20260709 12:19:22.713833 25223 debug-util.cc:398] Leaking SignalData structure 0x7b0800317940 after lost signal to thread 25300
W20260709 12:19:22.714843 25223 debug-util.cc:398] Leaking SignalData structure 0x7b0800247fc0 after lost signal to thread 25884
I20260709 12:19:22.864516 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:22.923082 25274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "258fe130eb914f5b858baf4782663574"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:22.923633 25274 raft_consensus.cc:606] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:22.926613 25274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:22.927157 25274 raft_consensus.cc:606] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:22.944334 25119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b13f2e891f348229e95286682b88911"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:22.944847 25119 raft_consensus.cc:606] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:22.947633 25274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:22.948145 25274 raft_consensus.cc:606] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:22.950850 25274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0821374625d4793801ab3b3f502714e"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:22.951345 25274 raft_consensus.cc:606] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:22.953966 25274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:22.954514 25274 raft_consensus.cc:606] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:22.955576 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:22.957392 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:22.958847 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:22.984340 26236 raft_consensus.cc:993] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:22.985185 26313 raft_consensus.cc:1081] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:22.989805 25193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "258fe130eb914f5b858baf4782663574"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36436
I20260709 12:19:22.990502 25193 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:22.990859 25193 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:22.996977 25193 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:23.000540 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:23.001313 25119 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.016054 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:23.016947 25274 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:23.017272 25274 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:23.020071 25274 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:23.021222 25274 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.022511 25119 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:23.024143 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:23.026294 26304 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:23.026799 26304 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:23.027887 25193 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:23.027644 26304 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:23.030161 25274 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:23.054492 25024 catalog_manager.cc:5697] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.128731 26313 raft_consensus.cc:993] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:23.129248 26236 raft_consensus.cc:1081] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:23.130811 25196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36436
I20260709 12:19:23.131289 25196 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.131587 25196 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.136817 25196 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:23.143363 25196 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:23.147305 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:23.148550 25268 raft_consensus.cc:3055] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:23.149291 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:23.150151 25119 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.154655 25268 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:23.155615 25268 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:23.167402 25268 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.176599 25119 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:23.189826 25268 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:23.191684 25165 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:23.192744 26328 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:23.193328 26328 raft_consensus.cc:697] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:23.194451 26328 consensus_queue.cc:237] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:23.198150 26207 raft_consensus.cc:993] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:23.203656 26337 raft_consensus.cc:1081] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:23.210016 26183 raft_consensus.cc:993] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:23.218621 26183 raft_consensus.cc:1081] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:23.220973 25859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:19:23.221602 25859 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.221966 25859 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.228832 26183 raft_consensus.cc:993] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:23.229396 26329 raft_consensus.cc:993] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:23.229468 26183 raft_consensus.cc:1081] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:23.231702 25860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:19:23.232302 25860 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.232661 25860 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.234444 26329 raft_consensus.cc:1081] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:23.245394 25196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0821374625d4793801ab3b3f502714e"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36436
I20260709 12:19:23.246172 25196 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.246598 25196 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.251528 25859 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:23.254325 25859 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:23.255255 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:23.261147 25196 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:23.255254 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:23.257854 25198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b13f2e891f348229e95286682b88911"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36434
I20260709 12:19:23.262636 25198 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.263118 25198 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.264423 25193 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.258984 25860 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:23.261956 25268 raft_consensus.cc:3055] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:23.280336 25268 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:23.281767 25860 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:23.289417 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:23.290098 25195 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.296563 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:23.297389 25274 raft_consensus.cc:3055] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:23.297721 25274 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:23.298460 25274 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:23.299659 25274 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.300661 25198 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:23.281227 25268 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:23.303303 25268 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.304319 25198 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:23.304687 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:23.305191 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:23.305624 25273 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.305940 25121 raft_consensus.cc:3055] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:23.306347 25121 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:23.307091 25121 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:23.308319 25121 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.313278 25273 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:23.313710 25195 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:23.315213 25121 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:23.316357 25165 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:23.317648 26231 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:23.318212 26231 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:23.320291 25193 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:23.322832 25268 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:23.323194 25274 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:23.324363 25825 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:23.325635 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:23.326227 25119 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.328970 25196 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:23.329916 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:23.330636 25273 raft_consensus.cc:3055] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:23.330926 25273 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:23.331483 26231 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:23.331650 25273 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:23.341435 25119 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:23.342301 25273 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.345427 25822 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:23.352918 26338 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:23.365542 25273 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:23.367045 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:23.379346 26304 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:23.385006 26304 raft_consensus.cc:697] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:23.385983 26304 consensus_queue.cc:237] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:23.403038 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 57703.1us
I20260709 12:19:23.406224 26341 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:23.423467 25024 catalog_manager.cc:5697] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.442492 26338 raft_consensus.cc:697] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:23.443454 26341 raft_consensus.cc:697] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:23.452185 26341 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:23.458285 25121 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:23.454418 26338 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:23.473459 25024 catalog_manager.cc:5697] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:23.474833 25092 consensus_peers.cc:597] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 242311f4ad5044b2ada00bc49a50afeb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.473923 25268 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:23.476014 25196 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:23.477950 26337 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.480023 26335 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:23.480415 25024 catalog_manager.cc:5697] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.483165 25025 catalog_manager.cc:5697] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:23.484310 25121 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.485181 25025 catalog_manager.cc:5697] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:23.489009 26304 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:19:23.508040 26335 raft_consensus.cc:2955] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:23.511374 25268 raft_consensus.cc:2955] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:23.524555 25196 raft_consensus.cc:2955] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
W20260709 12:19:23.534626 25073 auto_rebalancer.cc:629] Failed to schedule move for tablet aaeb230a0f814ad1849053d7a19c90d6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:19:23.540637 25200 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:23.560974 25268 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.557731 25024 catalog_manager.cc:5697] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:23.564132 26340 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:23.632416 25119 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.634207 26304 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.647666 25127 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:23.651994 25268 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:23.653731 26304 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.658604 26340 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.659476 25268 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.664947 26340 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:19:23.691975 25167 consensus_peers.cc:597] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47f83e7883b540d9907ceefaa443f104. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.709867 26231 raft_consensus.cc:2955] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:23.721457 25268 raft_consensus.cc:2955] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:23.725755 25270 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:23.731643 25024 catalog_manager.cc:5697] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.746363 25196 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:23.746913 25241 consensus_peers.cc:597] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b73f31d21bb0468893aa53b0dcaf3e60. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.753263 25127 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:23.740375 25119 raft_consensus.cc:2955] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:23.771662 26329 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.773335 26236 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.790948 26236 raft_consensus.cc:2955] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:23.799579 25127 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.799212 25196 raft_consensus.cc:2955] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:23.801120 26328 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.812598 25023 catalog_manager.cc:5697] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.817008 25125 raft_consensus.cc:2955] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:23.852042 25268 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.855631 26340 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.872093 25196 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:23.877177 26338 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:23.929889 25268 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:23.931584 26342 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:23.934078 25127 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.936436 25270 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.937014 26304 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.943022 26328 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:24.096485 26371 ts_tablet_manager.cc:933] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:24.097007 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:24.124876 25196 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:24.146620 25273 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:24.150220 26341 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:24.151401 26342 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:24.182403 26371 tablet_copy_client.cc:323] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:24.196058 25137 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet 242311f4ad5044b2ada00bc49a50afeb from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:24.196662 25137 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet 242311f4ad5044b2ada00bc49a50afeb from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-242311f4ad5044b2ada00bc49a50afeb
I20260709 12:19:24.220242 25137 tablet_copy_source_session.cc:215] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:24.241506 26371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242311f4ad5044b2ada00bc49a50afeb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:24.261176 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 44080.8us
I20260709 12:19:24.294919 25125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:24.295852 25125 raft_consensus.cc:606] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:19:24.384871 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 102146us
I20260709 12:19:24.384351 26376 ts_tablet_manager.cc:933] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:19:24.391682 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 64645us
I20260709 12:19:24.412388 26371 tablet_copy_client.cc:806] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:24.413008 26371 tablet_copy_client.cc:670] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:24.514458 26376 tablet_copy_client.cc:323] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
I20260709 12:19:24.537220 26371 tablet_copy_client.cc:538] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:24.613961 26381 ts_tablet_manager.cc:933] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:24.658236 26371 tablet_bootstrap.cc:492] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
W20260709 12:19:24.685444 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 186572us
I20260709 12:19:24.689719 26381 tablet_copy_client.cc:323] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
W20260709 12:19:24.690987 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 192257us
W20260709 12:19:24.693871 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 78826us
I20260709 12:19:24.697667 25212 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet 47f83e7883b540d9907ceefaa443f104 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:24.698287 25212 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet 47f83e7883b540d9907ceefaa443f104 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-47f83e7883b540d9907ceefaa443f104
I20260709 12:19:24.707907 25196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:24.708575 25196 raft_consensus.cc:606] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:24.710968 25212 tablet_copy_source_session.cc:215] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:24.716758 26376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f83e7883b540d9907ceefaa443f104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:24.728039 25286 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet b73f31d21bb0468893aa53b0dcaf3e60 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:24.728685 25286 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet b73f31d21bb0468893aa53b0dcaf3e60 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-b73f31d21bb0468893aa53b0dcaf3e60
I20260709 12:19:24.783423 25286 tablet_copy_source_session.cc:215] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:24.789889 26381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73f31d21bb0468893aa53b0dcaf3e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:24.790759 26371 tablet_bootstrap.cc:492] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:24.791731 26371 tablet_bootstrap.cc:492] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:24.792044 26389 raft_consensus.cc:993] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:24.792440 26371 ts_tablet_manager.cc:1403] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.023s
I20260709 12:19:24.792567 26389 raft_consensus.cc:1081] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:24.797052 25268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:24.797662 25268 raft_consensus.cc:606] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:24.804209 25268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:24.804782 25268 raft_consensus.cc:606] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:24.806427 26371 raft_consensus.cc:359] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:24.809686 26371 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:24.809978 25125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:24.810622 25125 raft_consensus.cc:606] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:24.811908 25273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:24.812413 25273 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:24.812723 25273 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:24.810549 26371 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:24.821013 25268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:24.828295 25268 raft_consensus.cc:606] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:24.826411 26371 ts_tablet_manager.cc:1434] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 12:19:24.831025 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:24.832616 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:24.833380 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:24.838675 25273 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:24.841717 25273 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:24.853012 26376 tablet_copy_client.cc:806] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:24.853633 26376 tablet_copy_client.cc:670] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:24.855023 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:24.855628 25200 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:24.858078 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:24.858690 25119 raft_consensus.cc:3055] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:24.858994 25119 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:24.859712 25119 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:24.860908 25119 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:24.861274 26376 tablet_copy_client.cc:538] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:24.869791 26381 tablet_copy_client.cc:806] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:24.879262 26381 tablet_copy_client.cc:670] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:24.885712 26381 tablet_copy_client.cc:538] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:24.872367 25119 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:24.876253 25137 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-242311f4ad5044b2ada00bc49a50afeb received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:24.890223 25137 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-242311f4ad5044b2ada00bc49a50afeb on tablet 242311f4ad5044b2ada00bc49a50afeb with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:24.863852 25200 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:24.896759 25242 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:24.898229 26329 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:24.898769 26329 raft_consensus.cc:697] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:24.900080 26329 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:24.902348 26383 raft_consensus.cc:993] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:24.902907 26383 raft_consensus.cc:1081] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:24.904389 25200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36436
I20260709 12:19:24.904882 25200 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:24.905205 25200 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:24.905675 26381 tablet_bootstrap.cc:492] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:24.915855 25200 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:24.897930 26376 tablet_bootstrap.cc:492] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:24.918939 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:24.919494 25119 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:24.919797 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:24.920421 25268 raft_consensus.cc:3055] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:24.920743 25268 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:24.927464 25119 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:24.929064 25168 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:24.930269 26392 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:24.930811 26392 raft_consensus.cc:697] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:24.931854 26392 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:24.921625 25268 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:24.937204 25023 catalog_manager.cc:5697] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:24.940060 25268 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:24.955932 25268 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:24.957397 25200 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:24.966301 26395 raft_consensus.cc:993] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:24.966812 26395 raft_consensus.cc:1081] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:24.969341 25268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40096
I20260709 12:19:24.969955 25268 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:24.970332 25268 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:24.976718 25268 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:24.978572 25268 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:24.979944 25024 catalog_manager.cc:5697] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:24.983299 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:24.983925 25119 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:24.990376 26337 raft_consensus.cc:993] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:24.991120 26337 raft_consensus.cc:1081] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:24.999924 25858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46498
I20260709 12:19:25.000561 25858 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:25.000968 25858 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.008883 25119 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:25.011209 25242 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:25.012089 26329 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:25.012598 26329 raft_consensus.cc:697] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:25.013554 26329 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:25.031057 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:25.031912 25200 raft_consensus.cc:3055] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:25.032303 25200 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:25.036350 25200 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:25.039184 25200 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.041692 25858 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:25.050741 25200 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:25.054821 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:25.055003 25858 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:25.055461 25127 raft_consensus.cc:3055] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:25.055831 25127 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:25.056725 25127 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:25.058065 25127 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.060742 26376 tablet_bootstrap.cc:492] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:25.061766 26376 tablet_bootstrap.cc:492] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:25.062507 26376 ts_tablet_manager.cc:1403] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.165s	user 0.027s	sys 0.010s
I20260709 12:19:25.063498 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:25.064083 25273 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.067080 26381 tablet_bootstrap.cc:492] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:25.069746 25127 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:25.070870 25825 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:25.070974 25273 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:25.073020 26338 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:25.078577 26381 tablet_bootstrap.cc:492] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:25.086488 26338 raft_consensus.cc:697] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:25.094275 26338 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:25.091046 26381 ts_tablet_manager.cc:1403] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.186s	user 0.042s	sys 0.004s
I20260709 12:19:25.092857 26376 raft_consensus.cc:359] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:25.111548 26376 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:25.112249 26376 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:25.115619 26381 raft_consensus.cc:359] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:25.116433 26381 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:25.117092 26381 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:25.117899 26329 raft_consensus.cc:993] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:25.118921 26381 ts_tablet_manager.cc:1434] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:19:25.119112 26394 raft_consensus.cc:1081] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:25.120806 25286 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-b73f31d21bb0468893aa53b0dcaf3e60 received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:25.121228 25286 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-b73f31d21bb0468893aa53b0dcaf3e60 on tablet b73f31d21bb0468893aa53b0dcaf3e60 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:25.121726 26376 ts_tablet_manager.cc:1434] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:19:25.122859 25860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:19:25.123415 25860 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:25.123818 25860 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.124804 25212 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-47f83e7883b540d9907ceefaa443f104 received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:25.125238 25212 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-47f83e7883b540d9907ceefaa443f104 on tablet 47f83e7883b540d9907ceefaa443f104 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:25.123533 25024 catalog_manager.cc:5697] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:25.132717 25860 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:25.134459 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:25.134733 25860 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:25.135032 25200 raft_consensus.cc:606] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:19:25.136142 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:25.136626 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:25.138460 25125 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.136749 25273 raft_consensus.cc:3055] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:25.139278 25273 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:25.140071 25273 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:25.141345 25273 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.127878 25023 catalog_manager.cc:5697] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 1 to 2, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:25.147759 25196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:25.148447 25196 raft_consensus.cc:606] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:19:25.153481 25125 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
W20260709 12:19:25.154845 25012 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for b73f31d21bb0468893aa53b0dcaf3e60 already in progress [suppressed 4 similar messages]
I20260709 12:19:25.155234 25825 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:25.161590 26338 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:25.162132 26338 raft_consensus.cc:697] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:25.163000 26338 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:25.167248 25273 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:25.177138 25193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:25.177822 25193 raft_consensus.cc:606] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:19:25.181231 25860 raft_consensus.cc:1217] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:19:25.183621 25073 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:19:25.184064 25073 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for b73f31d21bb0468893aa53b0dcaf3e60 already in progress
W20260709 12:19:25.184371 25073 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for b73f31d21bb0468893aa53b0dcaf3e60 already in progress
I20260709 12:19:25.188058 25023 catalog_manager.cc:5697] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:25.311255 25200 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:25.313706 26394 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:25.339608 25119 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:25.341656 25119 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:25.344880 26329 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:25.350226 26396 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:25.378473 26395 raft_consensus.cc:993] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:25.379015 26390 raft_consensus.cc:1081] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:25.383438 25273 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:25.384609 25858 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Advancing to term 2
I20260709 12:19:25.385743 25127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:19:25.390403 26231 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:25.405480 26383 raft_consensus.cc:993] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:25.406013 26383 raft_consensus.cc:1081] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:25.408305 25860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:19:25.409049 25860 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:25.409474 25860 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.445066 25200 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:25.447791 25860 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:25.451236 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:25.451793 25121 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.452275 26416 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:25.458899 25126 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:25.459923 25859 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Advancing to term 2
I20260709 12:19:25.459900 25121 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:25.461894 25825 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:25.462848 26338 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:25.463310 26338 raft_consensus.cc:697] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:25.464179 26338 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:25.460815 26393 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:25.495173 25859 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:25.498466 26393 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:25.503495 25858 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:25.508826 26231 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:25.532601 25127 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:25.533058 25127 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:25.535161 25860 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:25.539665 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:25.540256 25268 raft_consensus.cc:3055] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:25.540628 25268 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:25.541496 25268 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:25.543467 25268 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.550787 25127 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:25.553200 25268 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:25.569640 25127 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:25.574393 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:25.575233 25200 raft_consensus.cc:3055] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:25.575675 25200 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:25.576771 25200 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:25.581215 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:25.584801 25200 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:25.624146 25270 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:25.623462 25024 catalog_manager.cc:5697] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:25.626184 26406 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:25.679744 26389 raft_consensus.cc:1064] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:25.679883 25127 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:25.681808 26338 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:25.683109 26389 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:25.692261 25200 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:19:25.706367 25093 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:25.708410 26375 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:25.708992 26375 raft_consensus.cc:697] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:25.710078 26375 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
W20260709 12:19:25.725018 26420 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:19:25.748452 26394 raft_consensus.cc:1064] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:25.752549 26394 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:25.765515 25193 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:25.767361 26389 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:25.768846 25859 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:25.770200 25127 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:25.773512 25269 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:25.777954 26406 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:25.781874 26337 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:25.790885 26406 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:25.798353 25268 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:25.806999 26337 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:25.809273 25859 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:25.811142 26383 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:19:25.850634 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 70549.2us
I20260709 12:19:25.852015 26337 raft_consensus.cc:2955] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:25.855764 25859 raft_consensus.cc:2955] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:25.863991 25200 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:25.864293 25025 catalog_manager.cc:5697] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 2 to 3, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:25.866321 25127 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:25.879786 25193 raft_consensus.cc:2955] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:25.890961 25023 catalog_manager.cc:5697] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:25.898990 26393 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:25.912918 26434 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:25.915514 25271 raft_consensus.cc:2955] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:25.940578 26329 raft_consensus.cc:2955] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:25.952993 25119 raft_consensus.cc:2955] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:25.960547 25271 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:25.962262 26406 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:25.966642 25193 raft_consensus.cc:2955] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:25.981137 25858 raft_consensus.cc:2955] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.013348 25025 catalog_manager.cc:5697] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.053112 25269 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.063197 25119 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:26.067085 26338 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:26.068658 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:26.080186 25119 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.093142 25200 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:26.095193 26375 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:26.098775 25859 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:26.100596 25196 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:26.101327 26394 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:26.102415 26434 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:26.104317 26337 raft_consensus.cc:2955] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.109200 25196 raft_consensus.cc:2955] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.112321 26393 raft_consensus.cc:2955] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.113444 25193 raft_consensus.cc:2955] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.115097 25856 raft_consensus.cc:2955] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.130858 25024 catalog_manager.cc:5697] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.123451 25858 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:26.139487 26386 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:26.149807 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet 242311f4ad5044b2ada00bc49a50afeb with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:26.151379 25271 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:26.153970 25858 raft_consensus.cc:2955] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.158578 26442 tablet_replica.cc:333] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:26.159807 26442 raft_consensus.cc:2243] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:26.160601 26442 raft_consensus.cc:2272] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:26.175748 26442 ts_tablet_manager.cc:1916] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:26.178253 25024 catalog_manager.cc:5697] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 4 to 5, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.186272 25271 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:26.190073 26386 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:26.200012 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet 47f83e7883b540d9907ceefaa443f104 with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:26.206377 25856 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Advancing to term 3
I20260709 12:19:26.208928 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 47f83e7883b540d9907ceefaa443f104 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:26.216820 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 242311f4ad5044b2ada00bc49a50afeb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:26.222939 25193 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:26.225320 26389 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:26.231848 26443 tablet_replica.cc:333] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:26.237962 26443 raft_consensus.cc:2243] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:26.239719 26443 raft_consensus.cc:2272] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:26.240540 25856 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:26.245193 26337 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:26.246168 26443 ts_tablet_manager.cc:1916] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:26.256906 26389 raft_consensus.cc:1064] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:26.248107 26442 ts_tablet_manager.cc:1929] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:26.258368 26442 log.cc:1199] T 242311f4ad5044b2ada00bc49a50afeb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/242311f4ad5044b2ada00bc49a50afeb
I20260709 12:19:26.260142 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet 242311f4ad5044b2ada00bc49a50afeb (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:26.259485 26389 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.275522 26443 ts_tablet_manager.cc:1929] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:19:26.276108 26443 log.cc:1199] T 47f83e7883b540d9907ceefaa443f104 P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/47f83e7883b540d9907ceefaa443f104
I20260709 12:19:26.278131 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet 47f83e7883b540d9907ceefaa443f104 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:26.284857 25856 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:26.286918 26386 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:26.293881 25271 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:26.296273 26375 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:26.296568 25193 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:26.311810 25271 raft_consensus.cc:2955] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.315585 26375 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:26.318004 26337 raft_consensus.cc:2955] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.337026 25193 raft_consensus.cc:2955] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.354327 25127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "392ec479375b41bbb38793a0c207912d"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:26.360854 25127 raft_consensus.cc:606] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:26.362591 25024 catalog_manager.cc:5697] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 2 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.367681 25269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:26.368300 25269 raft_consensus.cc:606] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:26.375258 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:26.375896 25200 raft_consensus.cc:606] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:26.376035 26375 raft_consensus.cc:993] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:26.376597 26375 raft_consensus.cc:1081] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:26.379977 25269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "392ec479375b41bbb38793a0c207912d"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:26.380497 25269 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:26.380838 25269 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.381398 25856 raft_consensus.cc:2955] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.382606 25271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:26.386325 25271 raft_consensus.cc:606] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:26.391603 25119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:26.392176 25119 raft_consensus.cc:606] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:26.396277 25119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:26.396845 25119 raft_consensus.cc:606] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:26.397850 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:26.399569 26434 raft_consensus.cc:993] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:26.400072 26394 raft_consensus.cc:1081] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:26.401672 25858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:19:26.402241 25858 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:26.402578 25858 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.411203 25269 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:26.412890 25858 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.413422 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:26.414198 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:26.416230 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:26.416867 25271 raft_consensus.cc:3055] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:26.417240 25271 raft_consensus.cc:740] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:26.416994 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:26.420794 25119 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.424731 25269 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:26.425963 25126 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.427419 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:26.427929 25193 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.418808 25858 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:26.419445 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:26.436280 25127 raft_consensus.cc:3055] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:26.436640 25127 raft_consensus.cc:740] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:26.437418 25127 consensus_queue.cc:260] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:26.438721 25127 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.417944 25271 consensus_queue.cc:260] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.442296 25269 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:26.442973 25271 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.446200 26386 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:26.448904 25193 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:26.450330 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:26.451527 26434 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:26.452006 26434 raft_consensus.cc:697] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:26.452869 26434 consensus_queue.cc:237] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:26.461472 25271 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:26.462827 25822 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:26.463747 26338 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:26.464211 26338 raft_consensus.cc:697] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:26.465081 26338 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.466058 25127 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:26.467691 25856 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:26.471007 26375 raft_consensus.cc:2955] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.476567 25119 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:26.479722 26386 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:26.487439 25856 raft_consensus.cc:2955] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.488523 25269 raft_consensus.cc:2955] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:26.536015 25024 catalog_manager.cc:5697] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:26.545228 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b73f31d21bb0468893aa53b0dcaf3e60 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:26.565033 26337 raft_consensus.cc:993] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:26.565543 26447 raft_consensus.cc:1081] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:26.569696 25271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:26.571043 25271 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:26.572256 25271 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.583351 25022 catalog_manager.cc:5697] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 5 to 6, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:26.594412 25271 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:26.597376 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:26.598013 25127 raft_consensus.cc:3055] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:26.598410 25127 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:26.599256 25127 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:26.600449 25127 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.600039 25025 catalog_manager.cc:5697] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:26.607486 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet b73f31d21bb0468893aa53b0dcaf3e60 with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:26.609532 25127 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:26.615306 25242 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:26.616655 26394 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:26.617291 26394 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:26.618347 26394 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:26.622898 25271 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:26.624545 26448 tablet_replica.cc:333] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:26.631491 26448 raft_consensus.cc:2243] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:26.632476 26448 raft_consensus.cc:2272] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:26.635866 26448 ts_tablet_manager.cc:1916] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:26.637220 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:26.639240 25196 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.647867 26447 raft_consensus.cc:993] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:26.648438 26447 raft_consensus.cc:1081] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:26.650255 25858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46498
I20260709 12:19:26.650817 25858 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:26.651150 25858 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.664947 25025 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:26.666986 26448 ts_tablet_manager.cc:1929] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:19:26.667830 26448 log.cc:1199] T b73f31d21bb0468893aa53b0dcaf3e60 P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/b73f31d21bb0468893aa53b0dcaf3e60
I20260709 12:19:26.672765 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet b73f31d21bb0468893aa53b0dcaf3e60 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:26.672307 25196 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:26.664954 25858 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.685009 25858 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:26.686625 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:26.687239 25127 raft_consensus.cc:3055] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:26.687320 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:26.687590 25127 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:26.688814 25196 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.688639 25127 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.689838 25127 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.696285 25196 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:26.698873 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:26.700510 25127 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:26.700624 26406 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:26.701231 26406 raft_consensus.cc:697] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:26.702090 26406 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.722761 25025 catalog_manager.cc:5697] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:26.758814 26383 raft_consensus.cc:993] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:26.759411 26434 raft_consensus.cc:1081] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:26.761310 25858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:19:26.761860 25858 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:26.762226 25858 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.767551 25858 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.769114 25858 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:26.769871 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:26.770113 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:26.770676 25200 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.770804 25271 raft_consensus.cc:3055] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:26.771303 25271 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:26.772101 25271 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.773439 25271 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.780750 25271 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:26.782349 25822 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:26.783749 26406 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:26.785454 26406 raft_consensus.cc:697] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:26.786700 26406 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.787693 25200 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:26.793385 26436 raft_consensus.cc:993] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:26.793946 26390 raft_consensus.cc:1081] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:26.795516 25858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46474
I20260709 12:19:26.796028 25858 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:26.796355 25858 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.797479 25025 catalog_manager.cc:5697] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:26.801975 25858 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.804226 25858 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:26.805325 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:26.805972 25271 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.805383 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:26.808081 25200 raft_consensus.cc:3055] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:26.808400 25200 raft_consensus.cc:740] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:26.809211 25200 consensus_queue.cc:260] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.810516 25200 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.819213 25271 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:26.823417 25200 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:26.823776 25822 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:26.824729 26338 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:26.825196 26338 raft_consensus.cc:697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:26.828737 26338 consensus_queue.cc:237] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:26.848775 25119 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:26.850811 26338 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:26.851997 25025 catalog_manager.cc:5697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:26.881132 25271 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:26.882716 26338 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:27.008876 25127 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:27.010229 26394 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:27.020666 25200 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:27.022167 26434 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:27.108359 25200 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:27.110540 26383 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:27.129629 25127 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:27.132015 26393 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:27.178710 25127 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:27.180184 26431 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:27.191632 25200 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:27.193369 26431 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:27.235859 25269 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:27.237542 26431 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:27.260267 25200 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:27.261896 26431 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:27.299247 25271 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:27.305363 26406 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:27.355291 25196 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:27.369479 26431 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:27.383843 25271 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:27.406836 25119 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:27.407819 25241 consensus_peers.cc:597] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6afd466aa7a2455fa2f85263e303ec0f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.408577 26383 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:27.415653 25193 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:27.423153 26383 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:27.439199 26394 raft_consensus.cc:2955] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.442867 25127 raft_consensus.cc:2955] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.461427 25196 raft_consensus.cc:2955] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.469460 25025 catalog_manager.cc:5697] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.474234 25200 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:27.493943 25271 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:27.495981 26436 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:27.505019 25167 consensus_peers.cc:597] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0e4085b9c3e4704891292cf0881ea14. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.507321 25127 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:27.512580 26396 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:27.521018 26396 raft_consensus.cc:2955] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.527856 25271 raft_consensus.cc:2955] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.538259 25127 raft_consensus.cc:2955] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.543287 25271 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:27.545218 25022 catalog_manager.cc:5697] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.584733 25200 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:27.586592 25119 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:27.586458 26393 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:27.587528 25241 consensus_peers.cc:597] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d4c46d8dc974803aa09fb2a6515ca35. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.588642 26383 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:27.593999 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:27.616633 26393 raft_consensus.cc:2955] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.619549 25126 raft_consensus.cc:2955] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.649453 25200 raft_consensus.cc:2955] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.677347 25196 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:27.678867 25126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:27.679797 25126 raft_consensus.cc:606] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:27.684561 25193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:27.685111 25193 raft_consensus.cc:606] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:19:27.688400 25271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:27.677436 25024 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.688992 25271 raft_consensus.cc:606] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:27.690232 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:27.691838 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:27.705205 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:27.734150 25271 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:27.736410 25167 consensus_peers.cc:597] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e42a38bc05c84ba69ac42605a0f627ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.742105 26436 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:27.751157 25119 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:27.752413 26478 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:27.764640 26396 raft_consensus.cc:2955] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.784056 25271 raft_consensus.cc:2955] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.804510 25119 raft_consensus.cc:2955] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.808064 25024 catalog_manager.cc:5697] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:27.931106 26485 ts_tablet_manager.cc:933] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:27.933135 26485 tablet_copy_client.cc:323] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
I20260709 12:19:27.938958 25286 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet 6afd466aa7a2455fa2f85263e303ec0f from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:27.939563 25286 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet 6afd466aa7a2455fa2f85263e303ec0f from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-6afd466aa7a2455fa2f85263e303ec0f
I20260709 12:19:27.946435 25286 tablet_copy_source_session.cc:215] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:27.951179 26485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afd466aa7a2455fa2f85263e303ec0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:27.973651 26485 tablet_copy_client.cc:806] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:27.974306 26485 tablet_copy_client.cc:670] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:27.979489 26485 tablet_copy_client.cc:538] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:27.989326 26485 tablet_bootstrap.cc:492] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:28.023201 26447 raft_consensus.cc:993] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:28.024112 26337 raft_consensus.cc:1081] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:28.036525 25269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:28.037338 25269 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:28.039130 25269 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:28.261531 26436 raft_consensus.cc:993] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:28.262514 26396 raft_consensus.cc:1081] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:28.341181 25269 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:28.361253 25269 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:28.374100 26488 ts_tablet_manager.cc:933] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:28.374158 26490 ts_tablet_manager.cc:933] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:28.390345 26492 ts_tablet_manager.cc:933] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:28.391800 25119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:19:28.392226 26485 tablet_bootstrap.cc:492] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:28.392565 25119 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:28.394433 26485 tablet_bootstrap.cc:492] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:28.394752 25119 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:28.395246 26485 ts_tablet_manager.cc:1403] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.406s	user 0.168s	sys 0.196s
I20260709 12:19:28.398676 26485 raft_consensus.cc:359] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:28.399595 26485 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:28.400363 26485 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
W20260709 12:19:28.406844 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 64393us
I20260709 12:19:28.408190 26488 tablet_copy_client.cc:323] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
W20260709 12:19:28.408488 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 64387.3us
I20260709 12:19:28.411597 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:28.412177 25122 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:28.412461 25122 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:28.413501 26485 ts_tablet_manager.cc:1434] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 12:19:28.413260 25122 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:28.414803 25122 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:28.419540 26492 tablet_copy_client.cc:323] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
W20260709 12:19:28.421706 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 50182.1us
I20260709 12:19:28.437196 25122 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:28.440326 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:28.440960 25859 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:28.442111 25119 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:28.444475 25119 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:28.447906 25859 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:28.448109 25858 raft_consensus.cc:1217] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:28.453266 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:28.453752 25196 raft_consensus.cc:3055] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:28.453997 25196 raft_consensus.cc:740] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:28.454869 25196 consensus_queue.cc:260] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:28.456365 25196 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:28.468775 25196 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:28.475836 25286 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-6afd466aa7a2455fa2f85263e303ec0f received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:28.476310 25286 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-6afd466aa7a2455fa2f85263e303ec0f on tablet 6afd466aa7a2455fa2f85263e303ec0f with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:28.480803 25285 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet 2d4c46d8dc974803aa09fb2a6515ca35 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:28.481395 25285 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet 2d4c46d8dc974803aa09fb2a6515ca35 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-2d4c46d8dc974803aa09fb2a6515ca35
I20260709 12:19:28.486500 26490 tablet_copy_client.cc:323] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
W20260709 12:19:28.487524 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 77394.4us
I20260709 12:19:28.489394 25285 tablet_copy_source_session.cc:215] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:28.492084 25212 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet b0e4085b9c3e4704891292cf0881ea14 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:28.492715 25212 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet b0e4085b9c3e4704891292cf0881ea14 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-b0e4085b9c3e4704891292cf0881ea14
I20260709 12:19:28.492983 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:28.493844 26393 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:28.494383 26393 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:28.495244 26393 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:28.496829 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4c46d8dc974803aa09fb2a6515ca35. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:28.502707 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 51111.8us
I20260709 12:19:28.504271 25093 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:28.506225 25212 tablet_copy_source_session.cc:215] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:19:28.516693 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 81027.9us
I20260709 12:19:28.518116 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:28.518724 25270 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:28.507277 26337 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:28.520576 26337 raft_consensus.cc:697] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:28.521369 26337 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:28.527457 25270 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:28.536005 25024 catalog_manager.cc:5697] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 2, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:28.565816 26394 raft_consensus.cc:993] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:28.566411 26394 raft_consensus.cc:1081] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:28.591796 25212 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet e42a38bc05c84ba69ac42605a0f627ca from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:28.592500 25212 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet e42a38bc05c84ba69ac42605a0f627ca from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-e42a38bc05c84ba69ac42605a0f627ca
I20260709 12:19:28.592886 26492 tablet_copy_client.cc:806] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:28.593482 26492 tablet_copy_client.cc:670] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:28.597996 26492 tablet_copy_client.cc:538] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:28.602656 25212 tablet_copy_source_session.cc:215] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:28.609537 26492 tablet_bootstrap.cc:492] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:28.612953 26488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e4085b9c3e4704891292cf0881ea14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.625984 25196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36436
I20260709 12:19:28.626471 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42a38bc05c84ba69ac42605a0f627ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.626657 25196 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:28.627111 25196 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:28.633682 25024 catalog_manager.cc:5697] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:28.637390 25196 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:28.640625 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:28.641161 25127 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:28.644821 25196 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:28.648170 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:19:28.645737 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.648833 25271 raft_consensus.cc:3055] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:28.649171 25271 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:28.649902 25271 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:28.650915 25271 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:28.655100 26492 tablet_bootstrap.cc:492] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:28.656049 26492 tablet_bootstrap.cc:492] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:28.656877 26492 ts_tablet_manager.cc:1403] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.048s	user 0.026s	sys 0.005s
I20260709 12:19:28.658138 25127 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:28.659214 25168 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:28.660161 26478 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:28.660655 26478 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:28.660475 26492 raft_consensus.cc:359] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:28.661408 26490 tablet_copy_client.cc:806] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:28.661310 26492 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:28.662073 26490 tablet_copy_client.cc:670] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:28.661643 26478 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:28.662231 26492 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:28.664721 26492 ts_tablet_manager.cc:1434] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:19:28.665632 25271 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:28.668872 25285 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-2d4c46d8dc974803aa09fb2a6515ca35 received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:28.669194 26488 tablet_copy_client.cc:806] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:28.669281 25285 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-2d4c46d8dc974803aa09fb2a6515ca35 on tablet 2d4c46d8dc974803aa09fb2a6515ca35 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:28.669941 26488 tablet_copy_client.cc:670] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:28.671132 26490 tablet_copy_client.cc:538] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:28.682281 26488 tablet_copy_client.cc:538] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:28.695672 26488 tablet_bootstrap.cc:492] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:28.701149 25859 raft_consensus.cc:1217] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:28.732410 26490 tablet_bootstrap.cc:492] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:28.768656 25022 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:28.779277 26490 tablet_bootstrap.cc:492] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:28.780424 26490 tablet_bootstrap.cc:492] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:28.781193 26490 ts_tablet_manager.cc:1403] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.049s	user 0.034s	sys 0.007s
I20260709 12:19:28.800882 26490 raft_consensus.cc:359] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:28.801824 26490 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:28.802600 26490 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:28.805171 26490 ts_tablet_manager.cc:1434] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:19:28.810935 26488 tablet_bootstrap.cc:492] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:28.813212 26488 tablet_bootstrap.cc:492] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:28.813962 26488 ts_tablet_manager.cc:1403] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.119s	user 0.021s	sys 0.016s
I20260709 12:19:28.816722 25212 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-e42a38bc05c84ba69ac42605a0f627ca received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:28.817190 25212 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-e42a38bc05c84ba69ac42605a0f627ca on tablet e42a38bc05c84ba69ac42605a0f627ca with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:28.806095 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:28.822016 26488 raft_consensus.cc:359] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:28.822927 26488 raft_consensus.cc:740] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:28.823591 26488 consensus_queue.cc:260] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:28.826483 26488 ts_tablet_manager.cc:1434] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:19:28.837157 25212 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-b0e4085b9c3e4704891292cf0881ea14 received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:28.837648 25212 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-b0e4085b9c3e4704891292cf0881ea14 on tablet b0e4085b9c3e4704891292cf0881ea14 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:28.906538 25270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:28.907136 25270 raft_consensus.cc:606] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:28.908048 25271 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:28.909886 26386 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:28.914947 25127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:28.915378 25858 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:28.915504 25127 raft_consensus.cc:606] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:28.918193 26386 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:28.921622 25268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:28.922185 25268 raft_consensus.cc:606] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:28.925484 25127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:28.926199 25127 raft_consensus.cc:606] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:28.929872 25196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:28.930529 25196 raft_consensus.cc:606] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:28.932047 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:28.939730 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:28.949002 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:28.969437 26491 raft_consensus.cc:1064] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:28.972184 25119 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:28.972265 26491 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:28.975473 25196 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:28.976297 26504 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:28.977880 26494 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:29.061861 25127 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:29.063433 26478 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:29.110263 25859 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:29.111644 26501 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:29.113727 25270 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:29.115453 26489 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:19:29.131188 26512 log.cc:927] Time spent T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:19:29.135540 26337 raft_consensus.cc:1064] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:29.137676 26337 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:29.158080 26504 raft_consensus.cc:993] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:29.158623 26504 raft_consensus.cc:1081] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:29.159322 26386 raft_consensus.cc:993] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:29.159766 26386 raft_consensus.cc:1081] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:29.162694 25859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:19:29.163223 25859 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:29.164335 25859 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:29.167526 25193 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:29.162818 25270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:29.163669 25268 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:29.172097 25859 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:29.169674 26447 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:19:29.170441 25270 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:29.176681 25270 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:29.179821 26386 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:29.183213 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:29.184037 25127 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:29.188475 25859 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:29.190282 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:29.190860 25273 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:29.191145 25273 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:29.191862 25273 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:29.193017 25273 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:29.214313 25857 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:29.213289 26337 raft_consensus.cc:2955] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:29.215916 25273 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:29.216997 25822 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:29.220085 26338 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:29.220616 26338 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:29.221517 26338 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:29.219204 26447 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:19:29.225345 25270 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:29.226910 25857 raft_consensus.cc:2955] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:29.232664 25193 raft_consensus.cc:2955] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:29.233507 25271 raft_consensus.cc:2955] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:29.245824 25023 catalog_manager.cc:5697] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:29.249586 25270 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:29.250633 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:29.251282 25858 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:29.256639 25127 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:29.257084 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:29.257659 25119 raft_consensus.cc:3055] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:29.257961 25119 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:29.258738 25119 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:29.259986 25119 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:29.264552 26383 raft_consensus.cc:1064] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
W20260709 12:19:29.265003 26383 raft_consensus.cc:1068] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Unable to promote non-voter 4456c1069d1541fab5b7cb29df9b6167: Service unavailable: leader transfer in progress
I20260709 12:19:29.260099 25025 catalog_manager.cc:5697] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 3 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:29.283835 25119 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:29.295912 25858 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:29.299324 25242 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:29.303236 26383 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:29.303738 26383 raft_consensus.cc:697] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:29.304540 26383 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:29.309700 25859 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:29.314538 26504 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:29.333488 26489 raft_consensus.cc:993] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:29.333945 26489 raft_consensus.cc:1081] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:29.339349 25270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40096
I20260709 12:19:29.343993 25270 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:29.344398 25270 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:29.354897 26386 raft_consensus.cc:993] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:29.355472 26386 raft_consensus.cc:1081] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:29.357164 25268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:29.357722 25268 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:29.358155 25268 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:29.370215 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 70961.8us
I20260709 12:19:29.376603 25196 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:29.381142 25270 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:29.383962 25270 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:29.385032 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:29.385670 25856 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:29.386730 25119 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:29.390838 25857 raft_consensus.cc:1217] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:29.366308 25268 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:29.392042 26504 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:29.393240 25268 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:29.395017 26527 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:29.400754 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:29.401363 25196 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:29.401674 25196 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:29.402387 25196 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:29.403707 25856 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:29.403942 25196 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:29.411083 25196 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:29.412317 25241 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:29.413442 26383 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:29.414354 26383 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:29.413424 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:29.415299 26383 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:29.416491 25193 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:29.474105 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:29.476107 25119 raft_consensus.cc:3055] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:29.476747 25119 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:29.483748 25193 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:29.490075 25119 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:29.509281 25024 catalog_manager.cc:5697] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 4, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:29.523011 25119 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:29.511420 26501 raft_consensus.cc:2955] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:29.532651 25193 raft_consensus.cc:2955] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:29.551149 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:29.563310 26383 raft_consensus.cc:993] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:29.563956 26383 raft_consensus.cc:1081] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:29.570192 25198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36436
I20260709 12:19:29.570984 25198 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:29.571427 25198 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:29.577208 25119 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:29.583626 25198 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:29.587069 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:29.587834 25127 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:29.552589 26491 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:29.601785 25856 raft_consensus.cc:2955] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:29.614221 26491 raft_consensus.cc:697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:29.615774 26491 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:29.624979 25198 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:29.628167 25127 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:29.629771 25168 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:29.630916 26489 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:29.631669 26489 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:29.632758 26489 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:29.680346 25268 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:29.684473 26338 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:29.711306 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:29.712127 25271 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:29.712440 25271 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:19:29.694773 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 125014us
I20260709 12:19:29.713560 25271 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:29.723996 25271 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:29.771916 25271 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:29.807253 25119 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:19:29.805173 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 75873.9us
I20260709 12:19:29.840299 26338 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:19:30.102799 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:30.466656 25121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "155471b361b441c095eae34b64eb0bed"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:30.467713 25121 raft_consensus.cc:606] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:30.474012 25024 catalog_manager.cc:5697] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:19:30.549327 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 764910us
I20260709 12:19:30.569243 25121 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:30.596307 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 46233.1us
I20260709 12:19:30.632848 26535 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:30.633720 26535 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:30.665640 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 68087.3us
I20260709 12:19:30.688764 26431 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:30.698359 26436 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:30.689465 26431 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:30.711066 26431 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:30.699155 26436 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:30.717767 25120 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:30.718142 25121 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:30.736137 25201 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:30.744444 25123 raft_consensus.cc:2955] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:30.751681 26535 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:30.759729 25197 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:30.765118 25858 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Advancing to term 2
I20260709 12:19:30.777608 26436 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:30.776177 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 90991us
I20260709 12:19:30.789402 26552 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:30.790397 25858 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:30.804250 26533 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:19:30.775674 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 86922.7us
I20260709 12:19:30.804904 26533 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:30.823298 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:19:30.818722 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.826473 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:30.807678 26383 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:30.812110 26491 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:30.828013 26495 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:19:30.840112 25860 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:30.841284 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:30.849541 26496 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:30.855763 26383 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:30.858771 26494 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:30.859404 26496 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:30.858796 26491 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:30.864193 25148 debug-util.cc:398] Leaking SignalData structure 0x7b080011ace0 after lost signal to thread 23882
I20260709 12:19:30.864637 26491 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:19:30.865572 25148 debug-util.cc:398] Leaking SignalData structure 0x7b08001203c0 after lost signal to thread 25059
W20260709 12:19:30.866845 25148 debug-util.cc:398] Leaking SignalData structure 0x7b0800033a00 after lost signal to thread 25151
I20260709 12:19:30.867305 25858 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:19:30.868016 25148 debug-util.cc:398] Leaking SignalData structure 0x7b080020e180 after lost signal to thread 25226
W20260709 12:19:30.869458 25148 debug-util.cc:398] Leaking SignalData structure 0x7b080030edc0 after lost signal to thread 25300
I20260709 12:19:30.872036 26533 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:30.808835 26552 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:30.874881 26552 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:30.875926 26549 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 12:19:30.883055 26546 raft_consensus.cc:1064] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:30.886642 26546 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:30.876982 26478 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 12:19:30.895206 25148 debug-util.cc:398] Leaking SignalData structure 0x7b080036a880 after lost signal to thread 25884
I20260709 12:19:30.890556 25024 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:30.912632 25273 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:30.936040 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:30.949236 25268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:30.954150 25268 raft_consensus.cc:606] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:30.954550 25268 raft_consensus.cc:614] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:30.967314 25858 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:30.963922 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:30.968676 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:30.970970 26527 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:30.971580 26527 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:30.972005 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:30.973438 25273 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:19:30.938721 26552 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:30.953533 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:30.953644 26501 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:30.981966 25198 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:30.962100 26559 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:19:30.983589 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 73304.6us
I20260709 12:19:30.986205 26504 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:19:30.961921 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 121810us
I20260709 12:19:30.974920 26383 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:31.009352 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:31.010424 26561 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:31.010990 26561 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:31.011557 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:31.013362 26561 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:31.014506 26501 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:31.016758 26501 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:31.017464 25119 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:31.043979 26527 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:31.046542 26536 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:31.049166 26501 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:19:31.064462 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:30.996284 26552 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:31.071957 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:31.074517 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:31.079716 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:31.047149 26536 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:31.055032 26549 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:19:31.089221 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 113888us
I20260709 12:19:31.098798 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:31.106478 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:31.109777 26552 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:31.093616 26549 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:31.116489 26549 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:31.117976 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:31.119494 26337 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:31.006125 26559 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:31.122170 26536 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:31.117677 26496 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:31.135480 26337 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:31.144394 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:31.153546 25165 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:19:31.155185 25165 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:31.145871 26552 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:19:31.158631 26337 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:31.159340 26436 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:31.150496 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:31.172231 25242 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:31.160391 26478 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:31.162997 26549 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:31.173300 26390 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:19:31.209082 26559 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:31.144450 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:31.210387 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:31.216301 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:31.179248 26536 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:31.193236 26549 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:31.237617 26542 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:31.238616 26542 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:31.193775 26501 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:19:31.237162 26549 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:31.270684 26556 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:31.271649 26556 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:31.205188 26527 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 12:19:31.274552 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 69053.1us
I20260709 12:19:31.249100 26447 raft_consensus.cc:993] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
W20260709 12:19:31.278182 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 106564us
I20260709 12:19:31.213649 26495 raft_consensus.cc:2955] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:31.242013 26542 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:31.294565 26564 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:19:31.297874 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:31.299247 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:31.311726 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:31.318434 26545 raft_consensus.cc:1064] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:31.325876 25269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:31.326514 25269 raft_consensus.cc:606] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
W20260709 12:19:31.322567 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 226552us
I20260709 12:19:31.331000 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:19:31.337180 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 115462us
I20260709 12:19:31.337224 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:31.340323 25090 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:31.341255 26542 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:31.297052 26536 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:19:31.318975 26545 raft_consensus.cc:1068] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Unable to promote non-voter 4456c1069d1541fab5b7cb29df9b6167: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:19:31.310205 26491 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:31.356142 26337 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:31.306243 26565 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:31.357360 26493 raft_consensus.cc:1081] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:31.357306 26337 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:31.360531 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:31.362830 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 91184.1us
I20260709 12:19:31.367333 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:31.371423 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:31.371953 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:31.377784 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:31.402067 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:31.402287 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:31.394402 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:31.405256 26337 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:31.435926 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:31.438570 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:19:31.402330 26568 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:19:31.440886 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:19:31.443709 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 205293us
I20260709 12:19:31.455230 26573 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:31.440136 26552 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:31.460150 26551 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:31.498267 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 57439.2us
I20260709 12:19:31.499476 25242 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:31.508527 25242 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:31.502362 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:31.503793 26552 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:31.454222 25857 raft_consensus.cc:2955] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:31.512426 26565 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:31.548708 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0821374625d4793801ab3b3f502714e"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:31.549326 25200 raft_consensus.cc:606] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:31.552150 25025 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 1 to 2, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:31.556285 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:31.557788 25165 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:31.559738 25853 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:31.560513 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:31.562305 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:31.563323 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:31.565891 25025 catalog_manager.cc:5697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 4, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:31.572542 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:31.584787 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:31.574991 26535 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:31.592376 25119 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:31.608629 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:31.565493 26576 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:31.624006 25273 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:31.631019 26556 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:31.632148 25276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "155471b361b441c095eae34b64eb0bed"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:31.632843 25276 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:31.633205 25276 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:31.668816 26589 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:19:31.633529 26495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41024 (request call id 78) took 1043 ms. Trace:
W20260709 12:19:31.669658 26575 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:19:31.681146 25276 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:31.683812 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:31.699256 26579 log.cc:927] Time spent T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:19:31.705116 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:31.740067 25276 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:19:31.746055 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 142252us
I20260709 12:19:31.755775 26577 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:31.766836 26577 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:31.705845 26549 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:31.782156 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 171135us
W20260709 12:19:31.787148 26582 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:19:31.807797 25093 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:31.812453 25200 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:31.753562 26561 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:19:31.824049 26534 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:31.841374 26583 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:19:31.852219 25093 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:31.887085 26594 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:19:31.891319 26549 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:31.797804 25822 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:31.897706 26585 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:31.896205 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 116281us
I20260709 12:19:31.923986 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:31.931753 26569 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:31.991264 26390 raft_consensus.cc:1064] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:31.679194 26495 rpcz_store.cc:276] 0709 12:19:30.566723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.566893 (+   170us) service_pool.cc:224] Handling call
0709 12:19:30.572386 (+  5493us) log.cc:844] Serialized 501 byte log entry
0709 12:19:30.710746 (+138360us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b18003689e0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:19:31.609943 (+899197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1573,"raft.queue_time_us":684,"raft.run_cpu_time_us":1624,"raft.run_wall_time_us":37431,"spinlock_wait_cycles":9972992,"thread_start_us":76622,"threads_started":1,"wal-append.queue_time_us":120240}
I20260709 12:19:31.994470 26390 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:32.093880 26590 raft_consensus.cc:1064] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:32.081290 26577 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:32.115845 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 263731us
W20260709 12:19:32.116967 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.118201 25093 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:32.125957 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:32.125772 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b0e4085b9c3e4704891292cf0881ea14 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:19:32.130869 25857 consensus_meta.cc:287] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.004s
W20260709 12:19:32.149999 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 315079us
W20260709 12:19:32.151808 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 209917us
I20260709 12:19:32.145843 26577 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:32.253175 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 91894.5us
I20260709 12:19:32.281944 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:32.122176 26548 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.221s
W20260709 12:19:32.317431 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 63239.9us
I20260709 12:19:32.317535 26390 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.334757 26390 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:32.273566 26561 raft_consensus.cc:993] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
W20260709 12:19:32.316470 26595 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:19:32.314957 26545 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:32.318522 26565 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:32.334312 26542 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.377384 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:32.377840 26478 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.344600 26436 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.379542 26390 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:32.273671 26447 consensus_queue.cc:1059] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:19:32.385668 26596 raft_consensus.cc:1081] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:32.367399 26559 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:32.370890 26569 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:32.383596 26561 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.382655 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:32.382990 26542 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:32.384606 26478 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:32.389776 26559 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:32.387408 26436 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:32.400941 26501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.030s	sys 0.105s
W20260709 12:19:32.420046 26501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.030s	sys 0.105s
I20260709 12:19:32.409971 25120 raft_consensus.cc:3055] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:32.417610 26447 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:19:32.450860 26606 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:19:32.388828 26565 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:32.553824 26602 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:32.413535 26561 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:32.453975 25120 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:32.381675 26545 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:32.413154 26569 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:32.545002 26542 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:32.575073 26545 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:32.544574 26447 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:32.547338 26494 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.577940 26447 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:32.581677 26436 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:32.583647 26559 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:32.554502 26602 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:32.620256 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 367813us
I20260709 12:19:32.588693 26494 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:32.647176 26494 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:32.652063 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:32.656029 25276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0821374625d4793801ab3b3f502714e"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40096
I20260709 12:19:32.656700 25276 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:32.657130 25276 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:32.659474 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:32.664306 26569 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:32.665091 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:32.666785 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:32.672945 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:19:32.670732 26590 raft_consensus.cc:1068] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Unable to promote non-voter 4456c1069d1541fab5b7cb29df9b6167: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }.
  Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:32.682155 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:32.690999 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:19:32.690478 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 287924us
I20260709 12:19:32.680420 26478 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:32.681826 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 322) took 1282 ms. Trace:
I20260709 12:19:32.699613 25276 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:32.671200 25120 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:32.701009 26549 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.701620 26590 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:32.703815 26602 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:32.686100 26447 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.730594 25276 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:32.696506 26431 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.735973 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:32.743320 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:32.744277 25195 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:32.746977 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:32.749963 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:32.753911 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:32.755684 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:32.731068 26478 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.763082 25121 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:32.773497 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:32.775033 26493 raft_consensus.cc:3055] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:32.758576 26561 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:32.817704 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 53664.4us
I20260709 12:19:32.768268 26585 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:32.772204 26436 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.744495 26590 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:32.743283 26447 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:32.747287 26431 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:32.775520 26493 raft_consensus.cc:740] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:32.768352 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:19:32.873131 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 54757.4us
I20260709 12:19:32.756335 26549 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:32.813623 26578 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:32.820608 26489 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:32.862318 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:32.817126 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:32.885443 26489 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:32.886148 25126 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:19:32.779446 26478 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:32.874542 26565 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:32.883574 26605 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 12:19:32.878502 26561 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.883057 26545 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.909513 25123 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:32.909651 26610 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:32.910728 25168 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:32.890480 26576 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.923718 25093 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:19:32.984589 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 60982.2us
I20260709 12:19:32.892758 26578 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.019119 26578 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.019888 26578 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:32.890908 26436 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:32.901660 26614 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.910760 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:32.910230 26610 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:32.907919 26612 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:19:33.054551 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 143901us
I20260709 12:19:33.052618 25121 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:19:32.909538 26601 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:33.024098 26494 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:33.029330 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:32.903518 26561 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.071985 26489 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.072335 26431 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.042510 26619 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:33.050661 26534 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:32.705945 25857 rpcz_store.cc:276] 0709 12:19:31.397326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.399653 (+  2327us) service_pool.cc:224] Handling call
0709 12:19:31.428217 (+ 28564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.447042 (+ 18825us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:32.131339 (+684297us) log.cc:844] Serialized 14 byte log entry
0709 12:19:32.643178 (+511839us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:32.643727 (+   549us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:32.649354 (+  5627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.663184 (+ 13830us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:32.678375 (+ 15191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93645,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5450,"thread_start_us":399823,"threads_started":2,"wal-append.queue_time_us":273305}
I20260709 12:19:32.940618 26545 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.097992 26620 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.098930 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.106343 26596 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:33.109323 26478 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.106673 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.025550 26576 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.101822 26545 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.054554 26623 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.108855 26626 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:19:33.110126 25852 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:33.272279 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:33.268733 26561 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.268211 26504 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:33.109692 26596 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.270241 26552 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:33.268029 26494 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:33.341974 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.074951 26612 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.348480 26587 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.342796 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.276213 26527 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.350987 25165 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:19:33.364472 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 92250us
I20260709 12:19:33.057907 26614 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.339630 26549 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.367704 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:33.095245 26619 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.324129 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.349643 26590 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.378124 26617 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:33.359493 26618 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:33.370098 26536 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:33.382356 26525 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:33.364199 26546 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:19:33.389756 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 282163us
I20260709 12:19:33.353286 26552 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.362164 26527 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.103356 26534 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.395923 26612 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.375383 26549 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:33.072379 26601 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.350726 26504 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.382498 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.369297 26494 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.388670 26590 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:33.270680 26620 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:33.417119 26624 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 12:19:33.403458 26536 raft_consensus.cc:697] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:33.406143 26610 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.407876 26552 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.418198 26436 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.349073 26587 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:33.447175 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 332391us
I20260709 12:19:33.447310 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.403177 26617 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:33.448179 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:33.431418 26545 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.410708 26546 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.413883 26525 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.270918 26623 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.440353 26618 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.460259 26631 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:33.447433 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.473299 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.471825 25275 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:33.473999 25200 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:19:33.484200 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:33.485080 25200 raft_consensus.cc:3055] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:33.485564 25200 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:19:33.487601 25195 consensus_meta.cc:287] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.739s	user 0.011s	sys 0.000s
I20260709 12:19:33.488214 25195 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:33.472108 26631 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.494648 25200 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.474798 25197 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:19:33.505636 25200 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.504132 26620 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:33.464949 26545 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.510990 26494 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.511164 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.511909 26552 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.512482 26552 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.513021 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.514650 26552 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:33.502892 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.501802 26631 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.525525 26504 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.526249 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.526279 26546 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.527809 26525 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:33.529412 26527 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:33.529403 26576 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.532025 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:33.544552 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 179254us
I20260709 12:19:33.538970 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.529496 26534 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.553663 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.554960 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.546185 26436 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.556442 26436 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.558312 26436 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.547317 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.523705 26619 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.564306 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.569816 26596 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.571030 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.572165 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.572604 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:33.573200 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.540668 25851 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:33.508428 26536 consensus_queue.cc:237] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.564224 26617 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:33.576839 25196 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:33.578661 26587 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.579569 26617 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:33.579982 25242 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:33.580075 26617 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:33.581888 26617 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.582544 26598 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:33.577437 26601 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.546687 26623 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.578661 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.589306 25200 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:19:33.588124 25167 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:33.595551 26612 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:33.595947 26612 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:33.596318 26612 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.596359 26618 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.598407 26545 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.598555 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.589383 26626 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.586324 25852 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:19:33.614046 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:33.614063 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.614852 25854 raft_consensus.cc:1813] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Handling vote request from an unknown peer 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:33.615513 25854 raft_consensus.cc:2410] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:19:33.601451 26614 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.599927 26626 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.617269 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:33.620183 25241 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:33.617282 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.621800 25859 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:19:33.625033 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.628216 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.629530 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.629552 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.626300 26491 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:33.631134 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.631376 26491 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:33.631820 26491 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.633663 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.634925 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.636395 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.635777 25193 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:33.640977 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.619112 26626 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.644330 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.637908 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.637557 26493 consensus_queue.cc:260] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.648941 26493 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.658974 26631 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.662465 25197 raft_consensus.cc:1240] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:33.667706 25860 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:33.669687 26623 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.670332 25822 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:33.670230 26623 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.672923 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.672122 26576 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:33.665050 26612 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.676677 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:33.682129 26612 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.690560 25120 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.691131 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.688386 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:33.695276 26612 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:33.695672 26447 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.697984 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:33.692521 26549 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.699981 26501 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:33.701876 26549 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.702277 26501 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.703940 26549 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.698621 25125 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
W20260709 12:19:33.705410 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.705786 25275 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:33.706681 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.707005 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.710950 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.740754 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.743242 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.747124 25275 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:33.744297 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.778895 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 452) took 1030 ms. Trace:
I20260709 12:19:33.779536 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:33.781809 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.782512 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.695914 26570 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:33.419430 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:33.789546 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 1523) took 1027 ms. Trace:
I20260709 12:19:33.701251 26447 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:33.791402 25168 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:33.791896 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:33.792335 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.779328 25856 rpcz_store.cc:276] 0709 12:19:32.748257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.748372 (+   115us) service_pool.cc:224] Handling call
0709 12:19:33.746536 (+998164us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800093398. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9b71 00007f2100de9a22 00007f2109d028d9 00007f2108e5cee0 00007f2108f260ab 00007f2108f26131 00007f2108ee7fc0 00007f2108ed2929 00007f2108ed23d2 00007f2102449bd4
0709 12:19:33.778485 (+ 31949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.778665 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:33.778690 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:33.778734 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:33.778752 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.778788 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:33.778849 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410880}
I20260709 12:19:33.793030 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.704203 26501 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:33.713680 26559 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.741904 26549 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.796432 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.790130 25127 rpcz_store.cc:276] 0709 12:19:32.751424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.751573 (+   149us) service_pool.cc:224] Handling call
0709 12:19:33.668724 (+917151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.668842 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:33.668856 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:33.668881 (+    25us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:33.668898 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.668929 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:33.740384 (+ 71455us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b540009e550. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:19:33.778626 (+ 38242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081244928}
I20260709 12:19:33.708629 26602 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:19:33.828555 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 44064us
I20260709 12:19:33.828799 25168 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:33.798672 26570 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:33.829663 26478 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:33.704931 26626 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 12:19:33.794461 26489 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:33.833350 26549 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.838474 25093 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:33.747120 26491 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.850863 26596 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:33.851298 26596 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:33.851715 26596 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.851886 26491 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:33.842310 25242 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.596s (SENT)
I20260709 12:19:33.853111 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:33.849655 25093 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:33.865638 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:33.866074 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:33.872632 25025 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41770 (request call id 242) took 2898 ms. Trace:
I20260709 12:19:33.828568 26447 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
W20260709 12:19:33.938593 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 73790.5us
I20260709 12:19:33.938979 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:33.940881 26593 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:33.835942 26559 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.855129 26574 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:33.939024 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 85503.4us
I20260709 12:19:33.944566 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:33.861541 26607 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:19:33.939376 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 89795.3us
I20260709 12:19:33.952492 25093 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:33.848114 26602 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.953888 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.955521 25241 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:33.957616 26548 raft_consensus.cc:2955] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:33.958703 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:33.949963 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:33.961589 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:33.961889 25093 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:33.943544 26631 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.965474 25126 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
W20260709 12:19:33.953502 26641 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:19:33.943207 26578 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:19:33.949596 26593 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:33.969115 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:33.969997 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:33.977212 25201 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:33.977823 26623 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.970933 26569 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:33.981308 26447 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:33.982421 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:19:33.974510 26640 log.cc:927] Time spent T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 12:19:33.987728 26559 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.960698 26607 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.990087 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:33.965626 26383 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:33.990166 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:33.991137 25120 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:33.972301 26547 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:33.991019 26383 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:19:33.991802 25120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 1511) took 1656 ms (client timeout 1596 ms). Trace:
I20260709 12:19:33.990142 26607 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:33.966645 26493 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:34.002779 25023 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41752 (request call id 263) took 2768 ms. Trace:
I20260709 12:19:34.003180 25023 rpcz_store.cc:276] 0709 12:19:31.097325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.097468 (+   143us) service_pool.cc:224] Handling call
0709 12:19:33.865252 (+2767784us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":255179,"reported_tablets":2}
I20260709 12:19:33.998425 26383 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:34.004866 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.005992 26569 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:34.006301 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.006619 26569 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:33.975123 26593 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:34.011487 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.012188 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.017014 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:19:34.018426 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 68544.9us
I20260709 12:19:34.001091 26638 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:34.021569 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 179277us
I20260709 12:19:34.000716 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:34.024040 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:34.027186 26549 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:34.023940 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.029713 26489 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:33.944315 25025 rpcz_store.cc:276] 0709 12:19:30.965471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.965673 (+   202us) service_pool.cc:224] Handling call
0709 12:19:33.863385 (+2897712us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:31.768870 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:31.769739 (+   869us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:31.769787 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:19:31.769815 (+    28us) tablet.cc:662] Decoding operations
0709 12:19:31.859232 (+ 89417us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:31.859363 (+   131us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:31.859410 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:19:31.859892 (+   482us) tablet.cc:701] Row locks acquired
0709 12:19:31.859919 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:19:31.860109 (+   190us) write_op.cc:270] Start()
0709 12:19:31.860273 (+   164us) write_op.cc:276] Timestamp: P: 1783599571860049 usec, L: 0
0709 12:19:31.860308 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:19:31.861225 (+   917us) log.cc:844] Serialized 924 byte log entry
0709 12:19:32.377979 (+516754us) op_driver.cc:464] REPLICATION: finished
0709 12:19:32.862806 (+484827us) write_op.cc:301] APPLY: starting
0709 12:19:32.872482 (+  9676us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:32.880561 (+  8079us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:32.890746 (+ 10185us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:33.041129 (+150383us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:33.066995 (+ 25866us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:19:33.076340 (+  9345us) write_op.cc:312] APPLY: finished
0709 12:19:33.102914 (+ 26574us) log.cc:844] Serialized 29 byte log entry
0709 12:19:33.109521 (+  6607us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:33.109613 (+    92us) write_op.cc:454] Released schema lock
0709 12:19:33.109650 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:33.110008 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:33.110051 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":184500,"reported_tablets":4,"spinlock_wait_cycles":242176,"child_traces":[["op",{"apply.queue_time_us":390638,"apply.run_cpu_time_us":3092,"apply.run_wall_time_us":294699,"num_ops":2,"prepare.queue_time_us":172009,"prepare.run_cpu_time_us":4344,"prepare.run_wall_time_us":92819,"replication_time_us":517483,"thread_start_us":460070,"threads_started":2}]]}
I20260709 12:19:34.002331 26493 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:34.043819 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.044618 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:34.046499 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.047159 25267 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:34.049574 26596 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.063894 25090 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:34.029898 26623 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.068930 26494 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:34.069351 26494 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:34.069722 26494 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.070963 25202 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:34.071707 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:34.050707 26493 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:34.000962 25120 rpcz_store.cc:269] 0709 12:19:32.335749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.337335 (+  1586us) service_pool.cc:224] Handling call
0709 12:19:33.690349 (+1353014us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b58003308d0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e6a0aa 00007f2103eec447 00007f2103f04fe7 00007f2103f067de 00007f2103f1227c 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c
0709 12:19:33.991670 (+301321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1985283456}
I20260709 12:19:34.050571 26489 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.076014 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:33.991827 26547 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.078526 25242 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:19:34.079016 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 55487.6us
I20260709 12:19:34.079699 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.080075 26623 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.082906 25825 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.084142 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.083748 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:34.088127 26617 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.121203 25274 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.129941 26609 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.118203 26534 consensus_queue.cc:1059] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:34.130120 25854 raft_consensus.cc:2955] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:34.134542 25276 raft_consensus.cc:2955] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:34.091253 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.105152 26447 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.131104 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.123905 26570 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:34.137509 26602 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:34.163439 25093 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.166983 25093 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.161742 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:34.172968 26383 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.173887 25022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33480 (request call id 180) took 2597 ms. Trace:
I20260709 12:19:34.181351 26593 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.191148 25022 rpcz_store.cc:276] 0709 12:19:31.472778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.472945 (+   167us) service_pool.cc:224] Handling call
0709 12:19:34.069999 (+2597054us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":4480}
I20260709 12:19:34.136850 26494 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:34.189388 26447 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.208439 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:34.209236 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.209393 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.209924 26494 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:34.200093 26596 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:34.201160 26493 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.201848 26593 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:34.198618 26602 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:34.202919 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.204130 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.205730 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.206868 26547 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:34.207316 26383 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:34.190053 26495 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.221272 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:19:34.221551 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 138736us
I20260709 12:19:34.238649 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.241133 26623 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:34.222266 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 136514us
I20260709 12:19:34.243423 25118 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 12:19:34.245106 26602 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.247272 26602 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:34.235697 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.249076 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.216823 26493 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:34.258550 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:34.261474 25825 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.262763 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.253371 26495 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:34.266785 26495 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.268823 26495 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:34.270506 26542 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:34.271049 26542 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.272231 26570 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:34.272619 26570 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:34.272895 25024 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41756 (request call id 289) took 2512 ms. Trace:
I20260709 12:19:34.273022 26542 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:34.278402 26547 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:34.278934 26547 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.280030 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.281100 26547 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:34.281265 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:34.283236 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.285348 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.286463 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.288344 25121 raft_consensus.cc:2955] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:34.299443 26574 raft_consensus.cc:3055] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:34.299870 26574 raft_consensus.cc:740] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:34.300691 26574 consensus_queue.cc:260] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.272965 26570 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:34.302421 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.306042 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:34.306344 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:34.306429 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:34.307179 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.309105 26569 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:34.303469 25168 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.273386 25024 rpcz_store.cc:276] 0709 12:19:31.760651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.761658 (+  1007us) service_pool.cc:224] Handling call
0709 12:19:34.272831 (+2511173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40949,"reported_tablets":2}
W20260709 12:19:34.321144 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 59730.6us
I20260709 12:19:34.278959 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.324059 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:34.305799 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:34.325745 25168 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.326278 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:34.327366 25168 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.308503 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.308831 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:34.328492 25168 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.329229 26478 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:34.329483 26643 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:34.330197 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:34.329982 26643 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.330457 26478 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.330670 26578 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.329237 26619 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.332057 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:34.332162 26643 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:34.333849 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.329720 26614 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.336274 26602 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.339295 26602 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.341338 26602 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:34.336382 26547 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.344431 25092 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:34.301995 26574 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.349927 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.351387 26447 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.353197 25854 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:34.354764 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:34.355661 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:34.365648 25090 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:34.368474 26561 consensus_queue.cc:1059] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:34.369053 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.369392 26561 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:34.369539 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.370262 26651 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.371002 26447 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.371220 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:34.372519 25168 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.373109 26545 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.371472 26614 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.381561 26612 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.369750 26561 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:34.376825 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:34.384111 25200 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:34.383384 26561 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.385504 26561 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.387665 25168 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.386062 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.392760 26652 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:34.387357 25093 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:34.395202 26495 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:34.395632 26495 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.395988 26495 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.397022 26612 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.393357 26652 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:34.398104 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 126269us
I20260709 12:19:34.399076 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.401053 26652 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:19:34.402673 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 98308.9us
I20260709 12:19:34.402431 26617 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.405874 25168 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.408020 26559 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:34.409319 26548 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.410456 25168 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.415480 25242 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.420105 26570 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.427398 25275 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:34.427632 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:34.428193 26501 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.430825 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:34.436201 25242 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.439795 26611 consensus_queue.cc:1059] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:34.440553 26501 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:34.440927 26643 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:34.441291 26652 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.441371 26643 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:34.442325 26643 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.440981 26501 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:34.443869 26489 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.446995 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:34.447153 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:34.447472 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.447530 26610 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:34.444056 25124 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:34.444087 26501 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.445819 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:34.448132 26610 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.448545 25200 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:34.448956 25127 raft_consensus.cc:2376] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2. Re-sending same reply.
I20260709 12:19:34.446389 25202 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:34.449807 26643 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:34.450289 26610 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:34.452176 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:34.455111 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:34.457237 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:34.457886 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:34.458194 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:19:34.458997 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 48592.9us
I20260709 12:19:34.460006 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:34.460502 25127 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:34.460695 25202 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 2: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:34.460795 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.461176 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.462643 26548 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:34.462635 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:34.463798 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.463936 25168 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.464686 26548 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.466305 26501 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.429744 26570 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:34.432636 25024 catalog_manager.cc:5697] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 2 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:34.482754 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:34.483379 25024 catalog_manager.cc:5697] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:34.474325 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:34.486500 25274 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:34.473217 25168 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.488318 25168 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.489279 26495 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.478735 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:34.468775 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.472491 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.484876 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.485929 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.477195 25273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:34.490955 26610 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.491405 26548 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.495400 25276 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:19:34.494637 25273 raft_consensus.cc:606] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:19:34.481789 26501 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:34.504050 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.506245 26525 raft_consensus.cc:2955] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:34.519834 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.520921 26548 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.508984 25124 raft_consensus.cc:2368] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:19:34.510327 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:34.530411 25090 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.531924 26574 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.533511 25090 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.535146 26574 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.535696 25273 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:34.537510 25090 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.543109 26574 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.533628 25851 raft_consensus.cc:2955] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:34.544668 25090 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.545634 26574 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:34.553114 25090 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.553870 26574 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.511322 26495 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:34.559352 26630 consensus_queue.cc:1059] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:34.560369 26630 raft_consensus.cc:3055] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:34.560704 26630 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:34.561540 26630 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.563138 26630 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:34.502503 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.512619 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:34.569257 25202 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.569682 26501 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:34.570093 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 67106us
I20260709 12:19:34.571292 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:19:34.572208 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6afd466aa7a2455fa2f85263e303ec0f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:34.574674 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.576023 25165 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.577440 25202 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:19:34.584467 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.586812 26489 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.587543 26489 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.585692 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.588765 25093 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:34.589377 26548 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.589736 26495 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:34.590595 26495 raft_consensus.cc:697] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:34.581461 25090 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:34.592190 26574 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:34.594106 26570 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.591653 26495 consensus_queue.cc:237] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.599714 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:34.600785 26548 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.602833 26548 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:34.604242 26489 raft_consensus.cc:3055] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:34.604609 26489 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:34.604736 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:34.605687 25274 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.605504 26489 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.606691 26489 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:34.635414 26570 consensus_queue.cc:1059] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:34.636811 26501 raft_consensus.cc:3055] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:34.637245 26501 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:34.638140 26501 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.641369 25242 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.645428 26570 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.647891 25242 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.648317 26501 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.650202 26570 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.654799 25274 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:19:34.658634 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.659530 26570 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.661449 26570 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:34.663930 26570 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:19:34.667006 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet b0e4085b9c3e4704891292cf0881ea14 with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:34.670382 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:34.680546 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:34.681178 25200 raft_consensus.cc:606] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:19:34.680567 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:34.683162 25127 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:19:34.686331 25202 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:19:34.697846 25200 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:34.700059 26570 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:34.702425 25242 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.703336 26570 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:34.705034 26652 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:34.707480 25851 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:34.708474 25274 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:34.709081 26630 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:34.711352 26630 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:34.714525 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.715240 26652 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:34.716434 25242 leader_election.cc:400] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:19:34.716725 25242 leader_election.cc:403] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:34.717773 26489 raft_consensus.cc:2955] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:34.719120 26652 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:19:34.720171 25854 raft_consensus.cc:2955] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:34.722142 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:34.723268 26570 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.730878 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e42a38bc05c84ba69ac42605a0f627ca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:34.734886 25124 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:34.752910 25275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:34.742499 25274 raft_consensus.cc:2955] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:34.754312 25275 raft_consensus.cc:606] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:34.764336 25121 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:34.761760 25022 catalog_manager.cc:5697] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:34.756985 25024 catalog_manager.cc:5697] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:34.786811 25124 raft_consensus.cc:2955] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:34.780977 26655 consensus_queue.cc:1059] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:19:34.789441 26570 raft_consensus.cc:993] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:34.790073 26570 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:34.790452 26570 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:34.790575 26501 raft_consensus.cc:1081] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:34.791486 26570 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.794689 25121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41032
I20260709 12:19:34.795516 25121 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:34.795904 25121 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:34.797917 26570 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:34.801358 25275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:34.801968 25275 raft_consensus.cc:606] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:19:34.803723 25025 catalog_manager.cc:5697] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 3, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:19:34.815804 26662 tablet_replica.cc:333] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:34.817178 26662 raft_consensus.cc:2243] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.818423 26662 raft_consensus.cc:2272] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.829039 25118 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:34.830365 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:34.832067 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:34.832831 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:34.778318 26652 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:19:34.833902 25121 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.845481 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:34.859421 26525 raft_consensus.cc:993] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:34.859974 26525 raft_consensus.cc:1081] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:34.862623 25197 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:34.871011 26662 ts_tablet_manager.cc:1916] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:34.841907 26501 consensus_queue.cc:1059] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:19:34.886140 26536 raft_consensus.cc:993] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
W20260709 12:19:34.886695 26665 log.cc:927] Time spent T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:19:34.886703 26536 raft_consensus.cc:1081] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:34.891665 26501 raft_consensus.cc:3055] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:34.892135 26501 raft_consensus.cc:740] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:34.893115 26501 consensus_queue.cc:260] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.894490 26501 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:34.901841 25197 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:34.906255 25093 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:34.908975 26495 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:34.912021 26495 raft_consensus.cc:697] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:34.913189 26495 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.935940 26662 ts_tablet_manager.cc:1929] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:19:34.936591 26662 log.cc:1199] T b0e4085b9c3e4704891292cf0881ea14 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/b0e4085b9c3e4704891292cf0881ea14
I20260709 12:19:34.937258 25197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36436
I20260709 12:19:34.938040 25197 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:34.938520 25197 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.951336 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:34.951964 25275 raft_consensus.cc:3055] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:34.952621 25121 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:34.955164 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet 6afd466aa7a2455fa2f85263e303ec0f with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:34.952253 25275 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:34.974011 25118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41032
I20260709 12:19:34.974864 26674 tablet_replica.cc:333] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:34.974920 25118 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:34.975559 25118 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:34.975926 26674 raft_consensus.cc:2243] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.976624 26674 raft_consensus.cc:2272] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.980194 26674 ts_tablet_manager.cc:1916] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:34.984042 25275 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:34.997682 25275 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:34.966806 25023 catalog_manager.cc:5697] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.011150 25275 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:34.948052 25197 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.019094 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet b0e4085b9c3e4704891292cf0881ea14 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:35.042671 25197 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:35.043663 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:35.044032 25200 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:35.044330 25273 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:35.044653 25273 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:35.045406 25273 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.061724 25273 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:35.045960 26494 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:35.047012 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:35.064327 25854 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:35.066617 26674 ts_tablet_manager.cc:1929] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:35.067054 26674 log.cc:1199] T 6afd466aa7a2455fa2f85263e303ec0f P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/6afd466aa7a2455fa2f85263e303ec0f
I20260709 12:19:35.071659 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet 6afd466aa7a2455fa2f85263e303ec0f (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:35.088382 25854 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:35.090281 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:35.105161 25024 catalog_manager.cc:5697] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 1 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:35.110513 25275 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:35.113029 26494 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:35.114066 25022 catalog_manager.cc:5697] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.138046 25202 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:35.051798 25118 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:35.143265 26570 consensus_queue.cc:1059] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:35.147548 26570 raft_consensus.cc:3055] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:35.147930 26570 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:35.148770 26570 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:35.149606 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet e42a38bc05c84ba69ac42605a0f627ca with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:35.150571 25273 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
W20260709 12:19:35.155998 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 65843.2us
I20260709 12:19:35.150218 26570 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:35.150002 26678 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:35.199226 26683 tablet_replica.cc:333] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:35.201572 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:35.202426 25273 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:35.202797 25273 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:35.203810 25273 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:35.216269 25273 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:35.199324 25118 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:35.256877 25273 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:35.258378 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:35.278044 26683 raft_consensus.cc:2243] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:35.253007 26678 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:19:35.306519 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 112549us
W20260709 12:19:35.314414 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.317968 26542 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:19:35.320381 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 62096.2us
W20260709 12:19:35.306049 26682 log.cc:927] Time spent T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:19:35.321462 26542 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:35.339840 26683 raft_consensus.cc:2272] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:35.340255 26542 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:35.372308 25273 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:35.373137 26489 raft_consensus.cc:993] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:35.373769 26690 raft_consensus.cc:1081] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:35.374786 26693 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:35.375735 25126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:19:35.388710 25126 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:35.389035 26683 ts_tablet_manager.cc:1916] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:35.389308 25126 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:35.415722 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 211413us
I20260709 12:19:35.423918 25126 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.428071 25126 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:35.435052 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:35.435880 25200 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:35.416531 26678 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.479934 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:35.480732 25202 raft_consensus.cc:3055] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:35.480994 25202 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:35.485297 25200 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:35.484889 25202 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.489120 25202 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:35.499588 26694 log.cc:927] Time spent T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.076s	user 0.003s	sys 0.000s
I20260709 12:19:35.502786 25202 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
W20260709 12:19:35.503015 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 54718.3us
W20260709 12:19:35.525139 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 64280.9us
I20260709 12:19:35.525063 26574 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:35.537142 26574 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.539253 26574 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:35.584035 25093 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:35.585021 26691 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:35.585572 26691 raft_consensus.cc:697] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:35.586788 26691 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.593051 25202 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:35.605242 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:35.606132 25273 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:19:35.618155 26576 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:35.620306 26576 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.622453 26576 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:35.626163 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:35.626855 25851 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:35.628829 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:35.629431 25858 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:19:35.626308 26683 ts_tablet_manager.cc:1929] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:35.633225 26683 log.cc:1199] T e42a38bc05c84ba69ac42605a0f627ca P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/e42a38bc05c84ba69ac42605a0f627ca
I20260709 12:19:35.633376 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:35.634093 25118 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:35.634935 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet e42a38bc05c84ba69ac42605a0f627ca (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:35.638720 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:35.640980 25202 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:35.642746 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:35.643532 26688 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:35.643893 26688 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:35.644263 26688 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:35.647435 25025 catalog_manager.cc:5697] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.646822 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:35.663931 26696 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:35.665339 26495 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:35.665380 26696 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:35.667217 25851 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:35.667336 26696 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:35.767786 25022 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 2, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.775717 26696 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.783541 25024 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.784724 26688 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.799173 26696 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:35.804064 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:35.804922 25200 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:35.806991 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:35.815342 25118 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:35.818684 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:35.818699 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:35.821101 25273 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:19:35.828568 25273 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:35.831935 26697 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:35.823092 26696 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:35.841370 26696 raft_consensus.cc:697] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:35.841521 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:35.842403 26696 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.865180 26630 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.865752 26630 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.867048 25851 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:19:35.868499 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:35.869501 26574 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:35.833786 26688 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:35.870002 26574 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:35.870872 26574 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.868067 26630 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:35.893564 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:35.907634 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:35.908315 25275 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:35.909052 25201 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:35.910387 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:35.912084 26630 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:35.912506 26630 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.912936 26630 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:35.913781 26542 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:35.921056 26698 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:35.921700 26698 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.924947 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:35.925838 25118 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:19:35.927718 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:35.928444 25200 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:19:35.928210 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:35.929883 25825 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:35.930395 25275 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:19:35.930898 26620 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:35.927278 26698 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:35.932940 25275 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:35.940369 26620 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:35.952499 25024 catalog_manager.cc:5697] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 3 to 4, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 4 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.956338 26678 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:35.956907 26630 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.959971 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:35.957583 25023 catalog_manager.cc:5697] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 3, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 3 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.976228 26630 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:35.976274 25851 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:35.980903 26630 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:35.990342 26690 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.991015 26690 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:35.993351 26690 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:35.995926 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:35.998396 26698 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:35.998929 25856 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:35.998934 26698 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.002192 26574 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:36.004206 26698 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.013151 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:36.013687 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:36.013962 25201 raft_consensus.cc:2368] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3.
I20260709 12:19:36.014567 25272 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 2: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:19:36.014876 26690 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:36.015421 26690 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.017683 26690 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.018615 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:36.019213 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:36.024178 25118 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 2: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:19:36.021770 25825 leader_election.cc:400] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3.
I20260709 12:19:36.025746 25825 leader_election.cc:403] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:36.026460 26698 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.025442 25272 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.048707 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:36.049616 25269 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:36.051649 26643 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:36.052858 26643 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.059098 26548 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:36.059866 26548 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.063925 26548 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.068470 26643 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.073002 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:36.073802 25275 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 2: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:19:36.075938 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:36.076848 25118 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 2: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:19:36.077695 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:36.078621 25269 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:36.088706 25165 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:36.089552 26678 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:36.089913 26678 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.090255 26678 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.098765 26678 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.102815 26678 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:36.110708 25165 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:19:36.111902 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:36.112566 25852 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.113431 26630 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:36.113644 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:36.113883 26630 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:36.114312 25275 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:36.114418 26697 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.115360 26697 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.115955 26630 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.118397 26697 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.120431 26716 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:36.121075 26716 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.121623 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:36.124508 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:36.125240 25275 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:36.126502 25822 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:36.127518 26696 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:36.127909 26696 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:36.128291 26696 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.130934 25852 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:36.133229 26630 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.138237 26696 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.138604 25202 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:36.139178 25167 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:36.124536 25272 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:36.141486 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:36.141517 25093 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:36.142491 25202 raft_consensus.cc:2368] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3.
I20260709 12:19:36.143548 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:36.144140 25275 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.144812 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:36.143560 25825 leader_election.cc:400] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3.
I20260709 12:19:36.146679 25825 leader_election.cc:403] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:36.149098 26643 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3.
I20260709 12:19:36.152999 26696 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.154464 25202 raft_consensus.cc:2393] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:36.154727 26697 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:36.161214 26697 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.161646 26697 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.157747 25275 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:36.154778 26690 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:36.158244 25201 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:36.174232 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:36.160066 26698 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3.
I20260709 12:19:36.169699 25165 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:19:36.176400 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:36.178298 25269 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:36.181728 26542 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:36.182391 26548 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:36.182794 26548 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:36.183151 26548 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.176734 26717 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.187590 26717 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.173097 26716 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.203863 25272 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:36.179059 26690 raft_consensus.cc:697] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:36.206270 26690 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.208916 25822 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:36.211845 26697 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.218653 26717 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:36.219779 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:36.223855 26576 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:36.224184 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:36.224408 26576 raft_consensus.cc:697] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:36.224779 25200 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.225365 26576 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.234424 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:36.235273 25124 raft_consensus.cc:2368] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3.
I20260709 12:19:36.236830 25200 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:19:36.224227 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:36.238492 25168 leader_election.cc:400] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3.
I20260709 12:19:36.238783 25168 leader_election.cc:403] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:19:36.238837 25093 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:36.225194 26630 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.243849 26617 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.244700 25118 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:36.245009 26688 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:19:36.257879 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 88259.1us
I20260709 12:19:36.258558 26630 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3.
I20260709 12:19:36.261631 25168 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:36.263392 26717 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:36.263768 26717 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.264109 26717 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.266187 26688 raft_consensus.cc:697] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:36.267215 26688 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.267788 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:36.268333 25275 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.266253 26697 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.265492 26548 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.279225 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:36.281971 26617 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.284961 26548 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.284960 26617 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:36.285902 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:36.285009 25118 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 2: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:19:36.286621 25120 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:19:36.289158 25275 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:19:36.292764 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:36.260010 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:36.310097 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:36.313982 25202 raft_consensus.cc:2393] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:36.315032 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:36.316504 25275 raft_consensus.cc:2368] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3.
I20260709 12:19:36.315570 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:36.285902 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:36.322711 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:36.323309 25195 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:19:36.327489 25272 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:36.303267 26719 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:36.334703 26719 raft_consensus.cc:697] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:36.335557 26719 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.319048 26630 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.338426 26630 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.338685 25022 catalog_manager.cc:5697] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.341114 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:36.340471 26630 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.342422 25851 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:19:36.318313 26718 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.343465 26718 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.345489 26718 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:36.352413 26542 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.353010 26542 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.356130 26542 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.355512 25023 catalog_manager.cc:5697] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 3 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.359090 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:36.356922 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:36.357733 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:36.366178 25202 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:36.365756 25241 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:36.367553 25093 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:36.368270 26542 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:36.368397 25272 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:36.368680 26542 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.369059 26542 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.376246 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:36.376696 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:36.376967 25269 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:36.377257 25275 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:36.378528 25165 leader_election.cc:400] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3.
I20260709 12:19:36.379642 25165 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:19:36.383829 25165 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:19:36.389397 25272 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:36.383749 26678 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:36.381325 26617 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:36.405149 26617 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.405668 26617 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.408972 25118 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:36.409572 26574 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:36.412128 26542 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.420248 26576 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:36.421566 26542 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.424258 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:36.424834 25275 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.413152 25023 catalog_manager.cc:5697] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.329123 26717 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.434221 26548 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:19:36.435994 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 52242.3us
I20260709 12:19:36.438690 25275 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:19:36.440693 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:36.440011 25090 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:36.450438 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:36.456141 25200 raft_consensus.cc:1240] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:36.457154 26717 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:36.458972 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 72961.3us
I20260709 12:19:36.434823 26548 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.466238 26602 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:36.466782 26602 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:36.467694 26602 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.471704 26717 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:36.472137 26717 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.472478 26717 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.444154 26688 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:36.459411 26678 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:36.462165 26548 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.476114 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:36.480154 25124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:36.490175 26716 consensus_queue.cc:1059] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:19:36.485136 26688 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.505141 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:36.504513 25124 raft_consensus.cc:606] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:36.512743 26678 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.531498 26688 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.534008 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:36.534866 25272 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:36.536446 25090 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:36.538272 26574 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:36.538784 26574 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:36.539254 26574 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:36.588873 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 84715.7us
I20260709 12:19:36.599824 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:36.596885 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:36.602609 26574 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.607120 26574 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.610885 26718 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:36.614527 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:36.626561 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:36.601361 26717 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.609851 26548 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:36.696185 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 57324.8us
I20260709 12:19:36.701140 26696 raft_consensus.cc:3055] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:36.701623 26696 raft_consensus.cc:740] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:36.702863 26696 consensus_queue.cc:260] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.605898 26617 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:36.704092 26736 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:19:36.706128 26617 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:36.710146 26548 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:36.710760 25201 raft_consensus.cc:2368] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3.
I20260709 12:19:36.711774 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:36.703436 26717 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:36.714483 25851 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.720785 25275 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:36.727113 25272 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:36.750257 25022 catalog_manager.cc:5697] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.753034 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:36.753325 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:36.753682 25275 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.756348 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:36.756922 25126 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.757923 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:36.758572 25272 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.762070 25269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:36.772616 25858 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:36.779155 26728 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:36.788188 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:36.788955 25198 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.788189 25272 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:36.795143 26696 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.726336 26643 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 12:19:36.791895 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 304018us
I20260709 12:19:36.803651 25272 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:19:36.805904 26643 consensus_queue.cc:1059] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:36.806977 26716 raft_consensus.cc:3055] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:36.807365 26716 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:36.808256 26716 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.809329 26716 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.787941 25126 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:36.809927 25024 catalog_manager.cc:5697] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.822597 25275 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:36.823052 25269 raft_consensus.cc:606] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:36.823390 25269 raft_consensus.cc:614] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:36.821255 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:36.826820 25273 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:36.827095 25200 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:36.828135 25198 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:36.816498 25851 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:36.846746 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:19:36.852501 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 108508us
I20260709 12:19:36.872040 25093 leader_election.cc:400] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3.
I20260709 12:19:36.851791 26678 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:36.881804 25165 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:36.857957 26617 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:36.901587 26617 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:36.887398 25090 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:36.922814 26617 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.918517 26728 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:36.897660 26678 raft_consensus.cc:697] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:36.926527 26728 raft_consensus.cc:697] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:36.927451 26678 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:36.897301 26690 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:19:36.902423 25852 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:36.938102 25275 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:19:36.939594 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 45385.4us
W20260709 12:19:36.941488 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 80755.6us
W20260709 12:19:36.944904 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 64355.5us
I20260709 12:19:36.946674 25275 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:36.947885 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:36.946118 26495 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:36.978434 25200 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:36.978855 25200 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:36.979517 25202 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:36.979594 25200 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:36.944355 26723 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:19:36.994632 26728 consensus_queue.cc:237] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:37.018649 25200 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:37.022660 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 64154.4us
I20260709 12:19:37.026263 26495 raft_consensus.cc:697] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:19:37.031936 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 85031.3us
I20260709 12:19:37.041870 25200 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:19:37.042452 25200 pending_rounds.cc:85] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 1
I20260709 12:19:37.042788 25200 pending_rounds.cc:107] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:19:37.043115 25200 raft_consensus.cc:2889] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:37.046677 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 58222.3us
I20260709 12:19:37.052451 25854 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:37.107082 26495 consensus_queue.cc:237] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:37.113404 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 47237.9us
I20260709 12:19:37.069752 26688 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:19:37.122591 26758 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:19:37.131970 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 54921.9us
I20260709 12:19:37.116904 26751 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:19:37.201239 26697 raft_consensus.cc:993] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:37.201840 26697 raft_consensus.cc:1081] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:37.248437 25272 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:37.286801 25275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:37.287405 25275 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:37.287746 25275 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:37.300258 25124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:37.301047 25124 raft_consensus.cc:606] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:37.321928 26744 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:19:37.323580 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 71292.3us
I20260709 12:19:37.324563 26763 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:37.329885 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:37.331851 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:37.332674 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:37.340680 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 98761.6us
I20260709 12:19:37.395159 26751 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:37.397099 26697 raft_consensus.cc:993] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:37.397619 26697 raft_consensus.cc:1081] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:37.433347 25272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:37.433971 25272 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:37.434974 25272 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:37.413491 25275 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:37.444844 25276 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:37.445880 25275 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:37.447239 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:37.449318 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:37.450280 25120 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:37.450639 25120 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:37.451462 25120 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:37.452421 25120 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:37.459394 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.469889 25272 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:37.487998 25194 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:37.491966 25022 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 2 to 4, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195), now has a pending config: VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193), VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194), VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195), VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:37.495050 25120 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:19:37.489495 25023 catalog_manager.cc:5697] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:37.501538 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:37.501981 25272 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:37.501863 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:37.503692 25126 raft_consensus.cc:3055] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:37.504106 25126 raft_consensus.cc:740] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:37.505136 25126 consensus_queue.cc:260] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:37.506273 26759 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:37.506767 26759 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:37.506703 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:37.507112 25126 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:37.507597 25854 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:37.508721 26754 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:19:37.509255 26759 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:37.513815 25856 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:37.516484 25118 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:37.517141 26726 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:37.521404 25854 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:37.523607 26748 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:37.529495 25241 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:37.530412 26748 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:37.531137 26748 raft_consensus.cc:697] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:37.532413 26748 consensus_queue.cc:237] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:37.544222 25126 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:37.553254 26759 raft_consensus.cc:2955] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:37.596698 25272 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:37.557112 25194 raft_consensus.cc:2955] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:37.602469 26678 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:19:37.619458 25126 raft_consensus.cc:3055] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:37.619834 25126 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:37.620532 25126 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:37.621454 25126 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:37.627188 25856 raft_consensus.cc:2955] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:37.632323 25126 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:19:37.634593 25126 pending_rounds.cc:85] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 1
I20260709 12:19:37.644860 25126 pending_rounds.cc:107] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:19:37.645265 25126 raft_consensus.cc:2889] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:37.647053 26678 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:37.656877 25268 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:37.658499 26723 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:37.694528 25856 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:19:37.695171 25856 pending_rounds.cc:85] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 5
I20260709 12:19:37.695400 25856 pending_rounds.cc:107] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:19:37.695628 25856 raft_consensus.cc:2889] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:37.700807 25126 raft_consensus.cc:2955] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:37.707116 26723 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:19:37.751916 25025 catalog_manager.cc:5697] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 3 to 4, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:37.754556 25025 catalog_manager.cc:5697] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 3, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:37.829489 25024 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 2 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193), VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194), VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195), VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:37.856986 25022 catalog_manager.cc:5697] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 4 to 5, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 5 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:37.862735 25022 catalog_manager.cc:5697] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:37.913437 25273 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:37.920092 25200 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:37.921650 26754 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:37.927134 25851 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:37.929039 26759 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:37.933408 26748 raft_consensus.cc:2955] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:37.940251 25851 raft_consensus.cc:2955] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:37.952844 25856 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:37.960582 25856 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:19:37.962172 26726 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:37.972952 25120 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:19:37.975067 26652 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:37.975772 25200 raft_consensus.cc:2955] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:37.980638 26763 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:37.981375 26763 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:37.984243 26763 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:37.989656 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:37.990584 25194 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:38.002326 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:38.003147 25851 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:19:38.034164 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:38.035637 26751 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:38.036079 26751 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:38.036471 26751 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:38.039283 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d4c46d8dc974803aa09fb2a6515ca35 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:38.044298 26751 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:38.051211 26751 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:38.060344 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:38.061264 25194 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:38.062842 25023 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 4 to 6, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:38.075126 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:38.105635 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d4c46d8dc974803aa09fb2a6515ca35 with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:38.112208 25126 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:38.114100 26748 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:38.116535 26791 tablet_replica.cc:333] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:38.119175 26791 raft_consensus.cc:2243] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.124770 26791 raft_consensus.cc:2272] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.130409 25856 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:38.131022 26791 ts_tablet_manager.cc:1916] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:38.132228 26754 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:38.187901 25851 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:19:38.208081 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:38.209457 26744 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:38.209987 26744 raft_consensus.cc:697] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:38.210916 26744 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:38.213826 26791 ts_tablet_manager.cc:1929] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:19:38.214464 26791 log.cc:1199] T 2d4c46d8dc974803aa09fb2a6515ca35 P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/2d4c46d8dc974803aa09fb2a6515ca35
I20260709 12:19:38.223481 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet 2d4c46d8dc974803aa09fb2a6515ca35 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:38.241968 25023 catalog_manager.cc:5697] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 3 to 4, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 4 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:38.333577 26728 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.334264 26728 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:38.337037 26728 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:38.338061 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:38.349354 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:38.350466 25856 raft_consensus.cc:2410] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:38.356302 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:38.358489 26728 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:38.485057 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:38.548936 25126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08989457946a4946811751dc96e31276"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:38.549573 25126 raft_consensus.cc:606] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:38.554332 25268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:38.555106 25268 raft_consensus.cc:606] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:38.559145 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b13f2e891f348229e95286682b88911"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:38.559703 25200 raft_consensus.cc:606] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:19:38.562667 25126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c305b34a0c54275af750c832f52691f"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:38.563235 25126 raft_consensus.cc:606] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:38.566398 25126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:38.566932 25126 raft_consensus.cc:606] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:38.568226 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:38.570225 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:38.574107 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:38.618716 26751 raft_consensus.cc:993] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:38.619303 26751 raft_consensus.cc:1081] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:38.620846 25268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08989457946a4946811751dc96e31276"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:38.621449 25268 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:38.621815 25268 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:38.647959 26690 raft_consensus.cc:993] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:38.648501 26690 raft_consensus.cc:1081] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:38.655591 25126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b13f2e891f348229e95286682b88911"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:19:38.656170 25126 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:38.656497 25126 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:38.662891 25126 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:38.664685 25126 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:38.666167 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:38.666731 25273 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:38.670789 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:38.671487 25194 raft_consensus.cc:3055] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:38.671862 25194 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:38.678149 25268 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:38.684830 25268 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:38.687580 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:38.691248 25200 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:38.699154 25200 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:38.700904 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:38.702626 26748 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:38.703166 26748 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:38.704110 26748 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:38.692049 25194 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:38.719288 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:38.719816 25120 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:38.720093 25120 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:38.720299 25273 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:19:38.721496 25090 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:38.720741 25120 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:38.722410 26744 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:38.723006 25120 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:38.723381 26744 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:38.724717 26744 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:38.726135 25194 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:38.727741 26751 raft_consensus.cc:993] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:38.728184 26751 raft_consensus.cc:1081] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:38.732203 25856 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46498
I20260709 12:19:38.732757 25856 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:38.733096 25856 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:38.741487 25856 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:38.744376 25120 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:38.741475 25194 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:19:38.751487 25856 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:38.752571 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:38.755216 25194 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:38.755065 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:38.757369 25120 raft_consensus.cc:3055] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:38.757706 25120 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:38.758522 25120 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:38.759773 25120 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:38.755826 25023 catalog_manager.cc:5697] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:38.765893 25025 catalog_manager.cc:5697] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 2 to 3, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:38.778440 25120 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:38.767436 25194 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:38.779829 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:38.782305 26643 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:38.782830 26643 raft_consensus.cc:697] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:38.783725 26643 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:38.788430 25194 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:38.790483 26751 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:38.794710 25194 raft_consensus.cc:2955] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:38.806079 26763 raft_consensus.cc:993] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:38.806630 26763 raft_consensus.cc:1081] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:38.809684 25273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c305b34a0c54275af750c832f52691f"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:38.810261 25273 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:38.810616 25273 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:38.818792 25273 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:38.834414 25273 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:38.835433 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:38.836040 25198 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:38.839581 25854 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:38.841634 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:38.844784 25120 raft_consensus.cc:3055] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:38.845208 25120 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:38.846099 25120 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:38.847522 25120 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:38.849529 26751 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:38.844182 25198 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:38.851019 25242 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:38.851810 26759 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:38.852308 26759 raft_consensus.cc:697] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:38.853127 26759 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:38.862447 25120 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:38.866829 25024 catalog_manager.cc:5697] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:38.947080 25023 catalog_manager.cc:5697] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:39.094132 26726 raft_consensus.cc:993] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:39.094655 26739 raft_consensus.cc:1081] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:39.097254 25856 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:19:39.097913 25856 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:39.099442 25856 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:39.104231 25856 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:39.107033 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:39.107228 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:39.107709 25194 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:39.108122 25856 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:39.107758 25272 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:39.108508 25272 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:39.109289 25272 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:39.110497 25272 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:39.115888 25194 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:19:39.124854 25272 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:19:39.126066 25822 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:39.127913 26696 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:39.138947 26696 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:39.139950 26696 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:39.156090 25200 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:39.160197 26739 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:39.185221 25126 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:39.187259 26643 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:39.195829 25022 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 5, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 5 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:39.214347 25268 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:39.221537 26751 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:39.224776 25194 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:39.236999 25194 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:39.239017 26751 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:39.248554 26643 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:39.268355 25120 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:39.270063 26748 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:39.331341 25126 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:39.333214 26739 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:39.413726 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 46884.8us
I20260709 12:19:39.440824 25120 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:39.455626 25201 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:39.474133 25268 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:39.475440 25202 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:39.476994 26751 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:39.478185 26744 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:19:39.485056 25092 consensus_peers.cc:597] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fb0b452100949b58ad2bf4a4aed36fa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:39.498728 26726 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:39.548820 25202 raft_consensus.cc:2955] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:39.536783 26763 raft_consensus.cc:2955] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:39.563414 25268 raft_consensus.cc:2955] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:39.595778 25120 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:39.594547 25021 catalog_manager.cc:5697] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 2 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:39.601781 25201 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:39.603330 26819 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:19:39.606582 25092 consensus_peers.cc:597] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b13f2e891f348229e95286682b88911. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:39.610477 25202 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:39.618700 25268 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:39.622201 26763 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:19:39.625771 26744 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:39.634545 26751 raft_consensus.cc:2955] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:39.641170 25272 raft_consensus.cc:2955] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:39.648545 25194 raft_consensus.cc:2955] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:39.663487 25268 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:39.665457 26643 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:39.685963 25127 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:39.731545 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:39.747936 25022 catalog_manager.cc:5697] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 4, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:39.780857 25194 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:39.789212 26744 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:19:39.802996 25273 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:39.813886 26833 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:19:39.836066 25092 consensus_peers.cc:597] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dba87711b0ab4e3394481dfecfeb886e. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:39.873478 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 73978.7us
I20260709 12:19:39.972496 26837 ts_tablet_manager.cc:933] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:39.991255 26837 tablet_copy_client.cc:323] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:39.993499 25137 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet 4fb0b452100949b58ad2bf4a4aed36fa from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:39.994197 25137 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet 4fb0b452100949b58ad2bf4a4aed36fa from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-4fb0b452100949b58ad2bf4a4aed36fa
I20260709 12:19:40.003355 26744 raft_consensus.cc:2955] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:40.004769 25272 raft_consensus.cc:2955] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:40.005995 25194 raft_consensus.cc:2955] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:40.037755 25137 tablet_copy_source_session.cc:215] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:40.047983 25025 catalog_manager.cc:5697] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.050930 26837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fb0b452100949b58ad2bf4a4aed36fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.041548 25272 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:40.072681 26837 tablet_copy_client.cc:806] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:40.073482 26837 tablet_copy_client.cc:670] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:40.079152 26837 tablet_copy_client.cc:538] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:40.094935 26837 tablet_bootstrap.cc:492] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
W20260709 12:19:40.095796 25241 consensus_peers.cc:597] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f120f7a3d32426ab1243e87fe0194ac. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:40.097191 25194 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:40.107089 26754 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:40.130929 25126 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:40.143311 26726 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:40.168118 26837 tablet_bootstrap.cc:492] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:40.177456 26837 tablet_bootstrap.cc:492] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:40.186250 25273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "392ec479375b41bbb38793a0c207912d"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:40.187070 25273 raft_consensus.cc:606] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:40.186842 26739 raft_consensus.cc:2955] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:40.189683 26837 ts_tablet_manager.cc:1403] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.012s
I20260709 12:19:40.196117 25126 raft_consensus.cc:2955] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:40.202380 26837 raft_consensus.cc:359] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:40.203732 26837 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:40.205027 26837 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:40.213153 26837 ts_tablet_manager.cc:1434] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:19:40.220078 25137 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-4fb0b452100949b58ad2bf4a4aed36fa received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:40.221931 25137 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-4fb0b452100949b58ad2bf4a4aed36fa on tablet 4fb0b452100949b58ad2bf4a4aed36fa with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:40.225347 25273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:40.225948 25273 raft_consensus.cc:606] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:40.235381 25126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:40.236012 25126 raft_consensus.cc:606] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:40.238132 26843 ts_tablet_manager.cc:933] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:40.240007 25022 catalog_manager.cc:5697] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:40.242105 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:40.246832 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:40.248020 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:40.257520 25200 raft_consensus.cc:2955] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:40.283753 26843 tablet_copy_client.cc:323] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:40.286433 25137 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet 6b13f2e891f348229e95286682b88911 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:40.287075 25137 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet 6b13f2e891f348229e95286682b88911 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-6b13f2e891f348229e95286682b88911
I20260709 12:19:40.305181 26837 ts_tablet_manager.cc:933] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:40.319242 25137 tablet_copy_source_session.cc:215] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:40.320474 25854 raft_consensus.cc:1217] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:19:40.323788 26843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b13f2e891f348229e95286682b88911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.328683 26837 tablet_copy_client.cc:323] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:40.332561 25137 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet dba87711b0ab4e3394481dfecfeb886e from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:40.333159 25137 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet dba87711b0ab4e3394481dfecfeb886e from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-dba87711b0ab4e3394481dfecfeb886e
I20260709 12:19:40.358507 26843 tablet_copy_client.cc:806] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:40.362830 25137 tablet_copy_source_session.cc:215] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:40.359108 26843 tablet_copy_client.cc:670] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:40.369691 26837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba87711b0ab4e3394481dfecfeb886e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.375583 26843 tablet_copy_client.cc:538] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:40.399742 26843 tablet_bootstrap.cc:492] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:40.423683 26837 tablet_copy_client.cc:806] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:40.424319 26837 tablet_copy_client.cc:670] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:40.428131 26837 tablet_copy_client.cc:538] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:40.456357 26759 raft_consensus.cc:993] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:40.456884 26759 raft_consensus.cc:1081] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:40.468233 25200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36436
I20260709 12:19:40.468863 25200 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:40.469239 25200 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.477813 26843 tablet_bootstrap.cc:492] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:40.478787 26843 tablet_bootstrap.cc:492] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:40.479419 26843 ts_tablet_manager.cc:1403] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.080s	user 0.029s	sys 0.000s
I20260709 12:19:40.480607 26837 tablet_bootstrap.cc:492] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:40.482558 26843 raft_consensus.cc:359] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:40.483690 26843 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:40.484098 25200 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:40.487315 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:40.487534 25200 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:40.487974 25127 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.491972 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:40.492565 25273 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:40.492871 25273 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:40.493729 25273 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:40.495419 25127 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:40.496608 25273 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.496942 26744 raft_consensus.cc:993] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:40.496837 25168 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:40.497460 26744 raft_consensus.cc:1081] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:40.497918 26830 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.498536 26830 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:40.499512 25272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:40.500151 25272 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:40.500500 25272 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:40.499469 26830 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:40.484432 26843 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:40.522413 25273 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:40.516927 25272 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:40.525846 26843 ts_tablet_manager.cc:1434] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:19:40.527732 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:40.528301 25127 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:40.528586 25127 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:40.529385 25127 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:40.531906 25136 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-6b13f2e891f348229e95286682b88911 received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:40.532044 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:40.532373 25136 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-6b13f2e891f348229e95286682b88911 on tablet 6b13f2e891f348229e95286682b88911 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:40.532617 25200 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:40.536728 25127 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:40.542303 25200 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:40.543591 25242 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:40.544474 26834 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:40.544902 25127 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:40.544970 26834 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:40.551785 26834 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:40.556926 26726 raft_consensus.cc:993] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:40.557382 26726 raft_consensus.cc:1081] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:40.562871 25202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "392ec479375b41bbb38793a0c207912d"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36436
I20260709 12:19:40.563501 25202 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:40.563896 25202 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:40.546094 25272 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:40.579690 25202 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:40.581118 25022 catalog_manager.cc:5697] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.583074 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:40.583639 25127 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:40.584173 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:40.584700 25272 raft_consensus.cc:3055] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:40.584976 25272 raft_consensus.cc:740] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:40.589098 25025 catalog_manager.cc:5697] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 4, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.591677 25127 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:40.592996 25168 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:40.595268 26830 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:40.598168 26830 raft_consensus.cc:697] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:40.598389 26837 tablet_bootstrap.cc:492] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:40.597101 25272 consensus_queue.cc:260] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:40.599368 26837 tablet_bootstrap.cc:492] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:40.599668 25272 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:40.600104 26837 ts_tablet_manager.cc:1403] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.120s	user 0.029s	sys 0.013s
I20260709 12:19:40.600437 26830 consensus_queue.cc:237] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:40.601186 25202 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:40.617276 25272 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:40.649605 25025 catalog_manager.cc:5697] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.651809 26837 raft_consensus.cc:359] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:40.654065 26837 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:40.654841 26837 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:40.670089 26837 ts_tablet_manager.cc:1434] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.001s
I20260709 12:19:40.672179 25136 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-dba87711b0ab4e3394481dfecfeb886e received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:40.672592 25136 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-dba87711b0ab4e3394481dfecfeb886e on tablet dba87711b0ab4e3394481dfecfeb886e with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:40.674156 26843 ts_tablet_manager.cc:933] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:40.677793 26843 tablet_copy_client.cc:323] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
I20260709 12:19:40.680513 25285 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet 7f120f7a3d32426ab1243e87fe0194ac from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:40.681190 25285 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet 7f120f7a3d32426ab1243e87fe0194ac from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-7f120f7a3d32426ab1243e87fe0194ac
I20260709 12:19:40.697989 25285 tablet_copy_source_session.cc:215] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:40.714877 26843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f120f7a3d32426ab1243e87fe0194ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.716148 25854 raft_consensus.cc:1217] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:19:40.727304 26751 raft_consensus.cc:1064] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:40.731173 26751 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:40.743598 26843 tablet_copy_client.cc:806] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:40.746496 26843 tablet_copy_client.cc:670] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:40.754509 26843 tablet_copy_client.cc:538] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:40.761780 25854 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:40.763521 26744 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:40.773689 25272 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:40.775601 26751 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:40.776597 25194 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:40.780862 26744 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:40.806797 26843 tablet_bootstrap.cc:492] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:40.840396 26825 raft_consensus.cc:2955] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:40.841768 25194 raft_consensus.cc:2955] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:40.863379 25025 catalog_manager.cc:5697] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:40.877127 25854 raft_consensus.cc:2955] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:40.889570 25126 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:40.919894 25194 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:40.947501 25268 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:40.948975 26830 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:40.950963 25200 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:40.953189 26833 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:19:40.957904 26754 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:40.961035 25851 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Advancing to term 4
I20260709 12:19:40.972862 25851 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:41.010069 25127 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.013099 26856 raft_consensus.cc:2955] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.037158 26690 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.040122 26739 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:41.064407 25268 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:41.067507 26690 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:41.046370 25194 raft_consensus.cc:2955] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.142797 26759 raft_consensus.cc:1064] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:41.145300 26759 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:41.146453 25118 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:41.115373 25126 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:41.155697 25858 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:41.160737 26759 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:41.164629 25200 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:41.167523 25127 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:41.170989 26728 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:41.194898 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4fb0b452100949b58ad2bf4a4aed36fa with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:41.199579 26834 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:41.203343 25852 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:41.224030 26754 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:41.225868 26843 tablet_bootstrap.cc:492] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:41.226913 26843 tablet_bootstrap.cc:492] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:41.229553 26843 ts_tablet_manager.cc:1403] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.423s	user 0.080s	sys 0.139s
I20260709 12:19:41.233229 26843 raft_consensus.cc:359] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:41.234239 26843 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:41.234935 26843 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:41.241384 26843 ts_tablet_manager.cc:1434] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:19:41.244083 25285 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-7f120f7a3d32426ab1243e87fe0194ac received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:41.244578 25285 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-7f120f7a3d32426ab1243e87fe0194ac on tablet 7f120f7a3d32426ab1243e87fe0194ac with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:41.267376 25025 catalog_manager.cc:5697] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 2 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.272367 26744 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:41.271943 26739 raft_consensus.cc:2955] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.275547 25200 raft_consensus.cc:2955] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.341169 25025 catalog_manager.cc:5697] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 3 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:41.297199 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fb0b452100949b58ad2bf4a4aed36fa with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:41.323705 25852 raft_consensus.cc:2955] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.358886 25854 raft_consensus.cc:2955] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.364652 26825 raft_consensus.cc:1064] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:41.367851 26825 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:41.391855 26869 tablet_replica.cc:333] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:41.393723 26869 raft_consensus.cc:2243] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:41.394428 26869 pending_rounds.cc:70] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Trying to abort 1 pending ops.
I20260709 12:19:41.394757 26869 pending_rounds.cc:77] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting op as it isn't in flight: id { term: 2 index: 4 } timestamp: 7305623882663677952 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" old_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } } new_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } } }
I20260709 12:19:41.396107 26869 raft_consensus.cc:2917] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted
I20260709 12:19:41.396559 26869 raft_consensus.cc:2889] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:19:41.422451 25200 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:41.429335 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:41.434966 25272 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:41.435494 26869 raft_consensus.cc:2272] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:41.439486 26744 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:41.449149 26751 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:41.459529 25852 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:41.471391 26825 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:41.475499 25272 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:41.443018 25127 raft_consensus.cc:2955] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.505201 25852 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:41.507253 26739 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:41.512126 26869 ts_tablet_manager.cc:1916] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:41.514954 26834 raft_consensus.cc:2955] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.538717 26751 raft_consensus.cc:2955] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.545557 25854 raft_consensus.cc:2955] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.552007 25194 raft_consensus.cc:2955] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.554126 25852 raft_consensus.cc:2955] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.585692 25025 catalog_manager.cc:5697] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 4 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.607591 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dba87711b0ab4e3394481dfecfeb886e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:41.616504 25273 raft_consensus.cc:2955] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.626641 25118 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:41.631659 25024 catalog_manager.cc:5697] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 5 to 6, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:41.643172 26834 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:41.663461 25118 raft_consensus.cc:2955] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.672386 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet dba87711b0ab4e3394481dfecfeb886e with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:41.718165 26869 ts_tablet_manager.cc:1929] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:19:41.726562 26869 log.cc:1199] T 4fb0b452100949b58ad2bf4a4aed36fa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/4fb0b452100949b58ad2bf4a4aed36fa
I20260709 12:19:41.729487 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet 4fb0b452100949b58ad2bf4a4aed36fa (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:41.749202 25127 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:41.756629 25854 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:41.758565 26744 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:41.763244 25273 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:41.766016 26744 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:19:41.882388 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 207225us
I20260709 12:19:41.888742 26877 tablet_replica.cc:333] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:41.921687 26825 raft_consensus.cc:2955] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:41.957841 26877 raft_consensus.cc:2243] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:41.973553 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 197123us
I20260709 12:19:41.977501 26877 raft_consensus.cc:2272] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:41.967345 25024 catalog_manager.cc:5697] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 5 to 6, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.988534 26877 ts_tablet_manager.cc:1916] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:41.987749 25268 raft_consensus.cc:2955] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:42.004565 25852 raft_consensus.cc:1217] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:42.038203 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b13f2e891f348229e95286682b88911 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:42.032424 25268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08989457946a4946811751dc96e31276"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:42.044370 25268 raft_consensus.cc:606] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:19:42.067242 25858 raft_consensus.cc:2955] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:42.069849 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:42.070562 25200 raft_consensus.cc:606] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:42.075665 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:42.076285 25200 raft_consensus.cc:606] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:42.077487 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:42.079604 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:42.080400 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:42.083910 26875 raft_consensus.cc:993] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:42.084393 26875 raft_consensus.cc:1081] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:42.089196 25854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46474
I20260709 12:19:42.089735 25854 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:42.090147 25854 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.100477 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b13f2e891f348229e95286682b88911 with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:42.114861 26882 raft_consensus.cc:993] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:42.115478 26728 raft_consensus.cc:1081] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:42.119112 25268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40096
I20260709 12:19:42.119797 25268 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:42.120227 25268 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.113819 25854 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:42.138546 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:42.139135 25200 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:42.139415 25200 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:42.140153 25200 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:42.141269 25200 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.148576 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:42.154167 25274 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.161674 25274 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:42.149094 25200 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:42.185102 25822 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:42.186167 26876 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:42.186688 26876 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:42.187558 26876 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:42.193647 26739 raft_consensus.cc:993] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:42.146962 25854 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:42.194420 26739 raft_consensus.cc:1081] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:42.185128 25268 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:42.199168 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:42.199725 25200 raft_consensus.cc:3055] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:42.200129 25200 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:42.200991 25200 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:42.202077 25200 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.204094 25127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08989457946a4946811751dc96e31276"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41032
I20260709 12:19:42.204661 25127 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:42.204968 25127 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:42.197971 25268 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:42.212834 25127 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:42.215652 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:42.215855 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:42.216210 25194 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:42.216564 25274 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:42.216910 25274 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:42.217757 25274 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:42.218890 25274 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:42.223249 25194 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:19:42.224745 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:42.225533 26856 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:42.225979 26856 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:42.226897 26856 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:42.234095 25274 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:19:42.237139 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:42.237859 25118 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.239189 26877 ts_tablet_manager.cc:1929] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:19:42.239611 26877 log.cc:1199] T dba87711b0ab4e3394481dfecfeb886e P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/dba87711b0ab4e3394481dfecfeb886e
I20260709 12:19:42.241358 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet dba87711b0ab4e3394481dfecfeb886e (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:42.241634 25127 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:42.245203 25118 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:42.241379 26877 tablet_replica.cc:333] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:42.250226 25242 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:42.251020 26754 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:42.251528 26754 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:42.252445 26754 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:42.258761 25200 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:42.260121 25024 catalog_manager.cc:5697] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 2 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:42.261724 26877 raft_consensus.cc:2243] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:42.262704 26877 raft_consensus.cc:2272] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:42.264642 25025 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 3 to 4, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 4 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:42.276830 25023 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 4, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:42.287849 26877 ts_tablet_manager.cc:1916] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:42.309182 26877 ts_tablet_manager.cc:1929] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:19:42.309633 26877 log.cc:1199] T 6b13f2e891f348229e95286682b88911 P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/6b13f2e891f348229e95286682b88911
I20260709 12:19:42.311300 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet 6b13f2e891f348229e95286682b88911 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:42.448132 26759 raft_consensus.cc:1064] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:42.450665 26759 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:42.486238 25858 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:42.494840 25127 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:42.495967 26759 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:42.497731 26834 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:42.499183 25200 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:42.502707 26881 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:19:42.593429 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 52382.3us
I20260709 12:19:42.595005 26739 raft_consensus.cc:2955] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:42.605108 25127 raft_consensus.cc:2955] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:42.618773 25854 raft_consensus.cc:2955] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:42.626464 25024 catalog_manager.cc:5697] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:42.645788 25200 raft_consensus.cc:2955] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:42.653594 25274 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:42.665668 26833 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:42.667618 25274 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:42.673645 25200 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:42.674429 25858 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:42.675814 26834 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:42.676826 26833 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:42.684594 25194 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:42.685022 25202 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:42.686167 26739 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:42.687988 26754 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:42.690174 26834 raft_consensus.cc:2955] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:42.695864 25858 raft_consensus.cc:2955] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:42.702594 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7f120f7a3d32426ab1243e87fe0194ac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:42.722476 25200 raft_consensus.cc:2955] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:42.740072 25127 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:42.743551 26759 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:42.749488 25025 catalog_manager.cc:5697] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 3 to 4, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 1 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:42.756443 25200 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:42.757947 26876 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:42.773083 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f120f7a3d32426ab1243e87fe0194ac with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:42.785660 25274 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:42.789765 26876 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:42.802699 26903 tablet_replica.cc:333] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:42.804783 26903 raft_consensus.cc:2243] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:42.805647 26903 raft_consensus.cc:2272] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:42.839459 26903 ts_tablet_manager.cc:1916] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:42.856122 26903 ts_tablet_manager.cc:1929] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:42.856606 26903 log.cc:1199] T 7f120f7a3d32426ab1243e87fe0194ac P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/7f120f7a3d32426ab1243e87fe0194ac
I20260709 12:19:42.858419 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet 7f120f7a3d32426ab1243e87fe0194ac (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:43.314062 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:43.377883 25268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c305b34a0c54275af750c832f52691f"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:43.378539 25268 raft_consensus.cc:606] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:43.381016 25127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:19:43.381460 25127 raft_consensus.cc:606] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:43.382553 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:43.384390 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:43.385165 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:43.398636 26906 raft_consensus.cc:993] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:43.399219 26739 raft_consensus.cc:1081] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:43.401060 25200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c305b34a0c54275af750c832f52691f"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36436
I20260709 12:19:43.401635 25200 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:43.401975 25200 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:43.409098 25200 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:43.411950 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:43.412608 25127 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:43.419090 25127 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:43.421728 25168 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:43.422638 26879 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:43.423117 26879 raft_consensus.cc:697] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:43.423949 26879 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:43.428117 25200 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:43.431583 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:43.432163 25268 raft_consensus.cc:3055] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:43.432466 25268 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:43.433197 25268 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:43.436142 25268 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:43.446973 25268 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:43.447243 25022 catalog_manager.cc:5697] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.507077 26833 raft_consensus.cc:993] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:43.507583 26825 raft_consensus.cc:1081] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:43.509136 25200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36434
I20260709 12:19:43.509574 25200 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:43.509861 25200 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:43.515128 25200 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:43.517707 25200 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:43.518842 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:43.519479 25126 raft_consensus.cc:3055] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:43.519795 25126 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:43.520596 25126 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:43.522229 25126 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:43.523249 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:43.523841 25854 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:43.533439 25854 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:43.534744 25167 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:43.535823 25126 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:43.536429 26880 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:43.537022 26880 raft_consensus.cc:697] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:43.537936 26880 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:43.552181 25022 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 3, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.858191 25127 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:43.861563 26880 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:43.868268 25118 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:43.909735 25272 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:43.913578 26880 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:19:44.051949 25092 consensus_peers.cc:597] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 951ec28047e64bb7a386c7d66a082fd0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:44.072028 25194 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:44.075183 25124 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:44.078018 25268 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:44.079411 26920 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:44.085630 26920 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:44.088254 26923 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:44.108799 25854 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:44.113718 26923 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:44.119724 26919 raft_consensus.cc:2955] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.123046 25268 raft_consensus.cc:2955] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.139530 25124 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:44.145963 25194 raft_consensus.cc:2955] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.155134 25022 catalog_manager.cc:5697] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
W20260709 12:19:44.168200 25092 consensus_peers.cc:597] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1d4aa6fab2741dda3fcae71491a229a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:44.170897 25274 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:44.172425 26920 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:44.183597 25200 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:44.185004 26920 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:44.195566 26919 raft_consensus.cc:2955] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.202555 25274 raft_consensus.cc:2955] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.230225 25274 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:44.233767 25200 raft_consensus.cc:2955] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.261895 25200 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:19:44.261945 25241 consensus_peers.cc:597] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f698d5eb641d4490aaa13e25382450db. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:44.265071 25124 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:44.265727 26926 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:44.277627 26926 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:44.280637 25023 catalog_manager.cc:5697] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.290426 26739 raft_consensus.cc:2955] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.308990 25194 raft_consensus.cc:2955] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.310326 25124 raft_consensus.cc:2955] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.320156 25274 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:44.327962 25022 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 5, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.347333 25124 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:19:44.347910 25241 consensus_peers.cc:597] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3bde194ca9e544f1befacd3ad39463a2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:44.349176 26943 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:44.349805 25194 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:44.351436 26943 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:44.365907 26943 raft_consensus.cc:2955] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.370077 25202 raft_consensus.cc:2955] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.372058 25118 raft_consensus.cc:2955] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:44.391310 25022 catalog_manager.cc:5697] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.446661 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:44.514380 25202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:44.514884 25202 raft_consensus.cc:606] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:44.517385 25202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:44.517903 25202 raft_consensus.cc:606] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:19:44.519344 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:44.520589 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:44.521421 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:44.675680 26948 ts_tablet_manager.cc:933] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:44.682200 26948 tablet_copy_client.cc:323] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:44.683969 25136 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet 951ec28047e64bb7a386c7d66a082fd0 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:44.684561 25136 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet 951ec28047e64bb7a386c7d66a082fd0 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-951ec28047e64bb7a386c7d66a082fd0
I20260709 12:19:44.691082 25136 tablet_copy_source_session.cc:215] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:44.693866 26948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951ec28047e64bb7a386c7d66a082fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:44.706913 26911 raft_consensus.cc:993] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:44.707443 26911 raft_consensus.cc:1081] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:19:44.709159 25118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:19:44.709651 25118 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:44.709969 25118 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.718977 26948 tablet_copy_client.cc:806] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:44.719640 26948 tablet_copy_client.cc:670] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:44.719585 25118 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:44.722297 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:44.722992 25194 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:44.723281 25194 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:44.723845 25194 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:44.724829 25194 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.722297 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:44.727135 25854 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.746157 25854 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:44.737751 25194 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:44.751521 25093 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:44.752061 25118 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:44.752487 26921 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:44.752995 26921 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:44.766551 26921 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:44.772495 26951 ts_tablet_manager.cc:933] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:44.755486 26948 tablet_copy_client.cc:538] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:44.780432 26950 ts_tablet_manager.cc:933] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:44.791922 26951 tablet_copy_client.cc:323] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
I20260709 12:19:44.793694 25285 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet f698d5eb641d4490aaa13e25382450db from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:44.797592 25285 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet f698d5eb641d4490aaa13e25382450db from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-f698d5eb641d4490aaa13e25382450db
I20260709 12:19:44.800905 25022 catalog_manager.cc:5697] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 2, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.805653 26948 tablet_bootstrap.cc:492] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:44.907612 25285 tablet_copy_source_session.cc:215] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:44.910997 26951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f698d5eb641d4490aaa13e25382450db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:44.948658 26951 tablet_copy_client.cc:806] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:44.950066 26951 tablet_copy_client.cc:670] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:44.956419 26951 tablet_copy_client.cc:538] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:44.963138 26955 ts_tablet_manager.cc:933] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:44.975073 26950 tablet_copy_client.cc:323] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:44.976007 26955 tablet_copy_client.cc:323] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
I20260709 12:19:44.977005 25136 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet b1d4aa6fab2741dda3fcae71491a229a from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:44.977602 25136 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet b1d4aa6fab2741dda3fcae71491a229a from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-b1d4aa6fab2741dda3fcae71491a229a
I20260709 12:19:44.980751 26951 tablet_bootstrap.cc:492] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:44.996896 25136 tablet_copy_source_session.cc:215] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:44.998355 25285 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet 3bde194ca9e544f1befacd3ad39463a2 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:45.001195 25285 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet 3bde194ca9e544f1befacd3ad39463a2 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-3bde194ca9e544f1befacd3ad39463a2
I20260709 12:19:45.003907 26950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d4aa6fab2741dda3fcae71491a229a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:45.016409 26948 tablet_bootstrap.cc:492] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:45.017470 26948 tablet_bootstrap.cc:492] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:45.018745 26948 ts_tablet_manager.cc:1403] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.213s	user 0.029s	sys 0.032s
I20260709 12:19:45.030112 26880 raft_consensus.cc:993] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:45.030647 26880 raft_consensus.cc:1081] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:45.030802 26948 raft_consensus.cc:359] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:45.033017 26948 raft_consensus.cc:740] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:45.033175 25274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40096
I20260709 12:19:45.033702 25274 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:45.032642 25285 tablet_copy_source_session.cc:215] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:45.034924 25274 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:45.033813 26948 consensus_queue.cc:260] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:45.037281 26948 ts_tablet_manager.cc:1434] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:19:45.040318 25136 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-951ec28047e64bb7a386c7d66a082fd0 received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:45.040819 25136 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-951ec28047e64bb7a386c7d66a082fd0 on tablet 951ec28047e64bb7a386c7d66a082fd0 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:45.042615 26955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bde194ca9e544f1befacd3ad39463a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:45.046300 25274 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:45.049072 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:45.049574 25118 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:45.051653 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:45.052255 25194 raft_consensus.cc:3055] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:45.052557 25194 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:45.053582 25194 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:45.054913 25194 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:45.060007 25274 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:45.066766 25118 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:45.069661 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:45.074493 26739 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:45.075062 26739 raft_consensus.cc:697] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:45.075979 26739 consensus_queue.cc:237] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:45.079766 25852 raft_consensus.cc:1217] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:19:45.097615 25194 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:45.100908 26955 tablet_copy_client.cc:806] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:45.101625 26955 tablet_copy_client.cc:670] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:45.105497 26955 tablet_copy_client.cc:538] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:45.113678 26950 tablet_copy_client.cc:806] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:45.123376 26950 tablet_copy_client.cc:670] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:45.130724 26951 tablet_bootstrap.cc:492] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:45.131727 26951 tablet_bootstrap.cc:492] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:45.132426 26951 ts_tablet_manager.cc:1403] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.009s
I20260709 12:19:45.136312 26950 tablet_copy_client.cc:538] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:45.143990 26955 tablet_bootstrap.cc:492] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:45.148821 26951 raft_consensus.cc:359] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:45.149693 26951 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:45.157641 26950 tablet_bootstrap.cc:492] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:45.150332 26951 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:45.176455 26951 ts_tablet_manager.cc:1434] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:19:45.181391 25285 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-f698d5eb641d4490aaa13e25382450db received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:45.181842 25285 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-f698d5eb641d4490aaa13e25382450db on tablet f698d5eb641d4490aaa13e25382450db with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:45.184731 25022 catalog_manager.cc:5697] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 4, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:45.224968 26955 tablet_bootstrap.cc:492] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:45.225804 26955 tablet_bootstrap.cc:492] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:45.226516 26955 ts_tablet_manager.cc:1403] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.007s
I20260709 12:19:45.229269 26950 tablet_bootstrap.cc:492] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:45.230214 26950 tablet_bootstrap.cc:492] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:45.230880 26950 ts_tablet_manager.cc:1403] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.073s	user 0.019s	sys 0.008s
I20260709 12:19:45.233839 26950 raft_consensus.cc:359] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:45.234766 26950 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:45.235502 26950 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:45.238466 26950 ts_tablet_manager.cc:1434] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:19:45.240624 25136 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-b1d4aa6fab2741dda3fcae71491a229a received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:45.241071 25136 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-b1d4aa6fab2741dda3fcae71491a229a on tablet b1d4aa6fab2741dda3fcae71491a229a with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:45.242621 26955 raft_consensus.cc:359] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:45.243453 26955 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:45.244093 26955 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:45.249818 26955 ts_tablet_manager.cc:1434] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:19:45.255316 25852 raft_consensus.cc:1217] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 12:19:45.255514 25285 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-3bde194ca9e544f1befacd3ad39463a2 received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:45.255975 25285 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-3bde194ca9e544f1befacd3ad39463a2 on tablet 3bde194ca9e544f1befacd3ad39463a2 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:45.346879 25194 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:45.348067 26920 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:45.394440 25852 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:45.470654 25852 raft_consensus.cc:1217] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:19:45.563230 26922 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:45.568005 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:45.577122 26965 raft_consensus.cc:1064] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:45.580152 26965 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:45.670465 26739 raft_consensus.cc:1064] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:45.673547 26739 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:45.694602 25126 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:45.696992 26947 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:45.726817 25118 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:45.730508 25854 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:45.733855 25854 raft_consensus.cc:1217] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:19:45.743775 26926 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:45.758496 25194 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:45.769922 26947 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:45.788817 25194 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:45.809017 26926 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:45.811379 26975 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:45.870867 25200 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:45.873072 25274 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:19:45.881023 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 70758.7us
I20260709 12:19:45.884709 25852 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:45.880779 26922 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:19:45.893564 26920 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:45.901933 26920 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:19:45.937103 25127 raft_consensus.cc:2955] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:45.947690 26947 raft_consensus.cc:2955] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:45.966125 26922 raft_consensus.cc:2955] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:45.976930 25852 raft_consensus.cc:2955] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:45.984125 25200 raft_consensus.cc:2955] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:45.998461 26926 raft_consensus.cc:1064] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:45.995352 25851 raft_consensus.cc:2955] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.001171 26926 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:46.102530 25194 raft_consensus.cc:2955] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:19:46.119493 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 96097.4us
W20260709 12:19:46.123159 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 95345.8us
I20260709 12:19:46.129364 25126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08989457946a4946811751dc96e31276"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:33398
W20260709 12:19:46.130185 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 111869us
I20260709 12:19:46.146457 25274 raft_consensus.cc:2955] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.134768 25126 raft_consensus.cc:606] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:46.010694 25025 catalog_manager.cc:5697] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.172853 25120 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:46.173673 25852 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:46.174384 26947 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:46.176512 26978 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:46.177023 26919 raft_consensus.cc:993] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:46.177636 26919 raft_consensus.cc:1081] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:46.180022 25268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08989457946a4946811751dc96e31276"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40086
I20260709 12:19:46.180567 25268 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:46.180711 25201 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:46.180974 25268 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:46.185770 26980 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:46.194902 25272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "155471b361b441c095eae34b64eb0bed"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:46.195475 25272 raft_consensus.cc:606] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:46.197656 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:46.199317 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:46.200043 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:46.201025 25268 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:46.202903 25268 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:46.172008 25024 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 5 to 6, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.212857 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:46.213449 25120 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:46.213745 25120 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:46.214473 25120 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:46.215731 25120 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:46.225531 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:46.226228 25200 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:46.230765 25120 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:46.235828 25200 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:46.240787 26978 raft_consensus.cc:2955] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.244693 25126 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:46.246632 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:46.247730 26973 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:46.248257 26973 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:46.249037 26973 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:46.254221 25120 raft_consensus.cc:2955] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.260365 25200 raft_consensus.cc:2955] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.266541 25852 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:46.267104 25851 raft_consensus.cc:2955] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.270092 26919 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:46.277704 25200 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:46.279489 26994 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:46.283635 25854 raft_consensus.cc:2955] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.281363 26994 raft_consensus.cc:2955] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.292152 25202 raft_consensus.cc:2955] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.314502 25268 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:46.316432 25023 catalog_manager.cc:5697] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.321584 25852 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:46.326175 26739 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:46.335534 26739 raft_consensus.cc:2955] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.343022 25854 raft_consensus.cc:2955] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.349190 25025 catalog_manager.cc:5697] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.362620 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet 951ec28047e64bb7a386c7d66a082fd0 with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:46.365743 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 951ec28047e64bb7a386c7d66a082fd0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:46.365736 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f698d5eb641d4490aaa13e25382450db with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:46.367308 25126 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:46.378877 26973 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:46.380908 26994 raft_consensus.cc:1064] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:46.386318 27002 tablet_replica.cc:333] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:46.390069 27002 raft_consensus.cc:2243] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.391036 27002 raft_consensus.cc:2272] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.388298 26994 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:46.396364 25022 catalog_manager.cc:5697] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 4, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.397079 27002 ts_tablet_manager.cc:1916] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:46.406327 25126 raft_consensus.cc:2955] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.405097 25022 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 6 to 7, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.426059 25854 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:46.427834 25268 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:46.429522 26993 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:46.430507 26919 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:46.434309 25200 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:46.438321 26920 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:46.441838 27002 ts_tablet_manager.cc:1929] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:19:46.467020 27002 log.cc:1199] T 951ec28047e64bb7a386c7d66a082fd0 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/951ec28047e64bb7a386c7d66a082fd0
I20260709 12:19:46.478060 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet f698d5eb641d4490aaa13e25382450db with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:36418
I20260709 12:19:46.481784 25272 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:46.484611 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet 951ec28047e64bb7a386c7d66a082fd0 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:46.488806 25854 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:46.493347 25202 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:46.495774 26978 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:46.498765 26926 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:46.507230 27007 tablet_replica.cc:333] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:19:46.508844 26974 raft_consensus.cc:2955] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.516995 27007 raft_consensus.cc:2243] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.521247 25854 raft_consensus.cc:2955] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.530170 26994 raft_consensus.cc:2955] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.546438 25852 raft_consensus.cc:2955] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.546643 25272 raft_consensus.cc:2955] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.556193 25009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3bde194ca9e544f1befacd3ad39463a2 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:46.557737 25201 raft_consensus.cc:2955] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.568645 25022 catalog_manager.cc:5697] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.572896 26739 raft_consensus.cc:993] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:46.573520 26739 raft_consensus.cc:1081] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:19:46.576130 25202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "155471b361b441c095eae34b64eb0bed"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36436
I20260709 12:19:46.576627 25202 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:46.576960 25202 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:46.582952 25126 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:46.517760 25200 raft_consensus.cc:2955] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.532441 27007 raft_consensus.cc:2272] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.611766 27007 ts_tablet_manager.cc:1916] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:46.614070 25858 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:46.617539 26994 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:46.619105 25022 catalog_manager.cc:5697] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 4 to 5, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 2 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.626073 25202 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:46.632150 25194 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:46.632453 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:46.628531 26993 raft_consensus.cc:2955] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.633028 25120 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:46.635258 26994 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:46.640938 25854 raft_consensus.cc:2955] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.641069 25194 raft_consensus.cc:2955] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.646255 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bde194ca9e544f1befacd3ad39463a2 with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:41024
I20260709 12:19:46.646471 25120 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:46.647562 25168 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:46.648379 26990 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:46.648864 26990 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:46.649645 26990 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:46.656875 25202 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:46.657789 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:46.659657 25274 raft_consensus.cc:3055] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:46.659986 25274 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:46.660720 25274 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:46.661860 25274 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:46.663475 27007 ts_tablet_manager.cc:1929] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 12:19:46.663949 27007 log.cc:1199] T f698d5eb641d4490aaa13e25382450db P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/f698d5eb641d4490aaa13e25382450db
I20260709 12:19:46.667948 27008 tablet_replica.cc:333] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:19:46.672587 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1d4aa6fab2741dda3fcae71491a229a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:46.678903 25022 catalog_manager.cc:5697] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 4 to 5, VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) evicted. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:46.679646 27008 raft_consensus.cc:2243] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.683401 27008 raft_consensus.cc:2272] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.694446 27008 ts_tablet_manager.cc:1916] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:46.696543 25261 tablet_service.cc:1558] Processing DeleteTablet for tablet b1d4aa6fab2741dda3fcae71491a229a with delete_type TABLET_DATA_TOMBSTONED (TS 2e30bdd4cd1b45299f50b9bcfc9c1667 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40082
I20260709 12:19:46.697485 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet f698d5eb641d4490aaa13e25382450db (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:46.697538 27002 tablet_replica.cc:333] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:19:46.700517 27002 raft_consensus.cc:2243] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.701264 27002 raft_consensus.cc:2272] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.703130 25274 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:46.706499 27002 ts_tablet_manager.cc:1916] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:46.719451 27008 ts_tablet_manager.cc:1929] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:19:46.720005 27008 log.cc:1199] T 3bde194ca9e544f1befacd3ad39463a2 P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/3bde194ca9e544f1befacd3ad39463a2
I20260709 12:19:46.721630 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet 3bde194ca9e544f1befacd3ad39463a2 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:46.725307 25023 catalog_manager.cc:5697] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:46.732020 25202 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:46.740481 27002 ts_tablet_manager.cc:1929] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:19:46.741035 27002 log.cc:1199] T b1d4aa6fab2741dda3fcae71491a229a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/wals/b1d4aa6fab2741dda3fcae71491a229a
I20260709 12:19:46.741379 25120 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:46.741513 26974 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:46.742913 25009 catalog_manager.cc:5028] TS 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): tablet b1d4aa6fab2741dda3fcae71491a229a (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:19:46.744292 26978 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:47.126782 25120 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:47.128159 26990 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:47.161670 25274 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:47.167940 26880 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:47.606681 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:47.653568 25202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "258fe130eb914f5b858baf4782663574"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:47.654273 25202 raft_consensus.cc:606] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:47.657011 25272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:47.657531 25272 raft_consensus.cc:606] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:47.658702 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:47.660090 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:47.660856 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:47.785696 25126 consensus_queue.cc:237] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:47.791635 25272 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:47.792121 25092 consensus_peers.cc:597] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1f471cfad2348a09c4b699f01f9dfa9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:47.793222 25202 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:47.793427 26920 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:47.794865 26993 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:47.807454 27021 raft_consensus.cc:2955] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:47.809476 25272 raft_consensus.cc:2955] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:47.811233 25202 raft_consensus.cc:2955] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:47.845273 25022 catalog_manager.cc:5697] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 2, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:47.887784 25202 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:47.888770 26973 raft_consensus.cc:993] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:47.889321 26973 raft_consensus.cc:1081] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:19:47.891208 25852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:19:47.891763 25852 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:47.892115 25852 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:47.902082 25852 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:47.905486 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:47.906270 25120 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:47.906822 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:47.907462 25272 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:47.907783 25272 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:47.908550 25272 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:47.909716 25272 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:47.916759 25120 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:19:47.918826 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:47.920234 26883 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:47.920858 26883 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:47.921753 26883 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:47.924307 25274 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:47.925868 27016 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:47.927522 25852 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:47.928364 25167 consensus_peers.cc:597] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c305b34a0c54275af750c832f52691f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:47.928584 25126 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:47.930078 25272 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:19:47.934504 27016 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:47.960098 25022 catalog_manager.cc:5697] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 5, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 5 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.964936 27016 raft_consensus.cc:2955] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:47.967661 25268 raft_consensus.cc:2955] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:47.977212 25120 raft_consensus.cc:2955] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:47.987429 25126 consensus_queue.cc:237] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:47.995024 25022 catalog_manager.cc:5697] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 4, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
W20260709 12:19:48.004676 25092 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3552726c022345b394b69265b8f3b566. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:48.007642 25268 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:48.009364 26920 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:48.014670 25202 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:48.016834 26920 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:48.037310 27023 raft_consensus.cc:2955] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:48.052563 25201 raft_consensus.cc:2955] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:48.057132 25274 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:48.051470 25268 raft_consensus.cc:2955] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:48.069432 25024 catalog_manager.cc:5697] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 3, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.079064 25202 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:48.082917 26978 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:48.087880 25120 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:48.091598 26978 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:19:48.093776 25241 consensus_peers.cc:597] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5db99f5b516b4f578a44f8ba1bbc3fc9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:48.130352 26990 raft_consensus.cc:993] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:48.130986 26990 raft_consensus.cc:1081] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:19:48.133311 25274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "258fe130eb914f5b858baf4782663574"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40096
I20260709 12:19:48.134115 25274 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:48.140936 25274 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:48.146406 26978 raft_consensus.cc:2955] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:48.148869 25274 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:48.149380 25126 raft_consensus.cc:2955] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:48.153213 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:48.153868 25118 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:48.155289 25274 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:48.156400 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:48.157025 25202 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:48.157334 25202 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:48.158123 25202 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:48.159447 25202 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:48.176990 25118 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:19:48.182957 25202 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:19:48.183579 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:48.184530 26974 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:48.185016 26974 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:48.185880 26974 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:48.205600 25022 catalog_manager.cc:5697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index -1 to 4, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
W20260709 12:19:48.232795 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 47043.9us
I20260709 12:19:48.236052 25022 catalog_manager.cc:5697] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 2 to 3, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.245249 25202 raft_consensus.cc:2955] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:19:48.280627 27041 ts_tablet_manager.cc:933] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:48.290227 27041 tablet_copy_client.cc:323] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:48.292784 25136 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet f1f471cfad2348a09c4b699f01f9dfa9 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:48.293354 25136 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet f1f471cfad2348a09c4b699f01f9dfa9 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-f1f471cfad2348a09c4b699f01f9dfa9
I20260709 12:19:48.302980 25136 tablet_copy_source_session.cc:215] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:48.306416 27041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f471cfad2348a09c4b699f01f9dfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.320990 27041 tablet_copy_client.cc:806] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:48.321697 27041 tablet_copy_client.cc:670] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:48.325237 27041 tablet_copy_client.cc:538] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:48.328290 25118 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:48.332404 26883 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:48.334005 27041 tablet_bootstrap.cc:492] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:48.369179 27041 tablet_bootstrap.cc:492] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:48.371136 27041 tablet_bootstrap.cc:492] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:48.372061 27041 ts_tablet_manager.cc:1403] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.038s	user 0.031s	sys 0.000s
I20260709 12:19:48.380214 27041 raft_consensus.cc:359] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:48.381455 27041 raft_consensus.cc:740] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:48.382472 27041 consensus_queue.cc:260] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:48.386341 27041 ts_tablet_manager.cc:1434] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:19:48.396793 27047 ts_tablet_manager.cc:933] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:48.400450 25136 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-f1f471cfad2348a09c4b699f01f9dfa9 received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:48.400975 25136 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-f1f471cfad2348a09c4b699f01f9dfa9 on tablet f1f471cfad2348a09c4b699f01f9dfa9 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:48.404412 25274 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:48.406893 26883 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:48.416122 27047 tablet_copy_client.cc:323] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.194:43905
I20260709 12:19:48.418651 25212 tablet_copy_service.cc:140] P b83c12959b9848b3b7bbc680f5ee6225: Received BeginTabletCopySession request for tablet 9c305b34a0c54275af750c832f52691f from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:51270)
I20260709 12:19:48.419215 25212 tablet_copy_service.cc:161] P b83c12959b9848b3b7bbc680f5ee6225: Beginning new tablet copy session on tablet 9c305b34a0c54275af750c832f52691f from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:51270: session id = 4456c1069d1541fab5b7cb29df9b6167-9c305b34a0c54275af750c832f52691f
I20260709 12:19:48.428752 25212 tablet_copy_source_session.cc:215] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:48.452551 27041 ts_tablet_manager.cc:933] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:19:48.458833 27041 tablet_copy_client.cc:323] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:19:48.459969 27047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c305b34a0c54275af750c832f52691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.460948 25136 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet 3552726c022345b394b69265b8f3b566 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:19:48.461366 25136 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet 3552726c022345b394b69265b8f3b566 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-3552726c022345b394b69265b8f3b566
I20260709 12:19:48.468115 25136 tablet_copy_source_session.cc:215] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:48.471433 27041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3552726c022345b394b69265b8f3b566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.480321 27047 tablet_copy_client.cc:806] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:48.480966 27047 tablet_copy_client.cc:670] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:48.485203 27047 tablet_copy_client.cc:538] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:48.490950 27041 tablet_copy_client.cc:806] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:48.492532 27041 tablet_copy_client.cc:670] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:48.505904 27041 tablet_copy_client.cc:538] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:48.526333 27047 tablet_bootstrap.cc:492] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:48.540215 27053 ts_tablet_manager.cc:933] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:48.545477 27041 tablet_bootstrap.cc:492] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:48.553436 27053 tablet_copy_client.cc:323] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.195:44749
I20260709 12:19:48.555342 25285 tablet_copy_service.cc:140] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Received BeginTabletCopySession request for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:43556)
I20260709 12:19:48.555940 25285 tablet_copy_service.cc:161] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Beginning new tablet copy session on tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:43556: session id = 4456c1069d1541fab5b7cb29df9b6167-5db99f5b516b4f578a44f8ba1bbc3fc9
I20260709 12:19:48.565433 25285 tablet_copy_source_session.cc:215] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:48.599896 27053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.603837 27041 tablet_bootstrap.cc:492] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:48.606045 27041 tablet_bootstrap.cc:492] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:48.608139 27041 ts_tablet_manager.cc:1403] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.014s
I20260709 12:19:48.616710 27041 raft_consensus.cc:359] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:48.621032 27041 raft_consensus.cc:740] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:48.622500 27041 consensus_queue.cc:260] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:48.628815 27041 ts_tablet_manager.cc:1434] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:19:48.634793 25136 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-3552726c022345b394b69265b8f3b566 received from {username='slave'} at 127.0.0.1:48492
I20260709 12:19:48.635275 25136 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-3552726c022345b394b69265b8f3b566 on tablet 3552726c022345b394b69265b8f3b566 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:48.655241 27053 tablet_copy_client.cc:806] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:48.655939 27053 tablet_copy_client.cc:670] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:48.659974 27053 tablet_copy_client.cc:538] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:48.665927 27047 tablet_bootstrap.cc:492] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:48.667268 27047 tablet_bootstrap.cc:492] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:48.668062 27047 ts_tablet_manager.cc:1403] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.163s	user 0.045s	sys 0.019s
I20260709 12:19:48.677742 27047 raft_consensus.cc:359] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:48.678753 27047 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:48.679502 27047 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:48.685271 27053 tablet_bootstrap.cc:492] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:19:48.688882 27047 ts_tablet_manager.cc:1434] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:19:48.691232 25212 tablet_copy_service.cc:342] P b83c12959b9848b3b7bbc680f5ee6225: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-9c305b34a0c54275af750c832f52691f received from {username='slave'} at 127.0.0.1:51270
I20260709 12:19:48.691701 25212 tablet_copy_service.cc:434] P b83c12959b9848b3b7bbc680f5ee6225: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-9c305b34a0c54275af750c832f52691f on tablet 9c305b34a0c54275af750c832f52691f with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:48.700014 25202 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:48.701323 27040 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:48.731470 25858 raft_consensus.cc:1217] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:48.736990 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:48.749801 25120 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:48.759352 26974 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:19:48.801301 27057 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:19:48.822952 27053 tablet_bootstrap.cc:492] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:48.826647 27053 tablet_bootstrap.cc:492] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:19:48.827910 27053 ts_tablet_manager.cc:1403] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.143s	user 0.038s	sys 0.009s
I20260709 12:19:48.831653 27053 raft_consensus.cc:359] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:48.832657 27053 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:19:48.833477 27053 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:48.836560 27053 ts_tablet_manager.cc:1434] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:48.841310 25285 tablet_copy_service.cc:342] P 2e30bdd4cd1b45299f50b9bcfc9c1667: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-5db99f5b516b4f578a44f8ba1bbc3fc9 received from {username='slave'} at 127.0.0.1:43556
I20260709 12:19:48.841745 25285 tablet_copy_service.cc:434] P 2e30bdd4cd1b45299f50b9bcfc9c1667: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-5db99f5b516b4f578a44f8ba1bbc3fc9 on tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:48.938542 25268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "258fe130eb914f5b858baf4782663574"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:48.939206 25268 raft_consensus.cc:606] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:19:48.940704 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:48.942550 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:48.943413 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:48.968744 25852 raft_consensus.cc:1217] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:19:48.992857 25852 raft_consensus.cc:1217] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:19:49.082286 25852 raft_consensus.cc:1217] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
W20260709 12:19:49.980543 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 199790us
I20260709 12:19:51.047709 27065 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.049656 27066 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.050130 27065 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.050792 27066 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.053395 27067 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.054394 27067 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.055195 27066 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.055852 27066 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.056344 27068 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.056774 27066 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.057540 27067 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.057323 27068 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.058137 27067 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.058947 27067 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.060904 27066 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.061244 27067 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.054841 27065 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.061818 27068 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.061543 27066 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.063107 27068 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.063166 27066 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.064530 27065 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.065307 27065 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.066293 27066 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.064095 27068 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.067770 27065 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.071077 27068 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.134152 26978 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.136981 26978 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.134665 26974 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.143558 27068 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.157339 27069 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.247203 27069 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.158720 27070 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.229523 27079 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.247080 27068 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.159240 27072 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.260741 27072 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:51.260594 27079 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.256963 27069 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.263957 26974 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
W20260709 12:19:51.270171 25148 debug-util.cc:398] Leaking SignalData structure 0x7b080034c920 after lost signal to thread 23882
W20260709 12:19:51.271705 25148 debug-util.cc:398] Leaking SignalData structure 0x7b0800267860 after lost signal to thread 25059
W20260709 12:19:51.273490 25148 debug-util.cc:398] Leaking SignalData structure 0x7b08000e3080 after lost signal to thread 25151
W20260709 12:19:51.274657 25148 debug-util.cc:398] Leaking SignalData structure 0x7b0800120300 after lost signal to thread 25226
I20260709 12:19:51.279732 27068 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.295694 27079 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.298048 26974 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.298681 27072 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.265188 27070 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.302151 27070 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.303009 26978 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.304358 27069 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.305243 27069 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.305843 27079 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.312965 27079 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.315501 27069 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.315976 27079 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.326382 27069 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.328496 27069 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.327346 27079 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.330617 27079 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.333323 27069 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.334401 27079 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.337939 27077 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.343742 26915 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.347613 27077 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.350580 27049 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.354405 27076 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.355022 27049 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.355471 27076 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.357923 27049 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.359090 27076 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.353667 27077 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.350471 26915 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.362051 26915 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.365725 27078 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.366747 27078 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.372054 27078 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.374339 27078 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.430703 27066 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.431809 27066 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.434281 27067 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.435242 27083 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.435920 27070 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.436288 27073 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.436691 27070 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.437047 27074 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.437219 27072 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.434407 27075 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.524305 27075 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.435235 27067 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.527594 27075 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.528394 27067 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.543475 27084 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.543954 26915 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.544445 27084 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.544649 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.546491 27081 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.547343 27081 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.550246 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.544768 26915 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.553232 27078 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.551532 25272 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
I20260709 12:19:51.551851 27066 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.553855 26915 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.437990 27074 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.437079 27073 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.560803 27074 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.514942 27049 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.557031 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.561904 27067 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.562309 27073 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.562873 27067 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.432050 26978 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.564862 26978 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.555778 27082 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.567062 27082 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.435974 27083 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.558163 25822 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:51.569520 27077 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:51.569929 27077 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.555953 27085 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.570405 27083 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.561926 27049 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.556108 27072 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.530697 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.573099 27049 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.570461 27077 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.573722 27070 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.573562 27072 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.578563 27085 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.582615 27082 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.371012 27069 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.605624 27077 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:51.610103 25148 debug-util.cc:398] Leaking SignalData structure 0x7b0800358060 after lost signal to thread 25300
W20260709 12:19:51.611244 25148 debug-util.cc:398] Leaking SignalData structure 0x7b08002c9de0 after lost signal to thread 25301
W20260709 12:19:51.614614 25148 debug-util.cc:398] Leaking SignalData structure 0x7b08002bc1e0 after lost signal to thread 25884
W20260709 12:19:51.614925 25148 debug-util.cc:398] Leaking SignalData structure 0x7b0800376820 after lost signal to thread 25885
I20260709 12:19:51.555620 27078 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.590356 27067 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.585247 26978 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.619338 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.625159 27082 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.626205 27085 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.626546 25269 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:51.626879 27082 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.628796 25822 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:51.629277 26915 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.631206 27072 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.631114 26915 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.631934 27072 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.632977 25024 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41770 (request call id 323) took 2385 ms. Trace:
I20260709 12:19:51.633746 25024 rpcz_store.cc:276] 0709 12:19:49.247401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.247518 (+   117us) service_pool.cc:224] Handling call
0709 12:19:51.632691 (+2385173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176691,"reported_tablets":1}
I20260709 12:19:51.635578 27082 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.633170 26915 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.637689 27072 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.637619 27076 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.638561 27076 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.639271 27084 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.639802 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.641072 27076 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.627625 27069 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.642660 27075 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.643121 27067 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.643426 27075 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.643884 27067 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.645789 26883 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.646008 27049 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.646176 27067 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.646476 26883 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.646632 27049 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.647168 26978 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.647892 26978 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.648628 27049 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.649224 27049 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:51.649574 27049 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.649732 27077 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.651726 26978 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.542698 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:51.652318 27069 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.652518 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:51.653266 25276 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.658622 25022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33480 (request call id 265) took 2519 ms. Trace:
I20260709 12:19:51.659215 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.645829 27075 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.659116 25022 rpcz_store.cc:276] 0709 12:19:49.139548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.082671 (+1943123us) service_pool.cc:224] Handling call
0709 12:19:51.658421 (+575750us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":489324,"reported_tablets":1}
I20260709 12:19:51.648628 26883 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.662760 27070 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.663017 27074 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.664103 27079 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.664229 27074 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.664775 27079 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.666366 27080 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.666456 27073 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.667232 27080 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.668258 27092 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.662158 26978 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.669018 27092 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.669450 26978 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.669701 27080 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.666386 27091 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.670380 27083 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.670773 27091 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.671082 27083 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.673071 27091 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.673216 27083 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.673640 27091 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.667294 27074 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.677712 27091 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.649958 27049 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:51.680207 27091 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.673808 27083 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.669035 26915 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.665843 27070 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.674335 26883 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.674945 27076 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.675514 27065 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.676039 27068 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.676270 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.690371 25269 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:51.691095 27072 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.691520 25822 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:51.691700 27072 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.689594 27068 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:51.689280 27083 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.676465 27079 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.671415 27092 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.689280 27065 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.676937 27082 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.667289 27073 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.693802 25276 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:51.695605 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.703835 26883 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.705824 27073 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.725189 25822 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:51.728694 26978 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.711344 26915 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.709259 27082 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.699885 27080 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.751791 26883 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.706521 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.706640 27090 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:51.753223 27075 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:51.753563 27090 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.754246 27090 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:51.707479 27087 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.759737 27075 raft_consensus.cc:697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:51.760270 27087 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.761083 27075 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.761893 25273 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
I20260709 12:19:51.702488 27085 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.762735 27085 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.707199 27089 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.710007 27068 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.779186 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.728111 27072 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.726408 27070 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.769062 27089 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.775887 26978 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.776710 27071 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.777302 27088 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.706943 27076 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.803277 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.752784 25274 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
I20260709 12:19:51.803155 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.801721 27088 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.811151 26978 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.813409 26978 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.804867 27080 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:51.815673 27089 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.816133 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.816473 27071 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.818359 25272 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:51.826323 25822 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:51.829203 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 1881) took 2574 ms. Trace:
I20260709 12:19:51.850935 27083 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.798174 27023 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.828653 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.839762 25268 rpcz_store.cc:276] 0709 12:19:49.254896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.261158 (+  6262us) service_pool.cc:224] Handling call
0709 12:19:49.261625 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:51.798436 (+2536811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.801793 (+  3357us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:51.804933 (+  3140us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:51.804982 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.828889 (+ 23907us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.829030 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:51.852389 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:51.805136 27065 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:51.833843 27091 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:51.857368 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.827759 27076 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.859886 25269 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:19:51.862332 27064 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.863042 27064 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.832419 27049 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.846572 27088 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.865622 27064 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.867151 27080 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.867846 27071 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.868974 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:51.869187 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:51.870114 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:51.870239 25822 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:51.870472 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:51.871656 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:51.872733 27087 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.874449 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.886636 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:51.860982 27081 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.856988 27089 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:51.875351 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.887919 27089 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.888142 25276 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
I20260709 12:19:51.888391 27089 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.886752 27076 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:51.889015 27076 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.889453 27076 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:51.859342 27091 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:51.886365 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:51.895392 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:51.896927 25822 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:51.898732 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.902693 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:51.905959 26915 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.907815 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.908188 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.908565 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.910624 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.911000 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.911418 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.912014 25273 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:19:51.912695 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.912892 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.912081 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.903069 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:51.856846 27023 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.924238 27049 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.925089 27023 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.925892 27085 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.928259 27069 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.928864 27069 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.929361 27074 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.895195 27091 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.934478 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:51.929963 27074 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:51.899050 27082 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.898475 27079 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:51.947999 27097 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.948932 27074 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.948784 27097 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.952126 27097 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.952241 27069 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.940999 27092 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.947160 27064 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.953958 27092 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.954406 27064 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.956514 27064 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.956851 27092 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.903421 27095 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.918679 27083 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:51.961024 27095 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.965018 27095 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.940510 27096 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.965566 27062 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:51.940768 27081 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.966185 27062 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.976261 27062 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:51.976706 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:51.977597 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:51.978602 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:51.979202 25198 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:51.979614 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:51.980149 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:51.981464 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:51.968323 27083 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:51.982092 25199 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
I20260709 12:19:51.982409 27083 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.962054 27079 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:51.984344 27079 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:51.973212 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:51.966181 27096 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:51.996894 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:51.997797 25854 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:19:52.016515 27064 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:52.017366 27064 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.019774 27081 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.020146 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.020329 27101 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.021081 25193 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:52.024356 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.027014 25200 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:52.029495 27023 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:52.030120 27023 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.030652 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.031878 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.032213 27023 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.032315 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.032490 25193 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
I20260709 12:19:52.032969 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.034150 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.034684 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:52.035270 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.035480 27096 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.036259 27062 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:52.036861 27062 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.034255 27064 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.038408 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.038820 27062 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.039000 25194 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:52.040403 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.018822 27097 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:52.045257 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.045778 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.047040 25194 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
I20260709 12:19:52.052873 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:52.053273 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.026716 27095 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:52.021994 27101 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:52.047191 27023 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.056416 27023 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.056713 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.056895 27076 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.057286 25199 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:51.999907 27090 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.058326 25852 raft_consensus.cc:2393] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:52.056438 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.059693 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.055821 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.060549 25276 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:52.059118 25853 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:52.061086 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:52.061924 27022 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:52.062424 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.059747 25268 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:52.059943 27090 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.066195 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.076851 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.077286 27023 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.077756 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.077917 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.078917 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.079140 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.079478 25268 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:19:52.077968 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.084206 25271 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:52.094698 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.071170 27062 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.105247 27062 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.105659 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.106618 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.107333 27062 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.107613 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.107843 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.108080 27099 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:52.108773 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.098193 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.098315 25852 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:52.098950 27101 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.100019 27023 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.100924 27098 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.098955 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.104007 27100 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:52.108738 27099 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:52.115513 25241 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:52.116079 27095 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.117321 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.118040 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.062578 27022 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.129495 27100 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.118432 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.122540 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.122773 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.095995 27096 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:52.125154 27081 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.096151 27064 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:52.125281 27023 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.081691 27097 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.128252 25825 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:52.128932 27065 raft_consensus.cc:1064] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:52.131891 25858 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:52.134171 25851 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:19:52.132366 25856 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:52.123795 27089 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.148396 27103 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:52.149027 27096 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.133771 27087 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:52.167204 25860 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:52.148131 25297 debug-util.cc:398] Leaking SignalData structure 0x7b08000af7c0 after lost signal to thread 23882
I20260709 12:19:52.154018 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:52.147708 27064 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.107842 27062 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:52.130301 27083 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.134284 27098 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.170879 27085 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:19:52.166826 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 71554.5us
I20260709 12:19:52.201090 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.219333 25859 raft_consensus.cc:2393] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 2: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:52.231716 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.229173 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:19:52.180884 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 58894.9us
W20260709 12:19:52.230685 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 63674.7us
I20260709 12:19:52.236320 26915 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.236721 26915 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:52.237049 26915 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.180218 27087 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:52.223264 27076 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:52.243767 25297 debug-util.cc:398] Leaking SignalData structure 0x7b08000ed460 after lost signal to thread 25059
W20260709 12:19:52.245090 25297 debug-util.cc:398] Leaking SignalData structure 0x7b080026aea0 after lost signal to thread 25151
W20260709 12:19:52.245375 25297 debug-util.cc:398] Leaking SignalData structure 0x7b080013ebc0 after lost signal to thread 25152
I20260709 12:19:52.246187 27105 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:52.246765 27105 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.215262 27099 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.248842 27105 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.249571 27095 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.250218 27107 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.250808 27107 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.251628 27089 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.253039 27107 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.253350 27023 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.253883 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:52.255913 27096 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.257308 26915 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.220645 27022 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.226505 27085 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.247057 27097 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.259738 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.220160 27100 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.261732 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.262303 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:52.245424 27091 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.277524 26915 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:52.182971 27073 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.268922 25854 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 2: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:52.278559 26883 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:52.278924 26883 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:52.279325 26883 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:52.279227 25090 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:52.287984 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.260195 27087 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:52.290499 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.290923 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.292052 27091 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.291580 27065 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.292836 25853 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:52.276893 27085 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.282084 27073 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:52.304572 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:19:52.293416 25297 debug-util.cc:398] Leaking SignalData structure 0x7b08002da1a0 after lost signal to thread 25226
I20260709 12:19:52.297281 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.289608 25165 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:52.301914 25090 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:52.307112 25856 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:52.290110 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:52.215770 27103 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.305531 27073 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.319077 27103 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.319629 27103 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:52.320135 27103 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.324141 27106 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:52.324712 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.324859 27106 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.327266 27106 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.327831 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.328152 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.328456 25121 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:52.328719 25124 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:52.329149 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.329648 25855 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 2: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:52.333140 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.333966 25124 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:19:52.312089 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.312949 27097 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.300417 27100 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:52.293293 25268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:52.313611 27022 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:52.314471 27096 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.315428 25167 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:19:52.339895 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 62418.9us
I20260709 12:19:52.341500 25167 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:52.316793 27098 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.313055 27092 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.343592 27092 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:52.344014 27092 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.339345 27100 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:52.338315 25268 raft_consensus.cc:606] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:19:52.346261 27080 consensus_queue.cc:1059] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:52.346786 27100 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:52.347409 27081 raft_consensus.cc:3055] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:52.336714 25851 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:52.308761 25276 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:52.282562 27062 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.348795 25167 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:52.342833 27097 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.349835 25167 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:52.340740 25165 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:52.352877 27064 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.347818 27081 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:52.358533 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:52.359017 27081 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.359344 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.360180 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:52.358402 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.360312 27093 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:52.361476 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:52.361717 27083 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.310364 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.360219 27081 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:52.363319 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:52.363443 25857 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
W20260709 12:19:52.364567 25297 debug-util.cc:398] Leaking SignalData structure 0x7b080036da60 after lost signal to thread 25300
W20260709 12:19:52.364913 25297 debug-util.cc:398] Leaking SignalData structure 0x7b0800307ee0 after lost signal to thread 25301
W20260709 12:19:52.365255 25297 debug-util.cc:398] Leaking SignalData structure 0x7b0800264ea0 after lost signal to thread 25822
W20260709 12:19:52.365514 25297 debug-util.cc:398] Leaking SignalData structure 0x7b08001caea0 after lost signal to thread 25823
W20260709 12:19:52.365757 25297 debug-util.cc:398] Leaking SignalData structure 0x7b080031acc0 after lost signal to thread 25824
W20260709 12:19:52.365986 25297 debug-util.cc:398] Leaking SignalData structure 0x7b08000b44a0 after lost signal to thread 25825
I20260709 12:19:52.366139 26883 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:52.366938 25297 debug-util.cc:398] Leaking SignalData structure 0x7b08003806c0 after lost signal to thread 25884
I20260709 12:19:52.338603 27106 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:19:52.384466 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 43788.9us
I20260709 12:19:52.367317 27087 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.368316 27103 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.370591 25854 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:52.371140 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.348155 27079 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:52.374830 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.378216 27083 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:52.384593 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:52.414271 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:19:52.382066 25297 debug-util.cc:398] Leaking SignalData structure 0x7b0800380760 after lost signal to thread 25885
I20260709 12:19:52.428870 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:52.385993 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.386983 26883 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:52.430778 27087 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.430855 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.431952 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.432881 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.433943 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.388983 25165 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:19:52.439787 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 50897.6us
I20260709 12:19:52.390889 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.391085 25267 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:52.391585 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.347666 27096 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.392591 27072 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:52.392851 27082 raft_consensus.cc:1064] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:52.391618 27094 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.387075 27080 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:52.397598 27062 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.400466 27073 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.408565 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.410249 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.412323 25121 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
W20260709 12:19:52.412938 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 126275us
I20260709 12:19:52.452122 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:52.415043 25167 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:52.455226 25167 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:52.367245 27022 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.415921 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.457440 27022 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.458352 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.416054 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.458945 27070 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:52.416507 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.459647 27070 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:52.417080 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.460590 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.462303 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.463333 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.463852 26883 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.417374 27097 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.417968 27069 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:52.418457 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.418387 27074 consensus_queue.cc:1059] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:52.419500 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.442229 27079 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:52.422753 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.424547 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.382324 27106 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:52.426218 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.448855 27072 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:52.441314 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.464223 26883 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:52.484342 26883 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.465293 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:52.458968 25120 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:19:52.472760 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.473968 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.485859 25121 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:52.482367 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.419945 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.450481 27080 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:52.500967 27080 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.448652 27094 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:52.457782 27100 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.486601 25118 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:52.486613 25126 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:52.483920 27106 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.487947 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.488768 27085 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.489564 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.487064 25123 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:19:52.486449 27072 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:52.515767 25120 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:52.516752 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.517346 25120 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:52.494079 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.477599 27069 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:52.518365 25119 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:52.518513 27069 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:52.519237 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.492295 27096 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.496948 27073 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.499883 27082 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.485164 25127 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:52.515935 25860 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:52.503290 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:52.479460 27079 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:52.494966 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.534649 25121 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:19:52.519569 27100 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.523280 27094 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.523309 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.523974 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.525682 25124 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:52.522270 25825 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:52.527734 26883 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.529141 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.543784 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:52.532713 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:52.533970 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:19:52.526809 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.547655 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:52.549682 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:52.517354 27085 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.554555 27070 raft_consensus.cc:3055] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:52.514714 27092 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.554997 27070 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:52.555850 27070 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.556653 27092 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.557265 27070 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:52.503846 27083 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:52.563580 26883 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:52.544967 27081 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:52.568423 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.579859 25127 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:52.570874 25168 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:52.567744 27088 consensus_queue.cc:1059] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:19:52.584921 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.540169 27079 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.573176 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.588538 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.589206 25197 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:52.590456 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.574360 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.594604 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.575173 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.575980 27090 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:52.576654 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 54463.5us
I20260709 12:19:52.597563 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.504702 27103 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:19:52.590931 27081 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:52.597937 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.598619 27103 raft_consensus.cc:3055] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:52.599001 27103 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:52.599145 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.598644 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.577260 27083 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:52.582666 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.600214 27083 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:52.583743 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.584338 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.601516 25200 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 2: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:52.597962 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:19:52.585980 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 50711.8us
I20260709 12:19:52.602339 27090 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:52.602857 27090 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:52.603402 27090 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:52.587441 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.593091 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.593478 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.604194 25126 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:52.597095 25123 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
I20260709 12:19:52.610119 27065 raft_consensus.cc:3055] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:52.610564 27065 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:52.611451 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:52.598872 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.613626 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:52.614267 27065 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.615527 27065 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.619935 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:52.621605 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:52.623255 25860 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:52.627163 25168 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:52.629683 25168 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:52.631053 25168 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:52.635303 25168 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:52.625635 27092 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.652832 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.654053 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.655213 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.655505 25854 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:52.655627 25857 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:52.657142 25859 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:52.658018 25858 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:52.633275 27081 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:52.659073 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.659369 27081 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.633610 27074 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:52.659796 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.663532 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.664275 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.664608 27080 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.665330 25857 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:52.665387 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.667299 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.670607 25856 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:52.638340 27093 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:52.694231 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.659855 27081 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:52.649061 27092 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.624810 27103 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.642738 27088 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 12:19:52.707365 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 72178.6us
I20260709 12:19:52.671682 27074 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.708806 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.709443 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:52.696746 27073 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:52.680224 27093 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.713614 27093 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:52.713176 27103 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.715616 25168 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:52.714262 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.707683 27092 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.718281 27116 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:19:52.719043 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 263851us
I20260709 12:19:52.706173 27113 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:52.723666 25167 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:52.680608 27069 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.709942 27074 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:52.725453 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.743899 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.711275 27073 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.722944 27116 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.755230 25168 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:52.734284 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.731846 27113 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.755291 27073 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:52.770305 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.758821 27116 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.754155 25022 catalog_manager.cc:5697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:52.760823 27080 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.788064 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.795794 27072 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:52.802973 27080 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.803646 27080 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.804073 27080 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.806713 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.810734 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:52.812072 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:52.803105 27069 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:52.813628 27069 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:52.814330 27069 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.814702 27069 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.815114 27069 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.818470 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.820020 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:52.824061 27072 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.827503 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:52.830366 25825 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:52.838462 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:52.839469 27089 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:52.772334 27106 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.772246 27113 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:52.872867 27073 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:52.848515 27111 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.875101 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:19:52.901021 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 177407us
W20260709 12:19:52.908443 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 59306.7us
W20260709 12:19:52.902249 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 63895.6us
I20260709 12:19:52.867524 27079 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.877308 27094 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.866637 27083 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.913159 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:52.915272 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:52.943727 25193 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.916182 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:52.944355 25195 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:52.916911 27090 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:52.917928 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:52.921227 27073 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.921797 25196 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:52.911023 27074 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.908442 27111 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:52.924993 27106 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:52.926354 25118 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:52.927196 27081 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.930302 27093 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.912824 27088 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:52.906669 27110 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:52.935370 27080 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:52.937633 27079 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:52.966521 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 56457.7us
I20260709 12:19:52.967549 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:52.972775 25274 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:19:52.973394 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 66001.6us
I20260709 12:19:53.022156 25242 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:53.022387 25167 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:52.980022 25195 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:52.984375 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:52.985351 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.023495 25242 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:19:52.995242 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.001595 25200 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:53.004374 25273 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:53.004838 25194 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:53.024829 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.007468 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:53.009027 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.010710 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.012862 25854 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:53.026522 26915 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.018117 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.019057 25851 raft_consensus.cc:1240] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:52.998885 27111 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:53.030352 25167 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:53.033057 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:53.040102 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:53.042532 25167 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.014276 27088 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:53.019460 27110 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:53.021019 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.029166 27071 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:53.049827 25167 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:53.051719 27082 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:19:52.913743 27092 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:53.056491 25167 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:19:53.056723 25197 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:53.057699 27072 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.058382 27072 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:53.058759 27072 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:53.059152 27072 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:53.059343 27092 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:53.060323 27092 raft_consensus.cc:3055] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:53.060770 27092 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:53.049096 27121 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:53.061723 27092 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.064661 27074 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:53.065840 27093 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:53.066567 27121 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:53.036573 27122 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:53.039285 27081 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:53.078559 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.080681 25167 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.049831 25199 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:53.052672 27110 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:53.083690 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 59942us
I20260709 12:19:53.079499 27071 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:53.050588 27088 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:53.077804 27080 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:53.088536 27118 consensus_queue.cc:1059] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:19:53.092136 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:53.092972 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:19:53.142755 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.143177 25859 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:53.090442 25242 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:53.094640 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.094753 27073 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:53.097090 25858 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:53.074422 27070 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:19:53.094892 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:19:53.144080 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 53784.4us
I20260709 12:19:53.144755 25193 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:53.085955 27121 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:53.150622 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 55804.2us
I20260709 12:19:53.147902 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:53.151363 25825 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:53.152099 26883 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:53.152371 25825 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:53.152547 26883 raft_consensus.cc:697] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:53.153088 26915 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:53.156890 27085 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.145813 27087 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:53.149519 27117 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.166370 25127 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:53.170519 26883 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.172580 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.182519 27071 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:53.182698 25825 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:53.182687 25242 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:53.168452 27092 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:53.186492 27071 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:53.186153 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:19:53.193841 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 438657us
I20260709 12:19:53.194667 25168 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:53.195713 27087 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:53.191372 27085 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:53.198315 25242 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:53.199411 27126 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.201340 25242 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:53.202898 26915 raft_consensus.cc:697] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:53.203769 25168 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.204519 27070 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:53.204918 27070 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:53.205260 27070 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:53.205708 27069 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:53.207381 27113 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:53.209288 27126 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:53.209663 27082 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.208406 27110 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.211437 25168 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.212200 27082 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:53.213052 27110 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:53.220002 26915 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.192925 27094 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:53.201206 27088 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.203238 27083 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:53.231200 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.216549 27113 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:53.236558 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.217061 27069 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:53.235703 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:53.193686 27072 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.245069 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.247565 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.249200 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.249106 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.249799 25122 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:53.251441 27069 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:53.251684 25165 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.218649 27126 consensus_queue.cc:1059] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:19:53.262353 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.220896 27087 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:19:53.259807 27090 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:53.261175 27070 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.224390 27123 consensus_queue.cc:1059] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:19:53.271291 25198 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:53.271661 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.272953 25126 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:53.274158 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.234556 27065 consensus_queue.cc:1059] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:19:53.242152 27080 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:19:53.290382 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:53.291600 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 55940.5us
I20260709 12:19:53.241163 27127 consensus_queue.cc:1059] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:19:53.277851 25199 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:53.295827 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:53.257642 27111 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.300288 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:53.307080 25197 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:53.300288 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.300947 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.300882 25200 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:53.301343 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.278585 27129 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:53.309144 25119 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:53.314641 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:53.317128 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.286986 27132 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:53.269618 27116 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:53.324447 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:19:53.315776 25825 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.511s (SENT)
I20260709 12:19:53.331857 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.340981 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.344408 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.345767 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.346890 25200 raft_consensus.cc:2393] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 2: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:53.337815 25853 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:53.349203 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.336459 27132 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:53.371937 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.378301 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.343248 27087 raft_consensus.cc:3055] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:53.379721 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:53.377029 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.384655 27087 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:53.394357 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.394994 27136 raft_consensus.cc:3055] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:53.442713 25200 raft_consensus.cc:2393] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:53.396333 25123 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:53.396823 27111 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:53.398687 27135 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:19:53.406152 27072 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:53.377326 27088 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:53.341367 27121 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.506695 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.506647 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.507725 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.483426 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.461648 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.482517 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.483017 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.484830 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.518596 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:19:53.518872 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 196730us
W20260709 12:19:53.519224 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 264420us
I20260709 12:19:53.517729 25119 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:53.520190 25126 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:19:53.530973 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.452077 27136 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:53.519527 27123 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:53.534003 25123 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:53.539369 25168 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.542342 27123 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:53.544081 27123 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:53.544580 25122 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:53.545421 27123 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:53.546878 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.460714 27070 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:53.547402 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 231635us
I20260709 12:19:53.534276 25195 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:53.553558 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:53.552026 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:19:53.578199 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.560735 25168 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.650431 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.539264 27133 raft_consensus.cc:3055] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:53.536199 27116 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:53.654700 25195 raft_consensus.cc:1240] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:53.684589 25193 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 1. Current term is 2. Ops: []
W20260709 12:19:53.685256 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 124579us
I20260709 12:19:53.689296 25168 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.691004 25124 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:53.652872 27092 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:19:53.695015 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 143861us
I20260709 12:19:53.650988 27071 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.687449 27070 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:53.733283 25193 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:53.732479 25165 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.735854 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:53.685823 27133 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:53.743312 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.743247 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.745476 25124 raft_consensus.cc:2393] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:19:53.694527 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.746263 25274 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:53.748469 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.752902 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.754863 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.755613 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.534365 27132 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.758919 27145 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.741444 27128 raft_consensus.cc:3055] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:53.747865 27070 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:53.768040 25124 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:53.746742 27121 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:53.552920 27087 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.771458 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.771034 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.750811 27092 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:53.777098 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.785316 27094 raft_consensus.cc:3055] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:53.785741 27094 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:53.740646 27069 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:19:53.768153 27128 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:53.791499 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.793998 27092 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:53.797339 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.763782 27144 consensus_queue.cc:1059] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:19:53.819450 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 83645.7us
W20260709 12:19:53.819466 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 82502.9us
I20260709 12:19:53.757372 27136 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:53.831240 25201 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:53.820596 25168 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:53.852845 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.855254 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.819123 27076 raft_consensus.cc:3055] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:53.860886 25168 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:53.873862 27072 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:53.875696 27072 raft_consensus.cc:697] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:53.876861 27072 consensus_queue.cc:237] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:53.873878 27145 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:53.880334 27145 raft_consensus.cc:697] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:53.872195 27076 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:53.883293 27076 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.884569 27076 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:53.881479 27145 consensus_queue.cc:237] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:53.919785 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 215365us
I20260709 12:19:53.920652 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:19:53.921396 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 270455us
I20260709 12:19:53.922223 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.923159 25120 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:19:53.926664 27140 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:19:53.928498 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:53.929550 25197 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:53.929672 25193 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:53.929988 25199 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:53.930346 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:53.930435 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:53.800334 27094 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:53.931296 25195 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:53.932036 25194 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:53.797782 27133 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:53.931874 27128 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.932812 27092 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:53.935328 25197 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:53.941581 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.942780 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:53.948719 25165 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.954649 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:53.952834 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:53.956645 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.957428 27121 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.957564 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:53.957762 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.958436 25855 raft_consensus.cc:2393] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 2: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:53.960698 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:53.961172 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:53.962568 25858 raft_consensus.cc:2393] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:53.949847 27117 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.975039 27128 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:53.975191 27121 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:53.955170 27143 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.977481 27121 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:53.977329 27143 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:53.981310 25268 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:53.959558 27069 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:53.981782 25167 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:53.985193 25202 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:54.032418 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:19:54.033627 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 51926.6us
I20260709 12:19:54.037998 27143 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:53.982051 27133 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:54.039608 27121 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:54.040791 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:54.031986 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:54.052706 25200 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:54.046929 27121 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.061947 27121 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.034198 27117 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:54.070361 25167 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:54.072449 25167 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:54.074194 27129 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:54.074831 27129 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:54.076325 27093 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:54.076848 27093 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:54.078322 25199 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:54.080431 27136 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:54.084827 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.087167 25202 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:54.089663 25121 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:54.092458 25202 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:54.101136 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 540) took 1167 ms. Trace:
I20260709 12:19:54.101719 25853 rpcz_store.cc:276] 0709 12:19:52.933747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.934113 (+   366us) service_pool.cc:224] Handling call
0709 12:19:52.934489 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:53.383862 (+449373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:54.100750 (+716888us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b5400726854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:19:54.101011 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":905929984}
I20260709 12:19:54.106891 25851 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:54.104496 27094 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:54.111209 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:19:54.115155 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 161085us
I20260709 12:19:54.120566 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:54.122666 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:54.123950 27122 raft_consensus.cc:3055] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:54.118942 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:54.124400 27122 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:54.127014 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:54.121820 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:54.128003 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:54.125393 27122 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:54.132402 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.134447 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:54.134786 27122 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:54.131429 27133 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:54.141222 27133 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.147150 27065 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:54.147593 27133 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:54.148241 27088 raft_consensus.cc:3055] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:54.148633 27088 raft_consensus.cc:740] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:54.149534 27088 consensus_queue.cc:260] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:54.150794 27088 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:54.156507 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:54.156949 25198 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:54.157166 25268 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:54.159281 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:54.162807 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:54.165024 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.169688 25197 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:54.174062 25202 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:54.163669 25196 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:54.174212 27081 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:54.180749 27081 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.181120 27081 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:54.186657 27093 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:54.188112 27093 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:54.190887 27121 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:54.191560 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.213536 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:54.215400 25856 raft_consensus.cc:2393] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 5: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:19:54.220919 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.224694 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:54.225476 25855 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:19:54.226562 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:54.227286 25853 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:19:54.235810 25167 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:19:54.236315 25276 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:54.250494 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.256809 25241 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:54.216786 27071 consensus_queue.cc:1059] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:19:54.258453 27131 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:54.258878 27071 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:54.233678 27081 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.260428 27071 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.260277 27130 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:54.252133 27093 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:54.258937 27065 raft_consensus.cc:3055] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:19:54.261885 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 115618us
I20260709 12:19:54.261709 27087 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:54.273476 25022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33480 (request call id 266) took 1628 ms. Trace:
I20260709 12:19:54.274698 25201 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
W20260709 12:19:54.274988 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.262063 27071 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:54.271131 27065 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:54.273164 27093 raft_consensus.cc:697] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:54.282945 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:54.283548 25271 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:19:54.288703 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 45999.6us
I20260709 12:19:54.292975 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:54.293606 25851 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:54.287732 27081 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:54.305996 25851 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:19:54.307642 25167 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:54.308410 27130 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:54.308971 27130 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.310216 27080 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:54.310745 27080 raft_consensus.cc:697] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:54.311681 27080 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.333781 25242 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:54.274331 25022 rpcz_store.cc:276] 0709 12:19:52.645464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.645613 (+   149us) service_pool.cc:224] Handling call
0709 12:19:54.273417 (+1627804us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:52.936668 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:52.937426 (+   758us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:52.937483 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:19:52.937520 (+    37us) tablet.cc:662] Decoding operations
0709 12:19:52.937998 (+   478us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:52.938106 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:52.938138 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:53.006951 (+ 68813us) tablet.cc:701] Row locks acquired
0709 12:19:53.020299 (+ 13348us) write_op.cc:260] PREPARE: finished
0709 12:19:53.043267 (+ 22968us) write_op.cc:270] Start()
0709 12:19:53.070708 (+ 27441us) write_op.cc:276] Timestamp: P: 1783599593038164 usec, L: 0
0709 12:19:53.076595 (+  5887us) op_driver.cc:348] REPLICATION: starting
0709 12:19:53.192086 (+115491us) log.cc:844] Serialized 536 byte log entry
0709 12:19:53.955688 (+763602us) op_driver.cc:464] REPLICATION: finished
0709 12:19:54.112017 (+156329us) write_op.cc:301] APPLY: starting
0709 12:19:54.112143 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:54.112296 (+   153us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:54.112476 (+   180us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:54.126621 (+ 14145us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:54.126808 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:19:54.126850 (+    42us) write_op.cc:312] APPLY: finished
0709 12:19:54.180357 (+ 53507us) log.cc:844] Serialized 23 byte log entry
0709 12:19:54.180559 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:54.180660 (+   101us) write_op.cc:454] Released schema lock
0709 12:19:54.180700 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:54.181432 (+   732us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:54.181468 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1548,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":142032,"apply.run_cpu_time_us":2568,"apply.run_wall_time_us":69426,"num_ops":1,"prepare.queue_time_us":113239,"prepare.run_cpu_time_us":27274,"prepare.run_wall_time_us":624036,"raft.queue_time_us":158008,"raft.run_cpu_time_us":32452,"raft.run_wall_time_us":176120,"replication_time_us":860968,"thread_start_us":680170,"threads_started":4,"wal-append.queue_time_us":463106}]]}
I20260709 12:19:54.337733 27142 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:54.342291 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 88503.5us
I20260709 12:19:54.344550 27085 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:54.345199 27085 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.293861 27089 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:19:54.298589 27110 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:19:54.366621 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.353220 25269 raft_consensus.cc:2955] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:54.301393 27065 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.359601 27093 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:54.377274 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 78581.7us
I20260709 12:19:54.390463 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:54.392211 25271 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
W20260709 12:19:54.390200 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 47619.6us
I20260709 12:19:54.393991 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.394830 27170 consensus_queue.cc:1059] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:54.395316 27143 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:54.396389 25242 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:54.401111 27123 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:54.393530 27166 consensus_queue.cc:1059] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:19:54.402343 27085 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:54.395208 27094 raft_consensus.cc:2955] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:54.407675 27071 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.409982 25201 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:54.412976 27173 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:19:54.426975 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.428694 27166 raft_consensus.cc:3055] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:54.429162 27166 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:19:54.430253 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 63729.9us
I20260709 12:19:54.432948 27143 consensus_queue.cc:1059] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:54.435858 27166 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.436659 27065 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:54.437135 27166 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:54.414204 27164 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:54.438619 27133 raft_consensus.cc:3055] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:54.438990 27133 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:54.439801 27133 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:54.441005 27133 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:54.446450 27174 raft_consensus.cc:3055] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:54.446914 27174 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:54.447084 25024 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41770 (request call id 324) took 1648 ms. Trace:
I20260709 12:19:54.447533 25024 rpcz_store.cc:276] 0709 12:19:52.798464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.798642 (+   178us) service_pool.cc:224] Handling call
0709 12:19:54.447021 (+1648379us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31364,"reported_tablets":4}
I20260709 12:19:54.447902 27174 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.449327 27174 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:54.431142 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 100085us
I20260709 12:19:54.450912 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.453054 25025 catalog_manager.cc:5697] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 2, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.454797 25025 catalog_manager.cc:5697] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 3 to 4, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.455775 25093 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.456243 25025 catalog_manager.cc:5697] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 4 to 5, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 5 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.457054 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.458196 25093 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.450750 25825 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:54.454813 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.458349 25274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:44212
I20260709 12:19:54.461937 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:54.464123 25271 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:19:54.460543 25274 raft_consensus.cc:606] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:19:54.459699 27164 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:54.466584 27132 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:54.480679 27136 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:54.492852 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:54.487383 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:54.496840 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:54.497501 25242 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.497639 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:54.498708 27088 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:54.503545 27168 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:54.497721 27163 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:54.487603 27143 consensus_queue.cc:1059] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 12:19:54.493707 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 95539.7us
I20260709 12:19:54.515280 27143 raft_consensus.cc:3055] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:54.515731 27143 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:54.516659 27143 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:54.517686 27168 raft_consensus.cc:1064] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:54.484119 27123 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:19:54.480265 27087 consensus_queue.cc:1059] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:19:54.518841 27142 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:54.519284 27142 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:54.519506 27087 raft_consensus.cc:3055] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:54.519997 27087 raft_consensus.cc:740] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:54.520227 27142 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:54.520911 27087 consensus_queue.cc:260] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:54.492254 27132 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:54.521855 27142 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:54.524601 27132 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:54.537500 27167 raft_consensus.cc:3055] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:54.538004 27167 raft_consensus.cc:740] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:54.539129 25270 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:54.538981 27167 consensus_queue.cc:260] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.540289 27167 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:54.541743 25092 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:54.545384 27074 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:54.549783 25271 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:54.564497 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:54.541821 27143 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:54.553000 27170 raft_consensus.cc:1064] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:19:54.569510 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.567910 25270 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:19:54.575582 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:19:54.577898 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 119759us
I20260709 12:19:54.583725 25092 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:54.551836 27130 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:54.574792 27087 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:54.576285 27169 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:54.579787 27166 consensus_queue.cc:1059] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:19:54.581172 25022 catalog_manager.cc:5697] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 4, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 4 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:54.592271 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:54.608486 25202 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:19:54.590644 25092 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:54.603070 25022 catalog_manager.cc:5697] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index 4 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:54.604972 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:54.611997 25859 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:54.573459 27167 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:54.619477 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.615885 27121 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:19:54.557864 27176 consensus_queue.cc:1059] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:19:54.591790 27173 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:54.602339 27071 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:54.591846 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:54.637504 25201 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:54.590296 27179 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:54.634411 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 43856.4us
I20260709 12:19:54.640676 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:54.637039 25851 raft_consensus.cc:2955] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:54.648238 27164 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:54.648168 27144 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:54.650810 25199 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:54.623268 27169 consensus_queue.cc:1059] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:19:54.642573 27177 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:54.641558 27167 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:54.572031 27168 consensus_queue.cc:237] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.667176 27176 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:54.699045 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.663194 27164 consensus_queue.cc:1059] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:19:54.680353 27130 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.711709 27132 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.643523 27170 consensus_queue.cc:237] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.715039 27130 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.725128 25274 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:54.728947 25269 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:19:54.713079 27178 log.cc:927] Time spent T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:19:54.736398 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:54.739938 25274 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:54.738054 25859 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:54.741375 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:54.742758 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:54.743453 25201 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:54.744581 25241 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:54.714228 27163 raft_consensus.cc:3055] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:54.725199 27130 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:54.786343 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 145750us
I20260709 12:19:54.787824 25092 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:19:54.793175 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 158431us
I20260709 12:19:54.769488 27163 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:54.770385 27071 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:19:54.773898 27175 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:19:54.802855 25093 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.772389 27121 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:54.766106 27094 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:19:54.773658 27134 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:54.802304 25092 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:54.795514 27093 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.796761 27169 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:54.813331 27180 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:19:54.776162 27079 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:19:54.796710 27167 consensus_queue.cc:1059] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:19:54.826522 27134 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.876504 27134 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:54.807264 27071 raft_consensus.cc:697] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:54.946928 27163 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:54.948268 27163 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:54.831434 27121 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
W20260709 12:19:54.960737 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 157960us
I20260709 12:19:54.961885 25093 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:54.843035 27093 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.017598 25202 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
W20260709 12:19:54.966850 27174 consensus_meta.cc:287] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.511s	user 0.003s	sys 0.015s
W20260709 12:19:54.967290 27140 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.160s	user 0.004s	sys 0.006s
W20260709 12:19:55.058707 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 96890.9us
I20260709 12:19:55.059798 25093 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.061175 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:19:55.032389 27181 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:19:55.032940 27173 raft_consensus.cc:3055] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:55.086632 27170 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.017206 27177 consensus_queue.cc:1059] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:19:55.071713 27166 raft_consensus.cc:3055] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:55.085065 27132 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:55.085683 27173 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:55.083757 27174 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:55.109234 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.110798 27085 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.101737 27121 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:55.103971 27136 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:55.138415 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 77293.5us
I20260709 12:19:55.144582 25093 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:19:55.138775 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 336530us
I20260709 12:19:55.148809 25092 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:55.150192 27188 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:55.159257 27192 log.cc:927] Time spent T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:19:55.073434 27071 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.109373 27166 raft_consensus.cc:740] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:19:55.174593 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 214683us
I20260709 12:19:55.162886 27170 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:55.136286 27198 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.195616 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:55.196400 25268 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
W20260709 12:19:55.197856 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 53396.9us
I20260709 12:19:55.198856 25093 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.200312 25093 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.202814 27174 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:55.203768 27174 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.201926 25093 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.204627 27174 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:55.211901 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:55.212999 25165 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:55.149070 27085 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.163060 27136 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.217563 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:55.233721 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:55.244704 25093 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.246932 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.248210 27166 consensus_queue.cc:260] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.249193 25093 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:55.250211 27198 consensus_queue.cc:1059] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:55.251331 27198 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:55.254082 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.254580 25195 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:55.272226 27093 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:55.207019 27176 raft_consensus.cc:3055] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:55.277868 27176 raft_consensus.cc:740] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:55.216775 27194 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.217134 27180 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.290781 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:55.282605 25127 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:55.288574 25856 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:55.296667 25268 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:19:55.298306 25267 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:19:55.300401 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.301945 27188 raft_consensus.cc:3055] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:55.302354 27188 raft_consensus.cc:740] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:55.302855 27085 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:55.303159 27188 consensus_queue.cc:260] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:55.305310 27167 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:55.252876 27087 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.223536 27079 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:19:55.363920 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 55019.7us
I20260709 12:19:55.320973 25122 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:55.272692 27174 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.371356 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:55.372349 25269 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
I20260709 12:19:55.305711 27167 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:55.276446 27168 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 12:19:55.376500 25822 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:55.278889 27176 consensus_queue.cc:260] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.280570 27134 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.275404 27170 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:19:55.369095 27079 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.374537 27118 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.319523 27187 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:55.363392 27121 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:19:55.409065 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 102975us
I20260709 12:19:55.214201 27173 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.308135 27093 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.418452 27173 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:55.418414 27093 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:55.420703 27093 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:55.416477 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 267741us
I20260709 12:19:55.402801 27195 raft_consensus.cc:3055] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:55.422786 25092 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.424511 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:55.425441 25274 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:55.426878 25165 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:55.427393 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.370221 27087 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:55.428037 25122 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:55.318507 27203 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 12:19:55.413357 27079 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:55.439875 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:55.407548 27201 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:19:55.424657 27195 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:55.447959 27187 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:19:55.451385 27190 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.356s	user 0.003s	sys 0.002s
I20260709 12:19:55.446290 27194 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:55.451570 27187 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:55.452316 27194 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:55.453650 27194 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.446475 27179 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:55.435726 27072 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:55.454267 25126 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:55.459462 25271 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:19:55.461776 25242 leader_election.cc:336] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.510s (SENT)
I20260709 12:19:55.414705 27204 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:19:55.461926 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.467375 25123 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:55.442179 27220 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:55.468879 27220 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.469223 27220 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:55.444147 27176 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:55.464151 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.416455 27118 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:55.504740 27118 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:55.506554 25118 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:55.507297 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 45556.7us
I20260709 12:19:55.509042 27133 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.510370 27194 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:55.515411 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.462955 27072 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:55.530730 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 60248.4us
W20260709 12:19:55.532320 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 92574.5us
I20260709 12:19:55.533267 25092 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.534623 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:55.538415 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.537609 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:19:55.550695 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 139072us
I20260709 12:19:55.552093 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.552493 25118 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:55.556641 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.551195 27072 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:55.568266 25122 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:55.569485 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.562662 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.520190 25123 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:55.556243 27164 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:55.559085 27203 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:55.567342 25825 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:55.557806 27174 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:55.585225 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.577086 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.561517 27201 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:55.583046 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.522086 27118 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 12:19:55.600114 25825 leader_election.cc:336] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.511s (SENT)
I20260709 12:19:55.600530 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.586921 25121 raft_consensus.cc:2376] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2. Re-sending same reply.
I20260709 12:19:55.589661 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:19:55.601351 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.601387 27143 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.601629 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.602121 27143 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:55.602830 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.603858 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.604249 27143 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:55.604988 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.606072 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.606101 27220 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:55.608182 25825 leader_election.cc:336] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.518s (SENT)
I20260709 12:19:55.608440 27220 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:55.608670 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.609035 27220 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:55.609632 25825 leader_election.cc:336] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.547s (SENT)
I20260709 12:19:55.604367 25121 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:19:55.610229 27222 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.610018 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.611790 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.613611 27222 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:55.614205 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.614743 25127 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
I20260709 12:19:55.615490 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.619691 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.611033 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.621690 25126 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:55.625010 25121 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
W20260709 12:19:55.632118 27224 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:19:55.634788 27072 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:55.552878 27179 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:19:55.580442 27136 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:55.639966 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.639463 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.640390 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:55.643802 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:19:55.605024 27163 consensus_meta.cc:287] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.004s
I20260709 12:19:55.646430 25126 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:55.663791 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.664574 25126 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:55.596854 27225 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:55.668220 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.668035 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:55.668052 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:55.671691 25193 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:55.672066 25197 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:55.646169 27074 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:55.677685 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.675896 25126 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:55.678826 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.679486 25126 raft_consensus.cc:2376] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2. Re-sending same reply.
I20260709 12:19:55.681344 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.686872 27079 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.690387 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:55.691226 25197 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:55.691560 27087 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:55.693809 25125 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:55.694928 25198 raft_consensus.cc:2393] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:55.619374 27201 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.699226 25127 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:55.703435 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.705469 25126 raft_consensus.cc:2376] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2. Re-sending same reply.
I20260709 12:19:55.714179 25125 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:55.714578 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.715315 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.689728 27079 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:55.716043 25125 raft_consensus.cc:2376] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4. Re-sending same reply.
I20260709 12:19:55.718412 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.719251 25125 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:55.711699 25193 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:55.677863 27122 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.726055 27122 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:55.723635 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.719866 27072 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:55.728976 27122 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:55.742985 25125 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:55.743046 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:55.729272 27195 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:55.746389 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.747125 25168 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:55.697875 27225 raft_consensus.cc:697] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:55.708901 27201 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:55.722311 27198 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:55.753121 25168 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:55.762451 27093 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:55.762962 27093 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:55.763775 27093 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:55.753747 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.766739 25125 raft_consensus.cc:2376] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2. Re-sending same reply.
I20260709 12:19:55.767959 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.769335 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.768924 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:55.770496 25125 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:55.698175 27206 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.754923 27121 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:55.756827 27072 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:55.759837 25123 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:55.760003 27134 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:55.745183 27122 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:19:55.790875 25121 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:55.696553 27074 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
W20260709 12:19:55.772959 27216 log.cc:927] Time spent T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:19:55.772527 27218 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:19:55.775499 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:55.775646 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:55.780318 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:55.783988 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:55.797173 25274 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:55.797387 25273 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:19:55.792526 27208 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:55.771613 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:19:55.794585 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 74734.8us
I20260709 12:19:55.796705 25269 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:55.800163 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.801108 25125 raft_consensus.cc:2376] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4. Re-sending same reply.
I20260709 12:19:55.802284 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:19:55.800402 25825 leader_election.cc:336] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.649s (SENT)
W20260709 12:19:55.806933 25825 leader_election.cc:336] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.709s (SENT)
I20260709 12:19:55.807430 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.808501 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:19:55.809139 25825 leader_election.cc:336] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.789s (SENT)
I20260709 12:19:55.809721 25825 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:55.809753 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.811506 25125 raft_consensus.cc:2393] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:55.813239 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.815219 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.816692 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.816823 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.817525 25121 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:55.817539 25125 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:55.795250 27121 raft_consensus.cc:697] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:55.808660 27187 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.829788 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.812917 27208 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:55.835186 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.836165 25125 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:19:55.777585 27225 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:55.836786 25825 leader_election.cc:336] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.692s (SENT)
I20260709 12:19:55.819435 27201 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.845587 27210 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:55.846212 27167 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.847349 27167 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:55.855736 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.857038 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.857735 25127 raft_consensus.cc:2368] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4.
I20260709 12:19:55.858364 27231 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:55.862071 25119 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:55.844552 27201 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.866106 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.867285 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.868127 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.868378 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.870074 25123 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:55.839587 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.871261 25274 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:55.872653 25273 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
W20260709 12:19:55.877166 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:55.874823 25825 leader_election.cc:336] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.701s (SENT)
I20260709 12:19:55.796342 27206 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:55.878759 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.878794 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:55.891373 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:55.892519 25121 raft_consensus.cc:2376] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2. Re-sending same reply.
I20260709 12:19:55.893676 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.894583 25123 raft_consensus.cc:2376] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4. Re-sending same reply.
I20260709 12:19:55.865818 27201 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:55.897259 27074 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:55.909483 25825 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:55.910779 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:55.906244 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:55.833989 27187 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:55.915480 25121 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:55.922416 25168 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:55.914551 25122 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:19:55.920799 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:19:55.921219 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.927521 27231 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:55.929369 27144 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:55.929544 27231 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:55.929809 27144 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:55.929961 27231 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:55.930238 27144 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:55.927996 27134 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:55.931830 27134 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:55.932252 27134 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:55.928102 27210 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:55.934806 27080 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:55.935264 27080 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.935668 27080 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:55.938808 27188 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:55.938625 27208 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:55.941267 25123 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:55.948221 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:55.950147 25123 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:55.939980 27208 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:55.958673 27121 consensus_queue.cc:237] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:55.737739 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:56.104583 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.097892 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:55.982702 25856 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:56.108933 25270 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:55.980376 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:56.058974 25024 catalog_manager.cc:5697] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 3 to 4, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 4 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:56.109961 25859 raft_consensus.cc:2393] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:56.032963 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:19:55.978343 25242 leader_election.cc:336] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.529s (SENT)
I20260709 12:19:55.979741 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:56.110997 25242 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:56.061338 25022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41770 (request call id 325) took 1568 ms. Trace:
W20260709 12:19:56.045486 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:56.030606 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 50578.1us
I20260709 12:19:56.044039 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:56.031631 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:19:56.115674 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 137359us
I20260709 12:19:56.116488 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:56.121940 25197 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:56.027869 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:56.117250 27094 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.123150 25853 raft_consensus.cc:2393] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:56.123011 27094 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:56.124116 25199 raft_consensus.cc:2376] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4. Re-sending same reply.
I20260709 12:19:56.125389 27094 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:56.045572 27212 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.126542 27212 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:56.117430 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 73527.4us
I20260709 12:19:56.127988 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:56.110862 25123 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:19:56.074143 25854 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:56.129774 25825 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:19:56.113126 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.117059 27143 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:56.131719 27212 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:56.045701 27122 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:19:56.133258 27166 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:56.121646 27130 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:56.134559 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:56.028105 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:56.136493 25855 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 2: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:56.137164 27122 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.130633 25168 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:55.959555 27223 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:55.980746 27218 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.164383 27199 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.164598 27218 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.167790 25198 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:56.131017 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:56.111315 25858 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:19:56.137809 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:56.125963 27136 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:56.140411 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:56.178066 25274 raft_consensus.cc:2393] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:56.142282 25202 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:19:56.117699 25242 leader_election.cc:336] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.531s (SENT)
I20260709 12:19:56.179234 25242 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:56.180583 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:56.181481 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:56.182301 25272 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:19:56.183212 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:56.183874 25272 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:56.112192 25022 rpcz_store.cc:276] 0709 12:19:54.493420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.497567 (+  4147us) service_pool.cc:224] Handling call
0709 12:19:56.061250 (+1563683us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:55.032102 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:55.151003 (+118901us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:55.163957 (+ 12954us) write_op.cc:435] Acquired schema lock
0709 12:19:55.163991 (+    34us) tablet.cc:662] Decoding operations
0709 12:19:55.252698 (+ 88707us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:55.272422 (+ 19724us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:55.276198 (+  3776us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:19:55.304996 (+ 28798us) tablet.cc:701] Row locks acquired
0709 12:19:55.305014 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:19:55.305162 (+   148us) write_op.cc:270] Start()
0709 12:19:55.305263 (+   101us) write_op.cc:276] Timestamp: P: 1783599595305118 usec, L: 0
0709 12:19:55.305288 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:19:55.408189 (+102901us) log.cc:844] Serialized 982 byte log entry
0709 12:19:55.462290 (+ 54101us) op_driver.cc:464] REPLICATION: finished
0709 12:19:55.630364 (+168074us) write_op.cc:301] APPLY: starting
0709 12:19:55.639339 (+  8975us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:55.666902 (+ 27563us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:55.692219 (+ 25317us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:55.695109 (+  2890us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:55.695284 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:19:55.695341 (+    57us) write_op.cc:312] APPLY: finished
0709 12:19:55.695553 (+   212us) log.cc:844] Serialized 29 byte log entry
0709 12:19:55.695712 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:55.695802 (+    90us) write_op.cc:454] Released schema lock
0709 12:19:55.695847 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:55.712139 (+ 16292us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:55.722053 (+  9914us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":928,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":163224,"apply.run_cpu_time_us":2511,"apply.run_wall_time_us":70482,"num_ops":2,"prepare.queue_time_us":367185,"prepare.run_cpu_time_us":4773,"prepare.run_wall_time_us":400666,"replication_time_us":156883,"thread_start_us":111174,"threads_started":1}]]}
I20260709 12:19:55.980865 27201 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.029279 27187 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:56.045420 27195 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:55.978686 27210 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.146s
I20260709 12:19:56.158500 27074 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.181378 25276 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
W20260709 12:19:56.208228 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 90542.6us
W20260709 12:19:56.219750 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:56.220350 25242 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.589s (SENT)
I20260709 12:19:56.220775 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:56.031193 27206 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:56.131902 27226 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:56.207221 25024 catalog_manager.cc:5697] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:56.206768 25025 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41756 (request call id 372) took 1987 ms. Trace:
I20260709 12:19:56.217482 25198 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:56.160467 27132 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:56.218724 25119 raft_consensus.cc:2955] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:19:56.162524 27223 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:56.231030 25198 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:56.206462 27081 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:56.211418 27087 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:56.138787 27144 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.157658 27134 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.162988 27122 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:56.246127 25198 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:56.239064 27081 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.157950 27231 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.234894 27223 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:56.225128 27074 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:56.252830 27081 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:56.164971 27199 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.178162 27080 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:56.215636 27201 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:56.210990 27136 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.223042 25025 rpcz_store.cc:276] 0709 12:19:54.219088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.221873 (+  2785us) service_pool.cc:224] Handling call
0709 12:19:54.263457 (+ 41584us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54002ef754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e78090 00007f2103f16f3a 00007f2109ccce9c 00007f2109dcb04e 00007f210828c2a4 00007f210828c232 00007f210828c161 00007f210828c0dc 00007f210828b392 00007f210224948c 00007f21022488c6
0709 12:19:56.206707 (+1943250us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:54.823580 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:54.824132 (+   552us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:54.824163 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:19:54.824180 (+    17us) tablet.cc:662] Decoding operations
0709 12:19:54.824714 (+   534us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:54.824788 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:54.824817 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:19:54.825147 (+   330us) tablet.cc:701] Row locks acquired
0709 12:19:54.825164 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:19:54.825292 (+   128us) write_op.cc:270] Start()
0709 12:19:54.825395 (+   103us) write_op.cc:276] Timestamp: P: 1783599594825246 usec, L: 0
0709 12:19:54.825418 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:19:54.942142 (+116724us) log.cc:844] Serialized 1317 byte log entry
0709 12:19:55.138695 (+196553us) op_driver.cc:464] REPLICATION: finished
0709 12:19:55.409738 (+271043us) write_op.cc:301] APPLY: starting
0709 12:19:55.411236 (+  1498us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:55.428697 (+ 17461us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:55.457164 (+ 28467us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:55.567758 (+110594us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:55.587837 (+ 20079us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:19:55.619859 (+ 32022us) write_op.cc:312] APPLY: finished
0709 12:19:55.661783 (+ 41924us) log.cc:844] Serialized 35 byte log entry
0709 12:19:55.672430 (+ 10647us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:55.680525 (+  8095us) write_op.cc:454] Released schema lock
0709 12:19:55.692801 (+ 12276us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:55.706316 (+ 13515us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:55.706349 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":454495,"reported_tablets":3,"spinlock_wait_cycles":24925056,"child_traces":[["op",{"apply.queue_time_us":236017,"apply.run_cpu_time_us":7913,"apply.run_wall_time_us":303560,"num_ops":3,"prepare.queue_time_us":341795,"prepare.run_cpu_time_us":4808,"prepare.run_wall_time_us":140519,"replication_time_us":313072,"spinlock_wait_cycles":1792,"thread_start_us":349960,"threads_started":2}]]}
I20260709 12:19:56.278236 25197 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:56.232901 27226 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:56.281311 25198 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
W20260709 12:19:56.281899 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 152294us
I20260709 12:19:56.287925 27074 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:56.290192 27203 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:56.312335 25825 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:56.279969 27087 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:56.317502 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:56.319437 25193 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:19:56.321076 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:56.321842 25276 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:56.321920 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:56.321338 25859 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:56.293902 27132 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.323238 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:56.313445 27074 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:19:56.325825 27212 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:56.327903 25202 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:56.313784 27226 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:56.309821 27072 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.314743 27094 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:56.322506 27173 consensus_meta.cc:287] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.903s	user 0.010s	sys 0.002s
I20260709 12:19:56.313982 27187 consensus_queue.cc:1059] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:19:56.342751 27187 raft_consensus.cc:3055] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:56.342962 27080 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:56.324077 27210 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:56.343155 27187 raft_consensus.cc:740] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:19:56.351950 25273 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:56.317406 27133 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:19:56.344650 27110 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:56.354434 27087 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.369274 27136 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:56.369164 27087 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:56.364990 25273 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:56.344960 27094 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:56.371555 27087 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:56.371158 27187 consensus_queue.cc:260] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.357085 27130 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:56.334718 27132 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.287379 25270 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:56.361207 27210 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:19:56.379317 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 212933us
I20260709 12:19:56.387241 25118 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:56.344532 27072 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.397246 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:56.409765 25122 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:56.413197 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:56.413956 25122 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:19:56.418555 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:56.419269 25119 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:56.428542 25122 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:19:56.462455 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:56.463497 25119 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:56.368212 27081 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:56.410728 27187 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:56.378206 27087 consensus_queue.cc:1059] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:19:56.472710 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:56.474493 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:19:56.471578 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:56.482278 27231 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:56.415521 27130 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:56.421355 27136 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:56.493930 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.480950 27223 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:56.483583 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 320581us
I20260709 12:19:56.464645 27144 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:56.487757 27225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.044s	sys 0.110s
I20260709 12:19:56.511267 25165 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:56.473665 27134 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:56.522933 27208 consensus_meta.cc:287] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
W20260709 12:19:56.514856 27225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.044s	sys 0.110s
I20260709 12:19:56.525624 25856 raft_consensus.cc:1240] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:56.518821 27218 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:56.515895 27136 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.538667 27074 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:56.528221 27201 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:56.551442 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 331087us
I20260709 12:19:56.520200 27210 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.547711 27074 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.548509 27218 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:56.557618 27188 consensus_meta.cc:287] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.000s
I20260709 12:19:56.569234 25855 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:56.555620 27201 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:56.562595 27235 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:19:56.572680 25127 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:19:56.563500 27072 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:56.565862 27218 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.565024 27074 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:56.576385 27203 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.588737 27218 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:56.596542 27081 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:56.588469 27132 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:56.628274 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 321562us
I20260709 12:19:56.565202 27130 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:56.610997 25242 leader_election.cc:336] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.657s (SENT)
I20260709 12:19:56.666369 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:56.666793 25822 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:19:56.626784 27223 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:56.668871 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:19:56.672361 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 114590us
W20260709 12:19:56.673242 25242 leader_election.cc:336] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.659s (SENT)
I20260709 12:19:56.673489 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:56.673621 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:19:56.612295 27203 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:56.681520 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:56.676820 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:19:56.668386 27237 log.cc:927] Time spent T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 12:19:56.676359 27232 log.cc:927] Time spent T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260709 12:19:56.684938 27087 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:56.724855 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1470) took 1165 ms. Trace:
I20260709 12:19:56.725404 25126 rpcz_store.cc:276] 0709 12:19:55.559922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.727942 (+168020us) service_pool.cc:224] Handling call
0709 12:19:55.728249 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:55.728861 (+   612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:55.728890 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:55.729346 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:19:56.206401 (+477055us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:56.206440 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.206503 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.724599 (+518096us) raft_consensus.cc:1685] finished
0709 12:19:56.724623 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.724786 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":476694,"threads_started":1,"wal-append.queue_time_us":686220}
I20260709 12:19:56.723871 27087 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.728533 27087 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:56.731314 27087 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:56.701411 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:56.704255 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:19:56.669874 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 346679us
W20260709 12:19:56.712646 27143 consensus_meta.cc:287] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.002s
I20260709 12:19:56.734495 27143 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:56.715926 27239 log.cc:927] Time spent T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 12:19:56.735327 27233 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 12:19:56.743466 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 270792us
I20260709 12:19:56.738694 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1472) took 1039 ms. Trace:
I20260709 12:19:56.678646 27231 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:19:56.756844 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 247454us
I20260709 12:19:56.678752 27220 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:56.666564 27188 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:19:56.761473 25168 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:56.677838 27244 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:56.763797 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:56.766960 25165 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:56.755101 25124 rpcz_store.cc:276] 0709 12:19:55.698987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.925158 (+226171us) service_pool.cc:224] Handling call
0709 12:19:55.925531 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:55.925934 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:55.925976 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:55.952311 (+ 26335us) log.cc:844] Serialized 26 byte log entry
0709 12:19:56.409846 (+457535us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:56.682407 (+272561us) log.cc:844] Serialized 14 byte log entry
0709 12:19:56.682625 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.684641 (+  2016us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.738455 (+ 53814us) raft_consensus.cc:1685] finished
0709 12:19:56.738477 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.738624 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8545,"raft.queue_time_us":841,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":21229,"thread_start_us":554629,"threads_started":2,"wal-append.queue_time_us":565123}
W20260709 12:19:56.792822 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 318397us
I20260709 12:19:56.781291 25165 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:19:56.830567 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:56.836499 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 55276.3us
I20260709 12:19:56.761132 27231 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.755172 27143 consensus_queue.cc:1059] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
W20260709 12:19:56.813225 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 51880.7us
I20260709 12:19:56.782364 27118 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:56.869306 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:56.851022 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2077) took 1044 ms. Trace:
I20260709 12:19:56.868492 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:56.843223 25165 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:19:56.798774 27121 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:56.850726 25168 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:56.755734 27225 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:19:56.798646 27220 raft_consensus.cc:697] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:19:56.881349 27243 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:56.883960 27243 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.877872 25127 rpcz_store.cc:276] 0709 12:19:55.806493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.867919 (+ 61426us) service_pool.cc:224] Handling call
0709 12:19:56.850825 (+982906us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54002ae754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:19:56.850950 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616330624}
I20260709 12:19:56.884394 27243 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:56.843699 27072 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:56.885313 27072 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:56.886298 27072 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.843784 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:56.798871 27085 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:19:56.881821 27206 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:19:56.867530 27166 consensus_meta.cc:287] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.734s	user 0.004s	sys 0.009s
I20260709 12:19:56.868166 27203 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:56.880295 25168 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:56.883343 27220 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:56.840660 27242 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:57.072095 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:56.994920 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1476) took 1104 ms. Trace:
I20260709 12:19:56.996182 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:57.072095 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:56.843839 27231 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:56.910383 27199 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:56.875509 27118 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:56.912039 27173 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:57.023983 25851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 563) took 1426 ms (client timeout 1571 ms). Trace:
W20260709 12:19:57.095777 25851 rpcz_store.cc:269] 0709 12:19:55.589329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.589449 (+   120us) service_pool.cc:224] Handling call
0709 12:19:57.015234 (+1425785us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b5400373cd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:19:57.015384 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139798272}
I20260709 12:19:56.844357 27087 raft_consensus.cc:3055] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:57.097185 27087 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:19:57.021382 25118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 345) took 1470 ms (client timeout 1666 ms). Trace:
W20260709 12:19:57.098273 25118 rpcz_store.cc:269] 0709 12:19:55.544075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.556410 (+ 12335us) service_pool.cc:224] Handling call
0709 12:19:57.014474 (+1458064us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b540021e8d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:19:57.014626 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813111168}
I20260709 12:19:57.072268 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:57.071452 25275 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:19:56.993626 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 234861us
I20260709 12:19:56.969265 25093 leader_election.cc:400] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:19:57.082790 25273 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:57.077455 27242 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:56.971369 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 91128us
W20260709 12:19:56.931859 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:57.061101 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 302592us
I20260709 12:19:56.907722 27094 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:56.868271 27136 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:57.008841 27226 consensus_meta.cc:287] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.001s
I20260709 12:19:56.848235 27122 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:57.040171 27187 consensus_meta.cc:287] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.001s
I20260709 12:19:56.974278 27255 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:57.042520 27133 raft_consensus.cc:3055] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:57.081833 25125 rpcz_store.cc:276] 0709 12:19:55.890802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.052617 (+161815us) service_pool.cc:224] Handling call
0709 12:19:56.052953 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:56.077868 (+ 24915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.077938 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:56.078807 (+   869us) log.cc:844] Serialized 26 byte log entry
0709 12:19:56.610816 (+532009us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:56.994135 (+383319us) log.cc:844] Serialized 14 byte log entry
0709 12:19:56.994499 (+   364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.994601 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.994654 (+    53us) raft_consensus.cc:1685] finished
0709 12:19:56.994672 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.994845 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":296740,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":22211,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":21779,"thread_start_us":775196,"threads_started":2,"wal-append.queue_time_us":575079}
I20260709 12:19:56.974426 27079 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:57.106112 25851 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:57.106359 25093 leader_election.cc:403] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:57.107144 25860 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:57.106339 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:19:57.132299 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 291315us
I20260709 12:19:56.951785 27143 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:57.086867 25267 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:56.913240 25855 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:57.047338 27074 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:57.136289 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:57.146041 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:57.149385 25125 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:57.015614 27218 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.137744 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:57.152453 25127 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:57.106268 27242 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:57.138335 25859 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:57.101636 27118 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:57.138295 27079 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.094640 27206 raft_consensus.cc:697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:57.139748 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:57.133845 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:57.149587 25124 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:57.041121 27243 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:57.137614 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 75632.2us
I20260709 12:19:57.137253 27188 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
W20260709 12:19:57.154951 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 158868us
I20260709 12:19:57.173237 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:57.131021 27133 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:57.166635 25197 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:19:57.177728 25093 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:57.167456 25119 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:57.154695 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:19:57.180456 25118 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:19:57.169243 25127 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
W20260709 12:19:57.163728 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 57004.4us
I20260709 12:19:57.106016 27173 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.183327 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:57.186408 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:57.191188 27136 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:57.191817 27136 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.192263 27136 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.194217 27270 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.194772 27270 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.196880 27271 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:57.128997 27226 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.143740 27143 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:57.206310 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:19:57.219098 25271 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:19:57.219780 25092 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:19:57.165627 27079 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:57.211696 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:57.222121 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:19:57.222817 25272 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:57.212566 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:57.213433 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:19:57.188669 27262 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.111s	user 0.000s	sys 0.002s
I20260709 12:19:57.214318 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:19:57.226558 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:19:57.230700 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 57459.8us
I20260709 12:19:57.137116 27255 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:57.185894 27166 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:57.177134 27251 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.233590 25242 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:57.156028 27187 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 12:19:57.217794 27267 log.cc:927] Time spent T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
I20260709 12:19:57.241863 25859 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:19:57.218606 27134 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:57.271018 27251 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.273466 25274 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:19:57.241870 27166 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.203136 27269 consensus_queue.cc:1059] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:19:57.232415 27188 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:19:57.328380 27136 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:57.272684 27274 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:57.332670 25272 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:57.349609 25120 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:57.301450 27166 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:57.291973 27254 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.330202 27276 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.244824 27133 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.299381 27279 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.378044 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 832) took 1107 ms. Trace:
I20260709 12:19:57.333364 27080 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.385758 25197 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 12:19:57.394160 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.363104 27260 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:57.312542 27206 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:19:57.228355 27195 raft_consensus.cc:2955] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:19:57.560825 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.383388 25858 rpcz_store.cc:276] 0709 12:19:56.270284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.270403 (+   119us) service_pool.cc:224] Handling call
0709 12:19:56.274540 (+  4137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:56.274884 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.274913 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:56.290647 (+ 15734us) log.cc:844] Serialized 26 byte log entry
0709 12:19:56.765627 (+474980us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b18001cfea0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae0d1 00007f2103ec9a0f
0709 12:19:57.007639 (+242012us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:57.007685 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.007759 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:57.373493 (+365734us) raft_consensus.cc:1685] finished
0709 12:19:57.373532 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:57.377946 (+  4414us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1695,"raft.queue_time_us":13701,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":15604,"spinlock_wait_cycles":8424320,"thread_start_us":241823,"threads_started":1,"wal-append.queue_time_us":778595}
I20260709 12:19:57.576346 27243 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:57.656674 27274 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.410395 27080 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.657089 27269 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.658006 27274 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.379254 27254 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.784328 27274 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:57.784529 27254 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:57.413539 27251 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:57.659014 27269 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:57.634927 27244 consensus_meta.cc:287] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.000s
I20260709 12:19:57.787056 27244 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:57.787199 27269 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:57.789147 27269 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.789769 27269 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.792363 27269 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:57.605801 27143 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:57.595851 27255 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:57.597888 27226 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:57.467453 27133 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:57.808378 25024 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33480 (request call id 267) took 3316 ms. Trace:
I20260709 12:19:57.809890 27255 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.810487 27255 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.812997 27255 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:57.460851 27270 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:57.527866 27141 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:19:57.500788 27261 log.cc:927] Time spent T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
W20260709 12:19:57.833537 27242 consensus_meta.cc:287] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.002s
I20260709 12:19:57.409351 27279 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:57.575555 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 342019us
I20260709 12:19:57.851336 25242 leader_election.cc:400] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4.
I20260709 12:19:57.851831 25242 leader_election.cc:403] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:57.852941 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 589) took 1119 ms. Trace:
I20260709 12:19:57.498221 27218 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:57.855702 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:57.856420 25855 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:19:57.853294 25270 rpcz_store.cc:276] 0709 12:19:56.719440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.719578 (+   138us) service_pool.cc:224] Handling call
0709 12:19:56.719954 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:56.720164 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.720188 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:56.720673 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:19:56.874786 (+154113us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:56.874821 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.874886 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:57.362996 (+488110us) raft_consensus.cc:1685] finished
0709 12:19:57.363019 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:57.838315 (+475296us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":153711,"threads_started":1,"wal-append.queue_time_us":356274}
I20260709 12:19:57.862056 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:57.863144 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:19:57.852571 25267 consensus_meta.cc:287] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.697s	user 0.004s	sys 0.007s
I20260709 12:19:57.382799 27276 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.864809 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:57.581897 27085 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:57.857313 27287 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:57.863420 27079 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.627s	user 0.007s	sys 0.004s
W20260709 12:19:57.882325 25271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.033s	sys 0.085s
W20260709 12:19:57.884018 25271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.033s	sys 0.085s
I20260709 12:19:57.879150 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:19:57.889333 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:57.864089 27270 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4.
I20260709 12:19:57.865911 27255 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:57.903582 25166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.028s	sys 0.126s
W20260709 12:19:57.906080 25091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.016s	sys 0.021s
I20260709 12:19:57.878563 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:57.976084 25168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.014s	sys 0.055s
W20260709 12:19:57.976313 27130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.043s	sys 0.100s
W20260709 12:19:57.976536 25168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.014s	sys 0.055s
W20260709 12:19:57.976670 27130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.043s	sys 0.100s
I20260709 12:19:57.977833 27301 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:19:57.961647 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 83033.5us
I20260709 12:19:57.901892 27079 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:57.966848 25122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.022s	sys 0.026s
I20260709 12:19:57.469127 27260 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:57.808830 25024 rpcz_store.cc:276] 0709 12:19:54.491499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.491673 (+   174us) service_pool.cc:224] Handling call
0709 12:19:57.808298 (+3316625us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:56.726421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:56.727066 (+   645us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:56.727106 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:19:56.727134 (+    28us) tablet.cc:662] Decoding operations
0709 12:19:56.727666 (+   532us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:56.727747 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:56.727791 (+    44us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:19:56.728201 (+   410us) tablet.cc:701] Row locks acquired
0709 12:19:56.728230 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:19:56.728431 (+   201us) write_op.cc:270] Start()
0709 12:19:56.728575 (+   144us) write_op.cc:276] Timestamp: P: 1783599596728359 usec, L: 0
0709 12:19:56.728628 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 12:19:56.729506 (+   878us) log.cc:844] Serialized 919 byte log entry
0709 12:19:57.080614 (+351108us) op_driver.cc:464] REPLICATION: finished
0709 12:19:57.151500 (+ 70886us) write_op.cc:301] APPLY: starting
0709 12:19:57.156156 (+  4656us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:57.176258 (+ 20102us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:57.206517 (+ 30259us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:57.286941 (+ 80424us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:57.331002 (+ 44061us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:19:57.362877 (+ 31875us) write_op.cc:312] APPLY: finished
0709 12:19:57.384693 (+ 21816us) log.cc:844] Serialized 29 byte log entry
0709 12:19:57.409484 (+ 24791us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:57.461044 (+ 51560us) write_op.cc:454] Released schema lock
0709 12:19:57.468907 (+  7863us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":426300,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":57301,"apply.run_cpu_time_us":10464,"apply.run_wall_time_us":681431,"num_ops":2,"prepare.queue_time_us":489876,"prepare.run_cpu_time_us":3519,"prepare.run_wall_time_us":31027,"replication_time_us":351762,"thread_start_us":405090,"threads_started":2}]]}
W20260709 12:19:57.908216 25166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.029s	sys 0.126s
I20260709 12:19:57.903417 27143 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:57.970494 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:57.900626 27269 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:57.888134 27278 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:57.875208 27287 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:57.971635 25091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.017s	sys 0.026s
I20260709 12:19:57.903697 27274 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:57.981432 25165 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:19:57.991457 25122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.022s	sys 0.026s
I20260709 12:19:57.993259 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:57.845160 27242 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.001009 25856 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:58.011878 27079 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:57.907024 27251 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 12:19:58.019419 27291 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.905120 27282 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:57.970265 25267 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:19:57.900662 27085 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.024466 25856 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:19:57.978513 27301 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:57.967116 27121 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:58.001166 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 814617us
I20260709 12:19:58.012995 27274 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.003594 27080 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.000627 27143 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.979151 27290 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:58.005586 27270 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.008021 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 568) took 1486 ms. Trace:
W20260709 12:19:58.014355 27118 consensus_meta.cc:287] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.002s
I20260709 12:19:58.012637 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:58.026489 25168 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:58.022464 27079 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.063840 25168 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:58.030604 27251 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:19:58.061748 27166 consensus_meta.cc:287] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.000s
W20260709 12:19:58.130575 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 66817.6us
W20260709 12:19:58.132200 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 228858us
I20260709 12:19:58.131731 25168 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:58.061980 27242 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.062403 25853 rpcz_store.cc:276] 0709 12:19:56.521431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.523892 (+  2461us) service_pool.cc:224] Handling call
0709 12:19:56.545213 (+ 21321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:56.563110 (+ 17897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.564616 (+  1506us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:56.605714 (+ 41098us) log.cc:844] Serialized 26 byte log entry
0709 12:19:56.997480 (+391766us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:56.997539 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.997617 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:57.971024 (+973407us) raft_consensus.cc:1685] finished
0709 12:19:57.972615 (+  1591us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:58.005144 (+ 32529us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":3956,"thread_start_us":314582,"threads_started":1,"wal-append.queue_time_us":535340}
I20260709 12:19:58.070251 27080 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:58.146898 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:19:58.064999 27118 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.020011 27291 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.031123 27143 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:58.028071 27274 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:58.157505 25092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.033s	sys 0.076s
I20260709 12:19:58.138959 25168 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:58.161342 25242 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:19:58.154599 27231 consensus_meta.cc:287] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 1.053s	user 0.005s	sys 0.008s
I20260709 12:19:58.030121 27121 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.139448 27279 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.135576 27290 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.190121 27290 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:58.174595 25092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.034s	sys 0.076s
W20260709 12:19:58.176478 25854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.004s	sys 0.022s
W20260709 12:19:58.192111 25854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.004s	sys 0.022s
W20260709 12:19:58.161593 27094 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.016s	sys 0.006s
W20260709 12:19:58.193151 27094 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.016s	sys 0.006s
I20260709 12:19:58.013810 27278 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.196563 27278 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:58.180015 25825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.009s	sys 0.025s
W20260709 12:19:58.181044 25241 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.010s	sys 0.028s
W20260709 12:19:58.197492 25825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.010s	sys 0.025s
W20260709 12:19:58.197649 25241 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.010s	sys 0.028s
W20260709 12:19:58.198107 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 1.03289e+06us
I20260709 12:19:58.198289 27265 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:58.198849 27265 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.199512 27223 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:58.200102 27223 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.201107 27265 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:58.202169 25270 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:58.181327 27260 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:58.205850 27223 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:58.185676 25193 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:19:58.160133 27080 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.205598 27260 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:58.206732 27080 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:58.065140 27270 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:58.210959 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 991188us
I20260709 12:19:58.211478 27270 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.212428 27270 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:58.213040 27270 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.215600 27270 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.216307 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:58.171391 27269 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:58.173126 27288 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:19:58.219946 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 238564us
I20260709 12:19:58.135159 27166 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:58.173350 27275 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:58.071492 27079 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.223477 25825 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:58.237439 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:58.238600 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:19:58.221174 27200 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:58.217864 27255 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:58.286077 27188 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:58.287324 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 570) took 1127 ms. Trace:
I20260709 12:19:58.288647 27110 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:19:58.295236 25120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 340) took 2755 ms (client timeout 1856 ms). Trace:
W20260709 12:19:58.381786 25120 rpcz_store.cc:269] 0709 12:19:55.540104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.551839 (+ 11735us) service_pool.cc:224] Handling call
0709 12:19:58.294968 (+2743129us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400454554. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:19:58.295121 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3829397888}
I20260709 12:19:58.382651 27256 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:58.299983 27173 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.304391 27286 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.383749 27256 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.384018 27286 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.374397 27200 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.322782 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 1510) took 1096 ms. Trace:
I20260709 12:19:58.385918 27200 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:58.386199 25274 rpcz_store.cc:276] 0709 12:19:57.226119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.226283 (+   164us) service_pool.cc:224] Handling call
0709 12:19:58.322497 (+1096214us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b54002a8d54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:19:58.322656 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100443904}
W20260709 12:19:58.330417 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.332894 27087 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.390547 27087 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:58.336341 27136 raft_consensus.cc:3055] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:58.380661 25859 rpcz_store.cc:276] 0709 12:19:57.159464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.160683 (+  1219us) service_pool.cc:224] Handling call
0709 12:19:58.287113 (+1126430us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b54008723d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:19:58.287254 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125580160}
I20260709 12:19:58.339977 27074 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:58.347440 27249 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:58.348485 27187 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:58.358250 27252 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.359486 27248 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:19:58.274811 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 47982.9us
I20260709 12:19:58.255612 25199 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:19:58.373346 27255 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:58.369545 27265 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:58.376627 27294 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:58.224500 27288 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.223169 27223 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:58.224619 27269 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:58.224643 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:58.236229 27275 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.184574 27231 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.238991 27276 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.025637 27282 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.371582 27278 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.375825 27287 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:58.237095 27302 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:58.405992 27301 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.414290 27266 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:58.394431 27136 raft_consensus.cc:740] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:19:58.425689 27286 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.253767 27293 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.399569 27173 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.422897 27085 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:58.434824 27248 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:58.483129 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 60373.1us
I20260709 12:19:58.394376 27188 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.487354 27231 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:58.480434 27275 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:58.488374 27305 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:58.402150 27187 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.697263 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:58.698069 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:58.666658 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:58.698601 25200 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:19:58.699251 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:58.699818 25193 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:19:58.520790 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:58.406966 27255 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:58.699982 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 499631us
I20260709 12:19:58.700045 25195 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:19:58.526630 25167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.020s	sys 0.020s
I20260709 12:19:58.513731 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:58.637413 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:58.803561 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:58.804013 25197 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
W20260709 12:19:58.516700 25091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.022s	sys 0.018s
W20260709 12:19:58.726784 27094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.033s	sys 0.066s
W20260709 12:19:58.728011 25242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.021s	sys 0.032s
W20260709 12:19:58.807588 25242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.023s	sys 0.039s
I20260709 12:19:58.514353 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:58.727757 25090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.004s	sys 0.022s
W20260709 12:19:58.726595 25168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.006s	sys 0.056s
I20260709 12:19:58.700075 27080 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:58.727134 25122 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.021s	sys 0.031s
W20260709 12:19:58.753237 25093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.015s	sys 0.013s
I20260709 12:19:58.753585 27310 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:19:58.754376 25240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.024s	sys 0.028s
I20260709 12:19:58.491460 27276 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:58.428130 27269 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:58.521816 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:58.423846 27288 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:58.630064 27251 raft_consensus.cc:697] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:58.555321 27173 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:58.493366 27252 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.791229 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:58.807557 27118 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.800900 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:58.587814 27110 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.698506 27210 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:19:58.804896 25091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.024s	sys 0.028s
I20260709 12:19:58.666904 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:58.805753 25167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.044s	sys 0.047s
I20260709 12:19:58.917273 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:58.917474 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 943844us
W20260709 12:19:58.845114 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.505592 27278 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.484602 27294 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:58.925663 25851 raft_consensus.cc:1240] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:58.874040 25168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.006s	sys 0.075s
I20260709 12:19:58.874259 25198 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
W20260709 12:19:58.874346 25090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.008s	sys 0.036s
W20260709 12:19:58.883581 25123 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.021s	sys 0.023s
W20260709 12:19:58.873654 25093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.016s	sys 0.014s
W20260709 12:19:58.873556 25122 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.027s	sys 0.031s
I20260709 12:19:58.891106 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:19:58.898900 27295 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.516s	user 0.001s	sys 0.000s
I20260709 12:19:58.900115 27319 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:58.900941 27318 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:58.870820 27212 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 12:19:58.902232 25240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.024s	sys 0.028s
I20260709 12:19:58.804737 27304 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.698735 27244 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:58.910669 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:58.804495 27121 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:58.903443 27072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.013s	sys 0.014s
I20260709 12:19:58.913501 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:58.920094 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:58.920428 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:19:58.951155 25123 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.030s	sys 0.027s
I20260709 12:19:58.893246 27166 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:58.986670 27166 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:58.987313 27166 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:58.807344 27094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.035s	sys 0.073s
I20260709 12:19:58.990825 27312 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:58.858632 27248 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:58.952273 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:58.919083 27291 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.965756 25202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c305b34a0c54275af750c832f52691f"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:19:58.997150 25202 raft_consensus.cc:606] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:19:58.965904 27320 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:58.909111 25853 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:58.914451 25855 raft_consensus.cc:1240] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:58.967561 25193 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:58.806084 27136 consensus_queue.cc:260] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.927561 27210 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.970497 27251 consensus_queue.cc:237] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:58.973032 27173 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:58.915774 27276 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.974293 27282 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.480755 27249 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.919581 27079 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:58.925441 27301 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:58.873200 27317 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:58.956239 27286 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.967645 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.047097 25856 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 3: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:19:58.993283 27072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.014s	sys 0.014s
I20260709 12:19:59.012408 27166 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:59.013330 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:19:59.013270 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:19:59.015421 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 63223.5us
I20260709 12:19:58.927289 27110 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.748872 27302 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.797216 27305 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:58.669011 27293 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:59.005471 27133 consensus_meta.cc:287] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.200s	user 0.011s	sys 0.001s
I20260709 12:19:58.991673 27312 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.025600 27291 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:58.992053 27252 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:59.030997 27173 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.994283 27244 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.003311 27304 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.002477 27320 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.033962 27136 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:59.033547 27282 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:58.911763 27310 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.044464 27317 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:58.993957 27319 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.010284 27318 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.113907 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.159853 25200 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:59.161293 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:19:59.165000 25092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.008s	sys 0.055s
W20260709 12:19:59.165434 25092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.008s	sys 0.055s
I20260709 12:19:59.045688 27188 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.167254 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.170627 25858 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:19:59.168843 27314 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:59.166450 27307 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:19:59.173674 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:19:59.095395 27303 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:19:59.174309 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:59.224694 25856 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:19:59.153972 27297 log.cc:927] Time spent T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.305s	user 0.001s	sys 0.001s
W20260709 12:19:59.174964 27299 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 12:19:59.175675 27133 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:59.061805 27187 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.242113 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.243010 25858 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:59.218823 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.174134 27188 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.246999 27188 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:59.208206 27291 raft_consensus.cc:697] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:19:59.039371 27301 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:59.146631 27200 consensus_meta.cc:287] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.760s	user 0.006s	sys 0.006s
I20260709 12:19:59.089898 27308 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:59.151428 27203 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:59.167120 27225 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.229713 27166 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:19:59.222289 27320 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.264559 27203 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:59.128789 27249 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:59.153641 27276 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.269281 27203 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:59.269798 27203 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:59.270267 27203 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.272141 27203 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.272553 27203 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.272936 27203 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.172118 27282 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.251341 27187 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.232999 27304 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.060000 27294 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:59.088275 27278 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.066041 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.172399 27173 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:59.244477 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.244556 25859 raft_consensus.cc:2410] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:59.279826 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.094357 27080 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:59.172354 27305 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.245569 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:19:59.246371 27110 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:59.246201 27133 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.248992 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.240520 27312 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:59.255118 27195 consensus_meta.cc:287] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.596s	user 0.008s	sys 0.006s
I20260709 12:19:59.255623 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 834) took 2927 ms. Trace:
I20260709 12:19:59.236568 27319 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.234622 27293 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.238621 27310 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.256580 25200 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:19:59.310519 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:59.311657 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:19:59.312287 25200 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 3: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:19:59.312868 27133 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.253808 25167 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:19:59.154495 27269 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:59.314584 27173 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:59.261276 25856 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:19:59.054931 27286 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.229274 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.221802 27314 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:19:59.266486 27323 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:19:59.262461 27200 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.266556 27320 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:19:59.299310 25852 raft_consensus.cc:2368] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3.
I20260709 12:19:59.299597 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.299983 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.315816 27269 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:59.280952 27304 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.321273 27256 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.274199 27308 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.306227 25854 rpcz_store.cc:276] 0709 12:19:56.327818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.327981 (+   163us) service_pool.cc:224] Handling call
0709 12:19:56.328286 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:56.741830 (+413544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.741878 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.374847 (+632969us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b2c00047098. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:19:57.379725 (+  4878us) log.cc:844] Serialized 26 byte log entry
0709 12:19:58.192523 (+812798us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:58.687537 (+495014us) log.cc:844] Serialized 14 byte log entry
0709 12:19:58.687905 (+   368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.688013 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:59.248557 (+560544us) raft_consensus.cc:1685] finished
0709 12:19:59.255398 (+  6841us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:59.255541 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36115,"prepare.queue_time_us":710157,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":36285,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":56188,"spinlock_wait_cycles":25725184,"thread_start_us":1491524,"threads_started":3,"wal-append.queue_time_us":1144825}
I20260709 12:19:59.267743 27225 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.275056 27166 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.319015 27319 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:19:59.281522 27187 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.326439 27291 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.492717 27130 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:19:59.328051 27318 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.477644 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:19:59.631706 27166 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.632310 27319 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.632838 27187 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.498509 27210 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:59.424360 27087 consensus_meta.cc:287] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.033s	user 0.011s	sys 0.001s
W20260709 12:19:59.550792 27274 consensus_meta.cc:287] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.366s	user 0.012s	sys 0.001s
I20260709 12:19:59.635500 27319 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.635666 27274 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:19:59.331127 27320 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.630693 27130 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:19:59.638360 27320 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.367072 25197 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:59.369437 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 427) took 1512 ms. Trace:
W20260709 12:19:59.411834 27307 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:19:59.374735 27203 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.460405 27282 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:59.466604 27255 consensus_meta.cc:287] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.001s
I20260709 12:19:59.463831 27244 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:59.504894 27275 consensus_meta.cc:287] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.720s	user 0.009s	sys 0.003s
I20260709 12:19:59.451184 27301 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:59.643375 27130 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:59.528564 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:19:59.669339 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 140826us
I20260709 12:19:59.639905 25199 rpcz_store.cc:276] 0709 12:19:57.857362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.860130 (+  2768us) service_pool.cc:224] Handling call
0709 12:19:59.369207 (+1509077us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400220e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:19:59.369361 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540453248}
I20260709 12:19:59.309319 27302 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:19:59.427486 27143 consensus_meta.cc:287] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.245s	user 0.007s	sys 0.004s
I20260709 12:19:59.327973 27188 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:19:59.671167 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 417374us
W20260709 12:19:59.674718 25241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.018s	sys 0.036s
W20260709 12:19:59.675030 25241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.018s	sys 0.036s
W20260709 12:19:59.676678 25119 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.451s	user 0.056s	sys 0.140s
W20260709 12:19:59.463471 27288 consensus_meta.cc:287] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.002s
W20260709 12:20:00.015167 25825 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.627s (SENT) [suppressed 43 similar messages]
W20260709 12:19:59.935477 25239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.023s	sys 0.034s
W20260709 12:19:59.940748 25123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.063s	sys 0.071s
I20260709 12:20:00.016810 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:00.038241 25239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.023s	sys 0.036s
W20260709 12:20:00.038349 25123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.063s	sys 0.075s
I20260709 12:19:59.665076 27255 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:19:59.935065 25240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.029s	sys 0.034s
W20260709 12:20:00.362006 25240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.386s	user 0.029s	sys 0.036s
I20260709 12:20:00.017549 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:19:59.941128 25242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.038s	sys 0.095s
W20260709 12:20:00.363844 25242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.551s	user 0.042s	sys 0.097s
I20260709 12:19:59.420194 27314 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:59.410816 27317 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:59.739486 27143 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:00.367165 27143 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:59.344866 27304 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.371021 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:00.020949 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 205546us
I20260709 12:20:00.373075 25167 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:00.373852 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:00.374327 25167 leader_election.cc:400] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3.
I20260709 12:20:00.374773 25167 leader_election.cc:403] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:00.374701 25854 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:19:59.465126 27200 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.670176 27275 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:00.376287 25201 raft_consensus.cc:2368] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:20:00.377521 27275 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:19:59.368954 27286 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.678751 27306 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:00.378507 27306 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.380960 27306 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:19:59.638531 27274 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:59.507438 27144 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:00.381989 27144 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.385123 27144 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:19:59.673936 27210 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:00.150249 27094 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:00.024091 25119 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.799s	user 0.056s	sys 0.140s
I20260709 12:20:00.386077 27094 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:00.387238 27243 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:00.387943 27243 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:00.386072 27210 raft_consensus.cc:697] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:00.389430 27210 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.393699 25854 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:00.398419 27314 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3.
I20260709 12:20:00.369668 27304 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:00.389331 27243 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.419586 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:00.324939 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:00.428591 25271 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:00.324565 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.029961 27254 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.435703 27254 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:20:00.047170 27288 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.041015 27319 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:00.041133 27244 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.323588 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:00.145020 25822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.350s	user 0.025s	sys 0.068s
W20260709 12:20:00.202594 27251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.048s	user 0.013s	sys 0.033s
I20260709 12:20:00.045815 27079 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:20:00.039233 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.337535 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:00.346259 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:00.388005 27094 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:00.461333 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:00.334843 27270 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.118s	user 0.031s	sys 0.032s
I20260709 12:20:00.494643 25275 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:00.488722 25822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.693s	user 0.028s	sys 0.084s
W20260709 12:20:00.496142 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 1.70079e+06us
I20260709 12:20:00.440086 27308 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:00.488998 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.489277 25270 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6.
I20260709 12:20:00.460870 25854 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:20:00.499773 25854 pending_rounds.cc:85] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 4
I20260709 12:20:00.485348 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.326166 27328 consensus_queue.cc:1059] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 12:20:00.492563 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:00.294308 27225 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:00.461052 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.490120 27079 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:00.509703 25268 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:00.502238 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.450425 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:00.483647 27274 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:00.495167 27270 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.279s	user 0.032s	sys 0.033s
I20260709 12:20:00.500697 25273 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
W20260709 12:20:00.488510 27251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.336s	user 0.013s	sys 0.047s
I20260709 12:20:00.500073 25854 pending_rounds.cc:107] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:20:00.506675 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.484182 27143 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:00.466338 27317 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.515872 25854 raft_consensus.cc:2917] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
W20260709 12:20:00.516808 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 501632us
I20260709 12:20:00.513146 27079 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:00.497654 27319 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.515980 27274 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:00.125384 25122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.054s	sys 0.036s
I20260709 12:20:00.047456 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 389) took 2828 ms. Trace:
W20260709 12:20:00.355052 25090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.377s	user 0.007s	sys 0.016s
W20260709 12:20:00.353017 25091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.402s	user 0.015s	sys 0.009s
W20260709 12:20:00.358795 25093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.382s	user 0.003s	sys 0.020s
W20260709 12:20:00.378880 25201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 1955) took 1858 ms (client timeout 1883 ms). Trace:
I20260709 12:20:00.506417 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:00.609334 25090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.632s	user 0.007s	sys 0.016s
I20260709 12:20:00.517285 25274 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:20:00.519034 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:00.517426 25857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.212s	user 0.009s	sys 0.035s
W20260709 12:20:00.524170 27223 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.520s	user 0.034s	sys 0.066s
W20260709 12:20:00.664840 25857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.359s	user 0.009s	sys 0.036s
W20260709 12:20:00.665225 27223 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.667s	user 0.034s	sys 0.066s
W20260709 12:20:00.665714 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 144461us
W20260709 12:20:00.618499 25168 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.020s	sys 0.029s
I20260709 12:20:00.666713 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 856) took 1423 ms. Trace:
W20260709 12:20:00.667069 25168 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.020s	sys 0.029s
W20260709 12:20:00.667658 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 651929us
I20260709 12:20:00.668906 25822 leader_election.cc:400] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6.
I20260709 12:20:00.667243 25857 rpcz_store.cc:276] 0709 12:19:59.242994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.300688 (+ 57694us) service_pool.cc:224] Handling call
0709 12:19:59.301026 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.301273 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:59.305019 (+  3746us) log.cc:844] Serialized 14 byte log entry
0709 12:20:00.665814 (+1360795us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:00.665934 (+   120us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:00.666129 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.666288 (+   159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:00.666552 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4770,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":1360022,"threads_started":1,"wal-append.queue_time_us":1269263}
I20260709 12:20:00.669356 25822 leader_election.cc:403] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:20:00.611121 25091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.660s	user 0.015s	sys 0.009s
W20260709 12:20:00.528729 27195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.201s	user 0.007s	sys 0.039s
W20260709 12:20:00.671551 27195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.346s	user 0.007s	sys 0.039s
W20260709 12:20:00.611348 25092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.445s	user 0.018s	sys 0.017s
I20260709 12:20:00.672729 27195 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:00.618441 25165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.015s	sys 0.018s
W20260709 12:20:00.611742 25093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.635s	user 0.004s	sys 0.020s
I20260709 12:20:00.651887 25267 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:00.620327 25200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.012s
W20260709 12:20:00.678673 25200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.001s	sys 0.012s
I20260709 12:20:00.652007 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:00.620800 25201 rpcz_store.cc:269] 0709 12:19:58.520419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.520538 (+   119us) service_pool.cc:224] Handling call
0709 12:20:00.378702 (+1858164us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54000b18d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:00.378825 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3851677440}
I20260709 12:20:00.659297 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.609042 25123 rpcz_store.cc:276] 0709 12:19:57.210493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.214872 (+  4379us) service_pool.cc:224] Handling call
0709 12:19:57.215297 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.460548 (+245251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:57.460829 (+   281us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.836650 (+375821us) log.cc:844] Serialized 26 byte log entry
0709 12:19:58.267817 (+431167us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:58.980667 (+712850us) log.cc:844] Serialized 14 byte log entry
0709 12:20:00.038769 (+1058102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.038843 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:00.038879 (+    36us) raft_consensus.cc:1685] finished
0709 12:20:00.038892 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:00.039014 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5245,"prepare.queue_time_us":633288,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":312854,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":48275,"thread_start_us":2296325,"threads_started":4,"wal-append.queue_time_us":912880}
I20260709 12:20:00.682099 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:00.608573 25122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.631s	user 0.065s	sys 0.049s
W20260709 12:20:00.531399 27290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.273s	user 0.021s	sys 0.081s
I20260709 12:20:00.683916 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 390) took 3473 ms. Trace:
W20260709 12:20:00.684175 27290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.426s	user 0.021s	sys 0.081s
W20260709 12:20:00.522742 27291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.016s	sys 0.029s
I20260709 12:20:00.553762 27255 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:00.685146 27290 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:00.686265 27290 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.687655 27274 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:00.688889 27288 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:00.689281 27290 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:00.497268 27244 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.690464 27286 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.691664 27286 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:20:00.522311 27254 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:00.693400 27244 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:00.673859 25165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.015s	sys 0.018s
I20260709 12:20:00.518733 25854 raft_consensus.cc:2889] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:00.689957 27290 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.695043 27290 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:00.685405 27291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.016s	sys 0.029s
I20260709 12:20:00.698405 27290 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:00.652670 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:00.660272 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:00.680236 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.699764 25268 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:00.700336 25272 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:00.700742 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.700892 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:00.673048 25092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.507s	user 0.019s	sys 0.017s
I20260709 12:20:00.701819 25268 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:00.620033 25198 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:00.703042 25271 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:00.519940 27143 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:00.705022 25271 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:20:00.705438 25271 pending_rounds.cc:85] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 4
I20260709 12:20:00.701651 25269 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:00.684712 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.705725 25271 pending_rounds.cc:107] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:20:00.767688 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.776229 25268 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:00.705948 27143 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:00.770172 25271 raft_consensus.cc:2917] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
W20260709 12:20:00.765791 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 97291.1us
I20260709 12:20:00.706818 27255 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.772475 25267 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:00.708069 27322 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:00.795341 25269 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:00.718138 27335 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:00.770090 27290 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.802563 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.803709 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.805470 25273 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:00.718461 27336 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:00.673873 27195 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.819121 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.825560 25271 raft_consensus.cc:2889] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:00.559121 27330 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:00.552211 27332 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.684510 25122 rpcz_store.cc:276] 0709 12:19:57.210792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.215671 (+  4879us) service_pool.cc:224] Handling call
0709 12:19:57.216012 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.272185 (+ 56173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:57.272222 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.330741 (+ 58519us) log.cc:844] Serialized 26 byte log entry
0709 12:19:58.010274 (+679533us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:58.951764 (+941490us) log.cc:844] Serialized 14 byte log entry
0709 12:20:00.683313 (+1731549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.683462 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:00.683557 (+    95us) raft_consensus.cc:1685] finished
0709 12:20:00.683573 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:00.683784 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30580,"prepare.queue_time_us":890334,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":320289,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":168,"thread_start_us":3317593,"threads_started":4,"wal-append.queue_time_us":810670,"wal-append.run_cpu_time_us":4772,"wal-append.run_wall_time_us":1834976}
I20260709 12:20:00.830554 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.831790 25268 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:00.807376 27255 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:00.831700 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.819729 27308 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.717736 27334 consensus_queue.cc:1059] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 12:20:00.574198 27319 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:00.841090 25272 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:00.847023 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:00.847731 25268 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:00.849298 27326 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.850198 27231 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEARNER]: Leader election lost for term 5. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6.
I20260709 12:20:00.851248 25199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:20:00.852497 25199 raft_consensus.cc:606] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:20:00.856966 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:00.858158 25197 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:00.858146 27336 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:00.860809 27336 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:00.860972 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:00.852056 27290 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.863968 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:00.865724 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 439) took 1853 ms. Trace:
I20260709 12:20:00.866348 25197 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:00.866160 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.877323 25198 rpcz_store.cc:276] 0709 12:19:59.012423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.012931 (+   508us) service_pool.cc:224] Handling call
0709 12:20:00.865383 (+1852452us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400360e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:00.865616 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2950146816}
I20260709 12:20:00.879081 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:00.880143 25198 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 2: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:00.881384 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:00.867733 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:00.868844 27332 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.885013 27255 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:00.869933 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:00.885967 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.871532 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:00.887063 25272 raft_consensus.cc:2368] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3.
I20260709 12:20:00.825917 27322 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:00.840351 27286 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:00.869418 27308 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:00.520644 27317 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.873922 25195 raft_consensus.cc:2955] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:00.876071 27195 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:00.845701 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.878705 27330 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:00.892952 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.850235 27326 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.896207 27244 raft_consensus.cc:3055] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:00.896818 27244 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:00.897364 27326 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:00.834233 27335 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.894241 27339 raft_consensus.cc:3055] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:00.901126 27339 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:00.903014 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.903439 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:00.903841 25271 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:20:00.904232 25123 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:00.905112 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:00.904668 27244 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:00.905727 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:00.893905 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:00.906605 25126 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:20:00.907778 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:00.907861 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:00.908948 25123 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:00.909466 25120 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:00.891520 27322 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:00.892683 27308 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:00.896873 27330 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:00.881630 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:00.910703 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:00.911618 25127 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:00.906066 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:00.885442 27332 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:00.913035 25122 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:00.913486 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:00.914712 25118 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:20:00.914844 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:00.886365 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:00.916376 27244 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:00.919358 25272 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:00.924301 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:00.925661 25201 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:00.902880 27339 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:00.925535 25267 raft_consensus.cc:2955] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:00.905982 25121 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
W20260709 12:20:01.210350 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.095808 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 384) took 3886 ms. Trace:
I20260709 12:20:00.962342 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:01.077839 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:01.181542 25275 consensus_meta.cc:287] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.003s
I20260709 12:20:01.182168 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:01.149173 25200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 1960) took 1913 ms. Trace:
W20260709 12:20:01.078346 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 121139us
I20260709 12:20:01.267890 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.038779 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:00.969923 27353 log.cc:927] Time spent T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:20:01.041615 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:01.043915 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:00.963070 27357 log.cc:927] Time spent T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:20:00.965142 27358 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:20:01.172181 27359 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
W20260709 12:20:00.963917 27350 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:20:01.305649 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.310881 25269 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:01.281317 27223 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.311959 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.312722 25269 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:01.312484 27223 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:01.312930 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:01.313633 25197 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:01.095568 27285 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:01.314463 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:01.315088 27223 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:01.315337 25199 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:01.316124 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.316330 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:01.316875 25271 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:01.317730 27339 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:01.317905 25271 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:01.309783 25274 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:01.319325 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:01.325059 27335 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:01.325923 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:01.326874 25201 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:01.327606 27329 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:01.328576 25854 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:01.328399 27329 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:01.040738 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:01.265384 25119 rpcz_store.cc:276] 0709 12:19:57.208948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.216605 (+  7657us) service_pool.cc:224] Handling call
0709 12:19:57.217002 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.462698 (+245696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:57.462744 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.841994 (+379250us) log.cc:844] Serialized 26 byte log entry
0709 12:19:58.184499 (+342505us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:00.386397 (+2201898us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.095119 (+708722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.095276 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:01.095372 (+    96us) raft_consensus.cc:1685] finished
0709 12:20:01.095395 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.095599 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11689,"prepare.queue_time_us":716431,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":240249,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":19250,"thread_start_us":3103946,"threads_started":4,"wal-append.queue_time_us":1341281,"wal-append.run_cpu_time_us":40058,"wal-append.run_wall_time_us":1574540}
I20260709 12:20:01.303495 27252 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.078748 27333 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.337560 25275 raft_consensus.cc:2410] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:20:01.289081 25200 rpcz_store.cc:276] 0709 12:19:59.235803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.317392 (+ 81589us) service_pool.cc:224] Handling call
0709 12:19:59.386626 (+ 69234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:59.674082 (+287456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:59.674111 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:59.821123 (+147012us) log.cc:844] Serialized 26 byte log entry
0709 12:20:00.679417 (+858294us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:00.679509 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.679659 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:01.128115 (+448456us) raft_consensus.cc:1685] finished
0709 12:20:01.128139 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.148815 (+ 20676us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b5400220e50. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:01.149078 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":694420,"raft.queue_time_us":290525,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"spinlock_wait_cycles":158382336,"thread_start_us":571641,"threads_started":1,"wal-append.queue_time_us":925817}
I20260709 12:20:01.335970 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.335721 25858 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:20:01.340409 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:01.336753 27223 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.969789 27079 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:01.350762 25272 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:01.351785 27304 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.346913 27252 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:01.347343 27335 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:01.352375 27304 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:01.358124 27243 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:01.357810 27335 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:01.358726 25268 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:01.361939 27285 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:01.362663 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.362689 27285 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:01.363844 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.364413 25269 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:20:01.365229 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.365765 25269 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:01.340687 25857 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:01.346463 27290 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:01.370002 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.371976 25195 raft_consensus.cc:2393] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:01.372403 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.347254 27223 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:01.380692 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 216933us
I20260709 12:20:01.379812 25273 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:01.365965 27285 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:01.380892 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.377355 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:01.383123 25269 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:01.381950 27362 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:01.387966 27362 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:01.389777 25272 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
W20260709 12:20:01.391446 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 429323us
W20260709 12:20:01.392200 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 51795.1us
I20260709 12:20:01.359694 27333 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:01.393137 27317 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:01.403409 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:01.404276 27243 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:01.405683 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.408283 25120 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:01.409389 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.410247 25275 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:01.412998 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.388628 27252 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:01.399945 25090 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:01.406622 25822 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:01.421172 27327 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:01.422873 27243 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:01.424206 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:01.430720 27335 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:01.436256 25822 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:01.436546 25857 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:01.436841 27223 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:01.437338 27362 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:01.437829 27327 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:01.438686 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:01.439339 25854 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:01.441218 25851 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:20:01.441891 25271 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
W20260709 12:20:01.444573 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 74282.2us
I20260709 12:20:01.451593 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.451049 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:01.455737 27291 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:01.438330 27329 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:01.454815 25241 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:01.450160 27252 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:01.462169 27252 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.469048 25241 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:01.469957 27231 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:01.471177 27079 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:01.471117 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:01.472438 25121 raft_consensus.cc:2368] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:20:01.454411 27326 consensus_queue.cc:1059] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:20:01.465216 27252 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:01.465386 27335 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:01.477044 27335 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.477475 27335 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:01.479938 25090 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:01.480876 27362 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:01.481016 25090 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:01.481467 27362 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.481884 27362 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:01.482210 25165 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:01.468644 25271 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
W20260709 12:20:01.489317 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1604047280002305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
W20260709 12:20:01.494673 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1604047280002305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
W20260709 12:20:01.495136 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1541047280002203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 12:20:01.497224 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1496047280002131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 12:20:01.497548 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1496047280002131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 12:20:01.497838 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1055047280001418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
W20260709 12:20:01.498139 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1055047280001418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
W20260709 12:20:01.498540 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1037047280001389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 12:20:01.498950 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1037047280001389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 12:20:01.499265 25242 connection.cc:256] RPC call timeout handler was delayed by -1.0461047280000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 12:20:01.502493 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.503712 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.504746 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.505329 27304 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:01.506208 27079 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:01.507984 27130 raft_consensus.cc:3055] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:01.508431 27130 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:01.480815 27231 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:20:01.509464 27130 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:01.487109 27244 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:01.490245 25276 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:01.488761 27339 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:01.526856 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.535100 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:01.536001 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 45531.8us
I20260709 12:20:01.537389 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:01.491103 27329 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:01.532881 25167 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:01.539471 25269 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:01.511245 27333 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:01.532680 27287 raft_consensus.cc:3055] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:01.547075 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:01.545601 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 84256.7us
I20260709 12:20:01.546164 25242 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:01.549811 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 80465.7us
I20260709 12:20:01.520308 27244 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.529337 27339 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.552085 25121 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:20:01.540812 27329 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.560271 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:01.561416 25125 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:20:01.568394 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:01.549398 27287 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:01.578584 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:01.554160 27243 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:01.579746 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:01.580041 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:01.559625 27244 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:01.563056 27130 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:01.555747 27339 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:01.606608 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 68120us
I20260709 12:20:01.607569 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:01.608462 27255 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:01.608916 27255 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:01.609320 27255 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:01.614046 27339 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:01.581396 25822 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:01.581666 25118 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:01.582309 25165 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:01.570125 27329 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:01.555061 27079 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:20:01.626215 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:01.635041 25126 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:20:01.588928 25122 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:01.616585 27243 raft_consensus.cc:697] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:01.620704 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:01.623896 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:01.624372 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 48226us
I20260709 12:20:01.636507 25125 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:01.634405 25276 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:01.581460 27304 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:01.641000 25127 raft_consensus.cc:2410] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:20:01.624869 27369 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:01.646824 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 62741.7us
I20260709 12:20:01.652813 25851 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:01.656849 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:01.657238 27079 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:01.657480 25127 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:01.657789 27079 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:01.658375 27079 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:01.660434 27243 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:01.643975 27369 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:01.664455 27369 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:01.664665 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:01.667574 27287 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:01.669140 27287 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:01.673014 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:01.674135 27304 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:01.674552 27304 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:01.674954 27304 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:01.712563 25118 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
W20260709 12:20:01.716343 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 74595.7us
I20260709 12:20:01.718261 25090 leader_election.cc:400] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3.
I20260709 12:20:01.718750 25090 leader_election.cc:403] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:01.721896 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:01.723202 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:01.705904 27339 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:01.723888 25120 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:01.730280 25118 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:20:01.733443 25276 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:01.735278 27362 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:01.737413 27362 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:01.738957 25127 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:01.747515 27255 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:01.749047 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:01.750201 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 102506us
W20260709 12:20:01.772766 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 199856us
W20260709 12:20:01.842823 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 89381.3us
I20260709 12:20:01.773270 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:01.909847 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:01.942819 25822 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:01.844944 25125 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:01.901755 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.867236 25126 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
W20260709 12:20:01.857669 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.965492 25271 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:01.964193 25118 raft_consensus.cc:2393] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 5: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:01.966821 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:01.967768 25118 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:20:01.841378 27335 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:01.964774 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:01.970752 25121 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:01.971064 27335 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:01.962735 27255 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:01.936964 27079 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:01.839838 27367 log.cc:927] Time spent T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.225s	user 0.004s	sys 0.000s
I20260709 12:20:01.982242 27370 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:01.982805 27370 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.983172 27370 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:01.983300 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:01.983814 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 610) took 1094 ms. Trace:
I20260709 12:20:01.985074 25242 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:01.984186 25270 rpcz_store.cc:276] 0709 12:20:00.888839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.968462 (+ 79623us) service_pool.cc:224] Handling call
0709 12:20:00.968882 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:01.285332 (+316450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:01.285374 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:01.341450 (+ 56076us) log.cc:844] Serialized 26 byte log entry
0709 12:20:01.521100 (+179650us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:01.521139 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.522279 (+  1140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:01.839188 (+316909us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:01.983369 (+144181us) raft_consensus.cc:1685] finished
0709 12:20:01.983391 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.983627 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":321642,"raft.queue_time_us":334710,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6243,"spinlock_wait_cycles":6595328,"thread_start_us":166613,"threads_started":1,"wal-append.queue_time_us":232734}
I20260709 12:20:01.986197 27255 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:01.987401 25274 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:01.987907 25119 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:01.800040 25122 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:01.786237 25123 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:01.987684 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.790067 25090 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:01.894552 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:01.957826 25241 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:01.956561 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.995682 27304 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:01.999270 27304 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.000505 27369 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.002301 25276 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:02.002853 27369 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:02.002877 25275 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:20:02.005230 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.006111 25120 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:02.007210 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.008030 25120 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.009213 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.011349 27304 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:02.011786 27304 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:02.012195 27304 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.013103 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.013665 25121 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:02.014158 27362 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3.
I20260709 12:20:02.015074 25125 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:01.939632 27252 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.018738 27252 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:02.019896 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.020607 25118 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:20:02.020452 27327 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:02.020479 27329 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.022114 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.022754 25118 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:20:02.023474 27329 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.023988 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.024641 25118 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:01.997622 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.020736 27255 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:02.026700 27255 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.027067 25269 raft_consensus.cc:2393] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:02.027153 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.027890 25165 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:02.028093 25127 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.028810 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.029687 25118 raft_consensus.cc:2410] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:20:02.033192 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.034015 25122 raft_consensus.cc:2376] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6. Re-sending same reply.
W20260709 12:20:02.039475 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 249525us
I20260709 12:20:02.042934 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:02.002206 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.057296 27362 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:02.059569 27362 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:02.059973 27362 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.066180 27291 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:02.066820 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:02.059070 27079 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.067984 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.250970 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:02.249521 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:02.059070 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.252408 25125 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6.
W20260709 12:20:02.138322 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 153341us
I20260709 12:20:02.102119 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.167369 25851 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:02.068835 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.148950 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.131108 25127 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:02.206174 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:02.091863 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:02.118382 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.259449 25126 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:02.260411 25120 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:02.253247 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:02.253651 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:02.102142 25165 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:02.267750 25121 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:02.027176 27255 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.255375 25119 raft_consensus.cc:2376] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4. Re-sending same reply.
I20260709 12:20:02.068418 25090 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:02.251873 25202 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:02.272599 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.273437 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.256243 25124 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:02.274384 25121 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:02.274751 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.275553 25120 raft_consensus.cc:2393] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:02.273335 25194 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:02.278137 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.279488 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.280375 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.281636 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:02.282344 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.282917 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.286873 25119 raft_consensus.cc:2376] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5. Re-sending same reply.
I20260709 12:20:02.249007 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:02.285162 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:02.293944 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 336206us
I20260709 12:20:02.102172 27335 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:02.044711 27378 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:02.280882 25123 raft_consensus.cc:2376] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6. Re-sending same reply.
I20260709 12:20:02.296106 25093 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:02.297251 25822 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:02.124812 27244 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.140686 25024 catalog_manager.cc:5697] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 3 to 4, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 4 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:02.296298 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:02.296437 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.137559 27370 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.297955 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.302598 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.412483 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.412604 27378 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:02.277580 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 213855us
I20260709 12:20:02.413242 25119 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:02.413355 27378 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:02.342921 27080 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:02.298408 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.339900 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:02.390846 27384 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:02.302570 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.417838 25121 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:02.417668 27384 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:02.419795 27244 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.296350 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 1947) took 1530 ms. Trace:
I20260709 12:20:02.297103 27335 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.422554 27335 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:02.412710 25120 raft_consensus.cc:2376] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5. Re-sending same reply.
I20260709 12:20:02.421355 25267 rpcz_store.cc:276] 0709 12:20:00.765834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.876206 (+110372us) service_pool.cc:224] Handling call
0709 12:20:00.876673 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:00.925353 (+ 48680us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:01.584150 (+658797us) log.cc:844] Serialized 14 byte log entry
0709 12:20:02.247571 (+663421us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:02.248836 (+  1265us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:02.266191 (+ 17355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.273417 (+  7226us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.293880 (+ 20463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17736,"raft.queue_time_us":30734,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":110,"thread_start_us":455017,"threads_started":2,"wal-append.queue_time_us":323575}
I20260709 12:20:02.324204 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:02.425014 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 145929us
I20260709 12:20:02.324797 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.427165 25125 raft_consensus.cc:2410] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:20:02.312001 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 209999us
I20260709 12:20:02.429013 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:02.411804 25126 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
W20260709 12:20:02.430066 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 132912us
I20260709 12:20:02.430562 27130 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:02.430737 27291 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:02.431056 27130 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.431545 27130 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:02.432451 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:02.412475 25024 catalog_manager.cc:5697] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 3 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:02.437806 27291 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:02.438768 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:02.341667 27304 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.442835 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.443271 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.443985 25124 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:02.444279 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.445137 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.445434 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.445770 25124 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:02.343873 27362 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.447675 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:02.448500 27362 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.449100 25124 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:02.435738 27252 consensus_queue.cc:1059] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:20:02.436077 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 161583us
I20260709 12:20:02.462486 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:02.462742 27370 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:02.436806 27244 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:02.449199 27362 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:02.463843 27362 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:02.464465 27362 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.451323 25119 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
I20260709 12:20:02.451676 27291 raft_consensus.cc:1064] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:20:02.454883 27335 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:02.465606 27291 raft_consensus.cc:1068] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: Unable to promote non-voter 4456c1069d1541fab5b7cb29df9b6167: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:20:02.466890 27231 raft_consensus.cc:3055] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:02.467397 27231 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:02.468819 27231 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.470220 27231 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:02.471172 25127 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:20:02.455906 27382 log.cc:927] Time spent T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.090s	user 0.003s	sys 0.000s
I20260709 12:20:02.459228 27304 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.460000 25167 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:02.475301 27291 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:02.475869 27291 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:02.476828 27291 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.479413 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.481969 27080 consensus_queue.cc:1059] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:02.482982 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.483083 27387 raft_consensus.cc:3055] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:02.484093 27387 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:02.484331 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.483551 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.485158 27387 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:02.486241 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.467003 27335 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:02.451712 25121 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:02.479960 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.420051 27384 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:02.487815 25118 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6.
W20260709 12:20:02.492666 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.487818 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.436264 27391 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:02.498083 27391 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:02.498551 27391 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.499212 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:02.481221 25093 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:02.486388 27387 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:02.501566 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:02.480254 27393 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:02.502281 27335 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:02.503695 27383 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:02.504237 27383 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:02.504725 27383 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:02.508978 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.512444 25127 raft_consensus.cc:2393] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:02.519208 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:02.512692 25093 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:02.520613 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:02.521543 25856 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:02.483717 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:02.514110 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.523581 25122 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:20:02.526847 27335 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:02.527814 27130 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.529166 25093 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:02.531783 27255 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:02.534013 25092 connection.cc:256] RPC call timeout handler was delayed by -2.330214228999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
I20260709 12:20:02.538645 27335 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:02.543035 25856 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:02.545531 25122 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:02.546818 25168 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:02.548244 25168 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:02.548684 25857 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:02.548970 27080 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:02.549391 27080 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:02.549726 27080 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.435186 25242 leader_election.cc:400] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:20:02.533847 27255 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.550895 25242 leader_election.cc:403] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:02.551599 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 125766us
I20260709 12:20:02.552049 27255 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:20:02.556540 27387 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:02.557693 27387 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:02.558138 27387 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.534329 27391 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.560729 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:02.562044 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.485181 25119 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:20:02.564421 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.564402 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.563391 27130 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:02.565580 25168 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:02.565806 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.566090 25121 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:02.566512 27243 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:02.566929 27243 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.567304 27243 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:02.567752 25168 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:02.569124 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.569737 25126 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:02.570845 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.571369 25126 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 1.
I20260709 12:20:02.572284 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.573009 25126 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:02.567153 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.574453 25124 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:02.574604 25122 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:02.561659 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.580199 25093 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:02.460265 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:02.581602 25093 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:02.584985 25858 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:02.589293 25123 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:02.589543 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:02.590394 27399 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:02.584254 27393 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:02.592836 25118 raft_consensus.cc:1240] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:02.598090 25122 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:02.586079 27335 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:20:02.605127 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 126717us
I20260709 12:20:02.605768 25119 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:02.606657 25856 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:02.585722 27080 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.438292 25024 catalog_manager.cc:5697] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 3, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:02.614599 25268 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:02.616740 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 156555us
W20260709 12:20:02.621575 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 53883.9us
I20260709 12:20:02.613721 25822 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:02.623737 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.624019 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.624774 25127 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:20:02.623242 25825 leader_election.cc:336] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.627s (SENT)
I20260709 12:20:02.625375 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.625456 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:02.626385 27130 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:02.626791 27130 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.627110 27130 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.627555 27080 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.620245 27243 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:02.628542 27391 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.615964 27393 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:02.629551 27393 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.619825 27335 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:02.630187 27243 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:02.630558 27335 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:02.624790 25024 catalog_manager.cc:5697] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 3 to 4, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 4 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:02.641464 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.642793 25127 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.646065 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:02.649386 25275 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:02.639988 27231 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:02.650408 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:02.637667 25024 catalog_manager.cc:5697] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:02.656574 25024 catalog_manager.cc:5697] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:02.658183 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:02.658839 25275 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:02.664088 25127 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:02.642520 27397 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:02.629822 27378 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.663465 25165 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:02.641502 27252 consensus_queue.cc:1059] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:20:02.658650 27231 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:02.690670 27231 raft_consensus.cc:3055] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:02.691207 27231 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:02.692369 27378 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.692914 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:02.693367 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 53119.8us
I20260709 12:20:02.692451 27231 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.695268 25825 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:02.696484 27252 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:02.696154 27231 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.666788 27397 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:02.698704 27397 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:02.663059 27400 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:20:02.671190 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 602814us
I20260709 12:20:02.674922 27130 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.703934 25858 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 3: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:02.676971 27383 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.713676 27080 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:02.714268 27080 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:02.713900 27387 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.714748 27080 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:02.715723 27383 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.678208 25275 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:02.679214 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:02.716475 27387 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.716737 25267 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:02.680909 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:02.688067 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:02.664323 25024 catalog_manager.cc:5697] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 6, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 6 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:20:02.712579 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 76429.5us
W20260709 12:20:02.713083 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 67466.3us
I20260709 12:20:02.721536 25856 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 3: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:02.722294 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:02.713708 27130 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:02.728888 27327 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:02.731772 25090 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:02.728250 25024 catalog_manager.cc:5697] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 3, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 3 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:02.734949 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 93907.7us
I20260709 12:20:02.734833 25024 catalog_manager.cc:5697] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:02.736375 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:02.738775 27079 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:02.739348 27079 raft_consensus.cc:697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:02.738562 25024 catalog_manager.cc:5697] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 2, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:02.740492 25168 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:02.741359 27399 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:02.742339 27399 raft_consensus.cc:697] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:02.743445 27399 consensus_queue.cc:237] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:02.714294 27393 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.740231 27079 consensus_queue.cc:237] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:02.738564 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:02.725818 25241 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:02.748772 27255 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:02.749334 27255 raft_consensus.cc:697] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:02.750286 27255 consensus_queue.cc:237] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.747378 27252 consensus_queue.cc:1059] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:20:02.725802 27335 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.753444 25090 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:02.751461 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:02.758816 25822 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:02.760202 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:02.760968 25275 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:02.761637 27389 raft_consensus.cc:2764] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:20:02.762423 27387 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:02.762976 27369 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:02.763515 27369 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:02.763878 27397 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:02.764448 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.770995 25090 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:02.769795 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:02.754324 27391 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:02.759963 27362 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.774938 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:02.776563 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:02.790686 25851 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 LEARNER]: Advancing to term 2
I20260709 12:20:02.777308 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:02.779778 27335 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.764456 27369 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.759474 27378 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:02.758831 27252 raft_consensus.cc:3055] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:02.784144 25090 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:02.787407 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 65184.1us
I20260709 12:20:02.794566 25120 raft_consensus.cc:1240] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:02.796200 25825 leader_election.cc:400] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6.
I20260709 12:20:02.794772 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:02.803788 25851 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:20:02.790261 27389 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:02.799888 25167 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:02.807058 25242 leader_election.cc:400] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:20:02.807364 25242 leader_election.cc:403] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:02.794474 27383 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:02.803036 27387 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:02.795253 27252 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:02.822527 27252 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.823310 27362 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.823870 27252 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.821566 27404 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:20:02.824136 25267 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:02.825169 27244 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:20:02.825703 27404 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:02.805639 27391 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:02.826257 27404 raft_consensus.cc:697] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:02.821067 25825 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:02.812296 27397 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:02.827217 27404 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.833375 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:02.826257 27391 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.830925 27231 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:02.806414 27398 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:20:02.841856 25822 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:02.809376 27389 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:02.810305 27393 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:02.860380 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.874444 27287 consensus_queue.cc:1059] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:20:02.877357 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 44109.9us
I20260709 12:20:02.831804 27383 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:02.861752 27391 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:02.870460 27326 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:02.888317 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:02.862329 27389 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.878798 27384 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:02.904088 27384 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:02.904573 27384 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:02.902453 27130 consensus_queue.cc:1059] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:02.914773 25242 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:02.923141 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 123083us
I20260709 12:20:02.931131 27383 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:02.929196 27326 raft_consensus.cc:697] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:02.935416 27326 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.898488 27287 raft_consensus.cc:3055] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:20:02.937270 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:02.952001 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 119918us
I20260709 12:20:02.890158 27080 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:02.961298 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:02.957899 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:02.959064 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 174972us
I20260709 12:20:02.920224 27244 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:02.929554 27385 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:02.949934 27287 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:02.978539 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:02.983590 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 106639us
I20260709 12:20:02.985217 25090 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:02.985245 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:02.991971 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.993264 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.994421 25122 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:02.979980 27385 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:02.983475 27255 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:03.001187 27419 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:03.001250 25090 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:03.002537 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.999648 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:02.985754 27304 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:03.004135 25120 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 4: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:03.004596 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:03.008071 25126 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:03.009361 27362 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:03.009755 27362 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.009815 25090 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:03.010226 27362 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:03.011250 25090 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:03.012068 27335 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:03.012362 25090 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:03.013010 27335 raft_consensus.cc:2764] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:20:03.013137 27393 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:03.013492 25090 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:03.014819 27335 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:03.015978 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:03.016650 25275 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:03.017297 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:03.017655 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:03.018302 25267 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:20:03.018522 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:03.018463 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:03.019568 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:03.019908 25276 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:03.020340 25269 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.022706 27362 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:20:03.024783 27362 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:02.983418 27378 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:03.019325 25270 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.026893 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:03.029425 25275 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:03.027599 25118 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:02.999977 27404 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:03.031471 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.991385 27387 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:20:03.034346 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:02.984535 27399 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:20:03.002816 27385 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.005995 27419 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:03.025730 27304 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:03.038810 27411 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 12:20:03.040009 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 54832.4us
I20260709 12:20:03.040812 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.043089 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:03.047287 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 90817.3us
I20260709 12:20:03.049280 25165 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:20:03.050160 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 250330us
I20260709 12:20:03.052011 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:03.052747 25275 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:03.055686 25269 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:03.057075 25165 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:03.059191 27255 raft_consensus.cc:697] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:03.060492 27255 consensus_queue.cc:237] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:03.073845 27255 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:03.074522 27255 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:03.077015 27255 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:03.076268 25090 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:03.083351 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.084338 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.084415 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:03.087232 25090 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:03.091423 25852 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:03.007336 27291 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:20:03.095289 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.093466 25275 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:03.093405 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:03.030782 27327 consensus_queue.cc:1059] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:20:03.041539 27304 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:03.103163 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 46184.8us
I20260709 12:20:03.106917 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.116671 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.117224 25851 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:03.039575 27419 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:03.106890 25090 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:03.093026 27393 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:03.115098 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.093185 27362 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:03.123442 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:03.124287 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 81254.8us
I20260709 12:20:03.129038 25242 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:03.038720 27416 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
W20260709 12:20:03.133539 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 79183.1us
I20260709 12:20:03.037206 27287 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:03.115527 25857 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:20:03.107859 27335 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:03.131660 27362 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:03.137108 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.125718 27393 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:03.146704 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.148128 27420 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.154909 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:03.155716 25124 raft_consensus.cc:2368] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:20:03.156545 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:03.157842 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:03.160882 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:03.162225 27420 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:03.146623 27362 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.149464 27080 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:03.155045 27393 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.151678 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:03.170258 25120 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:03.153789 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:03.152048 25851 raft_consensus.cc:2368] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:03.171146 25118 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:03.169425 25119 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:03.180560 25123 raft_consensus.cc:2368] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4.
I20260709 12:20:03.134560 27430 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:03.184094 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:03.186785 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:03.184932 25126 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:20:03.154560 27383 consensus_queue.cc:1059] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:20:03.192821 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.193888 27424 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:03.194526 27424 raft_consensus.cc:697] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:03.195483 27424 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:03.194772 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:03.191331 27399 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:03.138114 27378 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:03.184207 27420 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:03.217339 27428 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:20:03.243583 25124 raft_consensus.cc:2393] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:20:03.335382 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 228560us
W20260709 12:20:03.270545 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 135602us
I20260709 12:20:03.356185 25242 leader_election.cc:400] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 2. Current term is 3.
I20260709 12:20:03.277799 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.325362 25118 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.435696 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.250634 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.311861 25123 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:20:03.437961 25854 raft_consensus.cc:2368] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3.
I20260709 12:20:03.278990 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.279552 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.337918 27407 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.764961 27407 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:03.765627 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:03.667016 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:03.767470 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:03.767915 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.421898 25092 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:03.768680 25123 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:03.769147 27450 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:03.445115 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.770418 25123 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:03.486068 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:03.476851 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:03.253670 25270 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:03.474484 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:03.215734 27434 raft_consensus.cc:3055] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:20:03.334893 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 207785us
W20260709 12:20:03.478308 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 122252us
I20260709 12:20:03.771497 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:03.215966 27431 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:20:03.486500 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 61584.4us
I20260709 12:20:03.780656 25858 raft_consensus.cc:2368] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
W20260709 12:20:03.491740 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 54138.4us
I20260709 12:20:03.771314 25124 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:03.782770 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:03.308519 27370 raft_consensus.cc:3055] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:03.791937 25118 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:03.799762 25125 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 1.
I20260709 12:20:03.800112 25167 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:03.803043 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 381243us
I20260709 12:20:03.803628 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:03.804723 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:03.805387 25851 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:20:03.802940 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.806494 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:03.808152 25825 leader_election.cc:336] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.628s (SENT)
I20260709 12:20:03.808588 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:03.674574 27419 consensus_meta.cc:287] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
W20260709 12:20:03.676587 27384 consensus_meta.cc:287] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.002s
I20260709 12:20:03.809674 25852 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:03.287151 27244 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:03.371192 27404 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:03.475365 27444 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:03.808007 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:03.491285 27429 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:20:03.600239 27391 consensus_meta.cc:287] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.694s	user 0.003s	sys 0.012s
W20260709 12:20:03.700106 27304 consensus_meta.cc:287] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.001s
W20260709 12:20:03.614230 27389 consensus_meta.cc:287] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.700s	user 0.022s	sys 0.000s
I20260709 12:20:03.278435 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.813872 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:03.814366 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.842321 25123 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
W20260709 12:20:03.817623 27255 consensus_meta.cc:287] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.005s
I20260709 12:20:03.818595 27443 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:03.820035 25168 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:03.276697 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.277632 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.276823 27417 raft_consensus.cc:3055] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:03.820935 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:03.292943 27437 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:20:03.813061 25242 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:03.614583 27326 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:03.666798 27447 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:03.666260 27362 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.003s
I20260709 12:20:03.823366 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:03.274017 27335 raft_consensus.cc:697] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:03.619072 27441 log.cc:927] Time spent T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:20:03.834616 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.836293 25092 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:03.770529 27442 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:03.778690 27434 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:03.808574 27450 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:03.839859 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:03.947230 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:03.840269 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:03.801091 27370 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:03.843144 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.338522 27393 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:03.483520 27385 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:03.843418 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:03.882999 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:03.898464 25194 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
W20260709 12:20:03.897676 25824 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.004s	sys 0.011s
W20260709 12:20:03.973408 25824 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.005s	sys 0.014s
W20260709 12:20:03.917569 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.843725 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:03.897717 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:03.847852 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:03.877696 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:03.949884 25195 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:20:03.950232 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 130246us
I20260709 12:20:03.978206 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:03.899762 27451 log.cc:927] Time spent T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:20:03.897902 25199 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:03.981004 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 200802us
I20260709 12:20:03.985224 25242 leader_election.cc:400] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:03.985649 25242 leader_election.cc:403] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:03.986528 25202 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:03.898988 27453 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.990206 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:03.822465 27419 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:03.944684 27417 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:03.998576 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:03.883456 25853 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:20:03.834462 27384 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.003764 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:04.005172 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 189566us
I20260709 12:20:03.854936 27389 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:03.878835 27429 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.011564 27389 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:04.011987 27335 consensus_queue.cc:237] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.012842 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:03.839921 27444 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.015134 27419 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:04.014775 27370 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.016024 27444 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:04.017436 27417 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.040257 27417 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:04.040484 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:04.041152 27435 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.875s	user 0.002s	sys 0.000s
I20260709 12:20:04.019765 27455 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:04.020375 27445 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:04.020848 27291 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:03.944895 27255 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.022578 27434 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.025017 27385 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:04.026335 27407 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:03.945927 27447 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:03.845744 27304 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:03.994313 27383 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:03.991380 27453 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:03.849736 27391 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.031502 27424 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:04.006589 25857 raft_consensus.cc:2393] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:03.946251 27326 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:03.988292 25855 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:04.034503 27384 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:04.014174 27452 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:03.963794 27362 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.011575 27429 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:04.082223 27432 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
W20260709 12:20:04.176419 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 191391us
I20260709 12:20:04.201140 25858 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:04.201452 25242 leader_election.cc:400] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4.
I20260709 12:20:04.201798 25242 leader_election.cc:403] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:04.132565 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 296292us
I20260709 12:20:04.130717 25270 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:04.100157 25126 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:04.178944 25123 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:20:04.202626 25092 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.185806 27465 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:04.186415 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:04.103617 25198 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:04.213579 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.189898 27450 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:04.190950 27442 raft_consensus.cc:697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:04.233527 25855 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:04.234869 27454 consensus_queue.cc:1059] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:20:04.235898 27454 raft_consensus.cc:3055] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:04.234150 27442 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:20:04.236331 27454 raft_consensus.cc:740] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:20:04.192754 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 113286us
I20260709 12:20:04.238929 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:04.201607 27404 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:04.191181 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 344269us
I20260709 12:20:04.200686 27370 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:04.205844 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:04.048542 27448 raft_consensus.cc:670] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:20:04.210878 25854 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:04.258900 25194 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:20:04.082954 27080 consensus_queue.cc:1059] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 12:20:04.214900 25274 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:04.212880 27468 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:04.216749 27304 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:04.219169 25092 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.219249 27255 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:04.220184 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.220503 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.220898 25200 raft_consensus.cc:1240] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:04.223140 25125 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:04.232213 25857 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:04.235221 25276 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:04.086287 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.193313 25201 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:04.248785 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:04.248494 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:04.280130 25269 raft_consensus.cc:2368] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:04.210323 27385 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4.
I20260709 12:20:04.083568 25199 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:20:04.195163 27383 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.285022 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:04.222638 27287 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:04.281757 25090 leader_election.cc:400] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:04.297107 25090 leader_election.cc:403] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:20:04.238663 25267 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
W20260709 12:20:04.300938 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 81851.9us
I20260709 12:20:04.301713 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.262696 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:04.246672 27452 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:04.237349 27454 consensus_queue.cc:260] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.282326 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:04.343677 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:04.299345 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 78927.1us
I20260709 12:20:04.344487 25242 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:04.306479 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 48287.3us
I20260709 12:20:04.308802 27255 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:04.294730 27419 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:04.318794 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.354704 25273 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:04.355213 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.356142 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:04.357757 25199 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:04.321910 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.326642 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:04.326421 27448 consensus_queue.cc:1059] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:04.300048 27327 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:20:04.366668 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 85047.3us
I20260709 12:20:04.327689 25197 raft_consensus.cc:2410] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:04.328068 27468 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:04.328367 27383 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:04.329200 27326 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:04.329298 27453 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:04.330477 27362 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:04.305024 27384 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:04.373680 25271 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:20:04.330916 25198 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:04.333892 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:04.335533 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:04.379413 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:04.379902 25269 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:04.380717 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:04.380954 25090 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:04.381235 25269 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:04.336529 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:04.308589 27460 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:04.350998 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.351258 27418 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:04.352388 25270 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:20:04.319523 27450 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.343731 25822 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:04.353538 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:04.365356 25201 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:04.385984 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:04.258481 27424 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:20:04.260381 27404 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.382265 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:04.383251 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 81617.8us
I20260709 12:20:04.383751 25274 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 4: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:04.347831 27419 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:04.388733 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 44364.5us
I20260709 12:20:04.390013 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:04.390234 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.391359 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:04.392871 25242 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:04.391412 25276 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:04.362426 27455 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:04.373202 27452 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:04.376472 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:04.347450 27252 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:20:04.382774 27429 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.377806 27384 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:04.397686 27440 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.384490 27460 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:04.386759 27454 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:04.390161 27326 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:04.394508 27419 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:04.394416 27452 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:04.403587 27472 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:04.401911 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.405670 25092 leader_election.cc:400] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:04.396397 27464 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:04.404246 27460 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.399552 27384 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:04.400744 27429 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.420058 25268 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:04.420238 27429 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:04.401647 27427 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:04.422194 25194 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:04.405252 27326 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.423394 27326 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:04.427840 25267 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:04.430223 25267 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:04.432541 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1561) took 1107 ms. Trace:
I20260709 12:20:04.432929 25121 rpcz_store.cc:276] 0709 12:20:03.324741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.325764 (+  1023us) service_pool.cc:224] Handling call
0709 12:20:04.043385 (+717621us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800002798. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9b71 00007f2100de9a22 00007f2109d028d9 00007f2108e5cee0 00007f2108f260ab 00007f2108f26131 00007f2108ee7fc0 00007f2108ed2929 00007f2108ed23d2 00007f2102449bd4
0709 12:20:04.043596 (+   211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:04.043985 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.044031 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:04.058492 (+ 14461us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.259224 (+200732us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:04.294369 (+ 35145us) log.cc:844] Serialized 14 byte log entry
0709 12:20:04.294583 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.294652 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:04.432245 (+137593us) raft_consensus.cc:1685] finished
0709 12:20:04.432345 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.432460 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38362,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":179647,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":151,"spinlock_wait_cycles":23494528,"thread_start_us":50028,"threads_started":1,"wal-append.queue_time_us":167348}
I20260709 12:20:04.407868 27472 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.435791 27472 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:04.437912 27378 raft_consensus.cc:3055] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:04.400585 27440 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.406611 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.439405 25268 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:04.400866 27335 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:04.459156 27440 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:04.459820 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.462363 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.463176 25193 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 2: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:04.463951 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:04.464056 27472 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.465065 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.396603 27455 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.467906 27455 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:04.408196 27452 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:04.471709 27404 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:04.472142 25856 raft_consensus.cc:2410] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:20:04.474535 25092 leader_election.cc:400] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3.
I20260709 12:20:04.475252 27447 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:04.475826 27472 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:04.475886 25092 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.477207 25092 leader_election.cc:400] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:04.477474 25092 leader_election.cc:403] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:20:04.473889 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 81080.7us
I20260709 12:20:04.483958 25269 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:04.485212 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.486181 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:04.489712 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:04.492645 25092 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.496001 27455 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.491829 27447 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:04.455889 27467 consensus_queue.cc:1059] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:20:04.498095 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:04.438354 27378 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:04.499480 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:04.500986 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.500908 25165 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:04.503626 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:04.507514 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:04.509722 25092 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.490051 27472 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:04.513147 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.512311 25092 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:04.519193 25092 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.520196 27362 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:04.520936 27362 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:04.523099 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:04.524010 27472 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:04.525490 25092 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.526450 27472 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:04.526921 27472 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:04.527360 27472 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.529014 27452 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.530484 27424 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:04.500541 27389 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:04.493144 27384 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.534230 27384 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:04.536258 27391 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:04.540751 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:04.541438 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.543085 27452 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:04.543839 27450 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:04.544462 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2125) took 1358 ms. Trace:
I20260709 12:20:04.544955 25122 rpcz_store.cc:276] 0709 12:20:03.186318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.186480 (+   162us) service_pool.cc:224] Handling call
0709 12:20:04.544204 (+1357724us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400453b54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:04.544357 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2764726016}
I20260709 12:20:04.546833 27427 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:04.546921 27231 raft_consensus.cc:3055] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:04.492274 27385 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:20:04.552407 27419 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:04.554870 25854 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 677) took 1275 ms (client timeout 1516 ms). Trace:
W20260709 12:20:04.555316 25854 rpcz_store.cc:269] 0709 12:20:03.279341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.765352 (+486011us) service_pool.cc:224] Handling call
0709 12:20:04.554658 (+789306us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400470ed4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:04.554805 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021584128}
I20260709 12:20:04.499329 27335 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:04.547583 27231 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:04.507122 27079 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:04.497335 27440 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:20:04.557898 27231 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.559094 27440 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:04.543044 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.559510 27440 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:04.539448 25092 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.560420 25273 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:04.571941 25122 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:04.573808 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:04.576948 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:04.513680 27474 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:04.574640 25122 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:04.589694 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:04.581952 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.529764 27468 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
W20260709 12:20:04.586256 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 73152.9us
I20260709 12:20:04.586637 27417 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.592065 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.593261 25120 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:04.512091 27252 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.595340 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:04.514284 27447 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:04.511968 27398 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:04.595639 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:04.595948 25125 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:04.602537 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:04.604615 25119 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:04.559520 27231 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:04.497246 27326 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.496829 27455 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.598702 25118 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:04.559911 27393 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:04.589882 27327 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.616551 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:04.608058 25119 raft_consensus.cc:1240] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:04.619285 25121 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:04.621537 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.602756 27252 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.629981 27252 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:04.635390 25118 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:04.635834 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.616096 27481 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:04.634497 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:04.637833 27419 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:04.599292 27417 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.641448 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:04.631244 27385 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:04.633111 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:04.654821 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:04.658521 27417 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:04.659761 27460 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.614830 27378 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:20:04.662906 27378 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:04.663331 27326 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:04.618176 27327 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.667204 27327 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:04.667344 27455 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:04.661988 27460 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:04.633090 27440 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.669029 27434 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:04.669514 27383 consensus_queue.cc:1175] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4456c1069d1541fab5b7cb29df9b6167" responder_term: 6 status { last_received { term: 6 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 5 } }
W20260709 12:20:04.672588 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.669147 27440 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:04.677357 25125 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:04.705976 27472 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.670949 27424 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:20:04.718712 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:04.719650 25275 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:04.672423 27384 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:04.724231 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 51168us
I20260709 12:20:04.726773 27432 consensus_queue.cc:1059] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.727035 27429 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:04.731985 27439 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:04.734220 27291 raft_consensus.cc:3055] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:04.734781 27291 raft_consensus.cc:740] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:04.735841 27291 consensus_queue.cc:260] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.737366 27291 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:04.785903 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 131129us
I20260709 12:20:04.819972 27445 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:04.820561 27445 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:04.821413 27445 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.822824 27445 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:04.826622 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:04.828327 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 443352us
W20260709 12:20:04.829433 25825 leader_election.cc:336] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.834s (SENT)
I20260709 12:20:04.830420 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:04.831272 25270 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:04.851285 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:04.868038 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:04.852103 25119 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:04.876986 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:04.877640 25275 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:04.882206 25822 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:04.883108 25822 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:04.886616 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:04.887588 25276 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:04.826237 27468 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.824682 27231 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.828801 27481 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:04.898453 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.903956 25121 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:04.906065 25271 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:04.908190 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.879506 27419 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:04.912721 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.882418 27447 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.915943 25822 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:04.919292 27426 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:20:04.925246 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.926923 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:04.927611 25200 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:04.930143 27454 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:04.930655 27454 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:04.930792 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.931116 27454 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:04.932245 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:04.933980 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:04.935621 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 906) took 1102 ms. Trace:
I20260709 12:20:04.936156 25860 rpcz_store.cc:276] 0709 12:20:03.833340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.989441 (+156101us) service_pool.cc:224] Handling call
0709 12:20:04.560197 (+570756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:04.560393 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.560419 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:04.560463 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:04.560510 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.560566 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.935377 (+374811us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400470ed0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:04.935533 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1273725312}
I20260709 12:20:04.943257 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.949878 27079 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.950562 27079 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.950824 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.951860 25202 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 2: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:04.919691 27472 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:04.952878 27079 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:04.949211 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:04.953420 27419 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.896989 27417 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:04.890792 27326 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:04.952907 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.948532 27454 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.945282 25200 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:04.892019 27384 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.958652 27326 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.912770 27231 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.962702 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:04.965197 25242 leader_election.cc:336] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.599s (SENT)
I20260709 12:20:04.966341 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.908692 27481 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:04.907470 27468 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:04.955715 27447 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:04.987373 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:04.991199 25275 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:05.070729 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.039179 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:04.991869 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:04.878162 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 48786us
I20260709 12:20:05.044384 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:05.044247 25860 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:05.066286 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:04.958922 27417 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.070176 25196 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
W20260709 12:20:05.069700 25093 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.743s (SENT) [suppressed 59 similar messages]
W20260709 12:20:05.017824 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 277384us
I20260709 12:20:05.072700 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:05.075153 25854 raft_consensus.cc:2410] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:05.005661 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.023159 25197 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
W20260709 12:20:05.072382 25825 leader_election.cc:336] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 2.022s (SENT)
I20260709 12:20:05.077049 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.077425 25200 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:05.080672 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.084965 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:04.980361 27384 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.086220 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.088310 27384 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:04.982950 27326 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:05.093830 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.094161 27454 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:05.094410 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 129259us
I20260709 12:20:05.099148 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:05.094926 27452 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:05.100982 25200 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:05.102420 27476 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.608s	user 0.013s	sys 0.005s
W20260709 12:20:05.106906 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.065958 27419 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:05.123276 25851 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:05.044518 27231 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:05.133564 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.134511 25196 raft_consensus.cc:2393] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:05.072853 27481 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.178007 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:05.178921 25858 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:05.179418 25200 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:05.079584 27417 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.155174 25168 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:05.159893 27447 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:05.160252 27468 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:05.141072 27454 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:05.166630 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:05.154630 27484 log.cc:927] Time spent T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:20:05.168099 25856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 657) took 2084 ms (client timeout 1693 ms). Trace:
I20260709 12:20:05.168830 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:05.187301 25856 rpcz_store.cc:269] 0709 12:20:03.083827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.084103 (+   276us) service_pool.cc:224] Handling call
0709 12:20:05.167868 (+2083765us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54008e2454. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:05.168007 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3189137664}
I20260709 12:20:05.171025 25202 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:05.114652 27472 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.174758 25859 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:05.122128 27450 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:05.143205 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 70836.9us
W20260709 12:20:05.195473 25825 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 2.048s (SENT)
I20260709 12:20:05.195860 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.180836 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.200664 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:05.200971 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:05.185271 27079 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:05.204003 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.205292 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.206351 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.207542 25119 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:05.207809 25242 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:05.207926 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.209353 25123 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:05.211479 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.213621 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.216290 25200 raft_consensus.cc:2393] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:05.220835 25121 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:05.182700 27429 consensus_queue.cc:1059] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:20:05.230468 27478 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.736s	user 0.010s	sys 0.000s
W20260709 12:20:05.230801 27434 consensus_meta.cc:287] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
I20260709 12:20:05.209683 27447 consensus_queue.cc:1059] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:20:05.199463 27472 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.234169 27452 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:05.194337 27326 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.211906 27427 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:05.235546 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.187325 27440 consensus_queue.cc:1059] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:20:05.237267 25194 raft_consensus.cc:2410] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:05.237363 25122 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
W20260709 12:20:05.238274 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.231639 25195 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:05.242619 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.207312 27079 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.236819 27424 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:20:05.263324 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.264091 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1572) took 1015 ms. Trace:
I20260709 12:20:05.271490 27504 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:05.273294 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 77855.9us
I20260709 12:20:05.273687 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:05.272281 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 95750.3us
I20260709 12:20:05.275650 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.277555 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.259912 25196 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:05.278880 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.278750 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.269441 25124 rpcz_store.cc:276] 0709 12:20:04.248758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.248886 (+   128us) service_pool.cc:224] Handling call
0709 12:20:04.258935 (+ 10049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:04.278115 (+ 19180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.278148 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:04.298325 (+ 20177us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.928824 (+630499us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b180014fd40. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae0d1 00007f2103ec9a0f
0709 12:20:05.114509 (+185685us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:05.114552 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.114625 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:05.236814 (+122189us) raft_consensus.cc:1685] finished
0709 12:20:05.236834 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.264022 (+ 27188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5455,"raft.queue_time_us":21053,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":19149,"spinlock_wait_cycles":9816320,"thread_start_us":185438,"threads_started":1,"wal-append.queue_time_us":847115}
W20260709 12:20:05.277155 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 72021.5us
W20260709 12:20:05.285465 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:05.286219 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:05.286934 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.293553 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:05.294457 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.294217 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.267989 27079 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.296304 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:05.297137 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 89388.6us
I20260709 12:20:05.297277 25200 raft_consensus.cc:2410] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:05.298007 25197 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:05.299041 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.300912 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.301519 25201 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:05.302313 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.303236 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.297910 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:05.305806 25167 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:05.307209 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.307783 25196 raft_consensus.cc:2376] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6. Re-sending same reply.
I20260709 12:20:05.309898 25201 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:20:05.316305 27481 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.318167 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 465) took 1112 ms. Trace:
I20260709 12:20:05.276752 27504 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.318579 25195 rpcz_store.cc:276] 0709 12:20:04.206187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.219918 (+ 13731us) service_pool.cc:224] Handling call
0709 12:20:05.317986 (+1098068us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400178754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:05.318108 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197809024}
I20260709 12:20:05.320362 27504 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:05.294904 27326 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:05.321302 27464 raft_consensus.cc:3055] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:05.321702 27464 raft_consensus.cc:740] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:05.308288 27291 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:20:05.322518 27464 consensus_queue.cc:260] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:05.325551 27499 log.cc:927] Time spent T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:20:05.310307 25201 pending_rounds.cc:85] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 1
I20260709 12:20:05.331110 25201 pending_rounds.cc:107] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:20:05.331436 25201 raft_consensus.cc:2889] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:05.332831 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:05.333596 25165 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:05.333977 25090 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:05.335008 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.335662 25270 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:05.336984 25269 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:05.282558 27393 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:05.338651 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.347457 25268 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:05.347213 27393 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.348333 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.307999 27447 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:05.336679 27387 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:05.334870 27429 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:05.350167 27447 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.349695 27393 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:05.340394 25270 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:05.351595 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.341114 27434 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:05.341145 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:05.352298 25269 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.352504 27447 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:05.341732 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 46218.2us
I20260709 12:20:05.342106 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:05.338776 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.353474 25274 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.343032 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.354208 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.354341 25273 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:05.343535 27383 consensus_queue.cc:1059] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:05.344671 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.355304 25272 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
W20260709 12:20:05.355548 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 57716.6us
I20260709 12:20:05.345034 25267 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:05.345757 27398 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:05.346591 25165 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:05.349678 25268 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:20:05.357506 25090 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:05.343587 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.354902 25200 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:05.358865 25194 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:05.337634 27454 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:05.359176 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.361292 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.361316 25201 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:20:05.362957 25199 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:05.358282 27418 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.360462 27452 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:05.363900 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.387336 25272 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:05.387669 25197 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:05.365489 27383 raft_consensus.cc:3055] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:05.356868 27504 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:05.369215 25093 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:05.370370 27472 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:05.370535 27505 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:05.392122 27505 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:05.392645 27505 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:05.395875 27447 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:05.396384 27447 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:05.396799 27447 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.371621 25090 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:05.398272 27472 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.399856 27472 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:05.400271 27472 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.400352 27452 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:05.401786 27504 raft_consensus.cc:697] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:05.400454 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:05.376607 27429 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:05.377274 27387 consensus_queue.cc:1059] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.378822 25119 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:05.382174 25201 pending_rounds.cc:85] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 4
I20260709 12:20:05.383621 25269 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:05.402851 27504 consensus_queue.cc:237] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.408253 27481 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:05.408255 27443 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:05.385663 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.387897 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.401671 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.375762 25274 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:05.373878 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.403992 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.411178 25268 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:05.412694 25272 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:05.412886 25201 pending_rounds.cc:107] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:20:05.414758 25242 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.415407 27387 raft_consensus.cc:3055] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:05.415952 27387 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:05.416606 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.417055 27387 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.418000 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.365717 27417 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.395953 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:05.433056 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:05.433779 25272 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.434218 25093 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.414427 25201 raft_consensus.cc:2889] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:05.403729 27452 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.388670 27383 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:05.406855 27418 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.428544 27378 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:05.418287 27481 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:05.429857 27506 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:05.403745 27472 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:05.437075 25093 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.407485 27434 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:05.437240 25165 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:05.425302 27511 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:05.454488 27404 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:05.419672 27079 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.455776 27404 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.456271 27404 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:05.456341 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.457227 27079 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:05.446565 27429 consensus_queue.cc:1175] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:05.441192 27443 consensus_queue.cc:1059] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:20:05.458832 27378 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:05.460031 27443 raft_consensus.cc:3055] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:05.460384 27443 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:05.461232 27443 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.462468 27443 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:05.440025 25090 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:05.464603 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 104216us
I20260709 12:20:05.465145 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.442624 25242 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.447122 27468 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:05.435716 27512 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:05.440935 27442 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:20:05.466542 27391 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:05.471279 27287 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:05.471486 27391 raft_consensus.cc:697] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:05.439092 27467 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:05.438931 27393 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:05.452069 27418 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:05.463621 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:05.465732 25822 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:05.475203 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:05.472580 27326 raft_consensus.cc:3055] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:05.472501 27391 consensus_queue.cc:237] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.476289 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:05.476918 25268 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:05.467629 25090 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:05.473012 27335 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:05.478888 27398 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:05.479187 27335 raft_consensus.cc:697] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:05.480126 27449 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:05.480182 27335 consensus_queue.cc:237] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.480783 27449 raft_consensus.cc:697] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:05.481266 27378 consensus_queue.cc:1059] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.481936 27255 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:05.478880 27231 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:05.483397 27378 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:05.483788 27252 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.484062 27378 raft_consensus.cc:3055] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:05.484448 27378 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:05.484288 27252 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:05.485229 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 96664.5us
I20260709 12:20:05.485281 27378 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.486462 27252 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:05.435204 27444 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.487651 27460 consensus_queue.cc:1059] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:05.452165 27464 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.496124 25274 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:05.454804 27387 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.489102 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.508733 25274 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:20:05.498116 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.472669 27393 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:05.510727 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 70047.1us
I20260709 12:20:05.487257 27378 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:05.514046 25242 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.481637 27449 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.476329 27326 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:05.518181 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.525727 25274 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:05.512765 27493 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:05.515776 27287 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:05.538256 25268 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:05.484754 27383 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.524889 27255 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:05.541345 25242 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.544238 25825 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.546666 25822 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:05.517028 27454 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:20:05.549119 25242 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.520140 27079 consensus_queue.cc:1059] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:20:05.528023 27252 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:20:05.554319 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:05.546425 27291 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:05.546118 27508 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:05.560853 27454 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:05.557555 27255 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.550268 27287 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:05.547161 27460 consensus_queue.cc:1059] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:20:05.571638 27481 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:05.572031 27383 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:05.576375 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.597080 27079 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.597662 27079 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.535305 27493 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.568295 27454 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:05.600911 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 81227.3us
W20260709 12:20:05.614660 27517 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:20:05.600111 27519 raft_consensus.cc:3055] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:05.554337 27393 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.569334 27291 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.557802 27326 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.607450 27454 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:05.595506 27508 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.636375 27508 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:05.614707 27079 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:05.615044 27287 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:05.643342 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.627728 27460 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:05.618844 27519 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:20:05.643819 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 89565.8us
I20260709 12:20:05.657708 25272 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
W20260709 12:20:05.659972 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 110888us
I20260709 12:20:05.660699 25242 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.648272 27287 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.661531 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:05.653443 27460 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:05.668848 27519 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.672808 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:05.672973 25242 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.676717 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:05.677306 25122 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.679386 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:05.680001 25126 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:05.680459 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.681565 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.683319 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.681071 25201 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:20:05.670125 27519 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:05.665264 27287 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.690654 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:05.692396 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:05.692291 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.692624 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:05.691897 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.693042 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:05.695189 25122 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:05.695120 25120 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:05.696282 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.696597 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:05.694964 25121 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:05.706432 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:05.707141 25194 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:05.715684 25242 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.687199 27481 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:05.724738 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.734572 27527 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:05.735795 27527 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:05.738948 25126 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:05.687129 27505 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.692090 27447 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.764894 27442 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:05.765339 27442 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.765398 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:05.765748 27442 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.766100 25853 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Advancing to term 5
I20260709 12:20:05.730345 27460 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.724675 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.751469 27397 raft_consensus.cc:3055] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:05.755713 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:05.756318 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:05.757555 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:05.759050 25856 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:20:05.773307 27493 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:05.762410 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:05.860529 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:05.861657 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:05.863214 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:05.864017 25856 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
W20260709 12:20:05.766783 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 254723us
I20260709 12:20:05.864878 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:05.768251 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.768254 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.774525 27528 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.774590 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:05.775460 25857 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEARNER]: Advancing to term 7
I20260709 12:20:05.775949 27447 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:05.849041 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 297349us
I20260709 12:20:05.776541 27474 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:20:05.770787 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.776032 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:05.815794 25272 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:05.782051 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.761094 25200 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:05.850013 27508 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.870411 25270 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:05.870268 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:05.876655 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.878698 25860 raft_consensus.cc:2368] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:05.858825 27397 raft_consensus.cc:740] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:05.869853 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 145184us
I20260709 12:20:05.811228 27522 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:05.849244 27291 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:05.882625 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.892450 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.868943 27467 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:05.897584 27467 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:05.899581 27531 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.899966 27467 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:05.900504 27452 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:05.900209 27531 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.900934 27452 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:05.901351 27231 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:05.902194 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:05.855996 27404 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:05.902261 27530 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:20:05.909436 25274 raft_consensus.cc:2393] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:05.912510 25273 raft_consensus.cc:2393] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:05.881629 27524 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:05.895541 27460 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:05.933442 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:05.903532 27527 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:05.909453 27535 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:05.901373 27452 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:05.896416 27291 consensus_queue.cc:1059] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:20:05.885324 27508 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.952394 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:05.903496 27385 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:20:05.868435 27528 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:05.950954 27505 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:05.977301 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 82811.9us
I20260709 12:20:05.978117 25822 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:05.978366 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:05.978986 25822 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:05.980691 27527 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:05.999744 25822 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:05.958398 27472 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:06.016034 27520 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:06.016633 27520 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.017050 27520 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.021030 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:05.957015 27531 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:06.039638 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 60817.5us
I20260709 12:20:06.043385 27508 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:06.042599 27528 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:06.047868 27518 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:05.937880 27397 consensus_queue.cc:260] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:06.058528 27536 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:20:06.054508 27528 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:06.067646 27518 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:06.068377 27397 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.099124 27528 raft_consensus.cc:697] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:06.110185 27528 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.115341 27287 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:06.119325 27444 consensus_meta.cc:287] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.632s	user 0.004s	sys 0.006s
I20260709 12:20:06.125053 27444 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.128139 25857 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:20:06.134256 25857 pending_rounds.cc:85] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 4
I20260709 12:20:06.134719 25857 pending_rounds.cc:107] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 6.5
W20260709 12:20:06.129087 27255 consensus_meta.cc:287] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.555s	user 0.003s	sys 0.006s
W20260709 12:20:06.134613 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 363903us
I20260709 12:20:06.135390 27255 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:06.136245 25857 raft_consensus.cc:2889] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:06.137486 27432 raft_consensus.cc:3055] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:06.137905 27432 raft_consensus.cc:740] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:06.090310 27505 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:06.128289 27518 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.144182 25825 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:20:06.144253 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:06.147022 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:06.151062 27387 consensus_meta.cc:287] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.001s
I20260709 12:20:06.113312 27404 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:06.152715 27398 consensus_meta.cc:287] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.673s	user 0.008s	sys 0.002s
I20260709 12:20:06.153074 27552 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:06.147802 27432 consensus_queue.cc:260] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:06.154742 27432 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.153169 27398 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:06.156702 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 157070us
I20260709 12:20:06.164013 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:06.168174 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:06.158206 27287 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:06.171528 25272 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:06.171995 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:06.173686 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:06.174338 25272 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:06.145592 27231 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:20:06.185290 27543 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:06.185967 27543 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.147567 27505 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:06.196205 27440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.013s	sys 0.018s
W20260709 12:20:06.197363 27440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.014s	sys 0.019s
I20260709 12:20:06.202842 27468 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:06.203459 27468 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.205662 27468 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:06.170297 27545 consensus_queue.cc:1059] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:20:06.260785 25853 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEARNER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
W20260709 12:20:06.269590 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.273087 25201 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:20:06.272933 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:06.273988 25195 raft_consensus.cc:2393] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:20:06.252835 27454 consensus_meta.cc:287] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.000s
I20260709 12:20:06.237775 27553 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:06.280242 27442 consensus_meta.cc:287] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
W20260709 12:20:06.265450 27550 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:20:06.306656 25275 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:20:06.308578 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:06.314123 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.317178 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:06.318090 25858 raft_consensus.cc:2393] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:06.319144 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:06.313048 25198 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:20:06.280916 27538 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.175s
I20260709 12:20:06.324234 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:06.324973 25854 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:06.282289 27543 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:06.310099 27442 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:06.292363 27454 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.393276 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:06.394614 25825 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:06.398869 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:06.400235 27460 consensus_queue.cc:1059] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:06.400569 27545 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:06.400264 27556 log.cc:927] Time spent T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:20:06.411639 25860 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:20:06.412985 27505 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:06.334556 27468 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:20:06.422173 27287 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.337038 27452 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:06.429086 27287 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.401223 27552 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:06.426733 27460 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:06.427532 27397 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.427266 27545 raft_consensus.cc:697] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:06.469924 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:06.478875 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:06.446055 25272 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:06.475806 27326 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:06.499066 27452 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:06.497095 27424 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:06.502561 27424 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.504668 27424 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:06.506418 27519 consensus_meta.cc:287] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.812s	user 0.006s	sys 0.006s
I20260709 12:20:06.447403 27460 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.506973 27455 raft_consensus.cc:3055] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:06.507516 27455 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:06.438011 27552 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.432816 27505 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:06.508297 25202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 1992) took 1999 ms (client timeout 2023 ms). Trace:
I20260709 12:20:06.514766 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:06.514964 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:06.517970 27455 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.437410 27393 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:06.522691 25198 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:20:06.521557 25202 rpcz_store.cc:269] 0709 12:20:04.509257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.966455 (+457198us) service_pool.cc:224] Handling call
0709 12:20:06.508145 (+1541690us) spinlock_profiling.cc:243] Waited 87.9 ms on lock 0x7b540016d5d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:06.508243 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202234240}
I20260709 12:20:06.476948 27442 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:06.472622 27417 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:06.497633 27418 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.478899 25199 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:06.514405 27460 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.521844 27552 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.530143 27393 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.521221 27424 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:06.513125 27397 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:06.550818 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.553881 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:06.558573 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:06.557957 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 45471.2us
W20260709 12:20:06.559918 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 115205us
I20260709 12:20:06.561369 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:06.525321 27505 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.545957 27424 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:06.575584 27418 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:06.572085 27417 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:06.595758 27418 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:06.672154 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 62752.8us
I20260709 12:20:06.560786 27545 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.622622 25853 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:06.610242 27417 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.681213 27564 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:06.683876 27231 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:06.727110 27231 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.691018 27565 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.726346 27570 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.735481 27570 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:06.751518 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 1.28076e+06us
I20260709 12:20:06.752727 25852 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:06.739995 27569 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:06.731750 27397 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:06.753929 27560 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.321s	user 0.000s	sys 0.002s
I20260709 12:20:06.771212 27472 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:06.739425 27231 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:06.772056 27472 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:06.773059 27418 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:06.734861 27393 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:06.742621 27570 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:06.768146 25857 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.765518 27432 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:20:06.749187 27417 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:06.770150 27506 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:06.755913 27439 raft_consensus.cc:3055] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.734375 27565 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.781241 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:06.782675 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:06.792768 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:06.793128 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:06.769622 27569 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.785100 25119 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:20:06.717517 27564 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:06.793404 25268 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:06.793983 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:06.794657 25198 raft_consensus.cc:2376] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5. Re-sending same reply.
I20260709 12:20:06.777843 27505 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:06.794768 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:06.798727 25120 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:06.800683 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:06.801498 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:06.806193 25124 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:06.737221 27552 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.820026 25126 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.815017 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:06.822104 25202 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 2: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:06.822598 25119 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:06.823650 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.824546 25092 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:06.791013 27393 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:06.789740 27553 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:06.803853 25165 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:06.794356 27424 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:06.803409 27520 consensus_meta.cc:287] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.786s	user 0.013s	sys 0.001s
I20260709 12:20:06.790831 27439 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:06.794634 27440 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.827637 27574 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:06.799118 27472 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:06.805361 27570 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.843062 27520 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.851691 27564 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:06.852082 27520 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:06.852672 27574 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.853621 27439 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.854710 27439 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.855589 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:06.856184 25274 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.858166 27574 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:06.859344 27569 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:06.862493 25092 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:06.840479 27540 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:06.863538 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:06.863723 27464 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:06.837894 27385 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:06.872113 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:06.872169 25126 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:06.872864 25269 raft_consensus.cc:2393] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:06.875635 25198 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:06.830255 27426 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:20:06.883234 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:06.887204 27426 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:06.887693 27426 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:06.888556 27426 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:06.892310 27568 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:06.894107 25269 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:06.863536 27540 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.899256 25274 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
W20260709 12:20:06.882747 27577 log.cc:927] Time spent T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:20:06.841761 27553 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.861243 27570 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:06.910717 25092 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:06.870182 27569 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:06.934684 27569 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:06.935329 27442 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:06.935933 27442 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.936864 27569 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:06.906498 27540 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:06.937958 27442 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:06.942834 25092 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:06.944001 25092 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:06.943549 25022 catalog_manager.cc:5697] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.944870 27464 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:06.945292 27464 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:06.945641 27464 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:06.946185 27576 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:06.844774 27472 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:06.839404 27393 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.859881 27440 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:06.947528 25092 leader_election.cc:400] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:06.956177 25822 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:06.956864 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:06.958458 27574 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:06.895839 27385 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:06.908908 27552 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:06.914155 27426 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:06.982916 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:06.983137 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:06.992427 25274 raft_consensus.cc:2393] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:06.946859 27576 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.998207 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:07.001013 25024 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33480 (request call id 268) took 5358 ms. Trace:
I20260709 12:20:07.013407 25275 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:20:06.974510 27481 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.979652 27575 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.915946 27255 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:20:06.988001 27383 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:07.031442 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 135184us
I20260709 12:20:06.955850 27417 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:20:06.993923 27391 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:07.001840 27568 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:07.012689 27418 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:07.010190 25024 rpcz_store.cc:276] 0709 12:20:01.630963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.631280 (+   317us) service_pool.cc:224] Handling call
0709 12:20:02.004253 (+372973us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b5400002210. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100dea640 00007f2109cc1846 00007f2109dcb90e 00007f210828c2a4 00007f210828c232 00007f210828c161 00007f210828c0dc 00007f210828b392 00007f210224948c 00007f21022488c6
0709 12:20:06.989235 (+4984982us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:02.924792 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:02.925547 (+   755us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:02.925597 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:20:02.925636 (+    39us) tablet.cc:662] Decoding operations
0709 12:20:02.926789 (+  1153us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:02.926881 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:02.926909 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:20:02.927830 (+   921us) tablet.cc:701] Row locks acquired
0709 12:20:02.927883 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:20:02.928070 (+   187us) write_op.cc:270] Start()
0709 12:20:02.928217 (+   147us) write_op.cc:276] Timestamp: P: 1783599602927992 usec, L: 0
0709 12:20:02.928245 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:20:02.976107 (+ 47862us) log.cc:844] Serialized 3984 byte log entry
0709 12:20:04.021394 (+1045287us) op_driver.cc:464] REPLICATION: finished
0709 12:20:04.186978 (+165584us) write_op.cc:301] APPLY: starting
0709 12:20:04.187093 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:04.187345 (+   252us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:04.187484 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:04.188833 (+  1349us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:04.189227 (+   394us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:20:04.189292 (+    65us) write_op.cc:312] APPLY: finished
0709 12:20:04.189672 (+   380us) log.cc:844] Serialized 77 byte log entry
0709 12:20:04.189890 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:04.190036 (+   146us) write_op.cc:454] Released schema lock
0709 12:20:04.190116 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:04.190616 (+   500us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:04.190643 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":123,"reported_tablets":14,"spinlock_wait_cycles":6327552,"child_traces":[["op",{"apply.queue_time_us":165238,"apply.run_cpu_time_us":3595,"apply.run_wall_time_us":3596,"num_ops":10,"prepare.queue_time_us":91357,"prepare.run_cpu_time_us":7660,"prepare.run_wall_time_us":121751,"raft.queue_time_us":255306,"raft.run_cpu_time_us":8011,"raft.run_wall_time_us":192898,"replication_time_us":1092943,"thread_start_us":332753,"threads_started":4,"wal-append.queue_time_us":144178,"wal-append.run_cpu_time_us":26999,"wal-append.run_wall_time_us":2057145}]]}
I20260709 12:20:07.002254 27505 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:20:07.037791 27565 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.044442 27512 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:07.045413 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.071579 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.071799 27472 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:07.072432 25855 raft_consensus.cc:2393] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 2: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:07.073486 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.064743 27507 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:07.056355 27587 consensus_queue.cc:1059] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:20:07.074513 27507 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.076768 27507 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.064774 27385 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:07.044335 27383 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:07.080613 27570 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:07.080833 27383 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:07.081086 27393 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.104959 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:07.105626 25271 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 1.
I20260709 12:20:07.106941 25165 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:07.036437 27481 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.067046 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:07.114359 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 47449.2us
I20260709 12:20:07.116348 27452 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:07.103597 25855 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:07.117796 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.123144 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.123847 25859 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:07.139789 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:07.126458 27571 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:20:07.147130 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 699) took 1378 ms. Trace:
I20260709 12:20:07.053587 27568 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.161372 25852 rpcz_store.cc:276] 0709 12:20:05.769085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.860182 (+ 91097us) service_pool.cc:224] Handling call
0709 12:20:07.146972 (+1286790us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b54002b57d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:07.147071 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2049873792}
I20260709 12:20:07.167264 27568 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.104624 27512 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.169436 27512 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:07.170485 25199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 475) took 1490 ms (client timeout 1872 ms). Trace:
I20260709 12:20:07.170754 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:07.170934 25199 rpcz_store.cc:269] 0709 12:20:05.679757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.683548 (+  3791us) service_pool.cc:224] Handling call
0709 12:20:07.170300 (+1486752us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54004123d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:07.170415 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":827852672}
I20260709 12:20:07.171545 25853 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:07.174387 25197 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:07.180922 27287 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:07.149892 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.150887 27079 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.183202 27079 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:07.185245 27079 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:07.185491 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:07.186062 25196 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:07.186594 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:07.151829 27460 consensus_meta.cc:287] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.605s	user 0.000s	sys 0.010s
I20260709 12:20:07.187440 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.187870 27460 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.188236 27547 raft_consensus.cc:3055] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:07.188701 27547 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:07.188512 27540 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:07.152153 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:07.152370 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.152216 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.153347 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.153863 27481 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.112524 27439 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:07.142762 27553 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:07.197299 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:07.198045 25857 raft_consensus.cc:2393] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:07.196550 27439 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.198705 27439 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.199522 27440 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.181910 27543 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:20:07.202301 25855 raft_consensus.cc:2368] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4.
W20260709 12:20:07.204353 25273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 1583) took 1436 ms (client timeout 1751 ms). Trace:
W20260709 12:20:07.205211 25273 rpcz_store.cc:269] 0709 12:20:05.767477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.767978 (+   501us) service_pool.cc:224] Handling call
0709 12:20:07.204157 (+1436179us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b5400120f54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:07.204268 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102310016}
I20260709 12:20:07.205523 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.192683 27522 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:07.038396 27575 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.210614 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.113042 27383 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.163498 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.193504 25856 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:07.193013 25196 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:07.206236 25201 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:07.214363 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.164258 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.221359 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:07.222585 25859 raft_consensus.cc:2368] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4.
I20260709 12:20:07.218956 27464 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.226466 27531 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.224223 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:07.227615 25273 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:07.228763 27252 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:07.241484 25856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:07.243265 25856 raft_consensus.cc:606] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:20:07.243736 25856 raft_consensus.cc:614] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:07.241779 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:07.230401 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:07.233873 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.230762 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:07.245378 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:07.189920 27460 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:07.260601 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:07.251598 25241 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:07.227236 27588 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:20:07.264609 25196 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:20:07.189525 27547 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.268285 25201 raft_consensus.cc:2393] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:07.262199 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:07.265252 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.268812 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.270928 25852 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:07.270452 27449 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:07.268067 25241 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:07.276558 25241 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:07.278375 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.279343 25197 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:07.246680 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.272505 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.263243 27432 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:07.267721 27574 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:07.299068 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:07.271756 27512 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:07.294302 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.230578 27383 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.227039 27531 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:07.301465 25197 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:07.276137 27449 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.275157 27304 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:07.294282 27255 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:07.309250 25852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:07.310123 25852 raft_consensus.cc:606] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:07.297086 27432 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.305773 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.296984 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.305164 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.313786 25194 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:07.313620 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.319924 25197 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
W20260709 12:20:07.312093 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 299062us
I20260709 12:20:07.321929 25822 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:07.302210 27512 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:07.298174 25199 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:20:07.323235 25201 raft_consensus.cc:2393] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:07.307175 27449 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:07.306038 27574 raft_consensus.cc:697] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:07.340335 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.330096 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:07.341604 25268 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:07.311985 27255 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.326774 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:07.319538 27432 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:07.348675 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:07.349503 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:07.350225 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.341830 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.376099 25122 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:07.376003 25197 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:20:07.375820 25201 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:07.376005 25119 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:07.377384 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:07.377573 25201 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:07.377532 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:07.381508 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:07.381593 25122 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:07.382344 25119 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:07.327800 27551 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:07.354753 25196 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:07.383642 25122 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:07.351039 27255 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:07.387511 25201 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:20:07.387985 25201 pending_rounds.cc:85] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 1
I20260709 12:20:07.388267 25201 pending_rounds.cc:107] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:20:07.388556 25201 raft_consensus.cc:2889] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:07.384575 25119 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:07.328152 27512 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:07.389441 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 56181us
I20260709 12:20:07.392482 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:07.345752 27452 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:07.393329 25241 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:07.398008 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:07.399767 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.397430 25122 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:20:07.400866 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:07.401453 25274 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:07.401873 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.402495 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:07.404179 25168 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:07.421849 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:07.325933 27417 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:20:07.424362 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:07.426299 25201 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:20:07.430923 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.447615 25274 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:07.449843 25165 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:07.453514 25268 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:07.401268 27464 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.459803 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.405125 27427 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.404222 27543 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:07.430192 27079 raft_consensus.cc:2764] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:20:07.441805 27551 raft_consensus.cc:697] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:20:07.480320 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 77879.3us
I20260709 12:20:07.491079 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:07.499975 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 75689us
I20260709 12:20:07.525906 25202 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:07.479883 27443 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:07.536037 25855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:40270
W20260709 12:20:07.543560 27581 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:20:07.543864 25855 raft_consensus.cc:606] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:20:07.544144 27561 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:07.544474 25855 raft_consensus.cc:614] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:07.544651 27561 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:07.545150 27561 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:07.527073 27418 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:07.545930 27418 raft_consensus.cc:697] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:07.546350 27590 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:07.546981 27590 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.547233 27418 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.549263 27590 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:07.527323 27080 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:07.549968 27594 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:07.550520 27080 raft_consensus.cc:697] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:07.551910 27080 consensus_queue.cc:237] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:07.554641 27597 log.cc:927] Time spent T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 12:20:07.556188 27595 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 12:20:07.471556 27427 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.558684 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.557744 27594 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.477403 27543 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:07.456004 27574 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.540376 27443 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.574615 27304 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.579079 27383 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.578867 27304 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.581478 27304 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:07.581782 27426 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.001s
I20260709 12:20:07.581527 27439 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:07.594833 27598 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:20:07.593765 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.572432 25855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:07.599385 25193 raft_consensus.cc:2410] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:20:07.597333 25852 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:07.602159 25241 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:07.582572 27443 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:07.606163 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 168961us
I20260709 12:20:07.615633 27584 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:07.616631 27584 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.573300 27594 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:07.630983 27601 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:07.631690 27255 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.623199 27439 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:07.643137 27543 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:07.604529 27481 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.661468 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:07.702302 27600 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:20:07.622407 25855 raft_consensus.cc:606] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:07.627430 27304 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:07.627401 27427 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.582180 27551 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.623448 27575 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.713610 27439 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.715464 27531 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:07.754688 27427 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.720417 27304 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.770051 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:07.770717 25268 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:07.753626 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 295685us
W20260709 12:20:07.768388 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 266504us
I20260709 12:20:07.772384 25168 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:07.772596 25167 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:07.714356 27481 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:07.837990 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:07.832551 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 59262.3us
I20260709 12:20:07.725385 27231 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:07.835410 27603 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:20:07.836140 27591 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:07.846503 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.852373 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1591) took 1585 ms. Trace:
I20260709 12:20:07.757711 27607 raft_consensus.cc:993] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:20:07.852752 25272 rpcz_store.cc:276] 0709 12:20:06.267333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.268187 (+   854us) service_pool.cc:224] Handling call
0709 12:20:06.274204 (+  6017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.495797 (+221593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.852133 (+1356336us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400120554. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:07.852312 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394750208}
I20260709 12:20:07.848507 25168 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:07.756218 27255 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.860903 25268 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:07.778532 27304 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:07.861673 27604 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:07.870223 27529 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:07.870795 27529 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.871273 27529 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:07.872906 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1598) took 1085 ms. Trace:
I20260709 12:20:07.760308 27439 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:07.873317 25126 rpcz_store.cc:276] 0709 12:20:06.787557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.792919 (+  5362us) service_pool.cc:224] Handling call
0709 12:20:07.872697 (+1079778us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b540005b9d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:07.872829 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60481920}
I20260709 12:20:07.857453 27231 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.880892 27231 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:07.832358 27427 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.882252 27540 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:07.864459 27512 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.884435 27427 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.884938 27512 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:07.885634 27417 raft_consensus.cc:1081] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:20:07.886411 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:07.886878 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:07.890187 27439 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:07.890887 27607 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:07.891296 27607 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:07.891691 27607 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:07.886880 25199 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:07.894776 27616 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:07.895303 27594 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:07.900565 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:07.903112 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.903661 25195 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:20:07.870267 27383 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:07.873740 27584 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:07.901638 27432 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
I20260709 12:20:07.914901 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:07.923408 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 55142.5us
I20260709 12:20:07.926558 25272 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:07.932165 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.932819 25195 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
W20260709 12:20:07.940114 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.941080 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:07.911386 27383 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.937503 27481 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:07.949080 27584 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.949666 27584 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.946085 27611 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:20:07.951145 27611 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:07.951491 27611 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:07.952289 27611 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:07.952843 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.953473 25194 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:07.872807 27591 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:07.920560 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:07.895323 27616 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:07.996276 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 61682us
W20260709 12:20:07.995929 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 61367.1us
I20260709 12:20:07.912036 27610 consensus_queue.cc:1059] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:20:07.998000 25167 leader_election.cc:400] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4.
I20260709 12:20:07.954960 25242 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:08.000185 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 45303.3us
I20260709 12:20:08.000691 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.001024 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:07.999537 25167 leader_election.cc:403] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:08.002118 27531 consensus_queue.cc:1059] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:08.002367 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:08.003938 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.004420 25197 raft_consensus.cc:2393] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 7: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:08.007161 25167 leader_election.cc:400] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4.
I20260709 12:20:08.007903 25167 leader_election.cc:403] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:07.987257 27612 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:20:07.947355 27383 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:07.959758 27507 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:07.998620 27611 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:08.027987 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:07.928082 27432 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.030952 25127 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:08.006057 27255 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:08.026407 27439 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4.
W20260709 12:20:08.062955 27528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.549s	user 0.021s	sys 0.027s
I20260709 12:20:08.032202 27231 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:08.071516 27432 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.033087 27604 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:20:08.073614 27449 consensus_meta.cc:287] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.727s	user 0.005s	sys 0.006s
I20260709 12:20:08.074308 25202 raft_consensus.cc:2368] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:08.030507 27460 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:08.028955 25199 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:08.029675 27507 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:08.080132 27528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.572s	user 0.022s	sys 0.028s
I20260709 12:20:08.083290 27555 raft_consensus.cc:3055] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:08.060981 27255 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.056551 27591 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.086776 27507 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.094755 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:08.095434 25272 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:08.097683 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:08.093616 27255 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:08.081430 27231 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.084869 27449 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.096719 27555 raft_consensus.cc:740] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:08.119127 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 112130us
I20260709 12:20:08.121563 27304 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.122908 27616 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:08.124408 25272 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
W20260709 12:20:08.124670 27586 log.cc:927] Time spent T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 1.010s	user 0.008s	sys 0.006s
I20260709 12:20:08.128679 27454 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:08.130147 27607 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.088291 27460 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.104346 27591 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:08.132503 25093 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.132804 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:08.131871 27443 consensus_meta.cc:287] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.003s
I20260709 12:20:08.138362 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.138623 25854 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:08.140458 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:08.141002 25859 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:08.146133 27561 consensus_meta.cc:287] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.000s
I20260709 12:20:08.147219 27561 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.148551 27231 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:08.150162 27449 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:08.142200 27443 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.150110 27561 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:08.155722 25859 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:08.157513 25167 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:08.155817 25858 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:08.159354 25856 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:20:08.141738 27591 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.133911 27555 consensus_queue.cc:260] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.161074 27304 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.161379 27555 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.161676 27443 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.165788 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:08.166862 25856 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:08.162237 27610 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:08.173589 27443 consensus_queue.cc:1059] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:20:08.175861 27610 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:08.185058 27383 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:08.186658 27621 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:20:08.162760 27591 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:08.191613 27445 raft_consensus.cc:3055] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:08.177160 27610 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.208679 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 453) took 1422 ms. Trace:
I20260709 12:20:08.185711 27529 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.209086 25123 rpcz_store.cc:276] 0709 12:20:06.786245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.786359 (+   114us) service_pool.cc:224] Handling call
0709 12:20:06.786663 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.798477 (+ 11814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.798506 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:06.818179 (+ 19673us) log.cc:844] Serialized 26 byte log entry
0709 12:20:06.984926 (+166747us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:07.015399 (+ 30473us) log.cc:844] Serialized 14 byte log entry
0709 12:20:08.205386 (+1189987us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b1800338020. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287 00007f2103f29208
0709 12:20:08.205559 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.205655 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:08.205695 (+    40us) raft_consensus.cc:1685] finished
0709 12:20:08.208433 (+  2738us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.208631 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38148,"prepare.queue_time_us":26868,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3357,"raft.queue_time_us":1206404,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":23293,"spinlock_wait_cycles":2841856,"thread_start_us":136346,"threads_started":1,"wal-append.queue_time_us":141417,"wal-append.run_cpu_time_us":3532,"wal-append.run_wall_time_us":1098724}
I20260709 12:20:08.207293 27504 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:08.216426 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1597) took 1429 ms. Trace:
I20260709 12:20:08.199065 27445 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:08.216813 25121 rpcz_store.cc:276] 0709 12:20:06.787278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.796280 (+  9002us) service_pool.cc:224] Handling call
0709 12:20:06.796614 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.796837 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:06.950409 (+153572us) log.cc:844] Serialized 14 byte log entry
0709 12:20:08.216081 (+1265672us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:08.216143 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:08.216189 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.216256 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.216367 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1171365,"prepare.queue_time_us":39776,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2479,"thread_start_us":203199,"threads_started":2,"wal-append.queue_time_us":176138}
I20260709 12:20:08.218700 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:08.222407 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:08.222909 25272 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:08.226343 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:08.227674 27584 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.206007 27385 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:08.234395 27505 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:08.239331 27569 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:08.252449 27385 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:20:08.229566 27255 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.253738 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:08.254673 27385 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:08.239496 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 107073us
I20260709 12:20:08.255399 25092 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:08.255483 27255 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.256660 25092 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:08.256922 27547 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.241882 27474 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.243888 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:08.236971 27445 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.194772 27507 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.242228 27442 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:20:08.251704 27505 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.258868 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:08.259307 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:08.259822 25092 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:08.259836 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:08.297487 25193 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:08.297822 25197 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:08.260697 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:08.263165 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.300148 25121 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:08.301839 27460 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:08.302337 27505 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:08.302688 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:08.302990 25168 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:08.303326 25272 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:08.270555 27606 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.305145 25168 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:08.309087 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:08.307734 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.309810 25275 raft_consensus.cc:2368] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:08.308122 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:08.310617 25856 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.275426 27467 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:08.296057 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 455) took 1471 ms. Trace:
I20260709 12:20:08.314663 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.312068 25124 rpcz_store.cc:276] 0709 12:20:06.803625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.806928 (+  3303us) service_pool.cc:224] Handling call
0709 12:20:06.830655 (+ 23727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.870824 (+ 40169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.870854 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:06.877894 (+  7040us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.028917 (+151023us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:07.051926 (+ 23009us) log.cc:844] Serialized 14 byte log entry
0709 12:20:08.274915 (+1222989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.275020 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:08.275079 (+    59us) raft_consensus.cc:1685] finished
0709 12:20:08.275094 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.275264 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1225009,"prepare.queue_time_us":19382,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2555,"raft.queue_time_us":1216153,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":13830,"thread_start_us":190616,"threads_started":2,"wal-append.queue_time_us":162602,"wal-append.run_cpu_time_us":2158,"wal-append.run_wall_time_us":1019199}
I20260709 12:20:08.315323 25854 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:08.310353 25168 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:08.270628 27472 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:08.299569 27568 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.296567 27566 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:20:08.375552 27568 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:08.376118 27568 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.314678 27467 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:08.376680 27467 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:08.311494 27432 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:08.369802 25121 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:08.319736 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.306393 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:08.379160 25193 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:08.415407 25854 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:20:08.394055 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:08.306224 27443 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:08.418223 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.319748 27304 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:08.311630 27610 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:08.319995 27424 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:08.319051 27445 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:08.392135 27385 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:08.274923 27474 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.426903 27529 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.363611 27439 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:08.391888 27481 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.423735 25852 raft_consensus.cc:2368] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:08.432484 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:08.435024 25859 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.435642 25197 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:08.421727 27619 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:08.437047 25856 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:08.424016 27432 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:08.452054 25270 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:08.437099 27619 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.436532 27439 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.460207 25859 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:08.461731 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.441246 27584 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:08.446156 27383 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:08.318205 27606 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.450975 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:08.438079 27255 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:20:08.471030 27604 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4.
I20260709 12:20:08.456750 25267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:20:08.439700 27481 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.485579 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:08.439306 27385 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.433918 27304 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.463608 27439 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:08.447376 27424 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.492698 27543 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:08.493180 27543 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:08.489760 27574 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:08.493989 27574 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.496780 27574 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:08.494144 27543 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.500356 25241 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:08.487834 25857 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.504524 25270 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:08.508826 27474 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.509375 27606 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:08.517417 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:08.515087 25241 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.519956 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:08.498278 25267 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:08.526610 25267 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.467746 27584 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.531525 27481 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.518317 27594 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.538192 25241 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:08.542871 25165 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:08.539369 27584 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.540341 27619 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.543458 25241 leader_election.cc:400] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:08.559228 27604 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:08.541769 27594 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.560194 25241 leader_election.cc:403] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:20:08.535651 27543 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:08.573185 25241 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:08.575898 27594 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.592455 27607 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:08.575678 27591 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.576414 27604 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:08.596136 27604 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.541903 27481 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:08.576998 27522 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:08.577972 27584 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:08.597929 27522 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.570439 27255 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:08.599112 27505 raft_consensus.cc:2764] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:20:08.599408 27255 raft_consensus.cc:697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:08.599617 27439 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.600468 27255 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.601253 27442 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:08.591841 27619 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:08.602660 27619 raft_consensus.cc:697] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:08.598343 27464 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:08.603440 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:08.603700 27464 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.601832 27439 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:08.579121 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 319338us
I20260709 12:20:08.613493 25270 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:08.614976 25270 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 3. Current term is 5. Ops: []
W20260709 12:20:08.607342 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 344223us
I20260709 12:20:08.617657 25093 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:08.618801 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.619038 25093 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.619551 25119 raft_consensus.cc:2393] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 2: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:08.620167 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.620868 25123 raft_consensus.cc:2393] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:08.621435 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:08.604105 25858 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:08.621982 25126 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.621760 25093 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.623162 25125 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:08.615820 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:08.625622 25270 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:08.625725 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.626549 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:08.627236 25119 raft_consensus.cc:2393] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 2: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:08.628767 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:08.629449 25123 raft_consensus.cc:2393] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:08.630162 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:08.623319 25093 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:08.609714 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 66920.1us
I20260709 12:20:08.612485 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:08.632550 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.633266 25268 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:20:08.611023 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.634632 25859 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:08.634166 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:08.620299 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:08.636303 25122 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.633268 25852 raft_consensus.cc:2393] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:08.627949 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.639982 25123 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:08.629582 25090 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:08.643355 25241 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:08.644749 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.645408 25851 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:08.641078 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.634737 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:08.647992 25093 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.649086 25093 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.649577 25090 leader_election.cc:400] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:08.649899 25090 leader_election.cc:403] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:20:08.654104 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.657332 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.658461 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.659487 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.659823 25093 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.661206 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:08.661890 25860 raft_consensus.cc:2368] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:08.662212 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.662889 25118 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:08.671173 25858 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:08.672694 25167 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:08.671221 25122 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:08.674499 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.675146 25122 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:08.665972 25126 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:08.676223 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:08.677968 25197 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:08.677860 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.676885 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.681551 25127 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:08.683382 27505 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:08.683750 27619 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.684602 27565 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.634235 27464 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.655493 27474 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:08.686565 27474 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:08.686977 27474 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:08.635447 27569 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:08.691190 27569 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:08.691582 27569 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:08.692719 25267 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.714560 27385 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:08.679039 27631 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:08.715488 25267 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.693738 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.645653 27538 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.694417 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.696815 27481 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:08.697045 27505 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:08.697408 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:08.698639 27424 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:08.699028 27553 raft_consensus.cc:993] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:20:08.699293 27507 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:08.700261 27633 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.529500 27432 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.698513 27418 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:20:08.679131 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.701136 25857 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:08.701465 25822 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.701815 27555 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:08.663908 27393 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:08.703675 27547 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.705816 25852 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:08.660614 27570 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:20:08.707038 27591 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:08.707659 27464 consensus_queue.cc:1059] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:08.755232 27553 raft_consensus.cc:1081] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:20:08.765937 27464 consensus_queue.cc:1243] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [LEADER]: Peer b83c12959b9848b3b7bbc680f5ee6225 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:20:08.708694 27468 consensus_queue.cc:1059] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:08.766438 27505 raft_consensus.cc:3055] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:08.766852 27505 raft_consensus.cc:740] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:08.766973 27468 raft_consensus.cc:3055] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:08.709239 27304 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.750303 27633 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:08.633652 27504 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:08.709724 27391 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:08.777103 27504 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.709626 27594 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.710687 25093 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.710883 25268 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:08.624467 27584 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:08.633351 27575 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:08.624225 27447 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:08.711195 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 61732.2us
I20260709 12:20:08.680776 27531 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:08.798000 27531 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.797752 27584 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.798458 27531 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:08.792510 27505 consensus_queue.cc:260] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.713537 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:08.799710 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 78465.4us
I20260709 12:20:08.720384 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.799974 27505 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:08.800539 25124 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:08.801442 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.720860 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.802670 27610 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:08.803876 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.804468 25125 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:20:08.805008 27555 raft_consensus.cc:697] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:08.805994 27555 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.762339 27547 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.724799 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:08.737311 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.654773 27472 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:08.737434 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.767020 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:08.750190 25123 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:08.756414 27252 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:08.736195 25853 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:08.739547 27538 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.739323 27481 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.664278 27566 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.768235 27468 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:08.780131 27633 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.799814 25120 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:08.721163 25858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:08.816280 25126 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 7: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:08.688416 27568 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:08.828213 25858 raft_consensus.cc:606] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:08.829142 25118 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:08.696832 27565 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:08.825834 27566 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:08.835820 27566 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.851334 27455 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.859644 27464 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:08.860222 27464 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:08.864639 25127 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:08.881034 25167 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:08.881476 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:08.882197 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 171579us
I20260709 12:20:08.899243 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:08.900295 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:08.881567 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 180175us
I20260709 12:20:08.861220 27464 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.905900 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:08.906132 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 262856us
W20260709 12:20:08.907883 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 140591us
I20260709 12:20:08.909552 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:08.914739 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.917587 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:08.917975 27553 raft_consensus.cc:993] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:20:08.918484 27553 raft_consensus.cc:1081] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:20:08.919422 27538 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:08.920197 27468 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:08.921486 27464 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.922636 27481 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:08.925472 25022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41752 (request call id 362) took 6369 ms. Trace:
I20260709 12:20:08.932603 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:08.933301 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:08.934434 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:08.935777 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:08.903650 25093 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.860440 27547 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:08.971103 25198 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:08.976363 25195 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:20:08.980218 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.971408 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:08.971854 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:08.880744 27606 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.982792 25119 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:08.985497 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:08.985594 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:08.902534 27565 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.905102 27509 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:08.991348 25270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:20:08.989009 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.991957 25270 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:08.992578 25270 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.989269 25269 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:08.989682 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.986456 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:08.996310 25852 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEARNER]: Advancing to term 3
I20260709 12:20:08.905339 27391 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:08.974565 27447 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:09.025939 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:08.912781 27252 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
W20260709 12:20:09.029317 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.928265 27506 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:20:08.944180 27594 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:08.925877 25022 rpcz_store.cc:276] 0709 12:20:02.556298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.556592 (+   294us) service_pool.cc:224] Handling call
0709 12:20:02.570971 (+ 14379us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b54002ef754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e78090 00007f2103f16f3a 00007f2109ccce9c 00007f2109dcb04e 00007f210828c2a4 00007f210828c232 00007f210828c161 00007f210828c0dc 00007f210828b392 00007f210224948c 00007f21022488c6
0709 12:20:08.925394 (+6354423us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:07.207311 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:07.218331 (+ 11020us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:07.218363 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:20:07.218380 (+    17us) tablet.cc:662] Decoding operations
0709 12:20:07.218708 (+   328us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:07.218762 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:07.218787 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:07.218978 (+   191us) tablet.cc:701] Row locks acquired
0709 12:20:07.218991 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:20:07.219127 (+   136us) write_op.cc:270] Start()
0709 12:20:07.219230 (+   103us) write_op.cc:276] Timestamp: P: 1783599607219080 usec, L: 0
0709 12:20:07.219251 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:20:07.226713 (+  7462us) log.cc:844] Serialized 599 byte log entry
0709 12:20:07.829133 (+602420us) op_driver.cc:464] REPLICATION: finished
0709 12:20:07.830776 (+  1643us) write_op.cc:301] APPLY: starting
0709 12:20:07.830891 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:07.831020 (+   129us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:07.831175 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:07.831465 (+   290us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:07.831711 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:07.831782 (+    71us) write_op.cc:312] APPLY: finished
0709 12:20:07.854966 (+ 23184us) log.cc:844] Serialized 23 byte log entry
0709 12:20:07.867448 (+ 12482us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:07.875277 (+  7829us) write_op.cc:454] Released schema lock
0709 12:20:07.877174 (+  1897us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:07.908954 (+ 31780us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:07.908986 (+    32us) write_op.cc:454] Released schema lock
0709 12:20:08.223170 (+314184us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b1800283240. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2103ab64bc 00007f2100e0448b 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e1e455 00007f2103e8b190 00007f2103e84ae7 00007f2103e83dd9
Metrics: {"mutex_wait_us":810208,"reported_tablets":10,"spinlock_wait_cycles":12178176,"child_traces":[["op",{"apply.queue_time_us":1289,"apply.run_cpu_time_us":2289,"apply.run_wall_time_us":78168,"num_ops":1,"prepare.queue_time_us":205247,"prepare.run_cpu_time_us":64159,"prepare.run_wall_time_us":240334,"raft.queue_time_us":196679,"raft.run_cpu_time_us":1078,"raft.run_wall_time_us":7732,"replication_time_us":609675,"spinlock_wait_cycles":39881344,"thread_start_us":522804,"threads_started":4,"wal-append.queue_time_us":347405}]]}
W20260709 12:20:09.033367 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.036926 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:09.045163 25273 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:08.986361 27504 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:09.043279 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:09.039390 25270 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.045362 25242 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:08.999415 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:08.985110 27418 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:20:09.015403 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:08.991463 27440 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:09.020736 25267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:20:09.056372 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:09.067162 25851 raft_consensus.cc:3055] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:09.067513 25851 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:09.068012 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:09.054824 25270 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:09.063957 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:09.069479 25275 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:09.064594 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:09.054688 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:09.071159 25269 raft_consensus.cc:2410] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:09.022993 27522 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:09.068440 25851 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.038641 27509 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:09.074224 25851 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:09.000751 27568 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:09.038483 27393 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:08.996090 27606 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.042675 27570 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:09.068171 27631 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.000042 27565 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.081391 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:09.085036 27467 consensus_meta.cc:287] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.012s
I20260709 12:20:09.082453 25267 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:08.988183 27474 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:09.116727 25852 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:09.093822 25851 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:09.096616 25025 catalog_manager.cc:5697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 4 to 6, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 6 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:09.097816 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:09.099797 27639 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:09.106761 27509 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:09.089438 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 109336us
I20260709 12:20:09.081168 27584 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:09.110930 27643 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:20:09.116036 25201 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:20:09.149730 25241 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:09.093047 25199 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:09.119469 25025 catalog_manager.cc:5697] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 4, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:09.105793 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60547.5us
W20260709 12:20:09.088761 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 88338.9us
W20260709 12:20:09.132193 27641 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:20:09.124503 27639 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:09.074745 27440 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:20:09.158682 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:09.158959 27639 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:09.159375 25855 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
W20260709 12:20:09.141566 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 111821us
I20260709 12:20:09.162149 27591 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:09.162855 27591 raft_consensus.cc:697] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:09.163296 27553 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:09.163941 27591 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:09.146129 27442 consensus_meta.cc:287] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.544s	user 0.014s	sys 0.004s
I20260709 12:20:09.165499 27442 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:09.105103 27631 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.115029 27467 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.166514 25125 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:09.167970 27631 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:09.146564 27618 consensus_queue.cc:1059] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:09.169320 25121 raft_consensus.cc:1240] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:09.169560 27565 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:09.149644 25857 raft_consensus.cc:3055] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:09.171650 25857 raft_consensus.cc:740] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:09.172611 25167 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:09.172515 25857 consensus_queue.cc:260] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.173770 27624 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:09.174399 27624 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.174820 27624 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.182247 27569 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.184397 27569 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:09.190055 27468 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:09.191160 27474 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:09.173828 25857 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.126672 25092 leader_election.cc:400] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
W20260709 12:20:09.145684 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 113010us
I20260709 12:20:09.151613 25124 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:09.162864 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:09.196300 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:09.116720 25267 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.154317 25025 catalog_manager.cc:5697] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:09.147552 27606 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:09.199460 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 72959.8us
I20260709 12:20:09.204214 25856 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:09.193907 25855 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:20:09.203329 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 48310.3us
I20260709 12:20:09.210323 25242 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:09.205559 25025 catalog_manager.cc:5697] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:09.207644 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:09.207798 25092 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:09.213164 25242 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:09.221463 25273 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:09.213662 25025 catalog_manager.cc:5697] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 3, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:09.242386 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 271046us
I20260709 12:20:09.168007 27467 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:09.202610 27553 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:09.245000 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:09.250722 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:09.251515 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 44205.7us
I20260709 12:20:09.253914 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:09.255028 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:09.209652 27326 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.265704 25121 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:09.211495 27609 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:09.252972 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:09.267196 25202 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:20:09.269371 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:09.269594 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:09.269989 25195 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:09.271103 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:09.271742 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:09.272249 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:09.273334 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:09.265823 25125 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 2.
I20260709 12:20:09.278682 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:09.279407 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:09.280136 25122 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:09.280929 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:09.289896 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:09.241894 27543 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:09.296525 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:09.293727 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 53604.8us
I20260709 12:20:09.233476 27474 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:09.289530 25825 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:09.294667 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:09.294850 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:09.295424 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:09.297649 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:09.246614 27522 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:09.297945 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:09.298278 25194 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:09.298426 25202 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:09.299369 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:09.301203 25123 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:09.305632 25122 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:09.265324 27531 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:09.301548 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:09.307160 25125 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:09.308264 25201 raft_consensus.cc:2368] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5.
I20260709 12:20:09.308526 27531 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:09.301967 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:09.309443 25119 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:09.302068 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:09.312824 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:09.313355 25120 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:20:09.314599 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:09.306177 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:09.315317 25093 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:09.316128 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:09.316386 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:09.316802 25274 raft_consensus.cc:2368] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:09.317216 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:09.320575 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:09.321156 25127 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.265293 27455 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:09.322356 25122 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:09.356567 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:09.262708 27383 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:09.357544 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:09.358698 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.358958 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:09.359545 25196 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:09.359778 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:09.357395 25119 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:09.361276 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:09.361810 25119 raft_consensus.cc:2376] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4. Re-sending same reply.
I20260709 12:20:09.360946 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:09.364122 25202 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.364830 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:09.288914 27385 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.293335 27467 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:09.363157 25119 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:20:09.410147 25119 pending_rounds.cc:85] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 1
I20260709 12:20:09.410689 25119 pending_rounds.cc:107] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:20:09.411301 25119 raft_consensus.cc:2889] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:09.330962 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:09.405252 25202 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
W20260709 12:20:09.413954 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 83114.5us
I20260709 12:20:09.414994 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:09.315456 25123 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:09.421926 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 57160.4us
I20260709 12:20:09.423000 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:09.424765 25125 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:09.314200 27547 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:09.266270 27507 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 12:20:09.303252 27474 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.294498 27439 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:09.318434 27584 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:09.356989 27609 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:09.356567 27370 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:09.367465 27565 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:09.496168 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 136450us
I20260709 12:20:09.303045 27594 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.148s
I20260709 12:20:09.355106 27607 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:09.296185 27326 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.479475 27474 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.474689 27255 consensus_queue.cc:1059] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:20:09.369537 27455 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:09.426016 27442 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:09.432740 27464 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:09.427619 27553 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.297912 27604 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.186s
I20260709 12:20:09.435801 27574 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:09.476123 27509 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:09.481077 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 58190.8us
I20260709 12:20:09.478802 27619 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:09.525317 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:09.527524 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:09.482357 27439 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.374116 27633 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.482468 27522 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:09.490854 27609 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:09.519927 27566 consensus_meta.cc:287] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.008s
I20260709 12:20:09.390771 27383 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:09.513329 27565 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.505456 27370 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:09.418426 27653 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
I20260709 12:20:09.502656 25127 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:09.449635 27467 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.584925 27590 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:09.444782 27385 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:09.578001 25242 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:09.580685 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 55492us
I20260709 12:20:09.542804 27455 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:09.598837 25273 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:09.524410 27607 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.633082 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:09.587998 27439 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:09.635566 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:09.637499 25200 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:09.612632 27609 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.641119 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:09.627038 27370 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:09.627543 27507 raft_consensus.cc:3055] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:09.628011 27565 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.645606 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:09.576179 27553 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.583591 27509 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:09.695374 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 117482us
I20260709 12:20:09.639199 27665 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:09.637212 27607 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:09.698727 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:09.704931 27662 log.cc:927] Time spent T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:20:09.650162 27590 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:09.709478 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:09.707496 25198 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:09.624356 27566 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:09.714593 27566 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:09.715343 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:09.715950 25274 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:09.718345 25126 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:09.719523 27509 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:09.720901 27672 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:09.721341 27670 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:09.721431 27672 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:09.704931 27647 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:09.723742 27672 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:09.723917 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 506) took 1006 ms. Trace:
I20260709 12:20:09.644595 27454 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:20:09.726150 27619 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:09.726699 27619 raft_consensus.cc:697] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:09.727416 27467 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:09.727557 27619 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.724258 25197 rpcz_store.cc:276] 0709 12:20:08.717651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.718107 (+   456us) service_pool.cc:224] Handling call
0709 12:20:08.718489 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:08.793284 (+ 74795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:08.793333 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:08.808410 (+ 15077us) log.cc:844] Serialized 52 byte log entry
0709 12:20:09.252744 (+444334us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:09.431888 (+179144us) log.cc:844] Serialized 14 byte log entry
0709 12:20:09.433146 (+  1258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:09.433234 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:09.723710 (+290476us) raft_consensus.cc:1685] finished
0709 12:20:09.723731 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:09.723860 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77749,"prepare.queue_time_us":384209,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":4826,"raft.queue_time_us":83582,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":11849,"thread_start_us":553679,"threads_started":2,"wal-append.queue_time_us":736908}
I20260709 12:20:09.697022 27574 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:09.643874 27481 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:09.603688 27522 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:09.651974 27507 raft_consensus.cc:740] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:09.687851 27587 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:09.703573 27642 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 12:20:09.741477 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:09.742399 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:09.741909 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:09.752923 25851 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:09.743637 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:09.753523 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:09.705330 27543 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:09.756454 25274 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
W20260709 12:20:09.737087 27659 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 12:20:09.730360 27655 log.cc:927] Time spent T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260709 12:20:09.744732 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:09.752187 25194 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
W20260709 12:20:09.734720 27652 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
W20260709 12:20:09.750936 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 52297.3us
I20260709 12:20:09.764596 25242 leader_election.cc:400] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:09.757797 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:09.739795 27666 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:09.773622 25242 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:09.779973 25123 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
W20260709 12:20:09.830235 25270 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.003s	sys 0.010s
W20260709 12:20:09.872319 25270 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.006s	sys 0.021s
W20260709 12:20:09.798658 27661 log.cc:927] Time spent T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:20:09.810209 25090 leader_election.cc:400] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:09.772163 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:09.783833 25267 consensus_meta.cc:287] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.003s
I20260709 12:20:09.738981 27481 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.802587 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:09.797703 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:09.887750 25274 raft_consensus.cc:2368] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:09.887882 25268 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
W20260709 12:20:09.804461 27468 consensus_meta.cc:287] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.000s
I20260709 12:20:09.747313 27574 raft_consensus.cc:697] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:09.802744 27304 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:09.782661 25242 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:09.790918 27522 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:09.772228 27383 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:09.877933 27657 log.cc:927] Time spent T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
W20260709 12:20:09.784346 27660 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:20:09.880970 25090 leader_election.cc:403] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:20:09.882933 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 961) took 1001 ms. Trace:
I20260709 12:20:09.758838 27543 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:09.894989 25121 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
W20260709 12:20:09.898161 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 88195.2us
I20260709 12:20:09.897864 25858 rpcz_store.cc:276] 0709 12:20:08.881829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.881946 (+   117us) service_pool.cc:224] Handling call
0709 12:20:08.882286 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:08.902744 (+ 20458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:08.902774 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:08.913976 (+ 11202us) log.cc:844] Serialized 26 byte log entry
0709 12:20:09.202489 (+288513us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:09.202527 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:09.202590 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:09.882726 (+680136us) raft_consensus.cc:1685] finished
0709 12:20:09.882747 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:09.882877 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29774,"raft.queue_time_us":20106,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":42234,"thread_start_us":201606,"threads_started":1,"wal-append.queue_time_us":281301}
I20260709 12:20:09.903826 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:09.884276 27633 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:09.913676 25090 leader_election.cc:400] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:09.916546 25090 leader_election.cc:403] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:20:09.920706 27481 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:09.921398 27481 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:09.925195 27467 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:09.925982 27574 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.913352 27468 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:09.888726 25267 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.936566 25267 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:09.938201 25275 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:09.895593 27304 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.938771 27304 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:09.943431 27385 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:09.945968 25272 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:20:09.951332 25269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.002s	sys 0.016s
W20260709 12:20:09.951882 25269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.002s	sys 0.016s
I20260709 12:20:09.953743 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:09.954531 25860 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:09.956244 25858 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:09.879176 27370 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:09.896499 27674 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.957835 25241 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:09.831868 27507 consensus_queue.cc:260] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:10.043311 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 295423us
W20260709 12:20:09.994225 27673 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:20:09.992915 27391 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:10.004065 27584 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.003s
W20260709 12:20:10.006784 25857 consensus_meta.cc:287] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.804s	user 0.006s	sys 0.005s
W20260709 12:20:10.056207 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 273605us
I20260709 12:20:10.002568 27633 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:09.990720 27287 consensus_queue.cc:1059] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:20:10.003739 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:10.049808 27639 consensus_meta.cc:287] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.890s	user 0.011s	sys 0.000s
I20260709 12:20:10.060334 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:10.054536 27507 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:10.057873 27391 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.060053 27584 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:10.092060 27391 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.093261 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.052237 27638 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:10.075012 27370 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:10.075107 27467 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:10.076145 27455 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.079494 27506 raft_consensus.cc:1064] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:20:10.082499 27639 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:10.077773 27624 consensus_meta.cc:287] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.902s	user 0.006s	sys 0.006s
I20260709 12:20:10.104498 27624 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.106281 25195 raft_consensus.cc:2368] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3.
I20260709 12:20:10.002851 27674 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.108155 27639 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.086014 27555 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.081576 27439 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.093920 25269 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:10.103721 25275 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:10.085516 25093 leader_election.cc:400] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5.
I20260709 12:20:10.123587 25093 leader_election.cc:403] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:10.120458 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 60209.4us
I20260709 12:20:10.102864 27565 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.061653 25857 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:10.097767 27455 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.124246 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:10.129911 27633 raft_consensus.cc:697] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:10.135514 25122 raft_consensus.cc:2368] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3.
I20260709 12:20:10.110014 27553 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:10.136924 27618 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
W20260709 12:20:10.137539 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.137120 27633 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.135399 27569 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:10.158777 27569 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.159235 27569 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:10.125559 27555 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.164110 27555 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.138700 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 646) took 1177 ms. Trace:
I20260709 12:20:10.125159 27522 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:10.144377 25093 leader_election.cc:400] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3.
I20260709 12:20:10.132947 27570 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:10.165289 25093 leader_election.cc:403] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:10.164855 25857 rpcz_store.cc:276] 0709 12:20:08.958426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.971219 (+ 12793us) service_pool.cc:224] Handling call
0709 12:20:09.097699 (+126480us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b5800093398. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9b71 00007f2100de9eee 000000000036eb39 00007f2108e5d1e0 00007f2108f260c4 00007f2108f26131 00007f2108ed40a0 00007f2108ed3984 00007f210244e6d4 00007f210244e662
0709 12:20:10.135893 (+1038194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32940288}
I20260709 12:20:10.150580 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:10.152637 27674 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:10.154314 27439 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.155611 25090 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:10.168321 25241 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:10.174326 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:10.171608 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:10.176699 25195 raft_consensus.cc:2368] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:10.172317 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:10.172654 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:10.177543 25194 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:10.187114 27326 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.186597 25197 raft_consensus.cc:2955] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:10.190225 27464 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:10.190644 27464 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.190973 27464 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:10.191334 27543 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.174574 27391 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:10.207845 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:10.210186 27684 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:10.211035 27684 raft_consensus.cc:697] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:10.214411 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.213634 27684 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.238960 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:10.244318 25194 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:10.256199 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:10.257949 25127 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:10.247658 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:10.249997 25269 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:10.252017 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.254223 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:10.262405 25124 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:10.254446 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:10.255844 25123 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:10.263432 27554 consensus_queue.cc:1059] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:10.267832 27442 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.268792 27442 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.269589 27383 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:10.270205 25119 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:10.270139 27383 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.271661 25857 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:10.272271 27383 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.272785 27383 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:10.258716 27432 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:10.275210 27442 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.275102 27432 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.277235 27432 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.238555 27631 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:10.258955 27653 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:10.297451 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:10.231360 27607 consensus_meta.cc:287] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.005s
I20260709 12:20:10.298434 27653 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.299094 27607 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.301258 27607 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:10.301514 27653 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.199966 27468 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:10.302614 27623 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:10.303236 27623 raft_consensus.cc:697] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:10.259308 27529 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.304054 27623 consensus_queue.cc:237] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.305820 27255 raft_consensus.cc:3055] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:10.293239 27631 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.309693 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:10.315377 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.315672 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:10.316190 25271 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:10.316573 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.323974 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:10.306272 27255 raft_consensus.cc:740] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:10.333639 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:10.336030 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 161850us
W20260709 12:20:10.330884 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 70183.2us
I20260709 12:20:10.339574 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:10.340446 25123 raft_consensus.cc:2410] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:20:10.340777 27669 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:10.340974 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:10.341226 27669 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:10.341578 25119 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:10.336982 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:10.341616 25093 leader_election.cc:400] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4.
I20260709 12:20:10.344913 25271 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:10.347767 25093 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:10.337682 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:10.348281 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.349172 25271 raft_consensus.cc:2410] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:20:10.349958 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.350842 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:10.358786 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:10.360181 25194 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:10.361683 27505 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:10.362282 27505 raft_consensus.cc:697] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:10.341651 27669 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:10.363202 27606 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:10.363322 27505 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.363951 27606 consensus_queue.cc:1243] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:20:10.242275 27304 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.366581 25273 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:10.273231 27383 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.366921 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:10.304316 27440 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.308501 27604 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.361474 25093 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:10.368309 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:10.369168 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:10.370487 25120 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:10.374877 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:10.366132 27304 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.378476 27575 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:10.362392 27439 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:10.330348 27555 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:10.379081 27575 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.379873 27555 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.382596 27432 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:10.383158 27432 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.385221 27432 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.385424 27442 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:10.385833 27442 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.366142 27619 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:10.386252 27442 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:10.385957 27671 log.cc:927] Time spent T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:20:10.388403 27383 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.347287 27553 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.389549 27553 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.391587 27565 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.392225 27575 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.392804 27624 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.347453 27531 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:10.304328 27529 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.402643 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.423940 25271 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:10.403621 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:10.374938 27481 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:10.437811 27529 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.438621 27255 consensus_queue.cc:260] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.397840 27619 raft_consensus.cc:697] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:10.440353 27619 consensus_queue.cc:237] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.406364 27531 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.442349 27531 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:10.405422 27383 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:10.446429 27383 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.448513 27383 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.399189 27440 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:10.450412 27440 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:10.436020 27674 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:10.451277 27440 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.451834 27674 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:10.452225 27674 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:10.454267 27481 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:10.455214 27481 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.335736 27639 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 12:20:10.437580 27609 consensus_meta.cc:287] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.749s	user 0.015s	sys 0.001s
W20260709 12:20:10.410877 27474 consensus_meta.cc:287] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.857s	user 0.013s	sys 0.006s
I20260709 12:20:10.449918 27631 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:10.498936 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 136993us
I20260709 12:20:10.412544 27587 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:10.374140 27670 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:10.396556 27604 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.359457 27653 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:20:10.396667 27555 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:10.522056 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.525981 27604 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.527567 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:10.529351 25860 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:10.496941 27609 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.531879 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:10.532313 25859 raft_consensus.cc:2368] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3.
I20260709 12:20:10.431509 27575 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.482488 27385 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.509275 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2164) took 1614 ms. Trace:
I20260709 12:20:10.406109 25120 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:10.502882 27587 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.518666 27607 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.519373 25855 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:10.519975 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.521238 27464 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.502948 27670 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:10.532752 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:10.308830 27570 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5.
I20260709 12:20:10.432916 25119 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:10.532967 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:10.661307 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:10.662061 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:10.661989 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:10.663928 25126 rpcz_store.cc:276] 0709 12:20:08.895469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.899998 (+  4529us) service_pool.cc:224] Handling call
0709 12:20:10.509073 (+1609075us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b540009d154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:10.509201 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879391488}
I20260709 12:20:10.665439 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:10.665781 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:10.666930 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:10.667273 25126 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:10.667776 25127 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
W20260709 12:20:10.654198 25242 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.709s (SENT) [suppressed 6 similar messages]
W20260709 12:20:10.620201 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 85252.8us
I20260709 12:20:10.551764 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:10.722287 25123 raft_consensus.cc:2368] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4.
I20260709 12:20:10.549952 25858 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:10.739871 25168 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:10.681723 25119 raft_consensus.cc:1240] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:10.585059 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:10.743036 25854 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:10.719738 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:10.689471 25120 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:10.746239 25852 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:10.760936 25167 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:10.766595 25121 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:10.656719 25853 raft_consensus.cc:3055] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:10.589982 27609 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:10.683079 27670 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:10.769002 27623 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:10.803105 27383 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:20:10.721199 27442 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.731153 27519 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:10.682890 27391 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3.
I20260709 12:20:10.503474 27474 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.700498 27385 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.682847 27575 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.682888 27674 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.835033 27587 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.834277 27531 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:10.836289 27569 consensus_meta.cc:287] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.677s	user 0.011s	sys 0.000s
I20260709 12:20:10.708695 27607 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.837663 27464 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.838268 27445 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.805779 27529 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:10.813666 27432 consensus_queue.cc:1059] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:20:10.843879 27604 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:10.845366 27442 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.841753 27543 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:10.848410 27694 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.326s	user 0.002s	sys 0.000s
I20260709 12:20:10.776885 25120 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:10.798514 25853 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:10.833679 27669 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.859740 25118 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:10.858978 27474 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:10.865620 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:10.868295 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 104211us
I20260709 12:20:10.877897 27439 raft_consensus.cc:697] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:10.852593 27519 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.883607 27529 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.876286 25125 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
W20260709 12:20:10.876857 25093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.006s	sys 0.015s
I20260709 12:20:10.782783 27440 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:20:10.853652 27623 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:10.890201 25165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.014s	sys 0.041s
W20260709 12:20:10.868861 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 214698us
I20260709 12:20:10.911469 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:10.853096 27624 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:20:10.903846 25856 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
W20260709 12:20:10.904350 25093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.006s	sys 0.015s
I20260709 12:20:10.913496 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:10.914503 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:10.882037 27569 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.917447 25853 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.918450 27519 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.918710 27623 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:10.928452 27505 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:10.928849 27674 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:10.929157 27505 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.884871 27445 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.901039 27432 consensus_queue.cc:1243] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:20:10.902675 27529 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:10.932116 25242 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:10.915127 25165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.014s	sys 0.041s
I20260709 12:20:10.934777 25853 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:10.901733 27442 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:10.904309 27464 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:10.937705 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 168239us
I20260709 12:20:10.902241 27383 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:10.941623 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:10.942655 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:10.942873 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:10.943099 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:10.957397 25198 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:10.926116 27633 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:10.943776 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:10.959162 25202 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:10.945365 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.945551 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:10.946727 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:10.948141 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.925976 27474 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:10.919992 27506 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.920607 27672 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:20:10.950822 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.951586 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:10.988838 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.989207 25271 raft_consensus.cc:2393] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:10.935322 27385 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:10.972420 25198 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:10.963246 27464 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:10.981035 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.937390 27669 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:11.009047 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:10.953553 27481 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:20:11.014896 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.013336 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:11.009864 25276 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:10.990269 25274 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:11.015935 25200 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:10.989497 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:10.939452 27638 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:10.953358 27432 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:10.953655 27714 raft_consensus.cc:3055] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:10.963773 27633 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.955102 27575 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:10.959859 27383 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:10.947716 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 196086us
I20260709 12:20:11.021764 25196 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:10.956254 27442 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:11.018071 27638 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.020640 27714 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:10.990707 27474 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.050940 27474 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.056319 27569 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:11.056614 27529 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.057327 27607 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:11.058990 27529 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.062470 27442 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:11.062876 27638 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:11.063386 27531 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:11.064051 27467 raft_consensus.cc:2955] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:11.036755 27633 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:11.072793 27670 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:11.076503 27481 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:11.079762 27481 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.103164 27670 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:11.081872 27553 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:11.015146 27439 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.038882 27432 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.165098 25853 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
W20260709 12:20:11.385931 25853 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 658) took 1436 ms (client timeout 1907 ms). Trace:
W20260709 12:20:11.386590 25853 rpcz_store.cc:269] 0709 12:20:09.949182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.951175 (+  1993us) service_pool.cc:224] Handling call
0709 12:20:10.656536 (+705361us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b54002b5320. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e85dc0 00007f2103f11e18 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6
0709 12:20:11.385650 (+729114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159064832}
I20260709 12:20:11.387528 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:11.313452 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:11.104997 27383 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.389171 25851 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:11.540221 27505 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.354508 25193 raft_consensus.cc:2368] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
W20260709 12:20:11.459991 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.350782 25201 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:11.432649 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:11.372810 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:11.487623 27391 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:11.374159 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:11.370595 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:11.366380 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:11.559470 27432 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.565999 25270 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
W20260709 12:20:11.568902 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:11.571099 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 510511us
W20260709 12:20:11.573063 27574 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:20:11.560513 25198 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:11.189802 27716 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:20:11.610948 27566 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:20:11.229647 27702 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 12:20:11.560954 27464 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.561506 27565 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.614835 27565 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.615733 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1626) took 1305 ms. Trace:
I20260709 12:20:11.613066 27569 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:11.565752 25859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 722) took 1817 ms (client timeout 1561 ms). Trace:
I20260709 12:20:11.367426 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:11.249890 27638 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:11.225705 27714 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.595018 25856 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:11.595208 27570 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:11.374189 25167 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:11.602208 27391 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.487810 27393 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:11.450668 27326 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:11.492079 27442 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:11.619097 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 46491.6us
I20260709 12:20:11.613269 27566 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.664193 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:11.665125 25200 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:11.665450 27638 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:11.619422 25859 rpcz_store.cc:269] 0709 12:20:09.744282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.744441 (+   159us) service_pool.cc:224] Handling call
0709 12:20:11.139173 (+1394732us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b5400049554. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:11.562090 (+422917us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1776515840}
I20260709 12:20:11.616250 25269 rpcz_store.cc:276] 0709 12:20:10.309901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.310370 (+   469us) service_pool.cc:224] Handling call
0709 12:20:10.310802 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.321163 (+ 10361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:10.321211 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:10.321833 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 12:20:10.801193 (+479360us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:10.801233 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.801366 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:11.228822 (+427456us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:11.615170 (+386348us) raft_consensus.cc:1685] finished
0709 12:20:11.615210 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:11.615505 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10547,"raft.queue_time_us":19487,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":31192,"spinlock_wait_cycles":10431232,"thread_start_us":404085,"threads_started":1,"wal-append.queue_time_us":524628}
I20260709 12:20:11.663009 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:11.674525 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:11.690559 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:11.691614 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 378703us
I20260709 12:20:11.681838 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1651) took 1426 ms. Trace:
I20260709 12:20:11.700124 25276 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:20:11.708204 25121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1645) took 1460 ms (client timeout 1871 ms). Trace:
W20260709 12:20:11.708840 25121 rpcz_store.cc:269] 0709 12:20:10.247316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.247430 (+   114us) service_pool.cc:224] Handling call
0709 12:20:11.707731 (+1460301us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540021ded4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:11.708020 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029786496}
W20260709 12:20:11.711124 27633 consensus_meta.cc:287] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.607s	user 0.014s	sys 0.005s
I20260709 12:20:11.711795 27445 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.711670 27633 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:11.696780 25125 rpcz_store.cc:276] 0709 12:20:10.255371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.255965 (+   594us) service_pool.cc:224] Handling call
0709 12:20:11.681251 (+1425286us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400105c54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:11.681499 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400399616}
W20260709 12:20:11.713982 25123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2184) took 1341 ms (client timeout 1753 ms). Trace:
W20260709 12:20:11.721182 25123 rpcz_store.cc:269] 0709 12:20:10.372498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.373862 (+  1364us) service_pool.cc:224] Handling call
0709 12:20:11.713523 (+1339661us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54002ace54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:11.713815 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796582656}
I20260709 12:20:11.733594 27623 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:11.734248 27623 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:11.734740 27623 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:11.740200 27393 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.634672 27570 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.702566 27706 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:11.735353 27633 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:11.738310 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:11.639187 27569 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.765607 25092 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:11.780970 25274 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:11.782976 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:11.784206 25200 raft_consensus.cc:2393] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:11.781004 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 407298us
I20260709 12:20:11.791587 27714 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:11.738770 27442 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.712935 27326 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:11.815385 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.815867 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:11.794966 27474 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:11.825420 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:11.806277 27467 consensus_meta.cc:287] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.019s
I20260709 12:20:11.835528 27383 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:11.835532 25273 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:11.836843 27570 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.837708 27565 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.841012 25202 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:11.845078 27391 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.846287 27505 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.847049 27505 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.847805 27442 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.848169 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:11.849591 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:11.852098 27553 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:11.852867 27565 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:11.856971 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 155693us
I20260709 12:20:11.850953 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:11.863305 25202 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:11.849406 27442 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.873610 25856 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:11.849483 27505 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:11.886798 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 184466us
I20260709 12:20:11.884852 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:11.873858 27566 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.907439 27506 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:11.907698 25122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 482) took 2579 ms (client timeout 1591 ms). Trace:
I20260709 12:20:11.898737 27505 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:11.908262 27506 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:11.908272 25122 rpcz_store.cc:269] 0709 12:20:09.327829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.357240 (+ 29411us) service_pool.cc:224] Handling call
0709 12:20:11.907205 (+2549965us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b5400453154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:11.907465 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786923392}
I20260709 12:20:11.910339 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:11.911689 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:11.912487 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:11.913035 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:11.901412 27442 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.894917 27553 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:11.916296 27442 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.917622 27553 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:11.960892 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 65750.7us
I20260709 12:20:11.891901 27570 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:11.939203 27393 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:11.927954 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:11.891629 27565 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:11.929271 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:11.926937 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:11.909124 27505 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:11.930352 25274 raft_consensus.cc:2955] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:11.932441 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:11.923144 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:11.939088 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:11.964870 27706 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.969151 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:11.977735 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:11.978266 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:11.902876 27474 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.972424 25168 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:11.983651 27553 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:12.001204 27699 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:12.002197 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2052) took 1059 ms. Trace:
I20260709 12:20:12.002348 25275 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:12.002540 27699 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:12.003096 27699 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:12.003472 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:12.004117 27505 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:12.004256 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 61422.8us
I20260709 12:20:12.004738 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:12.005332 27506 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.005662 25093 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:12.009243 25195 raft_consensus.cc:2410] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:20:12.014843 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.005585 25197 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:20:12.012343 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:12.008019 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 85019.4us
I20260709 12:20:12.002605 25193 rpcz_store.cc:276] 0709 12:20:10.942488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.942616 (+   128us) service_pool.cc:224] Handling call
0709 12:20:12.001918 (+1059302us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54000b1dd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:12.002113 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911272704}
I20260709 12:20:12.013650 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:11.983515 27442 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:12.007319 27505 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:12.062742 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:12.005980 27706 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:12.064055 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:12.058591 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:12.064728 25122 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:12.001708 27553 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.086519 25194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2039) took 1099 ms. Trace:
I20260709 12:20:12.012603 27506 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.009052 27714 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:12.065959 25267 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:12.069485 25197 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:12.075686 25193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:20:12.078224 25270 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:12.015394 27565 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.079905 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:12.076668 25118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2174) took 2803 ms (client timeout 2586 ms). Trace:
I20260709 12:20:12.086962 25194 rpcz_store.cc:276] 0709 12:20:10.986848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.986973 (+   125us) service_pool.cc:224] Handling call
0709 12:20:12.063771 (+1076798us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b5800211b98. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9b71 00007f2100de9a22 00007f2109d028d9 00007f2108e5cee0 00007f2108f260ab 00007f2108f26131 00007f2108ed40a0 00007f2108ed3984 00007f210244e6d4 00007f210244e662
0709 12:20:12.086447 (+ 22676us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5388672}
I20260709 12:20:12.086647 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:12.100481 25273 raft_consensus.cc:2393] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:12.103899 27506 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.106176 27624 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:12.106276 27439 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.107064 27439 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:12.109236 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 152551us
I20260709 12:20:12.111328 25202 raft_consensus.cc:2393] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:12.111523 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 989) took 1156 ms. Trace:
I20260709 12:20:12.112378 25193 raft_consensus.cc:606] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 12:20:12.112303 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:12.112762 25122 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:12.112908 25193 raft_consensus.cc:614] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:12.113827 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 55543.4us
I20260709 12:20:12.114936 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:12.115855 25197 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:12.116384 27445 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.117113 25195 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:12.117059 27445 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:12.118276 27432 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:12.118467 25165 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:12.119925 25268 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:12.120075 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:12.111997 25857 rpcz_store.cc:276] 0709 12:20:10.955227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.961830 (+  6603us) service_pool.cc:224] Handling call
0709 12:20:11.018162 (+ 56332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:11.076321 (+ 58159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:11.077090 (+   769us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:11.431842 (+354752us) log.cc:844] Serialized 26 byte log entry
0709 12:20:11.602461 (+170619us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:11.602559 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:11.602684 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.111095 (+508411us) raft_consensus.cc:1685] finished
0709 12:20:12.111114 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.111308 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1017,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":120451,"threads_started":1,"wal-append.queue_time_us":674031}
I20260709 12:20:12.123730 27698 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:12.123759 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 111476us
W20260709 12:20:12.096805 25118 rpcz_store.cc:269] 0709 12:20:09.272782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.278448 (+  5666us) service_pool.cc:224] Handling call
0709 12:20:12.076217 (+2797769us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54000e9cd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:12.076482 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3633972096}
I20260709 12:20:12.127580 27326 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.130352 27326 consensus_queue.cc:1059] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:12.131810 27326 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.132517 27326 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.135196 27255 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:12.136538 27445 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.137249 27445 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:12.125579 25276 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:12.140038 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:12.007103 27570 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.076614 27391 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:12.164619 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:12.057349 27623 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.144637 27505 raft_consensus.cc:697] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:12.177284 25118 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:12.179081 27565 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:12.180140 27565 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:12.180944 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 59814.8us
I20260709 12:20:12.181847 25090 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:12.182272 27391 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:12.182786 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:12.183116 27566 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:12.183552 25121 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:12.184212 27505 consensus_queue.cc:237] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:12.004256 27699 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:12.183151 25090 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:12.179121 27553 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.187075 27699 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:12.174700 27714 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:20:12.118204 27442 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.192957 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:12.193401 27442 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.193938 25196 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:12.178390 25273 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:12.196661 27507 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:12.200002 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2054) took 1256 ms. Trace:
I20260709 12:20:12.202939 27506 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.203670 27506 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:12.204084 27506 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:12.204506 27506 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:12.095760 27474 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:12.200681 25201 rpcz_store.cc:276] 0709 12:20:10.943084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.943205 (+   121us) service_pool.cc:224] Handling call
0709 12:20:10.961344 (+ 18139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:12.019587 (+1058243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.033656 (+ 14069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:12.048886 (+ 15230us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:12.049000 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.199473 (+150473us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54000a7154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:12.199549 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.199858 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12827,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":146,"spinlock_wait_cycles":893982464}
I20260709 12:20:12.156298 27574 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:12.197517 27507 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.246009 25167 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:12.257252 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:12.259699 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.262019 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:12.255124 27574 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.238412 27569 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.271528 25271 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:12.275271 27507 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.276672 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:12.278462 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:12.278744 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:12.279203 25123 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:12.279594 25119 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:12.280464 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:12.281113 27574 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:12.281721 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:12.282662 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:12.283476 25127 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:12.284570 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:12.285234 25126 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:12.297128 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:12.301800 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 176734us
I20260709 12:20:12.303442 25125 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:12.299847 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 178494us
I20260709 12:20:12.311362 25167 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:12.314580 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:12.319617 25122 raft_consensus.cc:2393] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:12.322712 25118 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:12.317968 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:12.323861 25127 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:12.310945 27507 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:12.330871 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 220805us
I20260709 12:20:12.317595 25822 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:12.317214 27326 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.322969 27432 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:12.344122 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 161034us
I20260709 12:20:12.346398 25125 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:12.344208 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:12.349085 25124 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:12.351871 25090 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:12.355152 25090 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:12.347453 27555 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:12.344653 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:12.386911 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:12.386705 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 77159.3us
I20260709 12:20:12.360165 27734 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:12.393014 27734 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:12.393591 25122 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:12.393718 27730 log.cc:927] Time spent T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:20:12.361289 25090 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:12.394388 27734 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.396122 27734 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:12.398810 27740 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:12.334280 27638 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:12.386492 27393 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:12.399566 27740 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.399801 27638 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:12.400532 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.360232 25855 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:12.401378 27731 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:12.402011 27731 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.402853 25851 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:12.403318 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:12.403913 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:12.399708 27393 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:12.405526 27393 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:12.406006 27591 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:20:12.404910 25825 connection.cc:256] RPC call timeout handler was delayed by -1.0987946570000986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 12:20:12.406811 27591 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.399008 25857 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 4: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:12.408313 27706 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.409158 27391 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.409232 27736 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:12.405436 27606 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:12.410175 27736 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.360714 27442 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:12.360424 27326 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:12.380795 27432 raft_consensus.cc:697] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:12.431998 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 70806.3us
I20260709 12:20:12.350258 27507 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.386345 27735 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.408787 27738 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:12.388556 27555 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.445242 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:12.451673 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:12.449374 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:12.452672 25268 raft_consensus.cc:2410] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:12.450356 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:12.436805 27442 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:12.464694 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:12.432476 27474 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.443248 27569 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:12.462782 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:12.469905 27439 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:12.475472 27726 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:20:12.449551 27555 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:12.478991 25275 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:12.448223 27738 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:12.480048 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 166422us
I20260709 12:20:12.478438 25860 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:12.490177 25090 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:12.467554 27442 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:12.456358 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:12.477242 27574 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.515654 25242 leader_election.cc:400] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4.
I20260709 12:20:12.515559 27574 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:12.516649 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 50404.3us
W20260709 12:20:12.518153 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 172526us
I20260709 12:20:12.519030 27565 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.519893 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:12.520041 27740 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:12.521173 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:12.487571 25271 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:12.523356 27623 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.511534 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:12.506381 27746 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.507833 27736 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:12.509569 27638 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.494666 27752 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:12.494614 27474 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:12.510490 27591 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.485843 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:12.510933 27749 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:20:12.511540 27506 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:12.512307 27748 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:20:12.518924 25168 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:12.491320 25276 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:12.467325 27326 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.467629 27569 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.537550 27467 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:12.528595 25093 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:12.536759 25121 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:12.542464 27757 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.483517 27738 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:12.499439 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:12.600178 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 71671.6us
W20260709 12:20:12.574571 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.575675 25272 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:12.578227 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:12.523389 27706 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:12.604317 27706 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:12.524556 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.577095 27474 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.537420 25853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:12.584383 27731 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:12.582908 25855 raft_consensus.cc:2410] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:12.583317 27432 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.608131 25241 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:12.493245 27735 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.607941 27752 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.608703 27565 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:12.608876 27741 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:20:12.534847 27747 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:12.610137 27507 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:12.606388 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 79778.1us
W20260709 12:20:12.608034 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 89190.8us
I20260709 12:20:12.619071 25125 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
W20260709 12:20:12.626482 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 102149us
I20260709 12:20:12.596453 27569 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:12.650550 27731 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:12.651145 27731 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.651540 25127 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:12.652197 27755 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.596825 27467 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.576988 27638 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:20:12.633440 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 49677.8us
I20260709 12:20:12.616415 27474 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:12.628288 27746 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.692684 27746 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.694312 27714 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.694972 27714 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:12.695995 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 45213.1us
I20260709 12:20:12.696308 27752 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.696957 27624 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:12.633773 27757 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.698215 27638 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.699700 27757 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.700527 27638 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.655704 25199 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:12.697137 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:12.635169 27555 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.702894 27326 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.704558 25168 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:12.615381 27623 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:12.704873 27751 log.cc:927] Time spent T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:12.649312 25272 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:12.627408 27574 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:12.633823 25853 raft_consensus.cc:606] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:12.707386 25198 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:12.658402 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:12.660807 27754 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:12.662153 27747 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.662870 27467 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:12.664904 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:12.665019 27569 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:12.666431 27570 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:12.750826 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 86293.3us
I20260709 12:20:12.671334 27506 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.671540 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:12.678362 25092 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.508s (SENT)
I20260709 12:20:12.755271 25092 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:12.681676 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:12.683617 27735 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.697129 27714 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.704736 27555 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.643147 25090 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:12.646812 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:12.707755 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 51775us
I20260709 12:20:12.660243 27753 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:12.708202 25122 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:20:12.717005 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 50335.3us
I20260709 12:20:12.655267 27731 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:12.711712 25270 consensus_meta.cc:287] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.614s	user 0.016s	sys 0.000s
I20260709 12:20:12.652770 27755 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.669924 27393 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.751772 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:12.765614 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 122589us
I20260709 12:20:12.705933 27633 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.762719 25195 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:12.716285 25853 raft_consensus.cc:614] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:12.770885 25825 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:12.743474 27623 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:12.764595 25270 raft_consensus.cc:2410] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:20:12.742484 27754 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:12.773046 25241 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:12.776854 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 130101us
I20260709 12:20:12.768925 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:12.772970 27606 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:12.784938 27569 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.794438 25118 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 5. Ops: []
I20260709 12:20:12.794946 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:12.795912 25276 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:12.769958 27555 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:12.770483 27570 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:12.801450 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 97095.8us
I20260709 12:20:12.803897 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 528) took 1196 ms. Trace:
I20260709 12:20:12.804298 25198 rpcz_store.cc:276] 0709 12:20:11.607687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.618018 (+ 10331us) service_pool.cc:224] Handling call
0709 12:20:12.803745 (+1185727us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54002db254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:12.803842 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409280384}
I20260709 12:20:12.805295 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:12.805977 27734 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:12.807418 27747 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.807740 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:12.809087 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 130786us
I20260709 12:20:12.809341 27653 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.809919 27653 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.811069 27606 raft_consensus.cc:697] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:12.774083 27746 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:20:12.807612 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 63292.8us
I20260709 12:20:12.776469 27753 raft_consensus.cc:697] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:12.817628 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:12.813791 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:12.751533 27507 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:20:12.759930 27638 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:20:12.822321 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:12.786130 27754 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:12.763375 27442 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.787695 27591 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:12.832247 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60415.5us
I20260709 12:20:12.807610 27755 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:12.817886 27752 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:12.816222 27746 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.786056 27633 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:12.849030 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:12.852720 25272 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:12.850831 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:12.853484 25121 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:12.853523 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 91215.4us
I20260709 12:20:12.826344 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:12.831969 27747 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:20:12.855479 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 96487.3us
I20260709 12:20:12.845101 27569 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:12.854707 25023 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41770 (request call id 326) took 10200 ms. Trace:
W20260709 12:20:12.856102 25092 leader_election.cc:336] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.561s (SENT)
I20260709 12:20:12.838512 27255 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:12.862514 25276 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:12.839395 27591 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:12.864828 25023 rpcz_store.cc:276] 0709 12:20:02.625639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.625877 (+   238us) service_pool.cc:224] Handling call
0709 12:20:02.681383 (+ 55506us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b54002ef754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e78090 00007f2103f16f3a 00007f2109ccce9c 00007f2109dcb04e 00007f210828c2a4 00007f210828c232 00007f210828c161 00007f210828c0dc 00007f210828b392 00007f210224948c 00007f21022488c6
0709 12:20:12.825481 (+10144098us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317279,"reported_tablets":11,"spinlock_wait_cycles":18481024}
I20260709 12:20:12.870229 27653 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.870453 27753 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.874302 25126 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:12.875420 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:12.876056 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:12.876754 25124 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 7: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:12.877385 27747 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.878427 25119 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:20:12.850431 27746 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:12.847304 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:12.880152 25090 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:12.880014 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:12.898474 27753 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:12.944096 25122 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:12.946498 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 83472.2us
W20260709 12:20:12.916458 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 55609.1us
W20260709 12:20:12.899315 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 66113.3us
W20260709 12:20:12.941236 27769 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:20:12.946116 25124 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:12.942917 27753 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.896210 27255 raft_consensus.cc:697] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:12.945195 27747 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.899670 27752 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:12.916281 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 61048.6us
I20260709 12:20:12.950264 27570 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:12.914559 27566 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:12.966964 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:12.968842 27653 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:20:12.973935 25825 leader_election.cc:400] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3.
I20260709 12:20:12.974243 27653 consensus_queue.cc:1243] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:20:12.971210 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 91295.1us
I20260709 12:20:12.974889 27653 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:12.975081 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:12.975322 27653 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:12.975937 25168 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:12.976325 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:12.976567 27736 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:12.977221 27736 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:12.977895 27574 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:12.978314 27736 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.978613 27255 consensus_queue.cc:237] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:12.978858 27574 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:12.980332 27752 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.981871 27555 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:12.982060 27747 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:12.970566 27393 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:12.983024 27763 consensus_queue.cc:1059] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 12:20:12.986524 25272 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:12.995792 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:12.996620 25198 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:12.996765 25090 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:13.000897 25168 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:20:13.002429 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:13.002856 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.968036 27738 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:12.977913 25825 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:13.023146 25200 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:12.982589 27747 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:13.039377 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.028848 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.040367 25276 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:13.040659 25274 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 7: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:20:13.034757 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 48858.9us
I20260709 12:20:13.042340 25168 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:20:13.043555 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:13.006597 27699 consensus_meta.cc:287] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.819s	user 0.013s	sys 0.000s
I20260709 12:20:12.987128 27566 raft_consensus.cc:697] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:12.984776 27591 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:12.982659 27752 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:13.052013 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.055516 25856 raft_consensus.cc:2368] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5.
W20260709 12:20:13.055781 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 71389.6us
I20260709 12:20:13.038257 27393 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:13.035760 27569 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.068387 25269 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:13.066162 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 88322.3us
I20260709 12:20:13.074098 27326 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:13.074671 27326 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:13.075146 27326 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:13.076335 27768 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:20:13.045202 27445 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:13.037797 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:12.955401 27606 consensus_queue.cc:237] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:13.139113 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 69465.6us
I20260709 12:20:12.976334 27653 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:13.141148 25168 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:13.156754 27698 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:13.157764 27698 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:13.153465 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.158841 27698 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:20:13.151845 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 148271us
I20260709 12:20:13.155006 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:13.161108 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:13.154475 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:13.162968 25200 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:13.163190 27758 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:20:13.163955 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:13.164700 25202 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:13.165131 27738 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:13.165421 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:13.169191 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:13.173221 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:13.084443 27393 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:13.177130 25201 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:13.180765 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:13.076692 27507 consensus_queue.cc:1059] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 12:20:13.084056 27569 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:13.187732 27653 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:13.202800 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.184634 25853 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:13.207013 27393 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:13.207633 25167 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:13.208470 27445 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:13.214385 27445 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.214890 27445 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:13.215603 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:13.217492 27753 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:13.176883 27738 consensus_queue.cc:1059] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:20:13.214543 27742 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:13.236763 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:13.237332 27774 log.cc:927] Time spent T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:20:13.237564 25853 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:13.237600 25196 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:20:13.243393 27474 consensus_meta.cc:287] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 12:20:13.243826 27474 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:13.222325 25123 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:13.222319 25198 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:13.180274 27763 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:20:13.166131 27756 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:13.220082 27736 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:13.252599 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.260140 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.261089 25853 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:13.260867 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:13.263819 27777 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:13.268671 27734 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:13.269896 27633 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:13.274226 27738 consensus_queue.cc:1243] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:20:13.274801 27755 raft_consensus.cc:3055] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:13.255304 27756 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:13.275379 27755 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:13.245123 27776 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:13.277189 27776 raft_consensus.cc:697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:13.276594 27755 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:13.278163 27776 consensus_queue.cc:237] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:13.278550 27755 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:13.281416 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:13.282182 25856 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:13.246310 27467 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:13.289652 27467 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:13.218017 27747 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:13.205272 27566 consensus_queue.cc:237] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:13.291577 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.306442 27326 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:13.307050 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:13.541520 25851 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 12:20:13.663194 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.558200 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:13.356272 25025 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41756 (request call id 373) took 11044 ms. Trace:
I20260709 12:20:13.868824 25194 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:13.380452 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2197) took 1102 ms. Trace:
I20260709 12:20:13.870461 27714 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:13.654088 27569 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:13.871316 25120 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:13.871559 27714 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:13.640861 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:13.872707 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.873242 25857 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:13.368811 25856 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:13.874611 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.873875 27714 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:13.311673 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.876386 27789 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:13.877130 27789 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:13.877476 27714 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:13.877485 27758 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:13.878497 27714 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:13.879390 27789 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:13.515203 27445 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:13.879384 27758 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:13.549823 25276 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:13.881719 27714 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:13.881798 27758 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:13.882443 27445 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:13.883412 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.869227 25025 rpcz_store.cc:276] 0709 12:20:02.311883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.312284 (+   401us) service_pool.cc:224] Handling call
0709 12:20:13.356065 (+11043781us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:09.726304 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:09.727118 (+   814us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:09.727167 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:20:09.727189 (+    22us) tablet.cc:662] Decoding operations
0709 12:20:09.728094 (+   905us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:09.728182 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:09.728223 (+    41us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:20:09.728930 (+   707us) tablet.cc:701] Row locks acquired
0709 12:20:09.728944 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:20:09.729092 (+   148us) write_op.cc:270] Start()
0709 12:20:09.729190 (+    98us) write_op.cc:276] Timestamp: P: 1783599609729042 usec, L: 0
0709 12:20:09.729211 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:20:09.779197 (+ 49986us) log.cc:844] Serialized 2147 byte log entry
0709 12:20:10.929878 (+1150681us) op_driver.cc:464] REPLICATION: finished
0709 12:20:11.102421 (+172543us) write_op.cc:301] APPLY: starting
0709 12:20:11.102528 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:11.102706 (+   178us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:11.102845 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:11.104433 (+  1588us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:11.119835 (+ 15402us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:20:11.119896 (+    61us) write_op.cc:312] APPLY: finished
0709 12:20:11.120192 (+   296us) log.cc:844] Serialized 47 byte log entry
0709 12:20:11.120383 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:11.120509 (+   126us) write_op.cc:454] Released schema lock
0709 12:20:11.120553 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:11.120969 (+   416us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:11.121008 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":377758,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":172220,"apply.run_cpu_time_us":2858,"apply.run_wall_time_us":18539,"num_ops":5,"prepare.queue_time_us":269952,"prepare.run_cpu_time_us":25250,"prepare.run_wall_time_us":354220,"raft.queue_time_us":762333,"raft.run_cpu_time_us":81823,"raft.run_wall_time_us":93221,"replication_time_us":1200517,"thread_start_us":791252,"threads_started":4,"wal-append.queue_time_us":359724,"wal-append.run_cpu_time_us":123504,"wal-append.run_wall_time_us":1983912}]]}
W20260709 12:20:13.647296 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 46595.3us
I20260709 12:20:13.867694 25269 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:13.509932 25193 raft_consensus.cc:2410] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:20:13.542084 25851 pending_rounds.cc:85] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 4
I20260709 12:20:13.579769 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:13.444761 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:13.585289 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 275858us
W20260709 12:20:13.565384 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.541605 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.305840 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.550716 25274 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:13.648491 25267 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:20:13.466114 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 65975.1us
W20260709 12:20:13.898633 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 635545us
W20260709 12:20:13.894361 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.870434 25123 rpcz_store.cc:276] 0709 12:20:12.277850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.280208 (+  2358us) service_pool.cc:224] Handling call
0709 12:20:13.380226 (+1100018us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54000c49d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:13.380368 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1781442944}
I20260709 12:20:13.896867 25270 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:13.353885 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:13.887111 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:13.903177 25268 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:13.905378 25858 raft_consensus.cc:2368] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 2. Current term is 3.
I20260709 12:20:13.907259 25165 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:13.876641 25860 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
I20260709 12:20:13.474288 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.909209 25275 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
W20260709 12:20:13.394755 27754 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
W20260709 12:20:13.493705 27785 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.251s	user 0.000s	sys 0.002s
W20260709 12:20:13.360920 27778 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.195s	user 0.003s	sys 0.000s
W20260709 12:20:13.973071 25825 connection.cc:256] RPC call timeout handler was delayed by -1.9530356299999312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
I20260709 12:20:13.924971 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.928155 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.912166 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:13.894574 25851 pending_rounds.cc:107] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:20:13.356926 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.975741 25851 raft_consensus.cc:2889] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:13.976392 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.976462 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.976814 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.977358 25852 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:13.977627 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.977857 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.978102 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.978248 25275 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:13.978602 25851 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:13.394809 27255 raft_consensus.cc:3055] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:13.370397 27757 raft_consensus.cc:3055] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:13.932538 27326 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:13.309281 27756 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:13.933305 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.934239 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.934703 27754 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:13.935452 25196 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:13.982503 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.442226 27736 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:13.477156 27698 consensus_queue.cc:1059] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.461s
I20260709 12:20:13.941099 27758 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:13.941133 27714 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:13.942464 27623 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.944800 25165 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:13.947515 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.985387 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.886581 27624 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:13.950156 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2063) took 1242 ms. Trace:
I20260709 12:20:13.950320 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:13.873452 25853 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:13.988459 25276 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:13.955682 25268 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:13.957827 25241 leader_election.cc:400] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5.
I20260709 12:20:13.960047 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.874895 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.870703 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1003) took 1120 ms. Trace:
I20260709 12:20:13.309980 27474 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:13.993024 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:13.393100 27746 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:13.966709 25194 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:13.647384 27506 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.320s
I20260709 12:20:13.928965 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:13.973875 25856 raft_consensus.cc:2376] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4. Re-sending same reply.
I20260709 12:20:13.975028 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.979837 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:13.981505 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.979837 27255 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:13.936754 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:13.980369 27757 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:13.991079 25855 rpcz_store.cc:276] 0709 12:20:12.750211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.759178 (+  8967us) service_pool.cc:224] Handling call
0709 12:20:12.784179 (+ 25001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.784613 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.784669 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:12.785224 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 12:20:12.970744 (+185520us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:12.995281 (+ 24537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.010106 (+ 14825us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:13.292526 (+282420us) raft_consensus.cc:1685] finished
0709 12:20:13.292544 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.870510 (+577966us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1289,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9803,"thread_start_us":180937,"threads_started":1,"wal-append.queue_time_us":364244}
I20260709 12:20:13.999730 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.000178 27757 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.000730 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.001247 27757 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:14.001400 25855 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:14.002663 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:14.004014 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:14.005038 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.004755 27736 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.006325 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.006829 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.007587 25852 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:14.007736 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.008765 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:13.392109 27442 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:14.009687 27255 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.010733 27442 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.011024 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.011224 27442 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.011535 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:14.012190 25198 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:14.012255 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.014397 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.015151 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.985502 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:13.986588 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 57066.6us
I20260709 12:20:14.016609 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.993744 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:13.986286 27698 consensus_queue.cc:1243] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:20:13.997869 25858 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:14.020989 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:14.021543 25272 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:14.021749 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:13.989332 25241 leader_election.cc:403] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:20:14.017611 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:14.004014 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.020045 25267 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:14.023777 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:14.023777 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.009061 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.029537 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.029985 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:14.030189 25860 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:14.030757 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.031358 25851 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:14.032356 25860 raft_consensus.cc:2955] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:13.989890 27432 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:14.010949 27255 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:14.028849 25275 raft_consensus.cc:2393] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:14.034325 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:14.035118 25851 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:14.042981 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:14.042454 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 85026.2us
I20260709 12:20:14.044091 25852 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:14.047509 27789 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.047706 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:14.048377 25855 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:14.048084 27789 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.048851 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.049629 25855 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:14.052238 25267 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:14.054733 25858 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:14.057622 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:14.059059 25241 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:14.062566 25852 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:14.030803 27445 raft_consensus.cc:3055] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:13.987205 27624 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.067452 25272 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:14.068244 25241 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:14.072404 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:13.991241 27623 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:13.996730 27714 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.075742 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:14.081874 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:14.050407 27698 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:14.059352 27638 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5.
I20260709 12:20:14.087392 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:14.088507 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:14.069659 27445 raft_consensus.cc:740] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:14.072503 27784 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:14.086910 27779 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:14.088444 27789 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:13.987140 25199 rpcz_store.cc:276] 0709 12:20:12.708011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.747028 (+ 39017us) service_pool.cc:224] Handling call
0709 12:20:12.837465 (+ 90437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.899765 (+ 62300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.916110 (+ 16345us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:13.165768 (+249658us) log.cc:844] Serialized 564 byte log entry
0709 12:20:13.904226 (+738458us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:13.910714 (+  6488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.929733 (+ 19019us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:13.948391 (+ 18658us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:13.949810 (+  1419us) raft_consensus.cc:1685] finished
0709 12:20:13.949840 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.950086 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15499008,"thread_start_us":207742,"threads_started":1,"wal-append.queue_time_us":772333}
I20260709 12:20:14.111706 27746 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:14.077857 27748 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:20:14.094697 27763 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:14.104548 27795 log.cc:927] Time spent T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:20:14.105017 25858 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:14.121896 25090 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:14.105206 27714 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:14.105938 27445 consensus_queue.cc:260] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:14.093202 27784 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.108896 27474 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:14.129364 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:14.131328 25852 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:20:14.145678 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:14.146499 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.202296 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:14.121248 27442 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:14.118964 27754 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:14.126407 27784 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:14.094242 27698 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.139600 27746 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:14.135118 25857 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:20:14.241580 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 284839us
I20260709 12:20:14.200505 25025 catalog_manager.cc:5697] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 6, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 6 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:14.243016 25025 catalog_manager.cc:5697] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 4, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:14.204665 27445 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:14.256873 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:14.258996 25194 raft_consensus.cc:2393] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:14.260320 25025 catalog_manager.cc:5697] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 3 to 4, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:14.263293 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.263520 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.264312 25123 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:14.264518 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.265250 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.266137 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.266429 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.267019 25119 raft_consensus.cc:2393] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 5: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:14.266921 25124 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:14.267944 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.264057 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.269568 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.268556 25120 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
W20260709 12:20:14.264176 25092 leader_election.cc:336] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.842s (SENT)
I20260709 12:20:14.271214 25092 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:14.279050 25025 catalog_manager.cc:5697] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:14.290655 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 390978us
I20260709 12:20:14.301631 25127 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:14.287225 25025 catalog_manager.cc:5697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 6 to 7, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 7 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:20:14.314209 25025 catalog_manager.cc:5697] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 6 to 7, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 7 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.326385 25025 catalog_manager.cc:5697] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:20:14.334123 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 355578us
W20260709 12:20:14.371240 25825 connection.cc:256] RPC call timeout handler was delayed by -1.5921356300000298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2477s for a response
I20260709 12:20:14.372548 25825 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:14.334933 25165 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:14.336894 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.373960 25122 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:14.341522 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.342357 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:14.362607 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.374933 25118 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
W20260709 12:20:14.362643 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 288294us
W20260709 12:20:14.392910 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.380224 25025 catalog_manager.cc:5697] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:14.413561 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 345376us
W20260709 12:20:14.418558 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 154382us
I20260709 12:20:14.421391 27746 raft_consensus.cc:697] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:14.422542 25092 leader_election.cc:336] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.846s (SENT)
I20260709 12:20:14.370786 27624 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:14.423719 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.378473 27653 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:14.424576 25025 catalog_manager.cc:5697] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.431164 25118 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:14.417332 27789 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:20:14.416148 27439 consensus_queue.cc:1059] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:20:14.428081 25241 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:14.453624 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 120300us
W20260709 12:20:14.478068 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 68052.1us
I20260709 12:20:14.480338 27776 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:14.487449 25822 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:14.410709 27734 consensus_queue.cc:1059] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:20:14.493561 25025 catalog_manager.cc:5697] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 4, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 4 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.433238 27804 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:14.515774 25025 catalog_manager.cc:5697] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 3 to 6, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 6 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.520587 25118 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:14.520910 25025 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 5 to 7, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 7 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:14.523324 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:14.476698 27756 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:14.528419 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 111917us
I20260709 12:20:14.538424 27763 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:14.548928 25025 catalog_manager.cc:5697] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 6, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 6 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.553269 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.553998 25860 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:14.498574 27776 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:14.500873 27442 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:14.556541 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.462762 27624 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:20:14.562997 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:14.539238 27814 log.cc:927] Time spent T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:20:14.556180 25025 catalog_manager.cc:5697] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.513415 27812 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:14.531312 27623 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:14.539352 27803 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:14.588675 25092 leader_election.cc:336] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.556s (SENT)
I20260709 12:20:14.586455 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:14.592129 25195 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:20:14.592025 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:14.590883 25025 catalog_manager.cc:5697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 4, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:14.522720 27754 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:20:14.595263 25857 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:14.532271 27747 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:20:14.618718 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:14.598381 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.601876 27623 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:14.586907 27698 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:14.571061 27442 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.614532 27714 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:14.633466 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 44949.7us
I20260709 12:20:14.613857 25025 catalog_manager.cc:5697] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 3 to 5, now has a pending config: VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193), VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194), VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195), VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 5 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:14.587425 27776 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:14.639587 27802 log.cc:927] Time spent T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
W20260709 12:20:14.640084 27815 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:20:14.580600 27804 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.644181 25167 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:14.644100 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.628075 27816 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:14.643240 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:14.656994 25025 catalog_manager.cc:5697] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 4, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:14.632423 27736 raft_consensus.cc:3055] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:14.631130 27836 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:20:14.658497 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 140634us
W20260709 12:20:14.659912 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.602530 27803 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:14.669111 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 296566us
I20260709 12:20:14.640641 27623 raft_consensus.cc:697] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:14.660940 25025 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 6, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 6 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:14.664321 27807 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:20:14.682142 27805 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:20:14.614063 27746 consensus_queue.cc:237] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:14.678824 27839 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.687934 25822 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:14.689083 25195 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:14.677325 25025 catalog_manager.cc:5697] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:14.672240 27806 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:20:14.693045 25822 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:14.662418 27736 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:20:14.687177 27825 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:20:14.698622 25025 catalog_manager.cc:5697] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:14.646080 27714 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:14.699103 27811 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.186s	user 0.001s	sys 0.001s
I20260709 12:20:14.697136 27734 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:14.750147 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 57181.3us
I20260709 12:20:14.751287 25822 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:14.695253 27824 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:14.752823 25196 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:14.665588 27836 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:14.741330 27255 consensus_meta.cc:287] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.688s	user 0.012s	sys 0.000s
I20260709 12:20:14.759357 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:14.759353 25857 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:20:14.761901 27810 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:20:14.762319 27839 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:14.762781 25118 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:14.757231 27836 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:14.763778 27837 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:20:14.752506 27817 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.753163 27326 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:14.790299 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 227381us
I20260709 12:20:14.751052 27734 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:14.757227 27848 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:14.782612 27812 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:14.805929 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.809108 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:14.812103 25126 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:14.812686 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1656) took 1199 ms. Trace:
I20260709 12:20:14.796250 27734 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:14.815549 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 61140us
I20260709 12:20:14.820849 27442 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:14.809926 27824 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.830965 27804 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:14.831938 27776 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:14.815624 25271 rpcz_store.cc:276] 0709 12:20:13.613100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.613239 (+   139us) service_pool.cc:224] Handling call
0709 12:20:13.647378 (+ 34139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:13.648012 (+   634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:13.648040 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:13.919526 (+271486us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b2c0003d328. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:20:13.980524 (+ 60998us) log.cc:844] Serialized 26 byte log entry
0709 12:20:14.276012 (+295488us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:14.276074 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.276174 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.798239 (+522065us) raft_consensus.cc:1685] finished
0709 12:20:14.798270 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.812632 (+ 14362us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"spinlock_wait_cycles":58569600,"thread_start_us":261945,"threads_started":1,"wal-append.queue_time_us":419465}
I20260709 12:20:14.837545 25123 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:14.839371 27803 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:14.839715 27839 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:14.840668 25120 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:14.840502 27823 raft_consensus.cc:2955] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 4 to 6, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:20:14.842657 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.843603 25825 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:14.844332 27445 consensus_meta.cc:287] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.001s
I20260709 12:20:14.844612 27808 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:20:14.837684 27784 consensus_meta.cc:287] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.000s
I20260709 12:20:14.845168 27808 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:14.844686 27827 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 12:20:14.845607 27808 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:14.845597 27784 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.847774 27748 raft_consensus.cc:3055] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:14.848258 27784 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:14.801509 27763 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:20:14.850323 25274 raft_consensus.cc:2393] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:14.818576 27757 consensus_meta.cc:287] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.817s	user 0.010s	sys 0.006s
I20260709 12:20:14.854533 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.856922 25196 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:14.862854 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:14.852433 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:14.789688 27623 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.829428 27828 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.848219 27748 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:14.813467 27851 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.803017 27817 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.867779 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:14.901270 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.864899 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:14.866017 25273 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:14.819860 27812 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:14.905575 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 122442us
I20260709 12:20:14.794660 27736 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.861364 27804 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:14.862958 27803 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:14.909266 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 44247.2us
I20260709 12:20:14.919761 25825 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:14.901983 27839 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:14.924471 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:14.926877 25852 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:14.930878 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:14.931583 25127 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:14.863390 27824 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:14.928229 27803 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:14.949930 27748 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:14.952533 27442 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:14.921064 27804 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:14.937664 27714 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:14.906946 27828 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:14.953526 27748 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:14.910554 27851 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:14.929450 27839 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:14.971345 25126 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
W20260709 12:20:14.974337 27845 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:20:14.975157 27846 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:14.981282 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:14.987187 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.993624 27857 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:14.994227 27857 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:14.994607 27857 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:14.979390 27812 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:14.999939 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:15.000815 25269 raft_consensus.cc:2410] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:20:14.980090 27846 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:15.003043 27846 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:15.003219 27855 log.cc:927] Time spent T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:20:14.980937 27848 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.007308 27848 consensus_queue.cc:1059] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:20:15.060772 27857 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.061340 27863 raft_consensus.cc:3055] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:15.061928 27863 raft_consensus.cc:740] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:15.092373 27839 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:15.099284 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 171258us
I20260709 12:20:15.044586 27734 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.107792 27817 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:15.107856 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:15.109050 25854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:15.109613 25854 raft_consensus.cc:606] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:20:15.109972 25854 raft_consensus.cc:614] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:15.110698 27755 consensus_queue.cc:1059] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:15.111742 27755 raft_consensus.cc:3055] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:15.110917 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.112074 27755 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:15.117642 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:15.139887 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.145417 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.115100 27851 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:15.165145 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.207758 27803 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:15.098663 27863 consensus_queue.cc:260] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.163554 27824 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:15.263326 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.261335 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:15.265592 27865 log.cc:927] Time spent T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.102s	user 0.006s	sys 0.001s
I20260709 12:20:15.277971 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.267134 27863 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:15.290827 25092 leader_election.cc:336] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.970s (SENT)
I20260709 12:20:15.291302 25092 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:15.280021 27869 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.283674 27784 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.164444 27755 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.295837 25124 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:15.296371 27858 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.297147 27869 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.299556 27869 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:15.301229 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:15.301862 27393 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:20:15.304874 27836 consensus_meta.cc:287] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.001s
I20260709 12:20:15.305300 27836 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.306341 25856 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:15.307446 27836 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:15.307736 25092 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:15.308635 27393 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:15.309012 27393 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.309334 27393 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.309702 27846 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.311823 27846 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:15.313443 25856 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:15.318318 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:15.318729 27862 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:20:15.320227 27804 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:15.268272 27808 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.321228 27393 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.322219 27803 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:15.322453 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.325711 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.328847 27393 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:15.330411 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:15.322453 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:15.323783 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:15.331713 25276 raft_consensus.cc:2410] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:20:15.332163 25118 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:15.323818 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:15.333333 27393 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:15.335347 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 168252us
I20260709 12:20:15.322865 27808 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:15.277626 27857 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:15.356411 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:15.357064 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:15.358079 25267 raft_consensus.cc:2368] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6.
I20260709 12:20:15.362658 25822 leader_election.cc:400] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6.
I20260709 12:20:15.362826 25858 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:15.362993 25822 leader_election.cc:403] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:20:15.372649 25092 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:15.384538 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:15.388712 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:15.388852 25092 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:15.390977 25092 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:15.350764 27757 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.393293 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:15.398378 27848 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:15.398841 27848 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:15.399220 27848 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.399636 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:15.400806 27734 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:15.405645 27506 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.406718 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:15.406810 27840 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:15.407902 25121 raft_consensus.cc:2393] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 5: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:15.409118 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:15.409595 27506 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.409952 25124 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:15.410154 27506 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:15.412865 27506 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:15.350181 27784 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.422215 25118 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:15.422559 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:15.425323 25127 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:15.423568 25242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.344s	user 0.000s	sys 0.021s
W20260709 12:20:15.426714 25242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.000s	sys 0.021s
I20260709 12:20:15.428030 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:15.428869 25859 raft_consensus.cc:2376] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4. Re-sending same reply.
I20260709 12:20:15.394009 27857 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6.
W20260709 12:20:15.430336 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 1.37472e+06us
I20260709 12:20:15.393893 27804 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:15.432135 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:15.432901 27638 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:15.434731 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 510) took 1184 ms. Trace:
I20260709 12:20:15.435106 25242 leader_election.cc:400] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:15.435403 25242 leader_election.cc:403] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:15.435958 27638 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:15.436299 27784 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:15.437345 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.435962 25127 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:15.439297 25276 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:15.441454 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.444424 25092 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:15.422446 25857 raft_consensus.cc:2955] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:15.479172 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:15.480263 25825 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:15.480432 27857 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:15.480976 27857 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.481143 27873 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:15.481396 27857 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:15.481812 27873 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:15.490914 25825 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:15.497481 25092 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:15.435132 25119 rpcz_store.cc:276] 0709 12:20:14.250748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.371850 (+121102us) service_pool.cc:224] Handling call
0709 12:20:14.409631 (+ 37781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:14.409856 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:14.624539 (+214683us) log.cc:844] Serialized 14 byte log entry
0709 12:20:15.318303 (+693764us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b180045d8a0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae23a 00007f2103f18a2a
0709 12:20:15.420423 (+102120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:15.420480 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:15.427297 (+  6817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.427388 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:15.434653 (+  7265us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":232304,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":144,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6175,"spinlock_wait_cycles":7182080,"thread_start_us":293478,"threads_started":2}
I20260709 12:20:15.438441 27393 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:15.415373 27757 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:15.503401 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 64965.2us
I20260709 12:20:15.506174 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.491951 27804 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:15.495422 27836 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:15.516610 25092 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:15.518221 27817 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:15.520147 27506 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.521706 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.522852 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.523847 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:15.524792 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.525702 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.482873 27873 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.526682 25118 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:15.554296 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 545) took 1467 ms. Trace:
W20260709 12:20:15.554502 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 910331us
I20260709 12:20:15.554698 25201 rpcz_store.cc:276] 0709 12:20:14.086516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.087222 (+   706us) service_pool.cc:224] Handling call
0709 12:20:14.095656 (+  8434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:14.095943 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:14.427242 (+331299us) log.cc:844] Serialized 14 byte log entry
0709 12:20:15.553860 (+1126618us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b1800392b00. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287 00007f2103f29208
0709 12:20:15.553991 (+   131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:15.554053 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:15.554095 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.554160 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:15.554245 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2175,"prepare.queue_time_us":563037,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"spinlock_wait_cycles":10060032,"thread_start_us":429617,"threads_started":2,"wal-append.queue_time_us":217249}
W20260709 12:20:15.556221 27864 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.290s	user 0.002s	sys 0.000s
I20260709 12:20:15.556749 27624 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:15.557513 27789 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:15.557324 27624 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.557889 27789 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.558270 27789 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.560248 27624 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:15.560817 27624 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:15.562870 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.563966 27831 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:15.564141 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.518548 27804 raft_consensus.cc:697] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:15.564640 27831 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.565939 27804 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.567237 27755 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:15.567755 27831 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:15.546350 27784 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:20:15.530519 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.531178 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:15.531563 27757 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:15.537339 27828 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:15.574924 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1029) took 1014 ms. Trace:
W20260709 12:20:15.575943 27849 raft_consensus.cc:670] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } [suppressed 4 similar messages]
I20260709 12:20:15.575284 25860 rpcz_store.cc:276] 0709 12:20:14.560368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.562046 (+  1678us) service_pool.cc:224] Handling call
0709 12:20:14.562439 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:14.566654 (+  4215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:14.566683 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:14.580799 (+ 14116us) log.cc:844] Serialized 52 byte log entry
0709 12:20:14.668170 (+ 87371us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:14.683991 (+ 15821us) log.cc:844] Serialized 14 byte log entry
0709 12:20:14.684174 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.301690 (+617516us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4800060258. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2108e37aa1 00007f2108e2eb37 00007f2108e2e9ca 00007f2108f2626f 00007f2108f25f37 00007f2108f3a55c 00007f2108f3a508 00007f2108f3a488 00007f2108f3a443 00007f2108f396ec 00007f2107e63a96
0709 12:20:15.574635 (+272945us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b540054e7d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:15.574688 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:15.574728 (+    40us) raft_consensus.cc:1685] finished
0709 12:20:15.574741 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:15.574871 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15151,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":101279,"raft.run_cpu_time_us":4300,"raft.run_wall_time_us":635977,"spinlock_wait_cycles":44806912,"thread_start_us":49958,"threads_started":1,"wal-append.queue_time_us":86186}
W20260709 12:20:15.577201 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 498447us
W20260709 12:20:15.539005 27870 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.369s	user 0.004s	sys 0.000s
I20260709 12:20:15.510439 27803 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:15.518796 27836 raft_consensus.cc:697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:15.542533 25241 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:15.542730 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:15.550185 27874 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:15.552982 27506 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:15.622385 27874 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:15.571363 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 779743us
I20260709 12:20:15.623737 25856 raft_consensus.cc:2410] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:20:15.573616 27736 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:15.624802 27874 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:15.627120 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.628280 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.628854 25860 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:15.629688 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.574592 25090 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:15.646813 27566 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:15.646960 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 72463.9us
I20260709 12:20:15.538355 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:15.582288 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.579137 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:15.585148 25168 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:15.653076 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 68010.1us
W20260709 12:20:15.603137 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 60477.3us
I20260709 12:20:15.614455 27848 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.614687 27836 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.617014 27757 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:15.617659 25854 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
W20260709 12:20:15.618348 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 75926.9us
W20260709 12:20:15.618562 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:15.663239 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.665428 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:15.619973 27857 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.622567 27506 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:15.570055 25852 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:15.623616 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:15.667501 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:15.668011 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 44481.7us
I20260709 12:20:15.571887 27758 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:15.574468 27784 raft_consensus.cc:3055] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:15.630347 27828 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:15.631496 25856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:15.676005 25856 raft_consensus.cc:606] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:15.676477 25856 raft_consensus.cc:614] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:15.632895 27844 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:15.634835 25851 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:15.642760 27789 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:15.655021 25092 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.649s (SENT) [suppressed 31 similar messages]
I20260709 12:20:15.668073 25852 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:15.674557 25269 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:15.681106 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:15.682237 25273 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:15.704418 25857 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:15.709632 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:15.716918 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:15.718679 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 63679us
I20260709 12:20:15.721091 25092 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:15.674996 27439 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:15.766235 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:15.760568 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 46423.1us
I20260709 12:20:15.675482 27784 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:15.679886 27755 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:15.675658 25853 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:15.762362 25267 raft_consensus.cc:2955] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 4 to 6, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:15.760573 25092 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:15.780753 25194 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:15.782347 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:15.785194 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:15.785848 25276 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:15.783372 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:15.786854 25125 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:15.787559 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:15.789804 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:15.791942 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:15.792846 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:15.795580 25168 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:15.800266 25193 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:15.800155 25168 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:15.801900 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 128727us
W20260709 12:20:15.888324 25073 auto_rebalancer.cc:893] Removing replace marker failed: Replica b83c12959b9848b3b7bbc680f5ee6225 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:15.908295 27803 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:15.772848 27714 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:15.898685 27874 consensus_queue.cc:1059] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:15.679409 27606 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 12:20:15.898761 27847 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:15.912184 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 112145us
I20260709 12:20:15.899320 27834 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.899937 27822 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:15.898319 27841 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:20:15.888950 27852 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:15.900902 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:15.913949 25073 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:20:15.680154 27757 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:15.950650 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 121268us
I20260709 12:20:16.093214 25092 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:15.798072 27755 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:15.806668 27432 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.238s
I20260709 12:20:15.797924 27828 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:15.805861 27474 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:15.793468 27445 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.251s
W20260709 12:20:16.073698 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 396746us
I20260709 12:20:16.077886 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:15.914393 27748 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:20:16.086647 25242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.006s	sys 0.062s
I20260709 12:20:15.912062 25855 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 5: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:20:16.035152 27838 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 12:20:16.102730 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:16.107630 25167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.043s	sys 0.099s
W20260709 12:20:16.158089 25167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.044s	sys 0.099s
I20260709 12:20:16.014178 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:16.158418 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 601975us
W20260709 12:20:16.084311 25073 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:20:16.115234 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:16.013304 27831 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:16.035430 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:16.164641 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:16.122984 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:16.125476 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:16.125761 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:16.167546 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 210394us
W20260709 12:20:16.129736 25242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.007s	sys 0.063s
W20260709 12:20:16.172250 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 666808us
I20260709 12:20:16.129772 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:16.127573 25241 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:16.160954 25268 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:20:16.174132 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 46660.6us
I20260709 12:20:16.108273 27439 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.035616 27714 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:16.174954 25241 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:16.080205 27834 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:16.130642 27822 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:16.204401 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:16.218454 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:16.229043 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 56026.1us
W20260709 12:20:16.223374 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 100489us
I20260709 12:20:16.231995 25092 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:16.241004 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:16.178356 27873 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:16.248003 25859 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.010s	sys 0.015s
I20260709 12:20:16.121843 27852 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:16.210093 27816 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.000s	sys 0.065s
I20260709 12:20:16.113095 27784 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:16.240615 27871 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:20:16.267063 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:16.249609 27848 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:16.253551 27857 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:16.262681 27816 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.000s	sys 0.066s
W20260709 12:20:16.249881 25859 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.011s	sys 0.015s
I20260709 12:20:16.206128 27439 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:16.253006 27804 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:16.252254 27822 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:20:16.278647 27844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.018s	sys 0.025s
I20260709 12:20:16.257812 27789 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:16.273168 27623 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:16.285404 27784 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:16.301575 27844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.019s	sys 0.025s
I20260709 12:20:16.299042 27895 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:16.299063 27822 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:16.288228 27894 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:20:16.383178 25852 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.022s	sys 0.061s
W20260709 12:20:16.383689 25852 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.022s	sys 0.061s
I20260709 12:20:16.349891 25858 raft_consensus.cc:2955] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 4 to 6, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:16.413115 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:16.413993 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:16.412966 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:16.363299 27804 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:16.416844 25124 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:16.414064 25118 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:16.418895 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:16.351063 27826 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:16.351091 27844 raft_consensus.cc:697] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:16.363606 27895 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.382613 27822 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:16.437848 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:16.439492 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:16.382439 27894 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.441226 25165 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:16.351583 27623 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:16.452636 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:16.456068 27886 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:20:16.458302 27897 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:20:16.460279 27891 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:20:16.466463 27758 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:16.467252 27758 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:16.468834 25853 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 758) took 1363 ms (client timeout 1649 ms). Trace:
I20260709 12:20:16.472400 27698 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:16.350829 27885 consensus_queue.cc:1059] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:20:16.502468 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:16.514619 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.530082 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.439877 27895 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:16.443799 27755 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:16.504899 27865 log.cc:927] Time spent T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:16.444888 27894 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:16.534674 27714 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:16.513224 27834 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:16.440204 27826 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:16.564131 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 404770us
I20260709 12:20:16.537732 27848 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:16.550631 27698 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:16.556115 27852 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:16.584931 25852 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:16.589107 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:16.571555 27624 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:16.512168 25853 rpcz_store.cc:269] 0709 12:20:15.104987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.105918 (+   931us) service_pool.cc:224] Handling call
0709 12:20:16.468554 (+1362636us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54001d1fd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:16.468747 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021751552}
I20260709 12:20:16.592765 25859 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:16.594344 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.595477 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:16.596251 25851 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:16.601679 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:16.616209 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 375248us
I20260709 12:20:16.577427 27757 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:16.623592 25092 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:16.687458 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 63970.2us
I20260709 12:20:16.688282 25092 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:16.689424 25092 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:16.658157 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.693254 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 89162.4us
W20260709 12:20:16.738961 27902 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:20:16.701786 27812 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:16.575551 27848 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:16.747697 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:16.952462 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.953320 25195 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.011s	sys 0.017s
W20260709 12:20:16.953739 25195 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.011s	sys 0.017s
W20260709 12:20:16.764189 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 61851.4us
W20260709 12:20:16.753978 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 64609.2us
W20260709 12:20:16.946619 25272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.020s	sys 0.064s
W20260709 12:20:16.982285 25272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.020s	sys 0.065s
W20260709 12:20:16.956019 25860 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.012s	sys 0.064s
I20260709 12:20:16.690110 27439 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:16.920538 27816 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.009s	sys 0.023s
W20260709 12:20:16.983507 25860 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.013s	sys 0.064s
I20260709 12:20:16.703105 27804 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:16.988973 25242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.009s	sys 0.023s
W20260709 12:20:16.992406 25242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.010s	sys 0.023s
I20260709 12:20:16.576960 27844 consensus_queue.cc:237] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:16.702853 27873 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:17.002817 25267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.015s	sys 0.018s
W20260709 12:20:17.003228 25267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.015s	sys 0.019s
I20260709 12:20:17.003990 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2112) took 1338 ms. Trace:
W20260709 12:20:16.993000 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 731149us
W20260709 12:20:16.992486 25125 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.004s	sys 0.037s
W20260709 12:20:16.963228 27566 consensus_meta.cc:287] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.316s	user 0.012s	sys 0.000s
W20260709 12:20:16.996330 25241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.019s	sys 0.015s
I20260709 12:20:17.004984 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 784) took 1566 ms. Trace:
W20260709 12:20:17.015241 25125 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.004s	sys 0.037s
W20260709 12:20:17.006222 25165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.012s	sys 0.021s
W20260709 12:20:17.011973 25196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.080s	sys 0.078s
I20260709 12:20:16.753602 27907 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:20:17.015547 25241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.019s	sys 0.015s
W20260709 12:20:17.018339 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 826551us
I20260709 12:20:17.001261 27812 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:17.017072 25165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.012s	sys 0.021s
W20260709 12:20:17.023016 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 581808us
W20260709 12:20:17.017453 25196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.080s	sys 0.078s
W20260709 12:20:17.016876 25271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.012s	sys 0.011s
I20260709 12:20:17.003891 27763 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:17.036408 25168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.033s	sys 0.056s
W20260709 12:20:17.035113 25858 consensus_meta.cc:287] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
W20260709 12:20:17.035287 25271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.013s	sys 0.011s
W20260709 12:20:17.036854 25168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.033s	sys 0.056s
I20260709 12:20:17.041307 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:17.042766 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:17.043498 25275 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:17.044742 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:17.045472 25276 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:17.041595 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:17.019910 27566 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:17.047945 25825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.007s	sys 0.033s
W20260709 12:20:17.072144 25825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.007s	sys 0.034s
I20260709 12:20:17.073001 25269 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:17.073464 25269 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:17.005983 27804 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:17.001739 25090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.014s	sys 0.015s
W20260709 12:20:17.078989 25090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.014s	sys 0.015s
W20260709 12:20:17.073879 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 904324us
I20260709 12:20:17.035471 27623 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:17.024637 25853 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:20:17.079309 25242 connection.cc:256] RPC call timeout handler was delayed by -4.2972975830002724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 12:20:17.036563 27758 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:17.079319 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 984764us
I20260709 12:20:17.015107 27638 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 12:20:17.084220 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:17.017330 27836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.017s	sys 0.014s
I20260709 12:20:17.074288 25269 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:17.080068 25825 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:17.012687 27873 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:17.052402 27789 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.013s	sys 0.023s
I20260709 12:20:17.054369 27714 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.023367 27907 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:17.095711 27836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.018s	sys 0.014s
W20260709 12:20:17.112249 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 78342.4us
I20260709 12:20:17.126681 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:17.117806 25269 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:17.107596 27789 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.018s	sys 0.025s
I20260709 12:20:17.141291 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:17.141937 25856 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:17.112782 27755 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:17.112388 27852 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.118738 27623 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.150935 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:17.151743 25118 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:17.145200 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:17.046949 27763 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:17.118146 27698 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.135692 27826 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:17.167853 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:17.154439 27914 log.cc:927] Time spent T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 12:20:17.147768 27803 consensus_meta.cc:287] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.125s	user 0.010s	sys 0.005s
W20260709 12:20:17.145690 27895 consensus_meta.cc:287] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.583s	user 0.004s	sys 0.006s
W20260709 12:20:17.169131 27911 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:20:17.145098 27789 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:20:17.172056 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:17.168709 27698 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:17.206453 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:17.207345 25118 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:17.207737 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1674) took 1104 ms. Trace:
I20260709 12:20:17.208514 27439 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.154520 27852 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:17.209138 27439 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:17.210002 27889 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.975s	user 0.004s	sys 0.005s
I20260709 12:20:17.210559 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:17.211295 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 522) took 1771 ms. Trace:
I20260709 12:20:17.211866 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:17.212474 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:17.181833 25275 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:17.213210 25199 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 2.
I20260709 12:20:17.214404 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:17.215349 25201 raft_consensus.cc:2393] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:17.216722 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:17.217371 25202 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:17.218089 27506 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:17.180665 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1678) took 1058 ms. Trace:
I20260709 12:20:17.218961 25272 rpcz_store.cc:276] 0709 12:20:16.122705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.239731 (+117026us) service_pool.cc:224] Handling call
0709 12:20:16.256314 (+ 16583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.259438 (+  3124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.259470 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:16.285483 (+ 26013us) log.cc:844] Serialized 26 byte log entry
0709 12:20:16.982831 (+697348us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:16.982892 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.982993 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:17.180420 (+197427us) raft_consensus.cc:1685] finished
0709 12:20:17.180446 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.180602 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48669,"raft.queue_time_us":165154,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":19140,"thread_start_us":621057,"threads_started":1,"wal-append.queue_time_us":838933}
I20260709 12:20:17.126940 27714 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:17.208407 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:17.155272 25126 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:17.208108 25270 rpcz_store.cc:276] 0709 12:20:16.103856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.228293 (+124437us) service_pool.cc:224] Handling call
0709 12:20:16.253098 (+ 24805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.701325 (+448227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.701360 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:16.701831 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:20:17.072989 (+371158us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:17.073051 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.073150 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:17.207553 (+134403us) raft_consensus.cc:1685] finished
0709 12:20:17.207572 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.207681 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":168652,"spinlock_wait_cycles":10799488,"thread_start_us":578117,"threads_started":2,"wal-append.queue_time_us":422632}
I20260709 12:20:17.221994 27714 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:17.227849 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:17.015463 25860 rpcz_store.cc:276] 0709 12:20:15.438138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.645986 (+207848us) service_pool.cc:224] Handling call
0709 12:20:15.654298 (+  8312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:15.689958 (+ 35660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:15.690007 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:15.690650 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:20:16.220192 (+529542us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:16.991635 (+771443us) log.cc:844] Serialized 14 byte log entry
0709 12:20:17.004674 (+ 13039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.004758 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:17.004796 (+    38us) raft_consensus.cc:1685] finished
0709 12:20:17.004808 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.004931 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47865,"prepare.queue_time_us":269525,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":60521,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":27446,"thread_start_us":1191847,"threads_started":2,"wal-append.queue_time_us":670134}
I20260709 12:20:17.229404 25197 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:17.229995 25269 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:20:17.226048 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:17.231067 25202 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:17.231245 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 554) took 1464 ms. Trace:
I20260709 12:20:17.232566 27873 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:17.231629 25195 rpcz_store.cc:276] 0709 12:20:15.766403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.766528 (+   125us) service_pool.cc:224] Handling call
0709 12:20:15.766799 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:16.135407 (+368608us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:16.954152 (+818745us) log.cc:844] Serialized 14 byte log entry
0709 12:20:17.116707 (+162555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:17.116778 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:17.116849 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.231036 (+114187us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b5400361354. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:17.231080 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.231188 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4617,"prepare.queue_time_us":212605,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":18239,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":847153536,"thread_start_us":912366,"threads_started":2,"wal-append.queue_time_us":216326}
I20260709 12:20:17.225209 25194 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:17.233856 27830 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:17.234313 27830 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:17.226513 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:17.212489 25198 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:17.223380 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:17.237151 25126 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:17.223694 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:17.203126 27894 consensus_meta.cc:287] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.000s
I20260709 12:20:17.241125 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:17.226954 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:17.211663 25127 rpcz_store.cc:276] 0709 12:20:15.439487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.439621 (+   134us) service_pool.cc:224] Handling call
0709 12:20:15.493465 (+ 53844us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:15.493917 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:15.493959 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:15.494618 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 12:20:15.761495 (+266877us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:15.761539 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.761603 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:17.209434 (+1447831us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:17.211029 (+  1595us) raft_consensus.cc:1685] finished
0709 12:20:17.211049 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.211246 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5915,"raft.queue_time_us":4458,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":7656320,"thread_start_us":265774,"threads_started":1,"wal-append.queue_time_us":602207}
I20260709 12:20:17.166833 27909 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:17.157372 27623 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:17.279786 25123 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.032s	sys 0.043s
W20260709 12:20:17.297991 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:17.316004 25123 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.034s	sys 0.053s
I20260709 12:20:17.182473 27848 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:17.181246 27910 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:17.317030 27910 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:17.184887 27803 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:17.276352 25200 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:17.235709 27804 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:17.270454 27905 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
W20260709 12:20:17.323567 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 231960us
I20260709 12:20:17.235260 27830 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:17.356878 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 257101us
W20260709 12:20:17.367714 27923 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 12:20:17.368805 27915 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 12:20:17.161489 27925 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 12:20:17.359885 25193 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:17.275166 27912 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:20:17.379498 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 298427us
I20260709 12:20:17.306160 27846 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:17.238777 27895 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:17.358230 25090 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:17.483476 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 125300us
I20260709 12:20:17.484465 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:17.439888 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1688) took 1064 ms. Trace:
I20260709 12:20:17.273936 27894 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:17.327572 27909 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:17.506175 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:17.626654 25092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.027s	sys 0.015s
W20260709 12:20:17.990245 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:17.987941 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 846652us
W20260709 12:20:17.992254 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 624216us
W20260709 12:20:17.606868 25122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.012s	sys 0.028s
I20260709 12:20:18.032452 27907 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:18.032441 25122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.027s	sys 0.046s
W20260709 12:20:17.515265 27748 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.317s	user 0.005s	sys 0.037s
W20260709 12:20:18.034251 27748 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.856s	user 0.024s	sys 0.049s
W20260709 12:20:17.940634 27784 consensus_meta.cc:287] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.589s	user 0.008s	sys 0.006s
I20260709 12:20:18.034334 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.034584 27748 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:18.035189 25198 raft_consensus.cc:2410] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:18.035265 27698 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:18.035454 27748 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.036017 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:18.000826 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.001003 25092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.027s	sys 0.034s
W20260709 12:20:18.037708 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.590240 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1694) took 1196 ms. Trace:
I20260709 12:20:18.038219 25123 rpcz_store.cc:276] 0709 12:20:16.393949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.399699 (+  5750us) service_pool.cc:224] Handling call
0709 12:20:16.424958 (+ 25259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:16.425196 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:17.316453 (+891257us) log.cc:844] Serialized 14 byte log entry
0709 12:20:17.589750 (+273297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:17.589817 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:17.589870 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.589959 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.590156 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14066,"prepare.queue_time_us":717860,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":2785,"raft.queue_time_us":82902,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"thread_start_us":1093996,"threads_started":2}
I20260709 12:20:17.638846 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 785) took 2200 ms. Trace:
I20260709 12:20:18.005409 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.041085 25269 raft_consensus.cc:2410] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:20:18.039667 25858 rpcz_store.cc:276] 0709 12:20:15.438395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.651505 (+213110us) service_pool.cc:224] Handling call
0709 12:20:15.652007 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:15.652363 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:15.652391 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:15.683692 (+ 31301us) log.cc:844] Serialized 564 byte log entry
0709 12:20:16.349753 (+666061us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:17.037334 (+687581us) log.cc:844] Serialized 14 byte log entry
0709 12:20:17.039655 (+  2321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.039747 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:17.638562 (+598815us) raft_consensus.cc:1685] finished
0709 12:20:17.638591 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.638766 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3155,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":4152,"thread_start_us":437055,"threads_started":1,"wal-append.queue_time_us":824798}
I20260709 12:20:18.006708 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.011515 25855 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:18.011433 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:17.670425 27928 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:20:18.005281 27897 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:18.005402 27896 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:20:17.667488 27926 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.361s	user 0.000s	sys 0.000s
I20260709 12:20:18.014741 27909 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:17.940037 27822 consensus_meta.cc:287] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.436s	user 0.003s	sys 0.012s
I20260709 12:20:17.535656 27804 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:18.090340 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.090535 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 560) took 2305 ms. Trace:
I20260709 12:20:18.015400 27883 raft_consensus.cc:3055] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:17.552763 27910 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:18.096994 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.091054 25196 rpcz_store.cc:276] 0709 12:20:15.777890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.778097 (+   207us) service_pool.cc:224] Handling call
0709 12:20:15.778361 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:15.909275 (+130914us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:16.367005 (+457730us) log.cc:844] Serialized 14 byte log entry
0709 12:20:17.034642 (+667637us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:17.034701 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:17.034750 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.082417 (+1047667us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54004132d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:18.082475 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.082670 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91751,"prepare.queue_time_us":429110,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":8506,"raft.queue_time_us":11883,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":9315,"spinlock_wait_cycles":284410112,"thread_start_us":984816,"threads_started":2,"wal-append.queue_time_us":767358}
I20260709 12:20:18.018494 27894 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.114274 27939 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:18.114899 27939 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.117671 27939 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.122828 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.124303 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:17.729962 27869 raft_consensus.cc:3055] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:18.021661 25242 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:18.021872 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:17.493288 25822 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:17.549839 27803 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:20:18.029716 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.030123 27887 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:17.516785 25199 raft_consensus.cc:2410] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:20:17.671730 27930 log.cc:927] Time spent T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:20:18.030496 25272 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:17.516057 27846 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.027815 27921 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.031006 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:17.576118 27912 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:17.949857 27506 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:18.031710 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.149631 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1041) took 1551 ms. Trace:
I20260709 12:20:18.126402 27869 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:18.043936 25271 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:18.153244 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.050570 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.154836 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.156220 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:17.591509 27828 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:17.993096 27763 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.017866 27624 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:17.485277 25125 rpcz_store.cc:276] 0709 12:20:16.375476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.375639 (+   163us) service_pool.cc:224] Handling call
0709 12:20:16.419809 (+ 44170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:16.420069 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:20:17.020218 (+600149us) log.cc:844] Serialized 14 byte log entry
0709 12:20:17.439405 (+419187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:17.439485 (+    80us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:17.439560 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.439660 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.439805 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":675674,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":720,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":28854,"thread_start_us":995436,"threads_started":2}
I20260709 12:20:17.996150 27830 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:17.721065 27852 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:17.987162 27623 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:18.081938 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.167428 25275 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:18.083786 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 711) took 1893 ms. Trace:
I20260709 12:20:18.083906 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.169879 25194 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:18.086696 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.170951 25127 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:18.087320 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.093339 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.016834 25193 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:18.036705 27885 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.030541 27895 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:18.071074 27812 consensus_meta.cc:287] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.042s	user 0.009s	sys 0.002s
I20260709 12:20:18.187345 27812 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:18.098551 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.188794 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.189631 25196 raft_consensus.cc:2410] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:18.190361 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.191303 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.191965 25196 raft_consensus.cc:2410] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:20:18.192619 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.091076 25123 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:18.089757 27896 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.195281 27896 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.105749 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.196061 25201 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:18.196959 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.096848 27883 raft_consensus.cc:740] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:17.004386 25267 rpcz_store.cc:276] 0709 12:20:15.665222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.675151 (+  9929us) service_pool.cc:224] Handling call
0709 12:20:15.761984 (+ 86833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:15.762241 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:16.238155 (+475914us) log.cc:844] Serialized 14 byte log entry
0709 12:20:17.003616 (+765461us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:17.003670 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:17.003721 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.003800 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.003921 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":7541,"thread_start_us":764630,"threads_started":1}
I20260709 12:20:18.199301 25267 raft_consensus.cc:3055] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:18.199723 25267 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:18.200601 25267 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:18.200716 25196 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:18.201740 25267 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:18.047983 27925 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:18.110330 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:18.126931 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 633673us
I20260709 12:20:18.204607 25822 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:18.204787 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:18.206135 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:18.127133 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 105347us
I20260709 12:20:18.206744 25851 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:18.207301 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:18.208307 25198 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:18.208972 27938 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:18.209983 27848 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:18.209560 27912 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:18.212039 27848 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:18.130714 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:18.132136 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.137430 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:18.147891 25167 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:18.131035 27803 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:18.150251 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 128701us
W20260709 12:20:17.659444 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 219415us
I20260709 12:20:18.150913 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.150048 25852 rpcz_store.cc:276] 0709 12:20:16.598638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.602194 (+  3556us) service_pool.cc:224] Handling call
0709 12:20:16.602796 (+   602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.603251 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.603285 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:16.604408 (+  1123us) log.cc:844] Serialized 501 byte log entry
0709 12:20:17.097580 (+493172us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:17.097642 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.097734 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.149401 (+1051667us) raft_consensus.cc:1685] finished
0709 12:20:18.149432 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.149565 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":492260,"threads_started":1,"wal-append.queue_time_us":755730}
I20260709 12:20:18.131064 27804 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:18.133802 27909 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:18.156944 25269 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:18.135951 27736 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:18.138088 27758 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:18.098783 27822 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.164769 25271 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:18.155560 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:18.255627 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 100145us
I20260709 12:20:18.094116 27897 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.166555 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.176699 25273 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:18.172079 25120 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:18.168870 25856 rpcz_store.cc:276] 0709 12:20:16.190017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.192064 (+  2047us) service_pool.cc:224] Handling call
0709 12:20:16.192408 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.142437 (+950029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.080846 (+938409us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54002b57d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:18.083733 (+  2887us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2168284544}
I20260709 12:20:18.165423 27944 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:18.150130 27921 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:18.346630 25272 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:18.347922 27921 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:18.348881 27623 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:18.349332 27623 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:18.349762 27943 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.350373 27943 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.179279 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.181406 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.182416 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:18.354736 25193 raft_consensus.cc:2376] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6. Re-sending same reply.
I20260709 12:20:18.182132 27869 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.139720 27887 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.159205 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:18.186312 27885 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.037009 27755 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 12:20:18.366758 27844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.035s	sys 0.091s
I20260709 12:20:18.381307 25193 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:20:18.202555 25196 raft_consensus.cc:2955] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 4 to 6, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:20:18.215735 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 67932.5us
I20260709 12:20:18.384536 25167 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:18.206544 25822 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:18.385531 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 179036us
I20260709 12:20:18.217795 25242 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:18.386726 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 169030us
I20260709 12:20:18.388157 25242 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:18.389504 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:18.394447 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.257601 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:18.151860 27698 consensus_queue.cc:1059] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:20:18.322932 25856 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:18.324589 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 63878.8us
I20260709 12:20:18.258455 25270 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:18.345148 25267 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:20:18.436923 25267 pending_rounds.cc:85] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 2
I20260709 12:20:18.437206 25267 pending_rounds.cc:107] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:20:18.437433 25267 raft_consensus.cc:2889] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:18.438764 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 181236us
I20260709 12:20:18.349669 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.440546 25127 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:18.345890 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.356452 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:18.180842 27846 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:18.158059 27506 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.217402 27852 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:18.224313 27803 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:18.377295 25118 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 4. Current term is 5. Ops: []
W20260709 12:20:18.378002 25093 leader_election.cc:336] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.546s (SENT)
I20260709 12:20:18.450700 25093 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:18.203022 27925 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.227095 27736 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:18.349694 27623 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:18.168637 27624 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.456328 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.352742 27943 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.444984 27848 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.375138 25199 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:18.446446 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.223254 27942 consensus_queue.cc:1059] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.275s
W20260709 12:20:18.449379 27882 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 2.272s	user 0.029s	sys 0.086s
W20260709 12:20:18.381330 27844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.035s	sys 0.091s
I20260709 12:20:18.455430 27944 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:18.458983 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.373860 27939 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:18.378928 25853 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:18.381336 27869 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:18.465341 25125 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 5: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:20:18.447104 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 62654.3us
I20260709 12:20:18.323396 27804 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.453253 27907 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:20:18.322377 27758 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.446182 27896 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:18.450050 27921 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:18.451308 27833 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:18.471442 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.500236 25267 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:18.470434 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:18.452795 27846 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.453047 27653 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:18.456027 27736 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:18.470853 27882 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 2.306s	user 0.029s	sys 0.086s
W20260709 12:20:18.466436 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 77020.8us
I20260709 12:20:18.467952 27943 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:18.486568 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:18.495690 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.456367 27852 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:18.498869 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.469132 27848 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.497710 25167 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:18.531411 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.536242 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.533354 25125 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:18.501431 25120 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:18.540957 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.487783 27896 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:18.497057 27393 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:20:18.547111 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 49527.7us
W20260709 12:20:18.548175 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.538722 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:18.495934 27921 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:18.553916 25242 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:18.499682 27833 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:18.482501 27939 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.600790 25851 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:18.608697 25127 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:18.611559 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.617108 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.559563 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:18.618098 25127 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
W20260709 12:20:18.618542 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 59081.1us
I20260709 12:20:18.619525 25242 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:18.620597 27255 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:18.555841 27896 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.523126 27831 consensus_queue.cc:1059] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:20:18.562115 27921 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:18.556418 27784 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:18.568104 27895 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:18.568104 27833 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:18.624423 27817 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:18.633252 25092 leader_election.cc:336] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.649s (SENT)
I20260709 12:20:18.659696 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:18.524931 27846 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.636778 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:18.664988 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 481923us
I20260709 12:20:18.534551 27844 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:20:18.547457 27942 consensus_queue.cc:1059] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:20:18.639413 25242 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:18.534852 27943 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:18.658697 25126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.011s	sys 0.030s
I20260709 12:20:18.630697 25199 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:20:18.678253 25119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.012s	sys 0.006s
W20260709 12:20:18.675125 25126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.012s	sys 0.031s
W20260709 12:20:18.678757 25119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.012s	sys 0.006s
W20260709 12:20:18.633631 25200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.013s	sys 0.017s
W20260709 12:20:18.705722 25200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.013s	sys 0.017s
I20260709 12:20:18.622268 27945 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 12:20:18.701097 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 323109us
I20260709 12:20:18.664954 27817 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:18.713052 25197 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.037s
I20260709 12:20:18.646684 27822 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.661101 27895 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:18.668236 27904 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:20:18.709810 25825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.012s	sys 0.038s
W20260709 12:20:18.715106 25197 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.009s	sys 0.037s
I20260709 12:20:18.718222 25090 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:18.717065 25825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.012s	sys 0.038s
W20260709 12:20:18.722499 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 515230us
I20260709 12:20:18.724247 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:18.725176 25275 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.007s	sys 0.017s
I20260709 12:20:18.726486 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.728731 25121 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
W20260709 12:20:18.726495 25275 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.007s	sys 0.017s
I20260709 12:20:18.738729 25127 raft_consensus.cc:2410] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:20:18.740549 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:18.741575 27874 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:18.699015 27784 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:18.751128 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 51171.2us
I20260709 12:20:18.751940 27255 consensus_queue.cc:1059] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:18.725119 27748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.013s	sys 0.013s
I20260709 12:20:18.718339 27817 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:18.721307 27895 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:18.723420 27506 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.727351 27653 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:18.775972 27393 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:18.722784 27887 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.707126 27937 consensus_queue.cc:1059] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:20:18.756775 27904 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:18.753417 27925 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:18.767964 27748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.013s	sys 0.013s
I20260709 12:20:18.804448 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:18.806659 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.807474 25194 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
W20260709 12:20:18.784621 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 233489us
I20260709 12:20:18.766919 27698 raft_consensus.cc:3055] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:20:18.797214 25825 connection.cc:256] RPC call timeout handler was delayed by -1.1116660249999768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 12:20:18.826834 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:18.826543 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.828233 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:18.827474 25856 raft_consensus.cc:2376] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5. Re-sending same reply.
I20260709 12:20:18.829835 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:18.789655 27938 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.023s	sys 0.041s
I20260709 12:20:18.774725 27894 consensus_queue.cc:1059] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:20:18.784711 27393 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:18.784097 27757 raft_consensus.cc:3055] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:18.797796 27874 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:18.781230 27831 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:18.783763 27624 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.787714 27755 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:18.840781 27938 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.023s	sys 0.042s
I20260709 12:20:18.801041 27937 consensus_queue.cc:1243] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:20:18.827312 27912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.000s	sys 0.009s
I20260709 12:20:18.835414 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.850833 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.871897 25126 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:18.851357 27757 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:18.852144 27393 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:18.888584 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:18.855027 27848 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:18.802601 27776 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:18.841805 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:18.809011 27784 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.808672 27756 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:18.863250 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 145022us
I20260709 12:20:18.913669 25090 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:18.840222 25202 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:18.825608 27698 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:18.826519 27804 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.866787 27939 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.853156 27943 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.834386 27897 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:18.797842 27904 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.865490 27852 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:18.871529 27912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.000s	sys 0.009s
I20260709 12:20:18.919996 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:18.923518 27949 log.cc:927] Time spent T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:20:18.867098 27938 raft_consensus.cc:697] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:18.871220 27830 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:18.924822 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 83086.8us
W20260709 12:20:18.894459 27950 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
W20260709 12:20:18.943754 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.969079 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.989580 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.879364 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.865115 27874 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.920681 27763 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:18.924044 27784 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.867553 27831 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.868548 27755 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:19.071069 25120 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.002s
I20260709 12:20:19.102630 25120 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:19.104063 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:18.996559 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.095947 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.112754 25126 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:19.113967 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:19.123262 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.143594 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 717) took 1054 ms. Trace:
W20260709 12:20:19.146822 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.923882 27937 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.152122 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:19.162036 25120 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:19.144217 25860 rpcz_store.cc:276] 0709 12:20:18.088842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.088973 (+   131us) service_pool.cc:224] Handling call
0709 12:20:18.089235 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.089456 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:18.539301 (+449845us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.143122 (+603821us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:19.143199 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:19.143266 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.143355 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.143518 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17456,"prepare.queue_time_us":628017,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":153246,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":41090,"thread_start_us":1040491,"threads_started":3,"wal-append.queue_time_us":409877}
W20260709 12:20:19.080296 27951 log.cc:927] Time spent T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260709 12:20:19.079692 27962 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 12:20:19.156029 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:18.927932 27756 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:18.987718 25199 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:18.991189 27804 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:19.169060 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:19.285385 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 473573us
I20260709 12:20:19.294539 25126 raft_consensus.cc:2393] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:20:19.295151 27954 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.400s	user 0.000s	sys 0.000s
I20260709 12:20:19.295856 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.296720 25126 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:19.227438 25851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:18.989727 27967 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:18.923717 27474 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.225s
I20260709 12:20:19.090233 27848 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:19.237315 25092 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:19.323939 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 86746.7us
I20260709 12:20:19.324817 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:19.326321 27976 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:20:19.151298 27955 log.cc:927] Time spent T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
W20260709 12:20:19.246009 25853 consensus_meta.cc:287] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.758s	user 0.006s	sys 0.005s
I20260709 12:20:19.246234 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:20:19.331871 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 85724.1us
I20260709 12:20:19.150241 27846 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:19.079142 27964 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:19.338177 27964 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:19.338644 27964 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:19.340094 27784 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:19.340432 27736 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.000s
I20260709 12:20:19.340891 27736 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.334630 27968 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:19.342181 27977 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:20:19.343472 27874 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:19.036623 27757 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:19.271004 25120 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:19.262868 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2126) took 1145 ms. Trace:
I20260709 12:20:18.996162 27776 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.288993 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.299197 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.351279 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.231227 27937 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.312551 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:19.314735 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:19.350684 25268 rpcz_store.cc:276] 0709 12:20:18.117710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.213482 (+ 95772us) service_pool.cc:224] Handling call
0709 12:20:18.213836 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.377172 (+163336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:18.377206 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:18.377253 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:18.377282 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.262537 (+885255us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54002be3d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:19.262613 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.262793 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375141632}
I20260709 12:20:19.316103 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1690) took 1278 ms. Trace:
W20260709 12:20:19.319012 27623 consensus_meta.cc:287] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.000s
I20260709 12:20:19.312670 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:19.325570 27848 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:19.326946 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 398331us
I20260709 12:20:19.148083 27763 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.231696 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.324065 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1698) took 2198 ms. Trace:
I20260709 12:20:19.082391 27698 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:19.299484 27921 consensus_meta.cc:287] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.637s	user 0.004s	sys 0.008s
W20260709 12:20:19.061865 27952 log.cc:927] Time spent T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:20:19.353457 25856 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:19.377262 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:19.377482 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.357705 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.378371 25126 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:19.303411 27967 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.354408 25276 rpcz_store.cc:276] 0709 12:20:18.037451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.037567 (+   116us) service_pool.cc:224] Handling call
0709 12:20:18.038018 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:18.038401 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:18.038426 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:18.082440 (+ 44014us) log.cc:844] Serialized 501 byte log entry
0709 12:20:18.540213 (+457773us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:18.540263 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.540349 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:19.315886 (+775537us) raft_consensus.cc:1685] finished
0709 12:20:19.315910 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.316043 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":428846,"threads_started":1,"wal-append.queue_time_us":617305}
I20260709 12:20:19.368703 25119 rpcz_store.cc:276] 0709 12:20:17.100343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.107940 (+  7597us) service_pool.cc:224] Handling call
0709 12:20:17.127126 (+ 19186us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:17.428973 (+301847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.429017 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:17.559969 (+130952us) log.cc:844] Serialized 52 byte log entry
0709 12:20:18.679229 (+1119260us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:18.834846 (+155617us) log.cc:844] Serialized 14 byte log entry
0709 12:20:18.837551 (+  2705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.837638 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:19.298188 (+460550us) raft_consensus.cc:1685] finished
0709 12:20:19.298208 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.298329 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2338,"prepare.queue_time_us":631523,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":90043,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":15642,"thread_start_us":1082191,"threads_started":3,"wal-append.queue_time_us":787048}
I20260709 12:20:19.382583 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.377895 25120 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.379441 25856 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:19.380007 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:19.334633 25853 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:19.388484 25126 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:19.348999 27979 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:19.390728 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2215) took 1294 ms. Trace:
I20260709 12:20:19.391896 25126 rpcz_store.cc:276] 0709 12:20:18.096048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.388061 (+1292013us) service_pool.cc:224] Handling call
0709 12:20:19.388333 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.390508 (+  2175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.390675 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:19.305200 27804 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.370841 27623 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:19.387638 27967 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:19.395538 27896 consensus_meta.cc:287] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.735s	user 0.008s	sys 0.002s
W20260709 12:20:19.395846 27983 log.cc:927] Time spent T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:20:19.396006 27896 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.397897 25200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2085) took 2168 ms. Trace:
I20260709 12:20:19.399411 25854 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:19.398368 25200 rpcz_store.cc:276] 0709 12:20:17.229319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.321523 (+ 92204us) service_pool.cc:224] Handling call
0709 12:20:17.322212 (+   689us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:17.994281 (+672069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.994310 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:17.994869 (+   559us) log.cc:844] Serialized 52 byte log entry
0709 12:20:18.706564 (+711695us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:19.108871 (+402307us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.162316 (+ 53445us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.243470 (+ 81154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.243573 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:19.397693 (+154120us) raft_consensus.cc:1685] finished
0709 12:20:19.397716 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.397841 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123795,"prepare.queue_time_us":145215,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":885001,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":67426,"thread_start_us":854589,"threads_started":2,"wal-append.queue_time_us":758163}
I20260709 12:20:19.400525 27977 raft_consensus.cc:3055] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:19.400887 27977 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:19.401938 27895 consensus_meta.cc:287] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.001s
W20260709 12:20:19.389835 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 95723.2us
I20260709 12:20:19.402472 27895 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.376982 27921 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.404306 25270 raft_consensus.cc:1240] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:19.392379 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 721) took 1256 ms. Trace:
I20260709 12:20:19.405037 27852 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:19.405467 27852 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.382189 27847 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:19.405819 27852 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.408643 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.344918 27938 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.415936 27755 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:19.417873 27921 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.418263 25196 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:19.268601 27624 raft_consensus.cc:2955] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:19.421566 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2218) took 1302 ms. Trace:
I20260709 12:20:19.421939 25123 rpcz_store.cc:276] 0709 12:20:18.118925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.420780 (+1301855us) service_pool.cc:224] Handling call
0709 12:20:19.421091 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.421269 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:19.421293 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:19.421333 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:19.421368 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.421415 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.421511 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:19.423406 25123 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:20:19.423967 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2219) took 1304 ms. Trace:
I20260709 12:20:19.424268 25123 rpcz_store.cc:276] 0709 12:20:18.119167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.422853 (+1303686us) service_pool.cc:224] Handling call
0709 12:20:19.423180 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:19.423732 (+   552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.423910 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:19.429411 27817 consensus_meta.cc:287] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.648s	user 0.006s	sys 0.000s
I20260709 12:20:19.429855 25126 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:20:19.429849 27817 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:19.431453 25127 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:19.432056 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2221) took 1312 ms. Trace:
I20260709 12:20:19.432337 25127 rpcz_store.cc:276] 0709 12:20:18.119634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.430882 (+1311248us) service_pool.cc:224] Handling call
0709 12:20:19.431169 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.431840 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.432007 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:19.433010 27817 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:19.433434 25127 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:19.438522 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.441308 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2223) took 1313 ms. Trace:
I20260709 12:20:19.418785 27804 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.442536 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2217) took 1323 ms. Trace:
I20260709 12:20:19.409391 25202 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:19.450119 27925 raft_consensus.cc:3055] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:19.450605 27925 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:19.450515 27967 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.451754 25119 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 6. Ops: []
I20260709 12:20:19.451648 27925 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.452853 27925 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:19.454344 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1699) took 2353 ms. Trace:
I20260709 12:20:19.454887 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2078) took 1438 ms. Trace:
I20260709 12:20:19.455107 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2083) took 2226 ms. Trace:
I20260709 12:20:19.456593 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2216) took 1338 ms. Trace:
I20260709 12:20:19.457134 27904 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.456950 25119 rpcz_store.cc:276] 0709 12:20:18.118378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.389094 (+1270716us) service_pool.cc:224] Handling call
0709 12:20:19.444288 (+ 55194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.452190 (+  7902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.456377 (+  4187us) spinlock_profiling.cc:243] Waited 7.29 ms on lock 0x7b5400454054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:19.456526 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16777984}
I20260709 12:20:19.458315 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.455299 25201 rpcz_store.cc:276] 0709 12:20:18.016667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.200060 (+183393us) service_pool.cc:224] Handling call
0709 12:20:18.200320 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.474252 (+273932us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:18.753678 (+279426us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.246885 (+493207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:19.246934 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:19.246983 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.454670 (+207687us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54002da854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:19.454712 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.454831 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78127,"prepare.queue_time_us":357535,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":78603,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"spinlock_wait_cycles":629382400,"thread_start_us":685867,"threads_started":2,"wal-append.queue_time_us":664938}
I20260709 12:20:19.460557 25119 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:19.445210 25126 rpcz_store.cc:276] 0709 12:20:18.118670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.392681 (+1274011us) service_pool.cc:224] Handling call
0709 12:20:19.429443 (+ 36762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:19.431247 (+  1804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.442477 (+ 11230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:19.444598 25123 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:19.441756 25127 rpcz_store.cc:276] 0709 12:20:18.120137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.433009 (+1312872us) service_pool.cc:224] Handling call
0709 12:20:19.433280 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.433828 (+   548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.433991 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:19.463482 25241 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:19.470472 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:19.472663 25126 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:19.474285 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2224) took 1353 ms. Trace:
I20260709 12:20:19.474617 25126 rpcz_store.cc:276] 0709 12:20:18.120373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.461554 (+1341181us) service_pool.cc:224] Handling call
0709 12:20:19.461818 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.473054 (+ 11236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.474229 (+  1175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:19.475546 25167 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:19.469839 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:19.401680 27977 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.433769 27964 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.455533 25197 rpcz_store.cc:276] 0709 12:20:17.228630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.309819 (+ 81189us) service_pool.cc:224] Handling call
0709 12:20:17.310313 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:17.310626 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.310664 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:17.331827 (+ 21163us) log.cc:844] Serialized 26 byte log entry
0709 12:20:18.205280 (+873453us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:18.725272 (+519992us) log.cc:844] Serialized 14 byte log entry
0709 12:20:18.725450 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.725519 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:19.454899 (+729380us) raft_consensus.cc:1685] finished
0709 12:20:19.454921 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.455040 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20116,"prepare.queue_time_us":572229,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":141861,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8264,"thread_start_us":701468,"threads_started":2,"wal-append.queue_time_us":1158841}
I20260709 12:20:19.503976 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1048) took 1382 ms. Trace:
I20260709 12:20:19.559803 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:19.517942 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1712) took 1199 ms. Trace:
I20260709 12:20:19.560407 25120 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:19.505486 25268 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:19.454707 25122 rpcz_store.cc:276] 0709 12:20:17.100671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.101040 (+   369us) service_pool.cc:224] Handling call
0709 12:20:17.101465 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:18.033333 (+931868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:18.033475 (+   142us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:18.033913 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:20:18.534293 (+500380us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:18.565704 (+ 31411us) log.cc:844] Serialized 14 byte log entry
0709 12:20:18.619249 (+ 53545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.619346 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:19.454112 (+834766us) raft_consensus.cc:1685] finished
0709 12:20:19.454134 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.454285 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34034,"prepare.run_wall_time_us":7650,"raft.queue_time_us":167641,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":9782,"spinlock_wait_cycles":7102848,"thread_start_us":1431369,"threads_started":2,"wal-append.queue_time_us":667143}
I20260709 12:20:19.559036 25273 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:19.560994 25127 rpcz_store.cc:276] 0709 12:20:18.318804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.489478 (+1170674us) service_pool.cc:224] Handling call
0709 12:20:19.517471 (+ 27993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.517655 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:19.517678 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:19.517717 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:19.517746 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.517797 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.517889 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:19.560958 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.503832 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:19.497220 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.503990 25851 raft_consensus.cc:606] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:19.565412 25851 raft_consensus.cc:614] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:19.528604 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.558848 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 83385.4us
I20260709 12:20:19.567763 25167 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:19.568728 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.504910 27842 raft_consensus.cc:3055] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:20:19.459903 27869 consensus_meta.cc:287] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.977s	user 0.008s	sys 0.003s
W20260709 12:20:19.453930 27833 consensus_meta.cc:287] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.778s	user 0.005s	sys 0.001s
I20260709 12:20:19.569527 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.571262 25856 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
W20260709 12:20:19.528182 27393 consensus_meta.cc:287] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.001s
I20260709 12:20:19.622306 25859 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:20:19.623155 25859 pending_rounds.cc:85] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 4
I20260709 12:20:19.623430 25859 pending_rounds.cc:107] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:20:19.623643 25859 raft_consensus.cc:2889] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:19.623921 25859 pending_rounds.cc:107] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:20:19.624147 25859 raft_consensus.cc:2889] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:19.624826 25860 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:19.528198 27714 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:19.606285 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.459694 27623 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:19.444491 27756 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:19.559981 25858 rpcz_store.cc:276] 0709 12:20:18.121547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.124724 (+  3177us) service_pool.cc:224] Handling call
0709 12:20:18.138760 (+ 14036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.138972 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:18.560810 (+421838us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.456852 (+896042us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b180025fe40. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2103ab64bc 00007f2100e0448b 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae23a
0709 12:20:19.503640 (+ 46788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:19.503689 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:19.503734 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.503808 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.503922 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72272,"prepare.queue_time_us":628575,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":47191,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":55523328,"thread_start_us":632119,"threads_started":2,"wal-append.queue_time_us":426915}
I20260709 12:20:19.605712 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.644743 25197 raft_consensus.cc:2410] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:19.570385 27842 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:19.466121 27776 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.488777 27921 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:19.645666 25119 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
W20260709 12:20:19.645990 25857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.019s	sys 0.025s
I20260709 12:20:19.630015 25126 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: [2.5-5.6]
W20260709 12:20:19.651249 25857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.020s	sys 0.025s
I20260709 12:20:19.652226 25120 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 12:20:19.511304 27973 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
W20260709 12:20:19.527956 27803 consensus_meta.cc:287] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.064s	user 0.003s	sys 0.008s
I20260709 12:20:19.602937 27846 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:19.602774 27804 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:19.602747 27909 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:19.405042 25853 rpcz_store.cc:276] 0709 12:20:18.136273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.157633 (+ 21360us) service_pool.cc:224] Handling call
0709 12:20:19.392315 (+1234682us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:19.652328 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1047) took 1531 ms. Trace:
W20260709 12:20:19.671545 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.671460 25857 rpcz_store.cc:276] 0709 12:20:18.121122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.124812 (+  3690us) service_pool.cc:224] Handling call
0709 12:20:18.125144 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.125393 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:18.560256 (+434863us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.651885 (+1091629us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:19.651955 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:19.652023 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.652122 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.652261 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":625807,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":94,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5732,"thread_start_us":1520568,"threads_started":2}
I20260709 12:20:19.605283 27990 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:19.673308 25119 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:19.526969 27896 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.677510 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.515473 27937 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.506578 27831 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.626102 27977 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:19.646361 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 313765us
I20260709 12:20:19.691535 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:19.692755 25168 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:19.694470 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:19.514138 27975 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:19.517071 27736 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:19.516268 27908 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.671499 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:19.654577 27623 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:19.653256 27849 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:19.677361 27990 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:19.683880 27964 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:19.660631 27921 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:19.680708 27776 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:19.698391 25168 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:19.670408 27803 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:19.702593 27967 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.686494 27852 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:19.694408 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:19.697144 27895 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.672338 27846 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.629732 27393 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:19.699890 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.721242 25126 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:19.722139 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.718080 27999 consensus_queue.cc:1059] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:20:19.723778 27999 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:19.724079 27852 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:19.724148 27999 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:19.724835 27912 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:19.725104 27999 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.728278 27885 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.520859 27883 consensus_queue.cc:260] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.730582 27883 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:19.732676 27393 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:19.733628 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1706) took 2580 ms. Trace:
I20260709 12:20:19.734015 27999 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.735260 27439 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.736337 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:19.738080 27896 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:19.738544 27896 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:19.738950 27896 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.739925 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 824) took 1344 ms. Trace:
I20260709 12:20:19.740280 25270 rpcz_store.cc:276] 0709 12:20:18.395568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.475081 (+ 79513us) service_pool.cc:224] Handling call
0709 12:20:18.482403 (+  7322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.404725 (+922322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.739713 (+334988us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b540034d5d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:19.739869 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2119708928}
I20260709 12:20:19.695849 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:19.743294 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 47512.8us
I20260709 12:20:19.733994 25118 rpcz_store.cc:276] 0709 12:20:17.153417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.208725 (+ 55308us) service_pool.cc:224] Handling call
0709 12:20:17.209000 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.450558 (+1241558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.733398 (+1282840us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001b71d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:19.733559 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2686232832}
I20260709 12:20:19.705000 25168 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:19.700522 27990 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:19.703169 27974 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.614s	user 0.002s	sys 0.000s
I20260709 12:20:19.705509 27776 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.701124 27975 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.702730 27921 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.706151 27887 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:19.709556 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2208) took 1669 ms. Trace:
I20260709 12:20:19.755637 25121 rpcz_store.cc:276] 0709 12:20:18.040020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.040146 (+   126us) service_pool.cc:224] Handling call
0709 12:20:18.040399 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.738370 (+697971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.709322 (+970952us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b540009d154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:19.709496 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582564736}
I20260709 12:20:19.699281 27847 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:19.697326 27756 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:19.700963 27623 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.696803 27748 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:19.771212 27776 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.754976 27887 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.744052 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:19.775878 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:19.776165 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:19.776476 25859 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:19.622634 27833 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.777491 27736 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:19.777666 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:19.778230 27736 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:19.758258 27624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36418 (request call id 87) took 5859 ms. Trace:
W20260709 12:20:19.748849 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 43918.9us
I20260709 12:20:19.747505 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 1687) took 1735 ms. Trace:
I20260709 12:20:19.695050 27804 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.767460 27975 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.626297 27945 consensus_queue.cc:1059] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:20:19.766641 25853 raft_consensus.cc:2955] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:19.768818 27803 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:19.757417 27938 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:19.758513 27847 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:19.747828 27638 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:20:19.754685 28000 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:19.779156 25201 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:19.700778 27908 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:19.783218 27846 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:19.784292 25825 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:19.779095 27887 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:19.818631 27756 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:19.778926 27833 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.786459 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.825871 25118 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:19.826882 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:19.827477 25118 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:19.827811 27757 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:19.807919 27847 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:19.787513 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.830868 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:19.831200 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2088) took 1711 ms. Trace:
I20260709 12:20:19.812306 28000 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.831902 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.831980 28000 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.832711 25121 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 7: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:19.833037 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:19.717515 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.831568 25193 rpcz_store.cc:276] 0709 12:20:18.119336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.457698 (+338362us) service_pool.cc:224] Handling call
0709 12:20:18.469584 (+ 11886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.610317 (+140733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:18.610346 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:18.610385 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:18.610420 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.830993 (+1220573us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54000b18d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:19.831035 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.831150 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238558976}
W20260709 12:20:19.748109 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 143637us
I20260709 12:20:19.838292 27758 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.839413 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:19.839902 27944 raft_consensus.cc:3055] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:19.840258 27944 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:19.810269 27638 consensus_queue.cc:1243] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer b83c12959b9848b3b7bbc680f5ee6225 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:20:19.841081 27944 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.841748 27967 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.842249 27967 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.842777 27506 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:19.843556 27968 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:19.844347 27967 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.844430 27968 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:19.846935 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:19.848474 25167 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:19.791497 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.849398 25119 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 5: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:19.849146 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:19.792397 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:19.849622 25167 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:19.849926 25120 raft_consensus.cc:2376] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4. Re-sending same reply.
I20260709 12:20:19.850207 27925 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:19.850493 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.850847 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.851060 27653 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:19.851294 25119 raft_consensus.cc:2376] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8. Re-sending same reply.
I20260709 12:20:19.851670 25120 raft_consensus.cc:2410] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:20:19.798949 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:19.833426 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.855086 25121 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 5: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:20:19.855423 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.856034 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.856834 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:19.857586 25196 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.859654 27842 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.860931 27842 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:19.863041 25198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2083) took 1845 ms (client timeout 2171 ms). Trace:
W20260709 12:20:19.863464 25198 rpcz_store.cc:269] 0709 12:20:18.017890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.035778 (+ 17888us) service_pool.cc:224] Handling call
0709 12:20:19.862870 (+1827092us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b540016c6d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:19.862984 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394838400}
I20260709 12:20:19.864745 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:19.865428 25270 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:19.872632 27763 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.878687 27968 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:19.879935 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2220) took 1760 ms. Trace:
I20260709 12:20:19.880332 25123 rpcz_store.cc:276] 0709 12:20:18.119390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.424925 (+1305535us) service_pool.cc:224] Handling call
0709 12:20:19.425218 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.461748 (+ 36530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.879713 (+417965us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b54002ac954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:19.879876 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43841920}
I20260709 12:20:19.881628 25118 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:19.771215 27623 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.803115 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:19.894512 27846 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.894665 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:19.894951 27887 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:19.895364 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:19.895133 27846 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:19.895798 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:19.896036 25269 raft_consensus.cc:2393] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:19.896147 25195 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:19.896778 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:19.897228 27846 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:19.897442 25273 raft_consensus.cc:2368] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5.
I20260709 12:20:19.897710 27887 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:19.827662 27804 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:19.787544 25274 rpcz_store.cc:276] 0709 12:20:18.007589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.007735 (+   146us) service_pool.cc:224] Handling call
0709 12:20:19.742493 (+1734758us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54002fec54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:19.742619 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111689600}
I20260709 12:20:19.848357 27972 consensus_queue.cc:1059] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:19.849086 27816 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:19.792405 25124 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:19.802685 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 81790us
I20260709 12:20:19.785851 27624 rpcz_store.cc:276] 0709 12:20:13.906856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.912446 (+  5590us) service_pool.cc:224] Handling call
0709 12:20:14.004234 (+ 91788us) log.cc:844] Serialized 501 byte log entry
0709 12:20:19.749508 (+5745274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":228,"raft.run_cpu_time_us":1246,"raft.run_wall_time_us":1245,"thread_start_us":338992,"threads_started":1,"wal-append.queue_time_us":595123,"wal-append.run_cpu_time_us":2191,"wal-append.run_wall_time_us":1163468}
I20260709 12:20:19.888530 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:19.790153 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:19.897492 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:19.895140 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:19.914160 25272 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:19.812422 25825 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:19.897236 25269 raft_consensus.cc:2955] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:19.915253 25196 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
W20260709 12:20:19.901443 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 51891.1us
I20260709 12:20:19.894680 25127 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:19.905321 25273 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:20:19.905833 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.911626 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:19.920909 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:19.922782 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:19.923521 25276 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.926618 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:19.928248 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:19.941862 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:19.942589 25274 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:19.943665 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:19.944924 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:19.899868 27922 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:19.950747 27922 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:19.955875 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 143510us
I20260709 12:20:19.958916 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:19.959631 25200 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:19.961444 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:19.962543 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 54270.3us
W20260709 12:20:19.965319 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.965803 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.966044 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:19.966667 25118 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:19.968490 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 49209us
I20260709 12:20:19.873919 27763 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:19.912250 27938 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.969666 25822 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:19.966488 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 46358.2us
I20260709 12:20:19.986382 25276 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:19.971436 25242 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:19.975216 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 185202us
I20260709 12:20:19.906495 27623 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:19.979549 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:19.981963 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.983183 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:19.985473 25118 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:19.988435 25270 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:19.990127 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:19.912809 27944 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:19.967694 27804 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.010641 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.011219 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.006407 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:20.008126 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:20.008345 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.008227 25857 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:20.012151 25858 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:19.976994 27922 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:19.980283 27816 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:20.001331 25012 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9c305b34a0c54275af750c832f52691f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:19.978331 27803 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.030146 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.017899 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:20.031044 25118 raft_consensus.cc:2393] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:19.976676 27869 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:20.024658 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:19.998265 27623 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:20.036034 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.040423 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:20.040817 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.045590 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.048506 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.050827 25242 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:20.051568 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:19.982235 27938 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.057443 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.052372 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.058120 25127 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:20.026335 27784 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:20.069036 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.069826 25856 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:20.045794 27623 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:20.045290 27776 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:20.050160 27833 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:20.045795 27883 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.089922 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.092669 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:20.093230 25273 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:20.051301 28007 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:20.061478 27912 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:20.067473 27869 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:20.074676 27736 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:20.094936 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.090232 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2129) took 1950 ms. Trace:
W20260709 12:20:20.071578 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 71460.3us
I20260709 12:20:20.095273 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.066840 27921 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:20.105134 25271 rpcz_store.cc:276] 0709 12:20:18.140231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.357462 (+217231us) service_pool.cc:224] Handling call
0709 12:20:18.660235 (+302773us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:18.660712 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:18.660755 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:18.689535 (+ 28780us) log.cc:844] Serialized 26 byte log entry
0709 12:20:18.882051 (+192516us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:18.882097 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.882172 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:19.396832 (+514660us) raft_consensus.cc:1685] finished
0709 12:20:19.396852 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.089981 (+693129us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400298950. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:20.090175 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17277,"raft.queue_time_us":4386,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":32285,"spinlock_wait_cycles":695435008,"thread_start_us":130323,"threads_started":1,"wal-append.queue_time_us":535993}
I20260709 12:20:20.107780 25122 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:20.108399 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1713) took 1789 ms. Trace:
I20260709 12:20:20.108711 25122 rpcz_store.cc:276] 0709 12:20:18.319053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.107349 (+1788296us) service_pool.cc:224] Handling call
0709 12:20:20.107618 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:20.108181 (+   563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.108349 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:20.109611 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.093957 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.087119 27895 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.088610 27784 raft_consensus.cc:697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:20.094712 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:20.114792 25267 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:20.113785 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:19.980376 27763 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:20.098067 27993 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:20.046444 28000 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:20.066843 27925 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:20.022478 27804 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.038878 27803 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:20.112993 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.099807 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:20.126061 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:20.126657 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.104663 27869 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:20.117151 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.079838 27748 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:20:20.172541 27748 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.173148 27748 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:20.120571 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.175664 27748 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:20.176230 27748 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:20.176590 27748 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:20.127422 25197 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:20.182118 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.120463 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.098742 27912 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:20.121332 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:20.196259 27912 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:20.196815 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.198112 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.198676 25198 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:20.199559 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.199980 27758 raft_consensus.cc:3055] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:20.200100 25198 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:20.200460 27758 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:20.201020 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.134675 27990 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.201252 27758 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.203179 27990 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:20.139456 28000 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:20.204285 27804 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:20.205829 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 788) took 1379 ms. Trace:
I20260709 12:20:20.206225 25854 rpcz_store.cc:276] 0709 12:20:18.826792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.827937 (+  1145us) service_pool.cc:224] Handling call
0709 12:20:19.390093 (+562156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.399842 (+  9749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.205652 (+805810us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b540056b8d0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:20.205769 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1256400768}
I20260709 12:20:20.206905 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.207638 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 573) took 1012 ms. Trace:
I20260709 12:20:20.207991 25201 rpcz_store.cc:276] 0709 12:20:19.195087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.488104 (+293017us) service_pool.cc:224] Handling call
0709 12:20:19.488564 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.809416 (+320852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.207447 (+398031us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54000a5d54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:20.207590 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667741568}
I20260709 12:20:20.209125 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.209851 25201 raft_consensus.cc:2393] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:20.118558 27993 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.210310 27993 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:20.211050 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.212174 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.213217 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:20.101111 27883 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:20.215694 27883 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:20.118695 27895 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.216238 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2213) took 2133 ms. Trace:
I20260709 12:20:20.217557 27895 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:20.216617 25125 rpcz_store.cc:276] 0709 12:20:18.082860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.674966 (+592106us) service_pool.cc:224] Handling call
0709 12:20:18.707408 (+ 32442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.718667 (+ 11259us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:18.893931 (+175264us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.139176 (+245245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:19.139255 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:19.139325 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.216026 (+1076701us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5400003054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:20.216066 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.216185 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1920,"prepare.queue_time_us":622527,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":9048,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":82329,"spinlock_wait_cycles":25288448,"thread_start_us":385657,"threads_started":2,"wal-append.queue_time_us":545613}
I20260709 12:20:20.143164 27784 consensus_queue.cc:237] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.218786 27763 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:20.219837 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.144224 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:20.182894 25197 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:20.145143 25202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2093) took 1338 ms. Trace:
I20260709 12:20:20.196295 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:20.222486 25822 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:20.101311 28007 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:20.129139 27925 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.155321 27847 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:20.156121 27908 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:20.156512 27869 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:20.096653 27776 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:20.243420 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:20.244513 25268 raft_consensus.cc:2410] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:20:20.118158 27896 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:20.158424 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1697) took 3058 ms. Trace:
I20260709 12:20:20.161032 27844 raft_consensus.cc:3055] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:20:20.166684 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.168454 27848 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:20.168838 27803 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:20.169319 25123 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:20.170843 27698 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:20.184201 25120 raft_consensus.cc:2410] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:20:20.192936 25200 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:20.232628 27846 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:20.207998 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:20.150785 27938 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:20.213881 25193 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:20.221159 25202 rpcz_store.cc:276] 0709 12:20:18.807186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.466386 (+659200us) service_pool.cc:224] Handling call
0709 12:20:19.504726 (+ 38340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:19.544843 (+ 40117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:19.544878 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:19.571454 (+ 26576us) log.cc:844] Serialized 26 byte log entry
0709 12:20:19.802482 (+231028us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:19.802520 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.802590 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:20.144919 (+342329us) raft_consensus.cc:1685] finished
0709 12:20:20.144940 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.145084 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47804,"raft.queue_time_us":39140,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":25747,"thread_start_us":152117,"threads_started":1,"wal-append.queue_time_us":389133}
I20260709 12:20:20.221333 25198 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:20.313468 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.221432 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.314265 25195 raft_consensus.cc:2393] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:20.314628 25197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:20:20.226868 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.229054 27849 consensus_queue.cc:1059] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:20:20.316524 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 578) took 1022 ms. Trace:
I20260709 12:20:20.316936 25201 rpcz_store.cc:276] 0709 12:20:19.293893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.315789 (+1021896us) service_pool.cc:224] Handling call
0709 12:20:20.316055 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:20.316224 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.316248 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:20.316293 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:20.316331 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.316382 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.316473 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:20.226016 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 219705us
I20260709 12:20:20.318583 25825 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:20.221185 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:20.319468 25858 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:20.323666 28007 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:20.324142 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.251608 27844 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:20.245091 25168 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:20.327131 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 82136us
W20260709 12:20:20.249152 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.314277 25196 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:20.251083 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:20.246002 25124 rpcz_store.cc:276] 0709 12:20:17.100028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.100149 (+   121us) service_pool.cc:224] Handling call
0709 12:20:17.115920 (+ 15771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.906592 (+2790672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.158185 (+251593us) spinlock_profiling.cc:243] Waited 2.68 s on lock 0x7b540018a6d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:20.158364 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6154812160}
W20260709 12:20:20.282936 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 196563us
I20260709 12:20:20.328693 25196 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:20.143337 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:20.329236 25856 raft_consensus.cc:2376] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5. Re-sending same reply.
I20260709 12:20:20.303957 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:20.330500 25125 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:20.315258 25195 raft_consensus.cc:1240] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:20.209137 27909 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:20.238353 25273 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
W20260709 12:20:20.327423 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 74501.5us
I20260709 12:20:20.331501 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 577) took 1038 ms. Trace:
I20260709 12:20:20.313470 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.332329 25195 rpcz_store.cc:276] 0709 12:20:19.293520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.314849 (+1021329us) service_pool.cc:224] Handling call
0709 12:20:20.315107 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:20.331276 (+ 16169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.331448 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:20.339541 25195 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:20.325722 27847 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:20.342684 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:20.337935 25201 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:20.334169 25168 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:20.255748 27758 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:20.348359 25195 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:20:20.361528 25195 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:20:20.361449 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:20.363353 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:20.228690 27736 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:20:20.350576 25093 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:20.364490 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:20.364583 25093 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.365348 25270 raft_consensus.cc:2410] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:20.365550 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:20.366918 25271 raft_consensus.cc:2393] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:20.350589 25858 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:20.177631 27748 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.353497 25090 leader_election.cc:400] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5.
I20260709 12:20:20.339448 27624 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:20.354712 27842 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:20.354880 27803 raft_consensus.cc:2764] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:20:20.355846 25196 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:20:20.358834 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:20.379459 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60974us
I20260709 12:20:20.335345 27909 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:20.380254 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:20.359611 25201 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:20:20.332962 27846 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.373063 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.374171 25090 leader_election.cc:403] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:20.373785 25125 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
W20260709 12:20:20.376899 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 234104us
I20260709 12:20:20.383388 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.384271 25241 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.385658 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:20.398381 25167 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:20.388998 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 56558.9us
I20260709 12:20:20.400085 25822 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:20.390653 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:20.401075 25267 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:20.387046 25199 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:20.376106 27804 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:20.407582 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.411687 25119 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:20:20.413515 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:20.430377 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 83925.8us
W20260709 12:20:20.435209 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 62210.1us
W20260709 12:20:20.438383 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.439523 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.386731 27812 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:20.388657 27846 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:20.349215 28007 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
W20260709 12:20:20.452874 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 52900.7us
I20260709 12:20:20.395979 27897 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:20.397275 27938 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:20.408533 27624 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:20.416018 27763 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:20.378487 27757 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:20:20.415068 28014 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:20.449239 27849 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:20:20.463552 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 56041.9us
I20260709 12:20:20.491304 25242 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:20.469812 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 56353.7us
I20260709 12:20:20.492753 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:20.416426 27804 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:20.459700 27997 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:20.450932 27803 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:20.451363 28017 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:20.404850 27755 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:20:20.449038 27506 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5.
I20260709 12:20:20.381798 27844 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.470512 28019 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:20.482388 27965 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:20.483136 27925 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:20.483970 27624 raft_consensus.cc:697] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:20.484794 27896 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:20.486346 27623 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.487218 27776 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:20.494352 27897 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:20:20.493279 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:20.494127 25242 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:20.464476 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 55942.9us
I20260709 12:20:20.546703 25241 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:20.495074 28016 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:20.494503 27804 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:20.499522 27849 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:20.553874 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 59917.7us
I20260709 12:20:20.555145 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:20.517005 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 79620.9us
I20260709 12:20:20.558609 25093 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.500726 27757 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:20.488416 28014 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.508294 27997 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:20:20.551271 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 58054.9us
I20260709 12:20:20.518543 25194 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:20.572511 25197 raft_consensus.cc:606] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:20:20.572152 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.572971 25197 raft_consensus.cc:614] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:20.564460 25241 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:20.567668 25093 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:20.538359 28019 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:20.504611 27993 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.644356 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.549885 27844 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:20.647228 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.648458 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:20.665482 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 101102us
I20260709 12:20:20.651279 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.651631 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.666297 25241 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.652273 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.531574 27803 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:20:20.650956 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:20.679924 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:20.659277 25127 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:20.660811 28014 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:20.662070 27968 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:20.665928 25126 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
W20260709 12:20:20.724191 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 394766us
I20260709 12:20:20.724781 25126 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:20:20.666693 25120 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:20.561199 27965 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:20.517549 27912 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.576715 28007 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:20.577212 27776 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:20.572125 27925 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:20.742698 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 91821.6us
W20260709 12:20:20.742848 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 290370us
W20260709 12:20:20.737591 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 71369.1us
I20260709 12:20:20.746647 25242 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.748221 25241 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:20.578163 27506 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.146s
I20260709 12:20:20.571782 27849 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:20.750924 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 176029us
I20260709 12:20:20.675874 27964 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:20.652909 27638 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:20.666991 27757 raft_consensus.cc:697] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:20.752595 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.576882 27896 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.148s
I20260709 12:20:20.733175 27965 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:20.725793 27817 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:20.757958 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.725975 27968 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:20.762802 27964 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:20.654660 28012 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.125s
I20260709 12:20:20.751967 27883 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:20.744988 27894 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:20.775148 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.682116 27938 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:20:20.745944 27776 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:20.756167 27847 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:20.753206 28007 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:20.785791 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:20.762042 27895 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:20.782217 25860 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:20.789268 27964 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:20.799604 27944 consensus_meta.cc:287] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.781s	user 0.015s	sys 0.003s
I20260709 12:20:20.774227 27965 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:20.780999 27897 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:20.784055 27968 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:20.793110 25854 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:20.794989 27776 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:20.792606 27883 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:20.864382 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 101949us
W20260709 12:20:20.844147 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 58624.4us
I20260709 12:20:20.774317 27997 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.845606 28036 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:20.792387 27894 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:20.801920 28007 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:20.852850 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.799031 27817 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:20.761049 27624 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.802628 27938 raft_consensus.cc:3055] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:20.764139 27638 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:20.842991 27925 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.866547 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:20.868175 25090 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:20.841969 27755 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.862119 27942 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:20.872493 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 296877us
I20260709 12:20:20.799486 27847 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.853750 27895 raft_consensus.cc:697] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:20.880164 28017 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:20.878648 27849 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:20.799149 27803 consensus_queue.cc:1059] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:20:20.858347 27757 consensus_queue.cc:237] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:20.885104 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 120281us
I20260709 12:20:20.899483 25242 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.871279 27894 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:20.873713 27817 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:20.867662 27883 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:20.791627 28019 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:20.905710 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:20.906595 25860 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:20.880900 27638 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:20.889808 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.890203 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.911778 25120 raft_consensus.cc:2393] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:20.890269 27994 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:20.891487 25126 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:20.892453 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.896307 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.897274 27895 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.874610 27990 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.900590 25090 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.873754 28036 raft_consensus.cc:697] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:20.889292 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.924786 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:20.910151 25825 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.877282 27938 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:20:20.900825 28025 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:20:20.900256 27623 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:20.887152 27925 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:20.920611 25168 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:20.929999 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:20.931582 25201 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:20.932466 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:20.942076 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:20.942793 25126 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:20.933682 27736 consensus_queue.cc:1059] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:20.933847 28011 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:20.933797 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.946215 25165 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:20.933722 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:20.934340 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.932883 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:20.939913 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 52534.4us
I20260709 12:20:20.905048 28017 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:20.950436 25825 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:20.947820 25168 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:20.912561 27849 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:20.930065 28027 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
I20260709 12:20:20.950421 25198 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:20.955327 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.947661 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.956722 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:20.957376 25201 raft_consensus.cc:2393] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 8: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:20.916386 27994 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:20.918656 27993 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:20.944339 28032 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:20:20.962073 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:20.964838 25860 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:20.919101 27944 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:20:20.894181 27755 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.965761 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.951658 27912 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:20.967865 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.969688 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.978091 25854 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:20.978668 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:20.979374 25120 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:20.915320 27922 consensus_queue.cc:1059] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:20:20.970556 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:20.954242 27996 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:20.982805 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.982542 27938 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.983094 27996 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:20.983584 27996 raft_consensus.cc:697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:20.983790 27938 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:20.983976 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.984406 27996 consensus_queue.cc:237] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:20.984859 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.985949 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.986764 25860 raft_consensus.cc:2410] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:20.987733 25860 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:20.965220 27994 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:20.990366 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:20.899333 27942 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:20.964465 28011 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:21.025102 25120 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:20.971006 27971 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:20.938231 27990 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.001060 25271 raft_consensus.cc:1240] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:21.003459 25268 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:20.992121 25273 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:21.018877 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:21.015013 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 64368.8us
I20260709 12:20:20.963573 25855 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 1.
W20260709 12:20:20.976909 28030 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:20:20.968097 28013 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:21.038607 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:21.047650 25270 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:20:20.975342 27897 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.963408 27849 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.049943 25275 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:20.977133 28044 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:21.008337 28039 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:21.026244 28011 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:21.049909 28028 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:20:21.051230 27944 consensus_queue.cc:1243] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer b83c12959b9848b3b7bbc680f5ee6225 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:20:21.055855 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2139) took 1002 ms. Trace:
W20260709 12:20:21.068234 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 101217us
I20260709 12:20:20.964061 27817 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:21.034233 27971 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:21.072427 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:21.089389 25273 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:21.089967 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2105) took 1044 ms. Trace:
I20260709 12:20:21.090435 25195 rpcz_store.cc:276] 0709 12:20:20.045320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.362336 (+317016us) service_pool.cc:224] Handling call
0709 12:20:20.362609 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.362803 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.362832 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.363316 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.509372 (+146056us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:20.509405 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.509468 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.089761 (+580293us) raft_consensus.cc:1685] finished
0709 12:20:21.089778 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.089909 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":145722,"threads_started":1,"wal-append.queue_time_us":197578}
I20260709 12:20:21.087612 25276 rpcz_store.cc:276] 0709 12:20:20.053097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.053346 (+   249us) service_pool.cc:224] Handling call
0709 12:20:20.089235 (+ 35889us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.225236 (+136001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.225268 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.225686 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.409882 (+184196us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:20.409940 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.541274 (+131334us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540002b054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:20.541318 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.055523 (+514205us) raft_consensus.cc:1685] finished
0709 12:20:21.055549 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.055789 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5432,"spinlock_wait_cycles":311809280,"thread_start_us":162621,"threads_started":1,"wal-append.queue_time_us":307003}
W20260709 12:20:21.054955 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 103296us
W20260709 12:20:21.085335 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 125764us
I20260709 12:20:21.068032 28044 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.096020 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:21.103310 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.096704 27971 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:21.077821 28011 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:21.090266 28033 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:20:21.066262 27897 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:21.125015 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 86531.3us
I20260709 12:20:21.147230 25090 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:21.096483 27909 consensus_meta.cc:287] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.006s
I20260709 12:20:21.128546 25200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2100) took 1654 ms. Trace:
I20260709 12:20:21.054663 28047 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 12:20:21.118242 27846 consensus_meta.cc:287] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
I20260709 12:20:21.098301 27736 consensus_queue.cc:1059] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:20:21.090831 28039 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:21.148329 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 86629.4us
I20260709 12:20:21.148330 25200 rpcz_store.cc:276] 0709 12:20:19.473989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.325163 (+851174us) service_pool.cc:224] Handling call
0709 12:20:20.325476 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.325690 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.325718 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.326234 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.513578 (+187344us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:20.750267 (+236689us) log.cc:844] Serialized 14 byte log entry
0709 12:20:20.930217 (+179950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.930289 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.128329 (+198040us) raft_consensus.cc:1685] finished
0709 12:20:21.128350 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.128485 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24337,"prepare.queue_time_us":221819,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":11397,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6131,"thread_start_us":535608,"threads_started":3,"wal-append.queue_time_us":318479}
I20260709 12:20:21.105406 28044 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:21.055903 27623 consensus_queue.cc:1059] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:20:21.119663 27993 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:20:21.143776 27847 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.153740 25090 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:21.162700 25276 raft_consensus.cc:1240] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:21.054229 28036 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:21.169544 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 74704us
I20260709 12:20:21.157223 27925 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:21.193544 28045 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:21.193758 27942 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:21.194761 28042 log.cc:927] Time spent T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:20:21.198406 28052 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:21.199921 28055 consensus_queue.cc:1059] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:20:21.211169 28050 log.cc:927] Time spent T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:21.215958 27883 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:21.217473 27844 consensus_meta.cc:287] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.002s
I20260709 12:20:21.218742 25202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2114) took 1201 ms. Trace:
I20260709 12:20:21.219147 25202 rpcz_store.cc:276] 0709 12:20:20.017129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.354320 (+337191us) service_pool.cc:224] Handling call
0709 12:20:20.354689 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.355048 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.355075 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.355537 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.509091 (+153554us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:20.653115 (+144024us) log.cc:844] Serialized 14 byte log entry
0709 12:20:20.743981 (+ 90866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.744119 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.218505 (+474386us) raft_consensus.cc:1685] finished
0709 12:20:21.218529 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.218679 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90576,"prepare.queue_time_us":226046,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":92610,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":8031,"thread_start_us":279052,"threads_started":2,"wal-append.queue_time_us":406632}
I20260709 12:20:21.177773 27506 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:21.189690 25273 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:21.224460 28041 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:20:21.221933 27758 consensus_meta.cc:287] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.861s	user 0.007s	sys 0.003s
I20260709 12:20:21.227268 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2104) took 1596 ms. Trace:
I20260709 12:20:21.158907 27846 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:21.247586 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.232342 27965 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.153203 27909 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.229050 25193 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:21.239557 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:21.241938 28056 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:21.262290 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:21.243474 27869 consensus_meta.cc:287] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.958s	user 0.012s	sys 0.000s
I20260709 12:20:21.247068 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:21.269088 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.269779 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:21.270644 25242 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:21.252102 27965 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:21.253533 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2094) took 1419 ms. Trace:
I20260709 12:20:21.274590 25193 rpcz_store.cc:276] 0709 12:20:19.834629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.339605 (+504976us) service_pool.cc:224] Handling call
0709 12:20:21.228872 (+889267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:21.252475 (+ 23603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.253350 (+   875us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b5400178c50. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:21.253476 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2044246784}
I20260709 12:20:21.254369 25857 raft_consensus.cc:1240] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:21.254889 25276 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:21.249562 27804 consensus_meta.cc:287] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.679s	user 0.006s	sys 0.005s
I20260709 12:20:21.256625 27909 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:21.261322 25858 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:21.241710 28041 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.267204 25273 raft_consensus.cc:2410] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 12:20:21.250165 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 154203us
I20260709 12:20:21.229626 27776 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.238709 27755 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:21.206689 27736 consensus_queue.cc:1059] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:20:21.317384 25853 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:20:21.286429 25825 leader_election.cc:336] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.765s (SENT)
I20260709 12:20:21.318575 25165 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:21.260922 27849 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:21.322260 27763 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:21.340956 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:21.317945 28043 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:21.360991 28043 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:21.276330 27885 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:21.277308 27990 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.352288 25269 raft_consensus.cc:1240] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:21.356601 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:21.168016 28039 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.320200 27844 consensus_queue.cc:1059] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:20:21.277659 27964 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.247519 25199 rpcz_store.cc:276] 0709 12:20:19.631295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.219567 (+588272us) service_pool.cc:224] Handling call
0709 12:20:21.227025 (+1007458us) spinlock_profiling.cc:243] Waited 90.7 ms on lock 0x7b5400178c54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:21.227196 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208546560}
I20260709 12:20:21.369942 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:21.361490 28043 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:21.376091 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:21.342672 28000 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:21.321888 27804 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.354768 27883 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:21.281011 27942 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:20:21.276681 27869 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.362490 27908 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:21.355767 27763 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.389212 28039 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.389492 27964 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:21.390986 27776 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.392238 28041 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.393325 27846 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:21.394739 27968 consensus_meta.cc:287] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.004s
W20260709 12:20:21.395248 28007 consensus_meta.cc:287] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.002s
I20260709 12:20:21.396219 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55488 (request call id 14) took 1312 ms. Trace:
I20260709 12:20:21.396390 27638 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.365499 27758 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.379145 27990 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:21.420423 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:21.469131 25196 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:21.469640 28068 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:21.392916 28011 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.406862 28037 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.526466 28037 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.417114 27763 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:21.494360 25197 rpcz_store.cc:276] 0709 12:20:20.083527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.314517 (+230990us) service_pool.cc:224] Handling call
0709 12:20:21.396017 (+1081500us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54000a5354. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f08853 00007f2108ed660a 00007f210245c7d4 00007f210245c762 00007f210245c691 00007f210245c60c 00007f210245b8c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:21.396126 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591792000}
I20260709 12:20:21.416837 27897 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:21.415988 27506 raft_consensus.cc:697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:21.536515 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:21.427165 28000 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:21.537745 25851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:21.538223 25272 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:21.467722 28056 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:21.508014 28058 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.316s	user 0.002s	sys 0.004s
I20260709 12:20:21.513144 27992 raft_consensus.cc:3055] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:21.518731 27848 raft_consensus.cc:3055] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:20:21.520211 28024 log.cc:927] Time spent T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.741s	user 0.003s	sys 0.000s
I20260709 12:20:21.526863 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:21.560104 25276 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:21.536265 27506 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.538450 25851 raft_consensus.cc:606] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:21.494623 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 75084.1us
I20260709 12:20:21.414196 27994 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.506592 27895 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.497911 28007 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:21.553169 28048 log.cc:927] Time spent T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 12:20:21.553311 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:21.553509 27848 raft_consensus.cc:740] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:21.554169 28071 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:21.553203 27869 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:21.508351 27758 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.555440 27971 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:21.556622 28034 raft_consensus.cc:3055] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:21.554574 27803 raft_consensus.cc:3055] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:21.558226 25860 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:21.559054 25127 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:21.568588 25851 raft_consensus.cc:614] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:21.565917 25092 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:21.569152 28060 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.552523 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:21.569617 25165 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:20:21.545099 28062 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 12:20:21.575222 25119 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:21.592720 25194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 567) took 2691 ms (client timeout 1765 ms). Trace:
W20260709 12:20:21.593317 25194 rpcz_store.cc:269] 0709 12:20:18.893638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.996231 (+102593us) service_pool.cc:224] Handling call
0709 12:20:21.585137 (+2588906us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54000a5354. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:21.585247 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3236610432}
W20260709 12:20:21.560725 27894 consensus_meta.cc:287] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.004s
I20260709 12:20:21.496433 27968 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:21.539407 27938 consensus_meta.cc:287] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.000s
I20260709 12:20:21.559954 27992 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:21.583389 25267 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:21.589588 25276 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:21.595270 25165 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:21.530486 28068 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.598255 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:21.599941 28067 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:20:21.601759 27748 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:21.625286 28069 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:20:21.627373 27812 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:21.627550 28007 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.627957 27812 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:21.628970 27812 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.609140 27804 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.602311 27848 consensus_queue.cc:260] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.631184 27994 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:21.631361 27848 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:21.577147 27895 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.633255 27895 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.633785 25124 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
W20260709 12:20:21.602851 28021 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Append to log took a long time: real 1.069s	user 0.002s	sys 0.000s
I20260709 12:20:21.597126 27990 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:21.607841 25119 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:21.637588 27763 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.638096 27638 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.590485 27803 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:21.639221 27803 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:21.639776 27763 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.640219 27803 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:21.609570 27968 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.609339 28060 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.611939 25165 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:21.643370 28060 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.590353 28034 raft_consensus.cc:740] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:21.597002 27869 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:21.645618 28034 consensus_queue.cc:260] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:21.646113 27869 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.646690 28034 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:21.648291 27869 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:21.649340 28037 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.613443 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:21.618368 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:21.610322 27945 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:21.652384 25092 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:21.580746 28071 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.665562 28060 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:21.663712 27945 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.645589 27992 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.669051 27758 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.669476 28071 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.538889 28056 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.669310 27992 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:21.671262 25276 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:21.623246 27624 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:21.673323 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:21.669975 27945 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.652069 27748 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:21.673869 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:21.675132 25193 raft_consensus.cc:1240] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:21.608676 27894 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.677379 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.677479 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.665059 28037 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:21.678673 25195 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:21.678754 25193 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:21.679320 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.663810 27763 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:21.682056 27763 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:21.683269 28012 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:21.683657 28012 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:21.680821 25202 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:21.677379 27748 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.687805 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.693259 25200 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:21.696785 25271 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 8: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:21.700562 28052 raft_consensus.cc:3055] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:21.700990 28052 raft_consensus.cc:740] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:21.701128 28061 raft_consensus.cc:3055] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:21.701516 28061 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:21.701882 28052 consensus_queue.cc:260] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:21.702394 28061 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.703150 28052 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:21.703763 28061 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:21.705633 28017 raft_consensus.cc:3055] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:21.706065 28017 raft_consensus.cc:740] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:21.706538 28023 log.cc:927] Time spent T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.975s	user 0.002s	sys 0.002s
I20260709 12:20:21.707010 28017 consensus_queue.cc:260] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:21.707942 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1072) took 1720 ms. Trace:
I20260709 12:20:21.708847 28017 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:21.708359 25852 rpcz_store.cc:276] 0709 12:20:19.988049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.988761 (+   712us) service_pool.cc:224] Handling call
0709 12:20:20.005030 (+ 16269us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:20.227159 (+222129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.227190 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:20.229190 (+  2000us) log.cc:844] Serialized 52 byte log entry
0709 12:20:20.387040 (+157850us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:20.520445 (+133405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.520534 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.705817 (+1185283us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:21.707666 (+  1849us) raft_consensus.cc:1685] finished
0709 12:20:21.707687 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.707885 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17446,"raft.queue_time_us":48668,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6326,"spinlock_wait_cycles":24324352,"thread_start_us":361379,"threads_started":2,"wal-append.queue_time_us":346989}
I20260709 12:20:21.715682 27817 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:21.719506 25822 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:21.686932 27748 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:21.663723 28044 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.725884 28068 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:21.684162 28056 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.730269 25822 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:21.730115 28055 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:21.741812 27994 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:21.742365 27994 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:21.742552 27894 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.743206 27994 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.745493 28055 raft_consensus.cc:697] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:21.746475 28055 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.749706 27938 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:20:21.749972 28013 consensus_meta.cc:287] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.000s
I20260709 12:20:21.750785 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1076) took 1253 ms. Trace:
I20260709 12:20:21.759279 25858 rpcz_store.cc:276] 0709 12:20:20.497101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.497256 (+   155us) service_pool.cc:224] Handling call
0709 12:20:20.497545 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:21.280556 (+783011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.750466 (+469910us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b540054e7d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:21.750701 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1756094208}
I20260709 12:20:21.760293 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:21.761448 25858 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:21.762739 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:21.764237 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 743) took 1005 ms. Trace:
I20260709 12:20:21.764571 25857 rpcz_store.cc:276] 0709 12:20:20.758382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.759742 (+  1360us) service_pool.cc:224] Handling call
0709 12:20:20.760065 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:21.275709 (+515644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.764064 (+488355us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54006432d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:21.764195 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1136192384}
I20260709 12:20:21.765532 25860 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:21.757524 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:21.766536 25853 raft_consensus.cc:2393] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:21.721966 27763 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:21.753832 28049 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:21.754439 28013 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:21.774221 28049 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:21.780961 28049 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:21.781984 28011 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:21.782578 28049 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:21.783954 27971 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:21.758270 28012 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:21.791329 28044 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:21.794438 28043 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:21.796944 28012 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:21.797273 28043 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:21.846432 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:21.848853 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 196407us
W20260709 12:20:21.852185 25168 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.755s (SENT) [suppressed 32 similar messages]
I20260709 12:20:21.679350 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.855743 25199 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:21.858469 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:21.859572 25121 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
W20260709 12:20:21.860541 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.862957 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:21.864157 25122 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:21.870978 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:21.873843 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:21.878816 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:21.879890 25853 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:21.880640 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:21.881803 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:21.884209 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.887804 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2118) took 1640 ms. Trace:
I20260709 12:20:21.888484 25196 rpcz_store.cc:276] 0709 12:20:20.247205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.388641 (+141436us) service_pool.cc:224] Handling call
0709 12:20:20.417685 (+ 29044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:21.522298 (+1104613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.886985 (+364687us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002da854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:21.887536 (+   551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417608960}
I20260709 12:20:21.891074 25854 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:21.892761 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:21.904817 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.907021 25196 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: []
W20260709 12:20:21.913738 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.916263 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:21.913677 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:21.919142 25200 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:21.923943 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:21.926460 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:21.930097 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:21.931715 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:21.932644 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:21.938688 25854 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:21.939162 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.941628 25851 raft_consensus.cc:2410] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:21.941316 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:21.927333 25092 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:21.943563 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.948689 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:21.950161 25273 raft_consensus.cc:2410] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:21.954057 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:21.955475 25269 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:21.956525 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:21.956869 25196 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:21.958555 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:21.977363 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.978310 25199 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:21.979395 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.980125 25199 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:21.981001 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:21.984454 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:21.961288 25241 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:21.963732 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.964303 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:21.967232 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.969808 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.971372 25201 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:21.971612 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:21.972560 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:21.986207 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:21.987090 25855 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:21.988071 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:21.989176 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:21.959774 25269 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:21.990984 25198 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:20:22.047756 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 195763us
I20260709 12:20:22.058409 27996 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.059163 27996 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.051388 25194 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:22.062007 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:22.064320 25200 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:22.067559 25273 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:22.085752 25860 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:22.087127 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:22.089063 25857 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:22.088739 27844 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:20:22.091080 28044 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:22.091589 27921 consensus_queue.cc:1059] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:22.092243 27844 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:22.093237 28039 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:22.093520 27885 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:22.094064 28039 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.094385 27885 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.098332 25852 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
W20260709 12:20:22.118373 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 154372us
I20260709 12:20:22.099798 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:22.099743 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 138669us
I20260709 12:20:22.083410 27830 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.083395 27755 consensus_queue.cc:1059] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:20:22.126267 28053 consensus_queue.cc:1059] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:20:22.126519 27830 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.127795 28053 raft_consensus.cc:3055] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:22.128226 28053 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:22.129415 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:22.067405 27909 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:22.139133 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:22.141113 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.100982 28043 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:22.146322 28043 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.146786 28043 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:22.147933 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:22.098171 27971 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:22.150674 28075 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:22.151051 28053 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.152896 28053 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:22.122668 27885 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:22.098531 27942 raft_consensus.cc:3055] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:22.150450 27971 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.098284 27894 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:22.098460 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:22.155754 25198 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
W20260709 12:20:22.156461 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.156903 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 173005us
I20260709 12:20:22.097216 28039 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:22.165470 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:22.167963 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:22.169036 25272 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:22.169677 28016 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:22.170526 27755 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:22.170992 27755 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:20:22.171731 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 199311us
I20260709 12:20:22.098591 27776 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.172964 25193 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:22.173225 27776 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.176155 27776 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:22.177194 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 131234us
I20260709 12:20:22.178467 28044 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:22.179008 28044 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:22.179491 28044 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.179931 27996 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:22.181656 27847 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:22.182454 25167 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:22.167423 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:22.184491 25274 raft_consensus.cc:2393] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:22.162240 27849 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:22.163635 25276 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:22.164031 28051 consensus_queue.cc:1059] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:20:22.172149 27755 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.162134 27909 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.163692 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:22.207602 25200 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:22.198181 27847 raft_consensus.cc:3055] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:22.215337 27847 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:22.216370 25092 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:22.193033 28016 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:22.217592 28016 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:22.216997 27894 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.216621 27847 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.157423 27942 raft_consensus.cc:740] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:22.189496 27849 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.227089 25269 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:22.242312 27849 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:22.242493 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:22.243450 25274 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:22.247445 27803 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:22.249724 25126 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:22.250016 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:22.250391 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:22.250921 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:22.251190 25122 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:22.251490 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:22.251691 25124 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:22.252341 25121 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:22.254247 27971 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:22.255050 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:22.256057 25124 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:22.257491 27847 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:22.257226 27942 consensus_queue.cc:260] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.258700 27942 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:22.228259 27830 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:22.228643 28059 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:22.229461 27763 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 12:20:22.231153 28071 consensus_queue.cc:1059] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:22.233562 27897 consensus_queue.cc:1059] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:22.188807 27885 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:22.235178 25093 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:22.236478 27909 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:22.241397 28052 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:22.228053 28091 log.cc:927] Time spent T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:20:22.269963 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:22.235165 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 87433.1us
I20260709 12:20:22.274372 25273 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:22.280755 25121 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:22.272418 25168 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:22.291785 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 187668us
I20260709 12:20:22.293915 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:22.297140 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 62076.8us
I20260709 12:20:22.299019 25093 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:22.300021 28075 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:22.302716 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:22.304044 27894 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:22.304490 25120 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:22.290553 25090 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:22.306320 27925 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:22.306679 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:22.281932 28052 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:22.307361 28052 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:22.306506 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:22.290474 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:22.305881 25120 raft_consensus.cc:1240] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:22.323117 25200 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:22.335399 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:22.344914 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 122899us
W20260709 12:20:22.349718 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.357002 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:22.365281 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:22.330909 28059 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:22.370541 25125 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 8: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:20:22.371604 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.373371 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.375015 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 76150.7us
I20260709 12:20:22.347644 27909 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:22.380009 27909 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.380435 27909 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:22.382134 28075 consensus_queue.cc:1059] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:22.382381 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:22.379391 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1738) took 1148 ms. Trace:
I20260709 12:20:22.383080 28075 consensus_queue.cc:1243] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Peer b83c12959b9848b3b7bbc680f5ee6225 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:22.383884 27506 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:22.384543 28034 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:22.385087 28034 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:22.383309 25123 rpcz_store.cc:276] 0709 12:20:21.230835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.230998 (+   163us) service_pool.cc:224] Handling call
0709 12:20:21.231372 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:21.246343 (+ 14971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:21.246415 (+    72us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:21.868343 (+621928us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b2c00000c88. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:20:21.869732 (+  1389us) log.cc:844] Serialized 52 byte log entry
0709 12:20:22.036104 (+166372us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:22.036150 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.043455 (+  7305us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:22.378944 (+335489us) raft_consensus.cc:1685] finished
0709 12:20:22.378963 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:22.379210 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14384,"raft.queue_time_us":35942,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":42658,"spinlock_wait_cycles":6667136,"thread_start_us":157883,"threads_started":1,"wal-append.queue_time_us":197246}
I20260709 12:20:22.386093 28034 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:22.364763 27817 consensus_meta.cc:287] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.004s
I20260709 12:20:22.388933 27849 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.389891 25271 raft_consensus.cc:2368] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6.
I20260709 12:20:22.390484 27830 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:22.391129 27830 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:22.392447 27830 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:22.396119 28012 consensus_meta.cc:287] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.598s	user 0.005s	sys 0.010s
I20260709 12:20:22.398131 25270 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:22.398931 27895 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.399405 27895 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.401271 25196 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:22.365325 28044 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.413975 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:22.420727 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:22.422201 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 47727.9us
I20260709 12:20:22.427345 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:22.408555 27755 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:22.424221 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 239643us
I20260709 12:20:22.409893 27921 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.430631 25125 raft_consensus.cc:2368] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8.
I20260709 12:20:22.384352 27506 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:22.409322 27817 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:22.433292 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:22.436527 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:22.435861 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:22.432781 25120 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:22.436297 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:22.440956 25276 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:22.445008 25860 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:22.446331 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:22.448308 25272 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
W20260709 12:20:22.450811 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 162828us
I20260709 12:20:22.451707 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:22.451977 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:22.453195 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.454416 27885 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:22.454964 27817 consensus_queue.cc:1059] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:22.456277 27817 raft_consensus.cc:3055] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:22.456570 28061 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:22.456691 27817 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:22.457243 28061 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.458365 27909 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.458951 25852 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:22.459537 27848 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.460122 27848 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.460654 27909 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:22.454156 27894 consensus_queue.cc:1059] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:22.462327 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:22.462836 27894 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:22.463258 27894 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:22.463678 28061 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:22.464313 27894 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.467357 27894 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:22.462344 25127 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:22.470278 25859 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:20:22.471612 28049 consensus_meta.cc:287] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.669s	user 0.011s	sys 0.006s
I20260709 12:20:22.468827 25122 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:22.465587 27869 consensus_queue.cc:1059] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:22.167414 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:22.453929 25242 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:22.472414 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:22.438829 27506 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:22.483186 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 279628us
I20260709 12:20:22.493453 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:22.424387 28043 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.496196 25124 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:22.504012 25859 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:22.502473 25822 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:22.493727 27756 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.025s	sys 0.010s
I20260709 12:20:22.457890 27817 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.478806 28016 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.490166 28053 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:20:22.448138 27921 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.505463 27848 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:22.491298 28051 consensus_queue.cc:1059] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 12:20:22.543728 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 89882.6us
I20260709 12:20:22.547477 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:22.548418 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.541739 27756 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.026s	sys 0.011s
I20260709 12:20:22.491268 25023 catalog_manager.cc:5697] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 3 to 6, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 6 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:20:22.553511 25093 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:22.542922 27897 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.544381 28049 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:22.567145 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:22.554431 27748 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.769s	user 0.014s	sys 0.000s
I20260709 12:20:22.570866 25127 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:22.554337 27964 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:22.572904 28059 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:22.575464 27638 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:20:22.575595 27897 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.575984 28059 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.577876 27748 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.578307 27897 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:22.578768 25241 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:22.579339 28051 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:22.579804 28051 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.567183 27848 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:22.580307 28051 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:22.580386 27848 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:22.581012 27848 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:22.582124 27895 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:22.583820 27638 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:22.584437 27638 raft_consensus.cc:697] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:22.584470 28052 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.559800 27849 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:22.638237 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.589569 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.588323 25167 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:22.591611 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:22.651032 25165 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:22.569082 28049 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:22.589347 28093 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:20:22.650240 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 61979.9us
I20260709 12:20:22.644336 25241 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:22.657219 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 103820us
I20260709 12:20:22.659412 25269 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:22.574542 27817 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:22.663003 28049 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:22.637933 27748 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:22.644203 27897 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.592097 27784 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:22.668771 28098 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:20:22.667603 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 177289us
W20260709 12:20:22.668258 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 227964us
I20260709 12:20:22.670394 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:22.682374 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:22.694466 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 56502.8us
W20260709 12:20:22.687649 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 96170.2us
I20260709 12:20:22.618094 28012 raft_consensus.cc:3055] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:22.620817 27474 raft_consensus.cc:3055] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:22.585736 27623 consensus_queue.cc:1059] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.181s
I20260709 12:20:22.693560 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:22.720050 25093 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:22.707513 27474 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:22.723496 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:22.694972 27895 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:22.695662 28052 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:22.732741 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:22.704854 28012 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:22.693079 27784 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:22.736027 27885 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:22.736707 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:22.737629 27624 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:22.741297 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:22.732296 25858 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:22.616405 27638 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.755707 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:22.729691 27964 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:22.756037 27763 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:22.756774 28016 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:22.756533 27474 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.757154 25857 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:22.726864 28043 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:22.776719 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:22.777544 25853 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:20:22.704454 27897 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.764532 25822 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:22.746083 27784 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:22.748333 27624 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.760979 27748 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:22.765705 27763 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.796411 27756 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:22.756553 27885 raft_consensus.cc:697] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:22.776166 28053 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:22.796030 27964 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:22.803224 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 87081us
I20260709 12:20:22.800976 25168 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:22.804090 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 67580.1us
I20260709 12:20:22.793545 27624 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:22.792524 27921 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:22.803957 27763 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:22.827443 28103 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:20:22.828794 27942 consensus_meta.cc:287] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.008s
I20260709 12:20:22.822202 28012 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:22.833774 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 154645us
I20260709 12:20:22.846343 25093 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:22.849753 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 84503.3us
I20260709 12:20:22.834299 28053 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:22.853350 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.838769 27474 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:22.835083 27895 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:22.866309 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:22.866798 25269 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:22.867014 25856 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:22.864390 28012 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:22.874364 28086 log.cc:927] Time spent T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.725s	user 0.003s	sys 0.003s
I20260709 12:20:22.857098 28053 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.884167 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:22.884766 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 92495.5us
I20260709 12:20:22.886801 25242 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:22.888509 27897 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:22.909896 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:22.906935 25165 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:22.895757 28034 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:22.900534 25853 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:22.902144 28104 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:22.906260 25273 raft_consensus.cc:1240] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:22.909456 27896 raft_consensus.cc:3055] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:22.860536 27942 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:22.912972 25241 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:22.910429 28053 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:22.920404 25267 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:20:22.922256 25241 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:22.923949 25165 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:22.930217 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 43482.9us
I20260709 12:20:22.915387 27896 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:22.933530 28052 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:22.933836 27758 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:22.933609 27942 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.937448 25241 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:22.931859 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:22.934172 28052 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.932117 27869 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:22.925032 27748 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:22.941012 27895 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.941880 28109 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.930517 28098 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:20:22.942382 27964 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:22.942633 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:22.942858 28113 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.916697 27885 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.922631 27897 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:22.921233 28111 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:22.934484 27758 raft_consensus.cc:697] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:22.935915 28104 raft_consensus.cc:697] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:22.938828 27817 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:22.919660 28051 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.953207 28052 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:22.950649 27638 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:20:22.978906 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 47662us
I20260709 12:20:22.978420 28110 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:22.951921 27748 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:22.970191 25023 catalog_manager.cc:5697] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:22.967761 27897 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:22.988689 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 154077us
I20260709 12:20:22.987962 25165 leader_election.cc:400] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6.
I20260709 12:20:22.990713 25165 leader_election.cc:403] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:22.943426 27896 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.978243 28116 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:20:22.944818 27756 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:20:22.979808 27817 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.989333 27830 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.989974 27748 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:22.971220 27848 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.993589 27897 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:23.009085 28112 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:20:23.020494 27896 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:22.974939 28109 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.022567 27847 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.022950 28092 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.805s	user 0.003s	sys 0.000s
I20260709 12:20:23.022847 28109 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.023171 27847 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:22.998076 28016 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.024960 28016 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.023171 28110 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.026846 28110 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.027266 28116 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:23.028345 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.029417 28110 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.030014 25202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2123) took 1123 ms. Trace:
I20260709 12:20:23.030453 28016 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:23.030403 25202 rpcz_store.cc:276] 0709 12:20:21.906684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.906843 (+   159us) service_pool.cc:224] Handling call
0709 12:20:21.907322 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:21.908136 (+   814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:21.908180 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:21.908833 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 12:20:22.038122 (+129289us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:22.038156 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.038219 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:23.022280 (+984061us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:23.029563 (+  7283us) raft_consensus.cc:1685] finished
0709 12:20:23.029585 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.029956 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12817,"raft.queue_time_us":181074,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":35418,"spinlock_wait_cycles":52891392,"thread_start_us":128775,"threads_started":1,"wal-append.queue_time_us":308586}
I20260709 12:20:22.984150 28113 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.035425 28113 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:22.998507 27638 raft_consensus.cc:697] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:23.004436 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:22.970312 27869 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:22.994371 28098 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.011715 28114 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:23.008906 28104 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.010504 28071 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:23.002017 27817 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:23.025772 27847 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.066874 27748 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:23.070783 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 113723us
I20260709 12:20:23.047851 28109 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:23.078388 25858 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:23.081574 27848 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.082437 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.083336 28055 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:23.077487 28059 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.084448 28044 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.087819 25025 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33480 (request call id 269) took 9114 ms. Trace:
W20260709 12:20:23.089223 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 126687us
I20260709 12:20:23.084085 28055 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.073681 28071 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.014629 27830 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.116921 25023 catalog_manager.cc:5697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 4 to 6, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.132023 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:23.126808 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.135773 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:23.132040 27894 consensus_meta.cc:287] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.650s	user 0.012s	sys 0.000s
I20260709 12:20:23.128662 28071 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:23.136739 27755 consensus_meta.cc:287] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.699s	user 0.005s	sys 0.010s
I20260709 12:20:23.162187 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.164716 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:23.167138 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 233067us
I20260709 12:20:23.169088 25202 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:23.096794 27758 consensus_queue.cc:237] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.169088 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.143182 27942 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.150516 28114 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.174495 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.142594 28075 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.121197 28098 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.130425 28109 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.182107 25273 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:20:23.195683 25273 pending_rounds.cc:85] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 2
I20260709 12:20:23.189843 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.196717 25199 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
W20260709 12:20:23.190546 28118 log.cc:927] Time spent T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:20:23.191150 25023 catalog_manager.cc:5697] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 2 to 4, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:23.192278 25825 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:23.192467 27942 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.194446 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.199713 25193 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:23.195753 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:23.183943 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.196231 25273 pending_rounds.cc:107] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:20:23.236402 25273 raft_consensus.cc:2889] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:23.182999 28101 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:23.246673 25201 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:23.195660 28051 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.322221 28120 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:23.322412 27990 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.011s	sys 0.005s
I20260709 12:20:23.237047 28117 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:23.322992 28121 log.cc:927] Time spent T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:20:23.233623 28114 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.233422 27925 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.197144 27847 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.231249 27506 consensus_meta.cc:287] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.735s	user 0.004s	sys 0.008s
I20260709 12:20:23.335738 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.350296 28129 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.170329 27638 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.354328 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.354732 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:23.359479 25193 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:23.325353 27755 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:20:23.342098 27990 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.011s	sys 0.005s
I20260709 12:20:23.088266 25025 rpcz_store.cc:276] 0709 12:20:13.973559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.973753 (+   194us) service_pool.cc:224] Handling call
0709 12:20:23.087614 (+9113861us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:15.122666 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:15.183749 (+ 61083us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:15.183805 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:20:15.183833 (+    28us) tablet.cc:662] Decoding operations
0709 12:20:15.275085 (+ 91252us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:15.292150 (+ 17065us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:15.293237 (+  1087us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:20:15.313883 (+ 20646us) tablet.cc:701] Row locks acquired
0709 12:20:15.313939 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:20:15.314164 (+   225us) write_op.cc:270] Start()
0709 12:20:15.314313 (+   149us) write_op.cc:276] Timestamp: P: 1783599615314090 usec, L: 0
0709 12:20:15.314333 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:20:15.398601 (+ 84268us) log.cc:844] Serialized 8191 byte log entry
0709 12:20:16.044418 (+645817us) op_driver.cc:464] REPLICATION: finished
0709 12:20:17.661909 (+1617491us) spinlock_profiling.cc:243] Waited 71 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2100e040ac 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2107944ef0
0709 12:20:18.483829 (+821920us) write_op.cc:301] APPLY: starting
0709 12:20:18.518045 (+ 34216us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:18.699955 (+181910us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:18.707489 (+  7534us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:20.136037 (+1428548us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b5c001d2d0c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f210a100331 00007f210a100221 00007f210a0faf6c 00007f210785b30b 00007f210785afd3 00007f2107959e34 00007f210794597c 00007f2107949d61 00007f2107949d19 00007f2107949ca9 00007f2107949c71
0709 12:20:20.137126 (+  1089us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:20.137522 (+   396us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:20:20.137572 (+    50us) write_op.cc:312] APPLY: finished
0709 12:20:20.153722 (+ 16150us) log.cc:844] Serialized 139 byte log entry
0709 12:20:20.402783 (+249061us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:20.452691 (+ 49908us) write_op.cc:454] Released schema lock
0709 12:20:20.461633 (+  8942us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:20.477789 (+ 16156us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:20.477826 (+    37us) write_op.cc:454] Released schema lock
0709 12:20:21.602300 (+1124474us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
Metrics: {"mutex_wait_us":160,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":2424209,"apply.run_cpu_time_us":46306,"apply.run_wall_time_us":2002119,"num_ops":20,"prepare.queue_time_us":102602,"prepare.run_cpu_time_us":36955,"prepare.run_wall_time_us":389156,"raft.queue_time_us":301336,"raft.run_cpu_time_us":124244,"raft.run_wall_time_us":2735803,"replication_time_us":598042,"spinlock_wait_cycles":188734848,"thread_start_us":2944436,"threads_started":5,"wal-append.queue_time_us":428749,"wal-append.run_cpu_time_us":103761,"wal-append.run_wall_time_us":3338278}]]}
I20260709 12:20:23.353752 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.358202 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:23.187665 27763 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.365787 27830 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.187438 28049 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.228225 27784 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.377343 25202 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:23.379590 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.226531 28075 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:23.380530 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 188296us
I20260709 12:20:23.346891 25023 catalog_manager.cc:5697] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 reported cstate change: config changed from index 3 to 4, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193), VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194), VOTER 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195), VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 5 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.322340 27942 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:23.376422 27624 consensus_meta.cc:287] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.001s
I20260709 12:20:23.394999 25199 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:23.370060 27755 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:23.402231 25274 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:23.408851 25023 catalog_manager.cc:5697] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.411060 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:23.410854 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.412071 25202 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:23.413123 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.413812 25202 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:23.418264 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.419067 25194 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:23.392179 27748 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.359522 27506 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.429750 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:23.407536 27755 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:23.351874 28120 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.388780 27847 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.376433 28117 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.400504 27624 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.387846 27925 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.440675 25023 catalog_manager.cc:5697] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 2 to 4, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 4 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.378746 28129 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.471328 28120 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.472375 28129 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:23.472749 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:23.473284 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:23.449530 28117 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.449533 27624 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.450762 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.450331 28130 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:23.454119 28056 raft_consensus.cc:3055] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:23.454396 28109 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.494313 28109 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:23.495020 28109 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.440694 28127 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:23.498252 28098 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.458892 28114 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.488651 28139 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:23.499814 28139 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.501853 27763 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:23.457803 28052 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.501976 28139 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.489027 28136 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:23.460584 27942 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:23.461067 25196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2121) took 1486 ms (client timeout 1718 ms). Trace:
I20260709 12:20:23.464138 27925 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.464378 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.464825 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:23.465091 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.466362 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:23.515807 25195 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:23.516093 25200 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:23.467859 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.516928 25272 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:23.469723 25242 leader_election.cc:400] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8.
I20260709 12:20:23.470302 28037 raft_consensus.cc:3055] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:23.449805 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:23.475896 25121 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:23.485180 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:23.460611 27784 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:23.488579 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:23.484635 28056 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:23.489296 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:23.490796 25124 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:23.491411 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.492144 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.492061 27897 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.493052 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:23.510154 25196 rpcz_store.cc:269] 0709 12:20:21.974199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.976903 (+  2704us) service_pool.cc:224] Handling call
0709 12:20:22.099691 (+122788us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b5800211b98. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9b71 00007f2100de9eee 000000000036eb39 00007f2108e5d1e0 00007f2108f260c4 00007f2108f26131 00007f2108ed40a0 00007f2108ed3984 00007f210244e6d4 00007f210244e662
0709 12:20:23.460880 (+1361189us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54000b1dd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:23.460979 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633433600}
I20260709 12:20:23.504321 25023 catalog_manager.cc:5697] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 4 to 7, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 7 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.517915 25242 leader_election.cc:403] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:20:23.520385 25858 raft_consensus.cc:2410] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:23.445290 27748 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:23.509052 28136 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.529546 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.530649 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.499819 27506 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.507969 28052 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.446857 28051 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:23.507817 28053 consensus_meta.cc:287] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.000s
I20260709 12:20:23.530821 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.503454 28120 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.497825 28109 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.546952 25822 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:23.550793 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 101061us
W20260709 12:20:23.552063 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 82504.4us
I20260709 12:20:23.548653 25853 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:23.564445 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:23.565634 25271 raft_consensus.cc:2368] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8.
I20260709 12:20:23.565456 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.564746 25195 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:23.562623 25023 catalog_manager.cc:5697] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 2 to 5, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 5 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.570266 28114 consensus_queue.cc:1059] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:23.538522 28138 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:23.571403 28114 raft_consensus.cc:3055] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:23.571193 28138 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.571758 28120 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.573527 28138 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:23.575001 28122 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.378s	user 0.002s	sys 0.002s
I20260709 12:20:23.575059 28139 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.575785 28139 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.576395 25121 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:23.577361 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.507877 28129 consensus_queue.cc:1059] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:20:23.518976 28037 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:23.577916 25121 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:23.589174 25126 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:23.580956 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:23.570151 27755 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.585892 27897 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.580471 25023 catalog_manager.cc:5697] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:20:23.624856 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.625582 25121 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:23.550091 28117 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.627416 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 63022.3us
I20260709 12:20:23.556190 27847 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.568208 28052 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.503404 28071 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.551534 27921 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8.
I20260709 12:20:23.563083 28130 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:23.571775 28114 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:23.636256 25200 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:23.554711 28136 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.558341 27748 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.573915 28120 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.577872 28139 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.640805 25023 catalog_manager.cc:5697] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 5, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 5 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.642448 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.643477 25193 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:23.644038 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.644332 25860 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:23.568378 28053 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.642009 27990 raft_consensus.cc:3055] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:23.721745 27990 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:23.722507 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.587304 28132 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.662245 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:23.723811 28132 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.724439 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.725293 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:23.555168 28051 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.645251 27897 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:20:23.642519 27638 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:23.671060 28101 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6.
I20260709 12:20:23.648093 28052 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.671754 28061 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:23.673503 28053 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.553220 28056 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.637126 28037 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.676214 25242 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:23.677042 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:23.673779 28049 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.681665 25241 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:23.682129 28126 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.682528 27994 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:23.684010 28071 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.690855 27945 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:23.693002 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:23.694190 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:23.695051 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:23.696996 28043 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:23.698119 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.698470 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:23.699623 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:23.700537 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:23.701239 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:23.702255 27784 raft_consensus.cc:3055] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:23.703960 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:23.706327 25165 leader_election.cc:400] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8.
I20260709 12:20:23.706679 28138 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:23.708009 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:23.656370 25023 catalog_manager.cc:5697] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 1 to 3, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.714274 27748 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.715863 25195 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:23.716023 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:23.716784 25202 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:23.717041 25199 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:23.718827 25852 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:23.720127 27474 consensus_meta.cc:287] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.860s	user 0.009s	sys 0.001s
I20260709 12:20:23.720863 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:23.905968 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 224352us
I20260709 12:20:23.722450 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:23.736366 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:23.665740 27817 consensus_meta.cc:287] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.002s
I20260709 12:20:23.916450 27817 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.902818 27945 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:23.918568 27817 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:23.661664 28034 consensus_meta.cc:287] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.003s
I20260709 12:20:23.900565 27994 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.919440 27994 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:23.922691 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.923122 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.923563 25202 raft_consensus.cc:2393] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:23.924353 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.924911 27869 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.925433 25124 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:23.926389 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:23.926789 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:23.926968 25118 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:23.927577 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:23.928144 25124 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:23.924932 25193 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:23.930272 28061 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.932070 25194 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:23.932937 28061 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:23.933724 28037 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:23.934847 27897 consensus_queue.cc:1243] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:20:23.936616 25270 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:23.938359 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.938925 25270 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:23.939813 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.941669 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.944324 27869 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.944903 27869 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.944003 25270 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:23.792524 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.946520 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:23.947474 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 271336us
I20260709 12:20:23.729298 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:23.901399 25165 leader_election.cc:403] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:20:23.951704 25125 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:23.787036 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.952698 25272 raft_consensus.cc:2410] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:20:23.797858 25269 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:23.729377 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:23.733438 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 143471us
I20260709 12:20:23.903354 25854 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:23.903784 25196 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:23.902385 25853 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:23.900628 25122 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:23.721793 25276 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:23.722944 27990 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:23.909116 25119 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:20:23.956583 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 250358us
I20260709 12:20:23.954319 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:23.958452 25121 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 5: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:23.795313 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:23.910396 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.906706 25268 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:23.915678 28098 consensus_queue.cc:1059] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:23.951226 25023 catalog_manager.cc:5697] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 3 to 7, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 7 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.960028 25273 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:23.962697 25090 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:23.963196 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:23.965655 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:23.964500 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:23.963956 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 57315us
I20260709 12:20:23.973052 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:23.973899 25853 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:23.973261 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.974720 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.959945 25275 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:23.978659 25860 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:23.980046 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:23.981225 25200 raft_consensus.cc:2410] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:20:23.984390 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.975390 25276 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:23.729221 28132 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:23.796188 28039 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:23.988227 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:23.982385 25197 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
W20260709 12:20:23.999675 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 164218us
I20260709 12:20:24.000174 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:23.654548 28117 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.977432 25090 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:24.004820 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:23.998977 25851 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:24.005637 25268 raft_consensus.cc:2410] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:24.009441 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.010244 25196 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:23.730746 28055 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.996031 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:23.975641 25023 catalog_manager.cc:5697] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 2 to 3, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 3 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.904943 27784 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:23.929678 27945 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.001650 25127 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:23.997006 27990 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:23.999055 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:23.955485 27817 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:23.996518 25273 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: []
W20260709 12:20:24.012320 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 47895.7us
I20260709 12:20:23.968068 28136 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:23.969018 28137 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:24.013981 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:23.985175 25121 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:23.983678 28120 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.034593 28044 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:24.048086 28120 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.988605 28129 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:24.054385 25854 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:24.054517 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:24.052841 25125 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:24.057163 25126 raft_consensus.cc:2410] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:20:24.016553 25090 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:23.982601 28049 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:20:24.001892 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:23.950562 28043 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:23.973970 27921 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:23.997814 28053 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:24.018154 27763 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:24.019506 28127 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:24.027591 28051 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:24.083709 27869 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:24.044340 27474 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:20:24.053505 28136 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.040179 25853 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:24.086176 28136 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:23.986066 27506 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:24.073179 28098 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:24.086767 27506 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:24.076263 28053 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.046897 27803 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:24.087275 27506 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:24.087411 25269 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:24.047108 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:24.047245 28138 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:24.090322 25851 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:24.090096 27994 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.087414 28053 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:24.044399 25122 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:24.050158 25124 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:23.975817 28113 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:20:24.057339 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:24.052054 25093 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:24.050375 25120 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:24.058395 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.095412 25860 raft_consensus.cc:2393] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:24.061653 25121 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:24.097651 25851 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:24.103449 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2272) took 1698 ms. Trace:
I20260709 12:20:24.103854 25123 rpcz_store.cc:276] 0709 12:20:22.405017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.405145 (+   128us) service_pool.cc:224] Handling call
0709 12:20:22.423730 (+ 18585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.435945 (+ 12215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.435976 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:22.461581 (+ 25605us) log.cc:844] Serialized 26 byte log entry
0709 12:20:23.013582 (+552001us) spinlock_profiling.cc:243] Waited 899 us on lock 0x7b180033d840. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100def2a6 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9
0709 12:20:23.671416 (+657834us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b180033d840. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae0d1 00007f2103ec9a0f
0709 12:20:24.012795 (+341379us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:24.012832 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.012897 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.103274 (+ 90377us) raft_consensus.cc:1685] finished
0709 12:20:24.103291 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.103398 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16856,"raft.queue_time_us":8751,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5500,"spinlock_wait_cycles":26978944,"thread_start_us":341208,"threads_started":1,"wal-append.queue_time_us":1611225}
I20260709 12:20:24.016005 25118 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:23.958627 28126 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.048074 28044 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:24.053345 28129 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.079376 25119 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:20:24.081566 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 85654.9us
I20260709 12:20:24.131253 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:24.086828 28043 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:24.101910 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 85408.9us
I20260709 12:20:23.735033 28114 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.049968 27896 consensus_queue.cc:1059] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:20:24.018563 28039 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.081976 27763 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:20:24.136755 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 84772us
I20260709 12:20:24.104852 28109 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.141014 25125 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:20:24.096985 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:24.104518 28034 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.135725 27758 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.153782 28043 raft_consensus.cc:3055] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:24.109405 28051 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:24.153293 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:24.186287 25093 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:24.133721 28129 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:24.131609 28044 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:24.200390 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.164752 28120 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:24.162578 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 125063us
I20260709 12:20:24.137583 28113 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:24.139485 27869 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:24.140465 27763 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:24.139369 27994 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:24.152272 28066 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:24.152415 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 138950us
I20260709 12:20:24.182039 28043 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:24.164022 25855 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:24.222343 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 82143.6us
I20260709 12:20:24.080849 27784 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.194195 28052 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:24.115602 28098 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.195642 28123 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:24.182816 28117 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:24.215286 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 138741us
I20260709 12:20:24.163223 27474 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:20:24.189304 28037 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:24.185163 28051 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:24.212553 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:24.236646 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 83306.9us
I20260709 12:20:24.160588 28109 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:24.229378 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.223351 25274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 871) took 1337 ms (client timeout 1509 ms). Trace:
I20260709 12:20:24.206454 27849 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.238191 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.239048 25275 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:24.210629 28113 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:24.252121 25121 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:24.181687 28034 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.223235 28101 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:20:24.236902 28123 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.258579 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:24.245226 25274 rpcz_store.cc:269] 0709 12:20:22.875921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.876089 (+   168us) service_pool.cc:224] Handling call
0709 12:20:24.212761 (+1336672us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400027e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:24.212899 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135686912}
I20260709 12:20:24.249054 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:24.258647 25124 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:24.183342 27758 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.258811 28123 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:24.242859 28051 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:24.267706 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.303524 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.289556 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.302616 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:24.304208 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 94430.2us
I20260709 12:20:24.305431 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:24.305652 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:24.306241 25119 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:24.306311 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:24.308607 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.253746 27784 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:24.250561 27869 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.309460 25275 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
W20260709 12:20:24.327028 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 86782.4us
I20260709 12:20:24.327121 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:24.330142 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:24.330365 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:24.330731 25199 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:24.333735 28066 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.334296 28066 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.336685 28066 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:24.338284 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:24.339480 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:24.340031 25199 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:24.341020 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:24.341464 25121 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:20:24.341769 25199 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:24.342549 25121 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:24.344023 25121 pending_rounds.cc:85] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 1
I20260709 12:20:24.344349 25121 pending_rounds.cc:107] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:20:24.344632 25121 raft_consensus.cc:2889] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:24.352645 25202 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:24.353984 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:24.352488 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:24.357676 25200 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 7: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:24.358898 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:24.360085 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:24.367506 25822 leader_election.cc:336] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Timed out: RequestConsensusVote RPC to 127.23.81.195:44749 timed out after 1.509s (SENT)
I20260709 12:20:24.368031 25822 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:24.369632 28055 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:24.370586 25123 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 7: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:24.360756 25274 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:24.380646 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.327296 27897 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:24.307652 28156 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:24.262307 28120 consensus_queue.cc:1059] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 12:20:24.255509 27849 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.414748 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:24.400360 25196 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:20:24.347023 27803 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:24.404933 25275 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:24.403908 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:24.421758 25202 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
W20260709 12:20:24.422605 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.410398 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.373172 27756 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:20:24.426215 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 103602us
I20260709 12:20:24.429984 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:24.431671 25241 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:24.393318 27994 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.393016 27990 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:24.357831 27869 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.459182 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:24.420003 28055 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.442687 25124 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:20:24.452642 25195 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:24.419739 28098 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:24.466316 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.471789 25275 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:24.465705 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:24.470840 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:24.480014 25196 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:24.426759 27474 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:24.482442 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:24.461753 28133 log.cc:927] Time spent T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 1.036s	user 0.005s	sys 0.000s
I20260709 12:20:24.354980 28043 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.483753 25274 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:24.420888 28129 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.487560 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:24.490882 28120 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:24.461687 27994 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:24.494959 28160 log.cc:927] Time spent T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:20:24.495343 28164 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:24.495725 27474 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:24.496948 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 67021.8us
I20260709 12:20:24.498198 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:24.527264 25825 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:24.527735 25275 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:24.401283 28113 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.523057 27897 raft_consensus.cc:697] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:24.465936 28053 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:24.526208 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 111524us
I20260709 12:20:24.488545 27756 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:24.531556 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.534198 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:24.484637 27990 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.540962 25196 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:24.542320 25274 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:24.543051 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:24.523797 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 92217.9us
I20260709 12:20:24.536460 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:24.539482 25093 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:24.529650 28043 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:24.547863 25093 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:24.531306 27896 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:24.549314 25093 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:24.491721 28044 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.533102 27849 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:24.552894 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:24.543336 27756 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:24.506472 28055 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:24.585198 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.566378 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.552451 28155 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:20:24.612855 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60052.3us
I20260709 12:20:24.552112 28066 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:24.551167 28137 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8.
I20260709 12:20:24.560415 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.559986 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.552656 28113 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:24.623879 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:24.624366 25854 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:24.550336 28166 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:24.559507 27849 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:24.554808 28034 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:24.627935 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2128) took 1451 ms. Trace:
I20260709 12:20:24.628698 25196 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:24.607728 27756 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:24.659162 25199 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:24.634356 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.655884 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:24.641551 25193 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:24.662520 25275 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:24.678547 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:24.556943 27896 raft_consensus.cc:697] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:24.637856 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.632432 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.551445 28156 raft_consensus.cc:697] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:24.663287 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:24.535302 28164 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.627736 28175 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:24.673441 25198 rpcz_store.cc:276] 0709 12:20:23.176797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.176910 (+   113us) service_pool.cc:224] Handling call
0709 12:20:23.177330 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:23.190379 (+ 13049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.190412 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:23.190927 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:20:23.397192 (+206265us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:23.397250 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.397342 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.369762 (+972420us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:24.560846 (+191084us) raft_consensus.cc:1685] finished
0709 12:20:24.560877 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.627863 (+ 66986us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146400,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":7987072,"thread_start_us":205819,"threads_started":1,"wal-append.queue_time_us":179332}
I20260709 12:20:24.670897 27849 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:24.701936 27849 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:24.703457 27763 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:24.697764 27506 consensus_meta.cc:287] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.005s
I20260709 12:20:24.705406 27506 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.710711 27506 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:24.676776 25853 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:20:24.711257 27849 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.712327 25859 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:24.712990 25274 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:24.714845 27849 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:24.715188 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:24.715797 25855 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:24.717192 25855 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:24.680778 27897 consensus_queue.cc:237] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.631313 28075 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:24.666600 28174 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:20:24.688593 27869 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:24.723016 28174 consensus_queue.cc:1243] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:24.614140 28176 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:24.689659 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.628188 28172 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:24.676287 27638 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:24.696044 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:24.728149 25275 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:24.648483 27994 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:24.730159 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 200953us
I20260709 12:20:24.730952 25269 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:24.639056 28039 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:24.647365 28053 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:24.695700 27990 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:24.699083 28171 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:24.700003 28129 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:24.700322 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:24.671839 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:24.778431 25275 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
W20260709 12:20:24.778995 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 107236us
W20260709 12:20:24.779889 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 79635us
I20260709 12:20:24.780733 25822 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:24.780998 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:24.705983 27756 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.706553 25276 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:24.708549 27763 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:24.708819 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.712212 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:24.783985 25242 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:24.626932 28066 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.685674 28123 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:24.826004 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 172847us
W20260709 12:20:24.745316 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.616940 28168 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:20:24.762815 25267 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:24.765496 28164 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:24.695986 28166 raft_consensus.cc:697] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:24.725679 28176 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:24.786840 25273 raft_consensus.cc:2393] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 6: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:24.788949 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.800736 25822 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:24.826148 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.738055 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.826942 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:24.836454 25853 raft_consensus.cc:2368] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:24.829557 25168 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:24.829453 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:24.785660 28175 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:24.783054 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:24.838574 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.840063 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:24.825506 27869 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:24.843677 25198 raft_consensus.cc:2393] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:24.824335 27994 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:24.827922 28066 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:24.844681 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:24.824564 28177 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:24.846101 25168 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:24.736869 27638 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.848744 25119 raft_consensus.cc:2368] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:24.840775 28012 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:24.854271 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 72256.6us
I20260709 12:20:24.849009 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:24.830338 28129 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:24.857530 25853 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:24.844305 28175 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.833710 28176 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:24.859539 28175 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:24.860178 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:24.861600 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:24.862282 25853 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:24.863458 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:24.864765 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:24.839795 28039 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:24.847299 27869 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.870800 25273 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:24.850085 27994 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:24.850404 27474 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:24.854982 28177 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.877962 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:24.881245 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:24.882052 25267 raft_consensus.cc:2368] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
I20260709 12:20:24.883515 28166 consensus_queue.cc:237] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.884723 27921 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.885172 27921 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:24.894111 25270 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:24.895422 28175 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.897549 28175 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:24.876127 27869 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:24.872849 28055 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:24.875765 28012 raft_consensus.cc:697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:24.878341 27994 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:24.876896 28044 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:24.915848 28012 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.866477 28156 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.903564 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:24.881284 28177 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:24.924013 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:24.925143 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:24.905886 25198 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:20:24.922477 25857 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:24.927574 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:24.928166 25199 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:24.927628 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:24.930078 25242 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:24.931067 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:24.931643 25853 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:24.931936 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:24.858194 27896 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.934973 25196 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:24.934427 28187 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:24.935729 28187 raft_consensus.cc:697] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:24.936040 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:24.936651 28187 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.937345 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:24.935005 25123 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:24.938308 27885 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:20:24.939327 27885 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:24.939460 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:24.939716 27885 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:24.940932 25123 pending_rounds.cc:85] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 5
I20260709 12:20:24.940635 27885 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.941191 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:24.938265 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:24.942123 25121 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:24.942507 27756 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:24.942576 25198 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:24.944279 28051 consensus_meta.cc:287] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.003s
I20260709 12:20:24.944723 28051 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.941216 25123 pending_rounds.cc:107] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:20:24.941746 27885 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:24.947494 25123 raft_consensus.cc:2889] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:24.937913 25196 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:24.956600 25121 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:24.957821 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:24.892179 28129 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:20:24.914160 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:24.922820 28175 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:20:24.963385 28051 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:24.965967 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:24.970999 27869 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.973446 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:24.975360 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:24.977840 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:24.978483 25121 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:24.977245 25242 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:24.960681 27784 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:24.982391 25199 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:24.976353 28043 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:24.985803 27869 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:24.985735 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:24.986380 28113 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:24.987057 27638 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:24.987351 28066 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:24.987792 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:24.988674 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:25.005285 25196 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:24.989094 27994 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:24.900128 28039 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.001338 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:25.003574 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.010210 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:25.014334 28139 raft_consensus.cc:3055] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:25.014909 28139 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:25.015940 28139 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:25.021463 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:25.021654 27921 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.022466 25119 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:25.016008 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.034749 25121 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:25.036149 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:25.036978 25121 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:25.038350 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:25.039757 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:25.040277 25241 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:25.062109 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.007431 28113 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:25.062624 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:25.065232 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 66144.1us
I20260709 12:20:25.066344 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.037705 28044 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:25.042505 27869 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.016012 28123 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:25.073194 25860 raft_consensus.cc:2393] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:25.062186 28043 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.065837 28055 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:25.075132 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1102) took 1406 ms. Trace:
I20260709 12:20:25.086048 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:25.075918 27994 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:25.076704 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.088656 25859 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:25.089607 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:25.057888 27784 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:20:25.092162 28055 raft_consensus.cc:697] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:25.072369 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:25.057685 27756 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:20:25.074587 28189 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:20:25.085952 25852 rpcz_store.cc:276] 0709 12:20:23.668435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.678038 (+  9603us) service_pool.cc:224] Handling call
0709 12:20:23.678309 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.900854 (+222545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.074868 (+1174014us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b5400514ad4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:25.075050 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92787072}
I20260709 12:20:25.096241 28055 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.097919 25196 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:25.100467 25092 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.103736 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:25.102350 28113 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.065737 28168 consensus_queue.cc:1059] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:20:25.061990 27638 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 12:20:25.108435 28190 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:20:25.108630 28066 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:25.086406 28175 consensus_queue.cc:1059] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:20:25.110819 28175 raft_consensus.cc:3055] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:25.111171 28175 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:25.104244 25196 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:25.077988 27964 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:20:25.011621 28176 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.102250 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.104821 28044 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:25.122627 27869 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:25.123039 27869 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:25.104534 28177 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.114025 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:25.125591 25121 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 2: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:25.115615 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:25.116410 25855 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:25.112671 27756 raft_consensus.cc:697] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:25.121583 28012 raft_consensus.cc:3055] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:25.134114 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.112839 25092 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:25.126190 25119 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:25.136703 25852 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:25.127998 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:25.137769 25196 raft_consensus.cc:2393] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:25.138252 25852 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:25.139159 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:25.129190 25197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2134) took 1779 ms (client timeout 2082 ms). Trace:
I20260709 12:20:25.132341 27755 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:25.140758 25197 rpcz_store.cc:269] 0709 12:20:23.349972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.350123 (+   151us) service_pool.cc:224] Handling call
0709 12:20:25.129010 (+1778887us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54000415d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:25.129119 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406336384}
I20260709 12:20:25.136602 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:25.143275 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:25.143723 25119 raft_consensus.cc:2393] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:25.144832 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:25.143051 28123 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:25.146561 28166 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:25.146955 28166 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.147317 28166 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:25.145720 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:25.152277 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.154778 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:25.135303 27869 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.143178 28175 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.159247 28175 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:25.162818 27756 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.134135 27994 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.163316 28176 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.157186 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:25.174677 25092 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:25.146955 27945 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:25.135280 28012 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:25.188335 28012 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.189568 28012 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:25.190362 27994 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.192765 27994 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:25.194211 27869 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:25.195096 25119 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:20:25.199178 28177 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.200649 25271 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:25.207732 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.166831 28123 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:25.212039 27506 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:25.232283 25195 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
W20260709 12:20:25.243431 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 110631us
I20260709 12:20:25.250102 28055 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:25.212260 28034 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:20:25.222983 27506 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:25.250275 25825 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:25.251456 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:25.259099 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:25.260422 25825 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:25.262837 25825 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:25.264792 25825 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:25.267956 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:25.268404 25121 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:20:25.260519 27994 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:25.269191 28129 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:25.266427 28059 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:25.266307 27964 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:25.272130 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1751) took 1640 ms. Trace:
I20260709 12:20:25.272346 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 880) took 1232 ms. Trace:
I20260709 12:20:25.272543 25125 rpcz_store.cc:276] 0709 12:20:23.631577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.081871 (+450294us) service_pool.cc:224] Handling call
0709 12:20:24.112906 (+ 31035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:24.141550 (+ 28644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.271864 (+1130314us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b54002ae754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:25.272068 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61398272}
I20260709 12:20:25.272799 25276 rpcz_store.cc:276] 0709 12:20:24.040153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.040296 (+   143us) service_pool.cc:224] Handling call
0709 12:20:24.053898 (+ 13602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:24.784225 (+730327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.272081 (+487856us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b5400123754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:25.272262 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1500396416}
W20260709 12:20:25.274144 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.259560 27506 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:25.277592 25853 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:25.279258 28166 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.287691 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:25.291039 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.288846 25825 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:25.262872 27755 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:25.299842 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:25.299950 25242 leader_election.cc:400] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:25.299247 28127 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:25.300822 28164 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:25.301018 28127 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.300359 27755 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.301445 28127 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:25.301682 27755 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:25.301766 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:25.303306 25126 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:25.289733 28166 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:25.306627 25120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1744) took 1871 ms (client timeout 2134 ms). Trace:
W20260709 12:20:25.307083 25120 rpcz_store.cc:269] 0709 12:20:23.435160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.435307 (+   147us) service_pool.cc:224] Handling call
0709 12:20:25.306383 (+1871076us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54001b76d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:25.306504 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088697600}
I20260709 12:20:25.308648 25120 raft_consensus.cc:1240] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:20:25.310252 28178 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.311121 27506 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.314376 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:25.315062 25276 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:25.315968 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:25.316525 25274 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:25.299245 25121 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:25.318506 25118 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:25.320068 27506 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.321228 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.322187 25855 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:25.321923 25852 raft_consensus.cc:2368] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8.
I20260709 12:20:25.300499 25242 leader_election.cc:403] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:25.264819 28197 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:25.327890 28164 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:25.330919 25092 leader_election.cc:400] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8.
I20260709 12:20:25.327399 28155 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:25.332844 25825 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:25.347219 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.345932 25092 leader_election.cc:403] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:25.347962 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:25.354204 25274 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:25.346916 28197 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:25.356499 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.357326 28197 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.359130 25194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 611) took 1894 ms. Trace:
I20260709 12:20:25.359508 25194 rpcz_store.cc:276] 0709 12:20:23.464692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.503465 (+ 38773us) service_pool.cc:224] Handling call
0709 12:20:23.931729 (+428264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.932398 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.358947 (+1426549us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54000a7650. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:25.359076 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984183680}
I20260709 12:20:25.360980 28126 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:25.362251 28178 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:25.362766 28178 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:25.363169 28114 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:25.363613 28178 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.335414 27758 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.357735 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.372704 25272 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:20:25.373862 28117 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:25.373914 28126 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8.
I20260709 12:20:25.375078 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:25.344134 28164 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:25.381289 28109 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:25.381189 28061 consensus_queue.cc:1059] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:25.382655 28061 consensus_queue.cc:1059] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:25.347996 28155 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:25.385866 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.374338 28117 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:25.386680 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:25.386148 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:25.385797 28116 raft_consensus.cc:3055] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:25.387457 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:25.334344 27885 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:20:25.390785 25269 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:25.391427 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:25.395769 25126 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:25.397185 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.398222 25851 raft_consensus.cc:2393] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:25.400103 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:25.400573 25274 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:25.403578 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.391019 28061 raft_consensus.cc:3055] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:25.389940 28116 raft_consensus.cc:740] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:25.377287 28113 consensus_queue.cc:1059] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:20:25.402199 28171 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:25.407014 28113 raft_consensus.cc:3055] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:25.406211 28061 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:25.413097 25119 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:20:25.420984 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.426726 25274 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:25.428066 28126 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.407425 28113 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:25.407241 28171 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:25.333321 28127 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.443322 28061 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.445106 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:25.458447 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1747) took 1970 ms. Trace:
W20260709 12:20:25.470078 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 624000us
I20260709 12:20:25.470235 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:25.471108 25274 raft_consensus.cc:2410] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:20:25.471843 25168 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:25.473047 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:25.460247 28162 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.460712 28129 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:25.461350 27755 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.462743 28113 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.407140 28116 consensus_queue.cc:260] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.463725 25200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2152) took 1081 ms. Trace:
I20260709 12:20:25.468477 25276 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:25.470480 25127 rpcz_store.cc:276] 0709 12:20:23.487816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.487949 (+   133us) service_pool.cc:224] Handling call
0709 12:20:23.488284 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:24.017539 (+529255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.458211 (+1440672us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b5400453154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:25.458388 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171332480}
I20260709 12:20:25.476227 25269 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:20:25.480695 25269 pending_rounds.cc:85] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 2
I20260709 12:20:25.481038 25269 pending_rounds.cc:107] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:20:25.481415 25269 raft_consensus.cc:2889] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:25.482833 27623 raft_consensus.cc:2764] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:20:25.483529 27623 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:25.483994 27623 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:25.484908 27623 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.486274 28101 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:25.486786 28101 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.488544 27921 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.488955 28101 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.490595 28171 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:25.490590 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:25.492686 25168 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:25.493000 28169 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.810s	user 0.002s	sys 0.001s
I20260709 12:20:25.481103 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:25.496227 25851 raft_consensus.cc:2368] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:25.500036 28098 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:25.502492 28153 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:25.503480 28113 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:25.504398 27755 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:25.499600 27624 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:25.506110 28178 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:25.506678 28178 raft_consensus.cc:697] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:25.507081 28052 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:25.508389 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:25.477102 28053 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:20:25.511479 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.439990 28126 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.519809 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:25.525650 25126 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 8: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:25.519397 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:25.522302 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.475454 28120 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:20:25.517675 25168 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:25.507534 28178 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.534693 25168 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:25.439604 28117 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.537045 28117 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:25.477391 28162 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.514662 28116 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:25.538487 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 883) took 1297 ms. Trace:
I20260709 12:20:25.516865 28061 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:25.513160 28098 raft_consensus.cc:697] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:25.532063 27758 consensus_queue.cc:1059] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:20:25.577170 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:25.516711 27624 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:25.546983 28053 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:25.549252 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2143) took 1229 ms. Trace:
I20260709 12:20:25.538347 28138 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:25.550196 27847 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:25.558214 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.559406 28158 raft_consensus.cc:3055] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:25.559809 28155 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.552706 25270 rpcz_store.cc:276] 0709 12:20:24.241056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.247512 (+  6456us) service_pool.cc:224] Handling call
0709 12:20:25.538312 (+1290800us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540002add4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:25.538428 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262867328}
W20260709 12:20:25.508350 28055 consensus_queue.cc:1175] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "897be935c42e41b995f177155b042be0" responder_term: 6 status { last_received { term: 6 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 6 index: 6 } }
I20260709 12:20:25.561082 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1768) took 1310 ms. Trace:
I20260709 12:20:25.562304 28126 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.563362 28056 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:25.592484 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:25.574839 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.592392 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:25.576942 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.579496 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:25.580212 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:25.586854 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:25.566615 28153 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.581559 25193 rpcz_store.cc:276] 0709 12:20:24.319487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.319600 (+   113us) service_pool.cc:224] Handling call
0709 12:20:25.549072 (+1229472us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54004123d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:25.549189 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701561216}
I20260709 12:20:25.590274 25118 rpcz_store.cc:276] 0709 12:20:24.250743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.250854 (+   111us) service_pool.cc:224] Handling call
0709 12:20:25.318179 (+1067325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.318884 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.560883 (+241999us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001b76d0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:25.561025 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2453991168}
I20260709 12:20:25.599243 25090 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.600800 25090 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.552417 28120 consensus_queue.cc:1243] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:25.585757 28138 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.642275 28138 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:25.602788 25194 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:25.646576 25092 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.647876 28117 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.650627 25269 raft_consensus.cc:2410] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:20:25.650691 27847 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.651362 27847 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.595512 25167 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:25.604259 28109 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:25.604641 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.604753 28206 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:25.604724 28044 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:25.603672 28153 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:25.606521 28211 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:20:25.658502 28153 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.606940 28071 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:25.660539 28053 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:25.663709 25118 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:25.607852 25090 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:25.611465 28210 log.cc:927] Time spent T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:20:25.612339 28212 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:20:25.628518 27885 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7.
I20260709 12:20:25.671482 25093 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:25.636055 27624 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:25.587724 28158 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:25.637331 28098 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:25.680308 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:25.681324 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.681715 25093 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:25.654228 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 58816.4us
I20260709 12:20:25.652638 28039 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.654752 28206 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.655318 27847 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.656155 28052 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:25.656572 28109 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.665174 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:25.695676 25118 raft_consensus.cc:2376] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5. Re-sending same reply.
I20260709 12:20:25.662441 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:25.635398 28155 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.672278 25194 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
W20260709 12:20:25.672037 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 64278.9us
I20260709 12:20:25.698961 25860 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:25.699662 25090 leader_election.cc:400] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
I20260709 12:20:25.700134 25090 leader_election.cc:403] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:20:25.599463 28126 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:25.700330 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1121) took 1269 ms. Trace:
I20260709 12:20:25.678504 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:25.700577 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:25.700698 25854 rpcz_store.cc:276] 0709 12:20:24.425519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.428415 (+  2896us) service_pool.cc:224] Handling call
0709 12:20:25.695030 (+1266615us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54008723d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:25.695177 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365859584}
I20260709 12:20:25.701095 25165 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:25.701278 25276 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:25.702041 25122 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:25.702142 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:25.702510 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:25.684378 25825 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:25.703073 25268 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:25.703387 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:25.704299 28101 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:25.704473 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.705118 25854 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:25.705395 28128 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:25.670572 28066 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:25.709196 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:25.710490 25854 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:25.713001 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:25.717938 25854 raft_consensus.cc:2410] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:20:25.719193 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:25.719856 25854 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:20:25.698660 28109 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:25.706061 28051 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.705890 28128 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:25.679839 28037 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:25.688196 28158 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:25.690739 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:25.731101 25859 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:25.676514 28044 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:25.676961 28120 consensus_queue.cc:1059] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:20:25.673660 27755 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:25.692626 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:25.733918 25852 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:25.674121 28153 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:20:25.697968 25271 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:25.702260 27623 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.686525 28039 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:25.707607 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.737890 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.736924 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.707909 25090 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:25.736972 25854 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:25.723115 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2188) took 1240 ms. Trace:
I20260709 12:20:25.740468 25275 rpcz_store.cc:276] 0709 12:20:24.482980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.780262 (+297282us) service_pool.cc:224] Handling call
0709 12:20:24.780536 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:24.826740 (+ 46204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:24.826774 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:24.826815 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:24.826849 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.722880 (+896031us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b54002be3d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:25.722931 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.723057 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105743104}
I20260709 12:20:25.709748 27964 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:25.694589 28206 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.709755 28126 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
I20260709 12:20:25.687112 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:25.683127 25167 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
W20260709 12:20:25.747583 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 64534.8us
I20260709 12:20:25.748294 25167 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:25.713390 28066 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.744906 25851 raft_consensus.cc:1240] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:20:25.730069 28037 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:25.746168 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:25.751915 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 44118.2us
I20260709 12:20:25.754699 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:25.759366 25854 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:25.760291 25090 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:25.736598 28158 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:25.768962 25859 raft_consensus.cc:2368] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7.
I20260709 12:20:25.742465 27623 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:25.770563 28215 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:20:25.771862 27623 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.762650 28052 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:25.772791 28052 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.773151 28052 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:25.761838 27624 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:25.762082 28044 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:25.775063 28044 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.762959 28037 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:25.786213 25854 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:25.744923 28012 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.743875 27964 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:25.791932 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 104892us
I20260709 12:20:25.799501 25853 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:20:25.793304 25852 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:25.773792 27624 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:25.749845 28116 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:25.783247 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 79289.7us
I20260709 12:20:25.685031 28138 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:25.803809 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.732092 28051 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.807953 25124 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:25.808161 25201 raft_consensus.cc:2368] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:25.808341 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:25.808941 25118 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:25.810375 25118 raft_consensus.cc:1240] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:25.810731 28138 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.811329 27885 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:25.811902 27885 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.812350 25168 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:25.814960 27885 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:25.815567 28138 consensus_queue.cc:1059] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:25.816640 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:25.817250 25118 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:25.816933 28226 consensus_queue.cc:1059] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:25.817934 25165 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:25.816792 28138 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:25.828915 25853 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:25.745038 28101 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:20:25.754901 28039 raft_consensus.cc:697] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:25.738226 27755 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.782179 28206 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:25.798761 28176 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:25.851245 28176 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:25.851661 28176 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:25.852751 27945 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:25.853156 27945 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.853538 27945 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:25.853286 28037 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:25.832968 25852 raft_consensus.cc:1240] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:25.802681 27964 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:25.818710 28034 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:20:25.834470 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:25.805254 27624 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:25.838667 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:25.840474 25275 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:25.818840 28214 consensus_queue.cc:1059] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:20:25.845050 25118 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:25.848742 28226 raft_consensus.cc:3055] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:25.849915 27755 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:25.850780 28206 raft_consensus.cc:697] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:25.892202 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:25.892875 25202 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:25.855847 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:25.895633 25197 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:25.896842 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:25.828771 28138 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.898684 28138 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:25.753826 28178 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:20:25.802251 28117 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:20:25.868742 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 107287us
I20260709 12:20:25.902643 28117 raft_consensus.cc:697] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:25.902912 25167 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:25.904081 25167 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:25.872725 25168 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:25.938648 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.939131 25197 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:25.940528 28178 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:25.824440 28128 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.882789 28226 raft_consensus.cc:740] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:25.944823 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:25.953493 25202 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:25.914551 28214 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:25.924425 28101 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:25.916847 27758 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:25.955298 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:25.891775 28120 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:20:25.915428 28049 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:25.959867 25197 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:25.975895 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:25.984453 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 68669.4us
I20260709 12:20:25.968187 28123 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.986053 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:25.986433 25167 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:25.951730 28178 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.990170 25093 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.972293 28214 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:25.979499 28197 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.992799 25193 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:25.993307 25093 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.996383 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:25.997705 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:25.952065 28039 consensus_queue.cc:237] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:26.001401 28221 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:20:26.003149 28227 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:20:26.003903 28220 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:20:26.004594 27945 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.005849 28037 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:26.006723 28223 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:26.014803 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:26.015079 28223 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.015527 28223 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:26.014803 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:26.016314 28056 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.016685 25193 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:26.016767 28056 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:25.990913 28123 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:26.018961 28052 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.013751 25202 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:26.020542 28123 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:26.021739 25202 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:26.026275 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:26.028002 25202 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:26.183761 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:25.972450 28049 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:26.047017 25197 raft_consensus.cc:2368] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7.
I20260709 12:20:25.994495 28034 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:26.027303 25825 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:26.008677 27755 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:20:26.215296 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:26.262130 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 234915us
I20260709 12:20:26.046756 28120 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:25.984934 28117 consensus_queue.cc:237] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:26.179440 28123 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.176783 28055 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:26.263098 27755 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.298166 27755 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:25.988458 28206 consensus_queue.cc:237] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.183239 27869 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.998894 28226 consensus_queue.cc:260] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.323258 28226 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:26.274454 28012 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:26.326591 28012 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.327060 28012 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:26.008955 28197 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.284565 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:26.336172 25273 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:26.345312 27885 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:26.285601 28061 consensus_meta.cc:287] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.008s
W20260709 12:20:26.461450 25121 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.016s	sys 0.051s
W20260709 12:20:26.461864 25121 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.016s	sys 0.051s
I20260709 12:20:26.286929 28056 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:26.289413 28158 consensus_meta.cc:287] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 12:20:26.290294 28214 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.294263 27945 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:26.283113 28231 log.cc:927] Time spent T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.274s	user 0.000s	sys 0.000s
I20260709 12:20:26.310916 28049 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:26.315091 27869 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.382869 25273 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:26.285226 28123 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:26.493372 25123 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.028s	sys 0.077s
W20260709 12:20:26.517746 25123 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.029s	sys 0.078s
W20260709 12:20:26.462080 28176 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.001s
I20260709 12:20:26.494566 25857 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:26.495719 25120 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:26.345969 27885 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:26.303584 28178 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:26.276348 28052 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:26.321781 28116 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:26.507820 28101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.040s	sys 0.033s
W20260709 12:20:26.495014 27847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.019s	sys 0.007s
W20260709 12:20:26.507073 28114 consensus_meta.cc:287] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 1.143s	user 0.009s	sys 0.004s
I20260709 12:20:26.531005 28176 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:26.566618 28197 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:26.589746 28232 log.cc:927] Time spent T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:20:26.565968 27755 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.624785 28176 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:26.568202 28123 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:26.601545 27624 consensus_meta.cc:287] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.000s
I20260709 12:20:26.626335 27624 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.628043 27755 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:26.629065 27624 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:26.579411 27869 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:26.589426 28109 consensus_meta.cc:287] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.863s	user 0.011s	sys 0.000s
I20260709 12:20:26.630213 28109 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:26.632179 28109 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:26.632786 25126 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:20:26.632543 28012 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:26.588286 28138 consensus_meta.cc:287] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.000s
I20260709 12:20:26.634271 28138 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.634637 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:26.635208 25267 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:26.636291 28138 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:26.593501 25167 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.026s	sys 0.036s
I20260709 12:20:26.594463 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:26.616066 27964 consensus_meta.cc:287] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.746s	user 0.011s	sys 0.000s
I20260709 12:20:26.618281 28168 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.637140 27964 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.637312 28168 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.597491 27885 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:26.638208 25854 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:26.613181 27847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.020s	sys 0.007s
I20260709 12:20:26.605343 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2194) took 1220 ms. Trace:
I20260709 12:20:26.639295 25274 raft_consensus.cc:2410] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:20:26.636888 25167 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.026s	sys 0.036s
W20260709 12:20:26.621722 28223 consensus_meta.cc:287] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.000s
I20260709 12:20:26.639521 25271 rpcz_store.cc:276] 0709 12:20:25.384813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.387219 (+  2406us) service_pool.cc:224] Handling call
0709 12:20:26.605120 (+1217901us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54002bedd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:26.605269 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679136512}
W20260709 12:20:26.640127 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 627469us
I20260709 12:20:26.626681 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:26.639238 27964 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:26.641148 25273 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:26.641906 25856 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:26.640405 28223 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.643318 25193 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:26.644543 28223 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:26.648092 25267 raft_consensus.cc:2410] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:20:26.666949 27885 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:26.667487 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 832) took 1754 ms. Trace:
I20260709 12:20:26.667770 27885 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.667968 25855 rpcz_store.cc:276] 0709 12:20:24.912590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.155834 (+243244us) service_pool.cc:224] Handling call
0709 12:20:25.187471 (+ 31637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.322638 (+135167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.667250 (+1344612us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54008bbfd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:26.667412 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258559744}
I20260709 12:20:26.670544 27885 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:26.671792 28066 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:26.672068 27921 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.672839 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 899) took 1159 ms. Trace:
I20260709 12:20:26.673337 25269 rpcz_store.cc:276] 0709 12:20:25.506146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.508148 (+  2002us) service_pool.cc:224] Handling call
0709 12:20:26.665282 (+1157134us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400418a54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:26.665463 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318869888}
I20260709 12:20:26.674948 27921 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:26.679648 25202 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: []
W20260709 12:20:26.609884 28101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.040s	sys 0.033s
I20260709 12:20:26.681473 25198 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 12:20:26.681564 25851 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.011s	sys 0.040s
I20260709 12:20:26.684229 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:26.685977 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:26.683334 25851 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.011s	sys 0.040s
I20260709 12:20:26.687582 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:26.688402 25859 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:26.690507 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:26.679719 27885 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:26.716074 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:26.683455 28101 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:26.684159 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:26.724562 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:26.725428 25198 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:26.740447 27755 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.741176 27755 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.743860 27755 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:26.744861 28162 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:26.746467 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1126) took 1198 ms. Trace:
I20260709 12:20:26.747582 28162 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.748126 28162 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.751698 28162 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:26.752424 28162 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.753083 28162 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:26.755436 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 830) took 1843 ms. Trace:
I20260709 12:20:26.746845 25857 rpcz_store.cc:276] 0709 12:20:25.548180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.604363 (+ 56183us) service_pool.cc:224] Handling call
0709 12:20:26.746317 (+1141954us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54005a3a54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:26.746414 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933937024}
I20260709 12:20:26.718883 27921 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:26.757412 25168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.016s	sys 0.011s
W20260709 12:20:26.758421 25168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.016s	sys 0.011s
I20260709 12:20:25.478443 25200 rpcz_store.cc:276] 0709 12:20:24.382521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.649455 (+266934us) service_pool.cc:224] Handling call
0709 12:20:24.649832 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:24.650110 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:24.724188 (+ 74078us) log.cc:844] Serialized 14 byte log entry
0709 12:20:25.463175 (+738987us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b18001d5a20. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287 00007f2103f29208
0709 12:20:25.463324 (+   149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:25.463392 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:25.463449 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.463521 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.463642 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5852,"prepare.queue_time_us":192087,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":636716,"spinlock_wait_cycles":6653696,"thread_start_us":188435,"threads_started":2,"wal-append.queue_time_us":157234}
W20260709 12:20:26.721848 28222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.021s	sys 0.039s
I20260709 12:20:26.765432 25167 leader_election.cc:400] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7.
W20260709 12:20:26.760833 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:26.760663 25122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1771) took 2101 ms (client timeout 2137 ms). Trace:
W20260709 12:20:26.761449 28222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.021s	sys 0.040s
I20260709 12:20:26.755843 25860 rpcz_store.cc:276] 0709 12:20:24.911957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.148300 (+236343us) service_pool.cc:224] Handling call
0709 12:20:25.695335 (+547035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.699457 (+  4122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.755238 (+1055781us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54008723d0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:26.755373 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1257363328}
I20260709 12:20:26.721031 27885 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:26.777179 25122 rpcz_store.cc:269] 0709 12:20:24.654948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.655200 (+   252us) service_pool.cc:224] Handling call
0709 12:20:26.756256 (+2101056us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540009d654. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:26.756399 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2352240896}
I20260709 12:20:26.773346 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:26.772635 28012 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:26.783560 25859 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:26.770807 28101 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.778698 25200 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:26.781934 25822 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.010s	sys 0.014s
W20260709 12:20:26.789434 25165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.004s	sys 0.006s
W20260709 12:20:26.791163 25165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.005s	sys 0.006s
W20260709 12:20:26.787701 25166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.010s
W20260709 12:20:26.792557 25166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.000s	sys 0.011s
W20260709 12:20:26.787506 25822 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.010s	sys 0.015s
W20260709 12:20:26.793488 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 612377us
I20260709 12:20:26.801757 28139 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:26.787743 28162 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:26.803396 28243 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:20:26.834259 28126 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:26.864388 27869 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.834534 28059 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:26.871825 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:26.865073 27869 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:26.894999 28242 log.cc:927] Time spent T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:20:26.896397 27869 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:26.882182 28197 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:26.852977 28162 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.896405 25851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 796) took 1526 ms. Trace:
I20260709 12:20:26.841065 28126 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.893031 28059 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.893029 28012 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.956457 28059 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:26.897411 28197 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.957044 28126 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:26.957716 28066 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:26.958686 28197 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:26.958491 28066 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.961184 28066 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:26.962183 27921 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.962831 27921 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.957214 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2162) took 1380 ms. Trace:
I20260709 12:20:26.964251 25201 rpcz_store.cc:276] 0709 12:20:25.577011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.581383 (+  4372us) service_pool.cc:224] Handling call
0709 12:20:26.957017 (+1375634us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400220954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:26.957157 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493545216}
I20260709 12:20:26.965380 27921 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:26.956380 28012 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:26.968962 28012 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:26.973542 25168 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.137s (SENT) [suppressed 14 similar messages]
I20260709 12:20:26.924927 25851 rpcz_store.cc:276] 0709 12:20:25.370282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.751675 (+381393us) service_pool.cc:224] Handling call
0709 12:20:25.751971 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:25.787202 (+ 35231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.787235 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:25.819219 (+ 31984us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.687164 (+867945us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:26.687222 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.695537 (+  8315us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.896166 (+200629us) raft_consensus.cc:1685] finished
0709 12:20:26.896193 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.896346 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12045,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":847131,"threads_started":1,"wal-append.queue_time_us":935953}
I20260709 12:20:26.970674 28162 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.033223 27921 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:27.058470 27885 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:27.102867 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 409767us
W20260709 12:20:26.796797 25825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.017s	sys 0.049s
W20260709 12:20:27.104122 25825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.018s	sys 0.049s
W20260709 12:20:27.104434 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 839054us
I20260709 12:20:27.105906 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:27.107854 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:27.108590 25199 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:27.105196 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:27.103152 25196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.005s	sys 0.013s
W20260709 12:20:27.111794 25196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.006s	sys 0.013s
I20260709 12:20:27.112479 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2158) took 1285 ms. Trace:
I20260709 12:20:27.112599 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:27.046813 28257 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:20:27.117226 25093 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:27.112864 25196 rpcz_store.cc:276] 0709 12:20:25.826644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.826760 (+   116us) service_pool.cc:224] Handling call
0709 12:20:25.844124 (+ 17364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.844379 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:25.869697 (+ 25318us) log.cc:844] Serialized 14 byte log entry
0709 12:20:26.749426 (+879729us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b4800061ed8. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2108e37aa1 00007f2108e2eb37 00007f2108e2e9ca 00007f2108f2626f 00007f2108f25f37 00007f2108f3a55c 00007f2108f3a508 00007f2108f3a488 00007f2108f3a443 00007f2108f396ec 00007f2107e63a96
0709 12:20:27.112167 (+362741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:27.112209 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:27.112246 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.112326 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.112431 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26366,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":48834,"raft.run_cpu_time_us":18853,"raft.run_wall_time_us":748578,"spinlock_wait_cycles":14942464,"thread_start_us":1242060,"threads_started":2,"wal-append.queue_time_us":113345}
W20260709 12:20:27.110332 28246 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:20:27.062644 27921 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.126575 25093 leader_election.cc:400] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
W20260709 12:20:27.127311 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 254019us
I20260709 12:20:27.127836 25093 leader_election.cc:403] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:20:27.128468 28034 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:27.128940 28034 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:27.129331 28034 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:27.136281 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:27.137038 25193 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:27.138859 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:27.139346 25122 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:20:27.137987 28126 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:27.143426 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:27.115661 25200 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:27.145354 25122 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:27.146495 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:27.152092 25119 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:27.149164 28230 log.cc:927] Time spent T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.966s	user 0.011s	sys 0.000s
I20260709 12:20:27.122422 28039 consensus_queue.cc:1059] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:20:27.150966 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:27.135200 27921 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:27.156275 25123 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:27.156270 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:27.158375 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.126125 28066 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:20:27.161427 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:27.167943 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:27.160277 28256 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:20:27.182011 28123 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:27.183403 28123 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:27.184603 25093 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:27.186096 25093 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:27.186384 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:27.187004 25859 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
W20260709 12:20:27.173328 25856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1111) took 3474 ms (client timeout 1600 ms). Trace:
W20260709 12:20:27.174110 25194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2161) took 1598 ms (client timeout 1582 ms). Trace:
I20260709 12:20:27.178115 28206 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:27.179368 28248 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:27.163872 28059 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:27.181036 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.198410 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:27.188868 25194 rpcz_store.cc:269] 0709 12:20:25.576312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.576784 (+   472us) service_pool.cc:224] Handling call
0709 12:20:27.173926 (+1597142us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b54002dad54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:27.174042 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56887680}
I20260709 12:20:27.189551 25858 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:27.190625 28039 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:27.192517 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:27.187827 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:27.192803 28034 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.193241 25822 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:27.193912 25857 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:27.158861 28249 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:27.188562 25856 rpcz_store.cc:269] 0709 12:20:23.698402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.700200 (+  1798us) service_pool.cc:224] Handling call
0709 12:20:27.173133 (+3472933us) spinlock_profiling.cc:243] Waited 2.74 s on lock 0x7b54005f0fd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:27.173238 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6303337344}
I20260709 12:20:27.213228 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:27.214968 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1763) took 1217 ms. Trace:
I20260709 12:20:27.217114 25857 raft_consensus.cc:2393] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:20:27.201001 25092 connection.cc:256] RPC call timeout handler was delayed by -1.2176037980000274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2529s for a response
I20260709 12:20:27.198238 28257 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:20:27.217047 25272 rpcz_store.cc:276] 0709 12:20:25.997048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.997184 (+   136us) service_pool.cc:224] Handling call
0709 12:20:25.997434 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.002214 (+  4780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.002250 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.002938 (+   688us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.737943 (+735005us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b18003a9e40. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae0d1 00007f2103ec9a0f
0709 12:20:27.160950 (+423007us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:27.160987 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.161050 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:27.203028 (+ 41978us) raft_consensus.cc:1685] finished
0709 12:20:27.203050 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.214889 (+ 11839us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83707,"raft.queue_time_us":1960,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":15190,"spinlock_wait_cycles":13816704,"thread_start_us":421944,"threads_started":1,"wal-append.queue_time_us":1161049}
I20260709 12:20:27.194416 28206 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.197751 27885 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:27.203344 28012 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.235350 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:27.254503 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 586) took 1924 ms. Trace:
I20260709 12:20:27.274617 25857 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
W20260709 12:20:27.276389 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 137824us
I20260709 12:20:27.278048 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:27.278663 25856 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:27.274315 25121 rpcz_store.cc:276] 0709 12:20:25.330364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.331375 (+  1011us) service_pool.cc:224] Handling call
0709 12:20:25.331796 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:25.349079 (+ 17283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.349109 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:25.378534 (+ 29425us) log.cc:844] Serialized 26 byte log entry
0709 12:20:25.857331 (+478797us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b18002a52c0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae0d1 00007f2103ec9a0f
0709 12:20:25.944287 (+ 86956us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:26.462258 (+517971us) log.cc:844] Serialized 14 byte log entry
0709 12:20:26.462551 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.462635 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:27.148592 (+685957us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:27.254217 (+105625us) raft_consensus.cc:1685] finished
0709 12:20:27.254246 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.254418 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1656,"prepare.queue_time_us":702710,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":2179,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":50599,"spinlock_wait_cycles":53634176,"thread_start_us":593951,"threads_started":2,"wal-append.queue_time_us":600186}
I20260709 12:20:27.215016 28197 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:27.215355 28174 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:27.249608 28039 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:27.251904 28206 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:27.253446 28238 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.220695 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:27.276684 27869 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.204967 28258 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:20:27.277858 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:27.299048 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:27.299928 25856 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:27.218954 28261 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:20:27.301966 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 115987us
I20260709 12:20:27.303207 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:27.284742 28066 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:27.308535 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:27.309360 25194 raft_consensus.cc:2376] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9. Re-sending same reply.
I20260709 12:20:27.216915 28249 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.205648 28059 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.305848 25168 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:27.288432 28162 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:27.299285 28039 raft_consensus.cc:697] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:27.281352 28012 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.326716 25856 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:27.331053 25859 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:27.314462 28267 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.341312 25201 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:27.322659 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:27.302552 27869 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.294931 28174 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.299145 28238 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:27.313724 28066 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.307799 28261 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.327817 28256 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:27.449024 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2202) took 1492 ms. Trace:
I20260709 12:20:27.439368 25092 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:27.331070 28162 raft_consensus.cc:3055] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:27.453019 25119 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:27.339859 27885 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:27.438891 25856 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:27.447309 28277 consensus_queue.cc:1059] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:20:27.501650 25275 rpcz_store.cc:276] 0709 12:20:25.956455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.956624 (+   169us) service_pool.cc:224] Handling call
0709 12:20:25.956924 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.277777 (+320853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.277820 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.277875 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:26.277919 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.448719 (+1170800us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54003156d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:27.448785 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.448952 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737303808}
I20260709 12:20:27.329239 28248 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:27.516682 28248 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:27.506835 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:27.518777 28249 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:27.518981 28248 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:27.450227 28071 raft_consensus.cc:3055] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:27.341025 28265 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:27.340147 28034 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:27.431475 28263 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:27.510556 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 71303.3us
I20260709 12:20:27.485626 28271 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.542111 25092 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:27.543372 28274 raft_consensus.cc:3055] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:27.544025 28274 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:27.545218 28274 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.422619 27624 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:27.415361 28264 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.415372 28197 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:27.546780 27624 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.547046 28197 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.549633 28197 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:27.471547 28117 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:27.550143 27624 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:27.550364 28117 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.532873 25201 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:27.475915 28268 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:27.552421 28117 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:27.536047 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 206934us
I20260709 12:20:27.552688 28274 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:27.551920 28268 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:27.546801 28264 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:27.554903 28268 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:27.476476 25121 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:20:27.525343 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.555146 28264 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:27.562855 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:27.505682 28162 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:27.501498 28256 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:27.569643 28271 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.440928 28270 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 12:20:27.577164 28261 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:27.522161 28071 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:27.571475 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 45984.4us
I20260709 12:20:27.585312 25093 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:27.570904 28258 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:27.584697 28261 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.588964 28034 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:27.592387 28261 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.592912 28174 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:27.594657 28261 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:27.581874 28269 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:27.588824 28278 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.595557 28278 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:27.595558 28258 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:27.596240 28059 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:27.597864 28278 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:27.597987 28266 log.cc:927] Time spent T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:20:27.599336 27869 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:27.448027 28039 consensus_queue.cc:237] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:27.599539 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:27.599819 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:27.600509 28264 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:27.600240 28071 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.601038 28264 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.605551 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:27.607144 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:27.600287 25119 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:27.607915 25168 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:27.598138 28066 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:27.601891 28071 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:27.619359 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:27.622382 25199 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:27.623672 28233 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.624167 28233 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.626420 25855 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:27.626736 25193 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:20:27.599395 28037 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:27.627804 28037 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:27.613490 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:27.584352 28256 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:27.616916 28278 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:27.705590 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:27.678961 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:27.617398 28283 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:27.618283 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:27.356182 28267 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:27.540642 28265 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:27.627890 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:27.679821 28233 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:27.679224 28264 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:27.688175 28258 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:27.688773 25165 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:27.767997 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 85185.4us
I20260709 12:20:27.706876 28055 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.690804 27869 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.771744 25121 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:27.640542 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:27.628640 27885 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.628568 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:27.812665 25856 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:27.616196 28174 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.610359 28034 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:27.700361 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:27.815513 25274 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
W20260709 12:20:27.692801 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 63587.7us
W20260709 12:20:27.700973 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.701370 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:27.702776 28280 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:20:27.702695 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:27.703794 25271 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:27.679740 25201 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:27.825354 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:27.826094 25201 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:27.826603 28174 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.827059 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:27.828447 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:27.828995 28174 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:27.829149 25201 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:27.713297 25199 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:27.769991 28233 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:27.589298 28268 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:27.730212 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:27.589471 28275 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:27.738379 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:27.678601 28281 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:20:27.758633 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:27.566658 28263 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:27.698089 25267 raft_consensus.cc:2410] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:20:27.774334 25241 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:27.629160 28162 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.730654 28197 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:27.779559 25269 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:27.698998 28238 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:27.769405 25855 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
W20260709 12:20:27.732909 28139 consensus_meta.cc:287] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.927s	user 0.008s	sys 0.005s
I20260709 12:20:27.822265 28037 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.832160 25199 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:20:27.722955 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:27.786365 28137 raft_consensus.cc:3055] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:27.888294 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:27.751159 28256 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.840304 28287 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.788901 27869 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.902647 25193 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:27.840607 28153 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:27.867559 28278 raft_consensus.cc:697] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:27.901746 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 127617us
I20260709 12:20:27.841208 28174 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.781270 28055 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.950148 25241 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:27.965413 28270 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:27.966233 28277 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:27.936384 28249 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.969686 28249 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.972404 28249 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:27.979568 28265 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:27.904623 28238 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:27.937247 28285 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:20:27.905164 25195 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:27.904330 28137 raft_consensus.cc:740] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:27.844048 28282 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.935482 28267 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:27.982792 28055 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:28.019946 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 75084.3us
W20260709 12:20:28.023000 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 70465.2us
I20260709 12:20:28.021005 25090 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:27.919688 28292 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:28.047204 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.059871 25267 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:28.048688 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.059921 25090 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:28.061647 25273 raft_consensus.cc:2410] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:20:28.049907 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.062436 25275 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:28.051151 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:28.051862 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 283245us
I20260709 12:20:27.888118 27506 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:28.070431 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 46618.9us
I20260709 12:20:28.070279 27506 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.071532 28258 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:28.074769 28286 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:20:28.075554 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 533509us
I20260709 12:20:28.076457 25274 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:28.076545 28265 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:28.076709 28276 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:27.865907 28275 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.075744 25272 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:20:28.078856 28290 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:20:28.079453 28275 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:28.028110 28270 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:28.080821 28270 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.010246 28271 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:28.014861 28153 raft_consensus.cc:697] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:28.083985 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.084421 28153 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.002075 28034 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:28.090562 28268 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:28.103173 28268 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:28.103559 28268 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:28.058792 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:28.106009 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:28.106611 25855 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:28.107813 28256 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:28.005795 28223 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.109282 28223 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:28.111039 28278 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.999959 28174 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.115325 27506 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:28.116278 28174 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:28.117866 28263 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:28.122896 27921 consensus_meta.cc:287] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.960s	user 0.010s	sys 0.002s
I20260709 12:20:28.123395 27921 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.003921 28283 consensus_queue.cc:1059] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
W20260709 12:20:28.127456 28206 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.826s	user 0.011s	sys 0.000s
I20260709 12:20:28.127925 28206 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:28.150454 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.151583 25267 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:28.152053 28206 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:28.152675 28055 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:28.152863 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.153213 28055 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.155810 28055 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:28.157604 28277 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:28.158146 28277 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:28.159458 28268 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.160238 28277 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:28.163560 27869 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:28.165623 25271 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:28.165977 28289 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 12:20:28.167526 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.011516 28287 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:27.843783 28233 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.172346 25202 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:28.174415 28233 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:28.031411 28238 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.059826 28282 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.181176 28282 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:27.900918 28197 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.153950 25273 raft_consensus.cc:2410] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:28.076723 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:28.216576 25090 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:28.263314 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:28.192071 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 122283us
W20260709 12:20:28.285727 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 69286.9us
I20260709 12:20:28.287448 25090 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:28.289208 25856 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:28.125878 27921 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:28.177806 28238 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:28.311681 28206 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:28.311681 27909 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.433678 28206 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:28.434190 28206 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:28.433987 27909 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.436188 27909 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:28.323632 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:28.276620 27869 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.438437 27869 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:28.394562 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:28.397276 25196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.011s	sys 0.007s
W20260709 12:20:28.440670 25196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.013s	sys 0.008s
I20260709 12:20:28.314489 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:28.441262 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 364685us
I20260709 12:20:28.441390 25856 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:28.319368 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:28.438194 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:28.443810 25273 raft_consensus.cc:2410] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:20:28.442437 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:28.446707 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.444869 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:28.372931 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:28.399531 25268 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:28.452874 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:28.453487 25274 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:28.463297 25090 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:28.465859 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:28.465997 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:28.466850 25856 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:28.468402 25856 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:28.169934 28287 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:28.362579 28265 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.482661 28265 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:28.485563 28265 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:28.488190 28287 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:28.320546 28249 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:28.410539 28197 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:28.491291 25274 raft_consensus.cc:2410] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:20:28.499548 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:28.500842 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.319129 27803 raft_consensus.cc:3055] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:28.362422 27506 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:28.492051 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.461377 28263 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.461558 28174 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:28.512616 25857 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:28.489118 28053 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:28.578270 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:28.493729 28127 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:28.616948 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:28.617800 25274 raft_consensus.cc:2376] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9. Re-sending same reply.
I20260709 12:20:28.592262 25273 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:28.530159 27803 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:28.594188 25168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.023s	sys 0.033s
W20260709 12:20:28.629779 25168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.023s	sys 0.033s
I20260709 12:20:28.536062 27506 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:28.575714 28268 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:28.632341 25275 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:28.522815 28249 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:28.636186 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 365126us
I20260709 12:20:28.625605 28053 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.632360 27506 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:28.637630 27803 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.638980 27803 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:28.639345 28053 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:28.639890 28053 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.637681 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:28.641059 25165 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:28.641923 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:28.644810 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:28.645358 25274 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:28.645501 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.646762 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:28.648214 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.577075 28263 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.651528 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:28.654389 25127 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
W20260709 12:20:28.654462 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 191239us
I20260709 12:20:28.656756 25090 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:28.659622 25118 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:28.661221 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.634379 28288 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:28.664367 25272 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:28.666468 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:28.667234 25274 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:28.671149 25168 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:28.649305 28300 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:28.675175 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 233178us
I20260709 12:20:28.660511 28296 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:28.679697 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:28.679898 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.680649 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.640383 28053 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.671550 28287 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.630252 28174 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.670946 28268 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:28.677090 27869 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:28.664935 28292 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:20:28.689761 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.692826 25276 raft_consensus.cc:2368] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6.
I20260709 12:20:28.671789 28270 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:20:28.699702 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:28.701396 25267 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:20:28.688129 28299 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:28.711124 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:28.707373 25167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.003s	sys 0.058s
I20260709 12:20:28.689335 28276 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:20:28.716260 25167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.004s	sys 0.059s
I20260709 12:20:28.692195 28294 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:28.721444 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.721895 25092 leader_election.cc:400] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:28.722419 25092 leader_election.cc:403] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:28.694056 28292 consensus_queue.cc:1243] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer b83c12959b9848b3b7bbc680f5ee6225 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:20:28.723490 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:28.728376 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:28.694484 28302 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:28.683395 28296 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.694591 28268 raft_consensus.cc:697] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:28.687039 28287 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:28.682475 28300 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:28.729184 25193 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:28.750758 25092 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:28.717211 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:28.755381 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 107775us
I20260709 12:20:28.763926 25267 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:28.768951 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:28.770908 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:28.771569 25193 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:28.773082 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.773744 25276 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
W20260709 12:20:28.765487 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 103133us
I20260709 12:20:28.766980 25198 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:28.754791 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:28.776974 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:28.780351 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:28.782958 25193 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:28.784682 25857 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9.
I20260709 12:20:28.782943 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:28.785377 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.785591 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:28.786007 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:28.786456 28258 raft_consensus.cc:2764] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:20:28.786988 25856 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:28.787993 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.783931 25167 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:28.750792 28302 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.764624 28044 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:20:28.790977 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:28.792583 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:28.802168 25856 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:28.802508 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:28.793620 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 46037.7us
I20260709 12:20:28.785300 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:28.803203 25276 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:28.803684 25193 raft_consensus.cc:2410] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:20:28.790292 28306 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:20:28.770574 28294 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.811097 25193 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:28.804224 28308 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.812822 28197 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:28.814610 28249 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:28.815707 28153 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:28.816571 28287 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:28.804415 28311 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:28.818405 28305 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 12:20:28.818975 28304 log.cc:927] Time spent T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:20:28.817252 28268 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.819479 28300 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:28.923586 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:29.059993 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.429296 28261 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:28.820672 25855 consensus_meta.cc:287] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.001s
I20260709 12:20:28.942689 28312 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.427953 28294 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:28.964774 25822 leader_election.cc:336] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Timed out: RequestConsensusVote RPC to 127.23.81.195:44749 timed out after 1.954s (SENT)
I20260709 12:20:29.422144 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 908) took 1131 ms. Trace:
I20260709 12:20:28.915179 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:29.469215 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:29.469164 25275 rpcz_store.cc:276] 0709 12:20:28.290921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.291057 (+   136us) service_pool.cc:224] Handling call
0709 12:20:28.291402 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:28.632805 (+341403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.421818 (+789013us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540034e4d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:29.422071 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783646592}
I20260709 12:20:29.471488 28312 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:29.472131 28153 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:29.472654 28153 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:29.473019 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:28.888123 28239 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 2.172s	user 0.020s	sys 0.042s
I20260709 12:20:29.474484 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:29.467893 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 503137us
I20260709 12:20:29.208874 28292 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:28.947531 28206 consensus_meta.cc:287] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 12:20:29.481345 25275 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:20:29.481174 28206 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:29.481098 28292 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:29.481798 25275 pending_rounds.cc:85] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 5
I20260709 12:20:29.467335 25855 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:29.482160 25275 pending_rounds.cc:107] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:20:29.482468 25275 raft_consensus.cc:2889] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:28.821789 28053 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:29.470041 25852 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:28.821084 28126 raft_consensus.cc:3055] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:29.483541 28126 raft_consensus.cc:740] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:29.483723 28292 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:29.483979 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:29.484357 28308 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:29.484553 28126 consensus_queue.cc:260] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:29.486044 28126 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:28.797407 28288 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:29.486702 28288 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:28.926082 27506 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:29.524197 27506 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:28.900957 25859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 858) took 1699 ms (client timeout 2243 ms). Trace:
W20260709 12:20:29.525009 25859 rpcz_store.cc:269] 0709 12:20:27.201764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.296435 (+ 94671us) service_pool.cc:224] Handling call
0709 12:20:28.900661 (+1604226us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b5400373054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:28.900865 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61997824}
I20260709 12:20:29.526355 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:29.528720 28044 consensus_meta.cc:287] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.718s	user 0.006s	sys 0.002s
I20260709 12:20:29.529239 28044 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:29.476634 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2203) took 3502 ms. Trace:
I20260709 12:20:29.530189 25270 rpcz_store.cc:276] 0709 12:20:25.973804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.974113 (+   309us) service_pool.cc:224] Handling call
0709 12:20:25.984940 (+ 10827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:25.985357 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.985406 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:25.986894 (+  1488us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.456386 (+469492us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:26.456434 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.456510 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.887283 (+2430773us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:29.476300 (+589017us) raft_consensus.cc:1685] finished
0709 12:20:29.476323 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:29.476551 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":798,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3535,"spinlock_wait_cycles":8463872,"thread_start_us":461612,"threads_started":1,"wal-append.queue_time_us":695813}
I20260709 12:20:29.532725 25270 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:28.805284 28307 log.cc:927] Time spent T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
I20260709 12:20:28.810312 27869 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.667s
W20260709 12:20:29.402863 25167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.010s	sys 0.005s
I20260709 12:20:29.477653 28294 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:28.848330 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2180) took 1539 ms. Trace:
I20260709 12:20:29.468640 28311 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:28.835456 28258 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:29.429848 28261 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:29.219530 25165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.026s	sys 0.032s
I20260709 12:20:29.430070 28316 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:28.854489 28301 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 12:20:29.304755 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:29.482426 25855 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1137) took 1858 ms (client timeout 1643 ms). Trace:
I20260709 12:20:29.485402 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:29.569643 25852 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
W20260709 12:20:29.475271 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 671626us
I20260709 12:20:29.487641 28308 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:28.798615 28302 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:29.569218 25855 rpcz_store.cc:269] 0709 12:20:27.624086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.105740 (+481654us) service_pool.cc:224] Handling call
0709 12:20:29.482352 (+1376612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:28.855271 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:29.426558 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:29.474654 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:29.527014 25859 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:29.424011 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:29.573208 25276 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
W20260709 12:20:29.573704 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 149826us
W20260709 12:20:29.544842 25167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.010s	sys 0.015s
W20260709 12:20:29.574992 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 791081us
I20260709 12:20:29.575919 25167 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:29.578114 25858 raft_consensus.cc:2393] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:29.558693 25196 rpcz_store.cc:276] 0709 12:20:27.309289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.309452 (+   163us) service_pool.cc:224] Handling call
0709 12:20:27.309777 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:27.520313 (+210536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.520340 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:27.520877 (+   537us) log.cc:844] Serialized 52 byte log entry
0709 12:20:27.734647 (+213770us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:27.842761 (+108114us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.441081 (+598320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.847842 (+406761us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54002e31d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:28.847890 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.847938 (+    48us) raft_consensus.cc:1685] finished
0709 12:20:28.848063 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.848265 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":338788,"prepare.queue_time_us":421667,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":247177,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":78264,"spinlock_wait_cycles":483362688,"thread_start_us":825689,"threads_started":3,"wal-append.queue_time_us":365836,"wal-append.run_cpu_time_us":2891,"wal-append.run_wall_time_us":1291496}
I20260709 12:20:29.578462 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:29.579124 25852 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:29.534562 28249 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:29.543350 28299 consensus_meta.cc:287] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.001s
I20260709 12:20:29.534718 28312 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:29.584256 25197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 622) took 3621 ms (client timeout 2041 ms). Trace:
I20260709 12:20:29.570773 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:29.584692 25197 rpcz_store.cc:269] 0709 12:20:25.959418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.977089 (+ 17671us) service_pool.cc:224] Handling call
0709 12:20:29.579666 (+3602577us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b54000a8054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:29.580694 (+  1028us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103502080}
I20260709 12:20:29.586930 25092 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:29.588037 25092 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:29.529776 28012 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:29.562793 25165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.034s	sys 0.040s
I20260709 12:20:29.581373 25167 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:29.560585 28311 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:29.592785 25193 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:20:29.589917 25167 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:29.594666 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:29.595284 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.594777 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.598300 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2178) took 1957 ms. Trace:
I20260709 12:20:29.598685 25201 rpcz_store.cc:276] 0709 12:20:27.641223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.829944 (+188721us) service_pool.cc:224] Handling call
0709 12:20:27.830359 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:28.304389 (+474030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:28.304436 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:28.319632 (+ 15196us) log.cc:844] Serialized 26 byte log entry
0709 12:20:28.655360 (+335728us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:28.655396 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.655464 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:29.598087 (+942623us) raft_consensus.cc:1685] finished
0709 12:20:29.598104 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:29.598245 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90949,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":40747,"thread_start_us":764628,"threads_started":2,"wal-append.queue_time_us":360013}
I20260709 12:20:29.600863 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:29.601804 25121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1797) took 2003 ms (client timeout 1518 ms). Trace:
W20260709 12:20:29.602214 25121 rpcz_store.cc:269] 0709 12:20:27.598832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.599575 (+   743us) service_pool.cc:224] Handling call
0709 12:20:29.601640 (+2002065us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540021edd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:29.601735 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393802112}
I20260709 12:20:29.577415 28262 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:29.602280 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:29.615168 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.615533 25127 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:29.616338 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.616981 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:29.607383 25118 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:29.608234 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:29.598892 27623 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:29.618348 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:29.618956 27623 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:29.619889 27623 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:29.604499 25167 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:29.605816 25121 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:20:29.621832 25121 pending_rounds.cc:85] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 6
I20260709 12:20:29.622213 25121 pending_rounds.cc:107] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:20:29.622576 25121 raft_consensus.cc:2889] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:29.617823 25127 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:29.622223 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:29.624696 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:29.590296 28300 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:29.635294 25197 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:29.612588 28294 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:29.635759 28294 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:29.636468 25127 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:29.637181 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:29.638579 25825 leader_election.cc:336] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 2.041s (SENT)
I20260709 12:20:29.638656 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.640939 25276 raft_consensus.cc:2410] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:20:29.581048 28197 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:20:29.627384 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.628401 28308 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:29.628890 28288 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:29.629357 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:29.655185 25121 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:29.636173 28294 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:29.629537 28292 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:29.617411 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.626578 25167 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:29.630246 27869 consensus_queue.cc:1059] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:29.630851 25855 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:29.610728 25852 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:29.592981 28249 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:29.590197 28234 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:29.596436 28272 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:29.603917 28312 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:29.603390 28044 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:29.571467 28316 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:29.669659 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:29.593822 28153 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:29.670308 25196 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:20:29.671079 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 44600.5us
I20260709 12:20:29.594116 28299 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:29.659799 25118 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:29.659116 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:29.660697 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:29.625088 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 127862us
I20260709 12:20:29.662644 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.630875 28261 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:29.652559 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.657330 28292 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.683539 25822 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:29.684877 28324 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:20:29.669438 28312 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:29.709450 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:29.710005 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:29.682226 28012 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:29.701956 25121 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:29.711016 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.688416 28292 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:29.669597 28044 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:29.716217 25118 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:29.685527 28308 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:29.687927 28234 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:29.727017 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:29.713555 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:29.727679 25121 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:29.728849 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:29.626360 28262 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:29.684772 28272 raft_consensus.cc:697] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:29.652204 28302 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:29.669639 28137 consensus_queue.cc:260] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:29.688114 27623 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:20:29.717746 28325 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:29.625058 28268 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:20:29.726310 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:29.721396 28312 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:29.710251 28261 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
W20260709 12:20:29.718065 28323 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:20:29.717806 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:29.860394 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 151777us
I20260709 12:20:29.765657 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2228) took 1103 ms. Trace:
I20260709 12:20:29.729682 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:29.893035 25124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.004s	sys 0.011s
W20260709 12:20:29.744803 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 64357.7us
W20260709 12:20:29.711288 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 136894us
W20260709 12:20:29.930552 25124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.008s	sys 0.019s
I20260709 12:20:29.772707 25123 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:29.815816 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.931514 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:29.818626 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 800) took 4424 ms. Trace:
I20260709 12:20:29.929778 25275 rpcz_store.cc:276] 0709 12:20:28.662007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.488724 (+826717us) service_pool.cc:224] Handling call
0709 12:20:29.489116 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:29.489333 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:29.489361 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:29.489953 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 12:20:29.735216 (+245263us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:29.735256 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.735322 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:29.765428 (+ 30106us) raft_consensus.cc:1685] finished
0709 12:20:29.765447 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:29.765595 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":169519,"threads_started":1,"wal-append.queue_time_us":220877}
I20260709 12:20:29.932694 25854 rpcz_store.cc:276] 0709 12:20:25.394477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.787903 (+393426us) service_pool.cc:224] Handling call
0709 12:20:25.788146 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.638593 (+850447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.818298 (+3179705us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b540054e7d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:29.818523 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1954536704}
I20260709 12:20:29.759308 25201 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:29.772138 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:29.892375 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.935196 25853 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:29.937211 25196 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:29.727957 28308 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.720955 28012 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:29.941363 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:29.940269 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 256779us
I20260709 12:20:29.724716 28044 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:29.942703 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:29.720443 28249 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:29.945955 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:29.946834 25197 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 8: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:29.939560 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:29.854064 28303 log.cc:927] Time spent T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 1.166s	user 0.003s	sys 0.010s
I20260709 12:20:29.944629 25822 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:29.827728 27506 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.827466 28287 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:29.965993 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:29.934392 28071 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:29.947510 25123 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:29.969522 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:29.970297 25123 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:29.952399 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:29.945087 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:29.769413 28162 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:29.942788 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.974284 25194 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:29.945242 25196 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:29.812168 28296 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:29.955461 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:29.958390 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:29.941291 28328 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:29.891960 28153 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:29.819723 28316 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:29.819264 28234 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:29.966922 25853 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9.
W20260709 12:20:29.945384 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.972329 25822 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:29.976924 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:29.938687 28308 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:29.959913 28137 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.947306 28325 raft_consensus.cc:697] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:29.986975 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:30.005148 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.006352 25194 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:30.005216 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1801) took 2309 ms. Trace:
I20260709 12:20:29.987401 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.007980 25118 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:30.005103 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:29.986878 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:29.940846 28155 consensus_queue.cc:1059] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:20:29.998000 25123 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:29.987079 28328 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.002530 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:30.009877 25196 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:30.011673 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:29.971773 28249 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:30.007045 25124 rpcz_store.cc:276] 0709 12:20:27.691352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.691521 (+   169us) service_pool.cc:224] Handling call
0709 12:20:27.691851 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:27.692184 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.692212 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:28.911990 (+1219778us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b2c00000c88. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:20:28.912497 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:20:29.932176 (+1019679us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:29.932217 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.932287 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:29.996701 (+ 64414us) raft_consensus.cc:1685] finished
0709 12:20:29.996729 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.000368 (+  3639us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":354,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":33026816,"thread_start_us":1018332,"threads_started":1,"wal-append.queue_time_us":665237}
I20260709 12:20:30.016772 25123 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:30.017105 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.018245 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.018971 25124 raft_consensus.cc:2410] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:30.009025 25853 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
W20260709 12:20:30.020331 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 84727.8us
I20260709 12:20:30.022315 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:30.023602 25193 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:30.024398 25196 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:30.024875 25193 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:29.973819 28197 consensus_queue.cc:1059] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:20:30.033555 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 820) took 1232 ms. Trace:
I20260709 12:20:29.972100 28287 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:29.968017 27506 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.028141 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:30.004281 28270 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:30.034045 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.001508 28012 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:30.078045 25242 connection.cc:256] RPC call timeout handler was delayed by -1.3225362720002067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 12:20:30.033942 25858 rpcz_store.cc:276] 0709 12:20:28.801004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.592729 (+791725us) service_pool.cc:224] Handling call
0709 12:20:29.593043 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:29.593383 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:29.593412 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:29.603684 (+ 10272us) log.cc:844] Serialized 26 byte log entry
0709 12:20:29.723229 (+119545us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:29.723268 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.723328 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:30.033348 (+310020us) raft_consensus.cc:1685] finished
0709 12:20:30.033367 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.033497 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10875,"raft.queue_time_us":109,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":14916,"thread_start_us":96118,"threads_started":1,"wal-append.queue_time_us":308368}
I20260709 12:20:30.081255 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:30.034968 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1771) took 1391 ms. Trace:
I20260709 12:20:30.084913 25272 rpcz_store.cc:276] 0709 12:20:28.643811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.643958 (+   147us) service_pool.cc:224] Handling call
0709 12:20:28.660716 (+ 16758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:28.669065 (+  8349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.034757 (+1365692us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b5400298e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:30.034915 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7893888}
I20260709 12:20:30.085377 25857 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.086158 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1152) took 1302 ms. Trace:
I20260709 12:20:30.086532 25857 rpcz_store.cc:276] 0709 12:20:28.783741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.043047 (+1259306us) service_pool.cc:224] Handling call
0709 12:20:30.085207 (+ 42160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.085870 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.086088 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:30.087477 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:30.030469 28109 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:30.007531 28264 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.040863 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.021028 27869 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:30.012327 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:29.996901 28336 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:20:30.001287 28311 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.117271 28311 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:30.002588 28335 consensus_queue.cc:1059] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:20:30.117807 28174 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:30.118607 28335 raft_consensus.cc:3055] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:30.119010 28335 raft_consensus.cc:740] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:30.094522 28264 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:30.119848 28335 consensus_queue.cc:260] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.092582 28288 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.121526 28288 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.122236 25855 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:30.122766 28263 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:30.084393 25859 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:30.125452 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 819) took 1324 ms. Trace:
I20260709 12:20:30.037755 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:30.125895 25859 rpcz_store.cc:276] 0709 12:20:28.800753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.041358 (+1240605us) service_pool.cc:224] Handling call
0709 12:20:30.084159 (+ 42801us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:30.125144 (+ 40985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.125387 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:30.127375 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.127485 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:30.128252 25118 raft_consensus.cc:2410] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:20:30.121732 28264 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:30.088230 25857 raft_consensus.cc:2410] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:20:30.089740 25242 connection.cc:256] RPC call timeout handler was delayed by -1.0993362720000732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 12:20:30.091411 28268 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:30.136839 25242 connection.cc:256] RPC call timeout handler was delayed by -1.0164279150001221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2609s for a response
W20260709 12:20:30.137621 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.138628 25242 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:30.021097 28328 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:30.092391 25120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1772) took 4424 ms (client timeout 2220 ms). Trace:
I20260709 12:20:30.021560 28249 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.094367 27869 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.097860 27506 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:30.100987 28223 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:30.106645 28262 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:30.111333 25199 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:30.113539 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:30.114555 28126 consensus_meta.cc:287] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.004s
I20260709 12:20:30.082616 28325 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.123482 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 821) took 1322 ms. Trace:
I20260709 12:20:30.165220 25852 rpcz_store.cc:276] 0709 12:20:28.801264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.663551 (+862287us) service_pool.cc:224] Handling call
0709 12:20:29.663886 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:29.684898 (+ 21012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:29.684928 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:29.712306 (+ 27378us) log.cc:844] Serialized 26 byte log entry
0709 12:20:29.973095 (+260789us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:29.973145 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.973238 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:30.123280 (+150042us) raft_consensus.cc:1685] finished
0709 12:20:30.123304 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.123429 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5563,"raft.queue_time_us":18285,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":7588,"thread_start_us":220360,"threads_started":1,"wal-append.queue_time_us":282626}
I20260709 12:20:30.128500 25859 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:30.168905 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:30.126238 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.155792 28300 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.174495 28300 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.174966 28302 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:30.176332 28263 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:30.177089 25127 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:30.151284 27869 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:30.007963 28272 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:30.182637 28294 consensus_meta.cc:287] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.004s
I20260709 12:20:30.183284 28294 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:30.037855 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 82505.3us
I20260709 12:20:30.135387 28292 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:30.184711 25093 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:30.141423 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 172923us
W20260709 12:20:30.142657 25120 rpcz_store.cc:269] 0709 12:20:25.660941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.662194 (+  1253us) service_pool.cc:224] Handling call
0709 12:20:30.079031 (+4416837us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b540009d154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:30.085152 (+  6121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1837542784}
I20260709 12:20:30.139775 25242 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:30.186867 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 47195.6us
I20260709 12:20:30.209954 25194 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:30.210443 25859 raft_consensus.cc:2393] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:30.211735 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:30.093184 28270 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.143712 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:30.144532 28350 consensus_queue.cc:1059] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:30.146130 28249 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:30.254496 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.144694 28197 raft_consensus.cc:3055] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:30.134801 28288 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:30.150897 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:30.319450 25853 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 3.
I20260709 12:20:30.152379 28268 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:30.214407 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.214843 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:30.094319 28344 consensus_queue.cc:1175] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" responder_term: 9 status { last_received { term: 9 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:30.215564 25242 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:30.216149 28262 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:30.216733 28126 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:30.217149 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:30.147156 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:30.320523 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:30.512244 25200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2185) took 1793 ms. Trace:
I20260709 12:20:30.512892 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:30.512240 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 296733us
I20260709 12:20:30.512856 25200 rpcz_store.cc:276] 0709 12:20:28.719353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.719502 (+   149us) service_pool.cc:224] Handling call
0709 12:20:28.719783 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:28.793230 (+ 73447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:28.793264 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:28.793306 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:28.793342 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.511962 (+1718620us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b540016d0d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:30.512021 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.512189 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168468224}
I20260709 12:20:30.515259 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:30.517063 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 299952us
I20260709 12:20:30.518198 25093 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:30.519521 25118 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:30.523787 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1794) took 3033 ms. Trace:
I20260709 12:20:30.511231 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:30.540287 25852 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
W20260709 12:20:30.597661 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.679162 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:30.680403 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 126670us
W20260709 12:20:30.679071 25195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2155) took 4693 ms (client timeout 2173 ms). Trace:
W20260709 12:20:30.682739 25195 rpcz_store.cc:269] 0709 12:20:25.825773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.825896 (+   123us) service_pool.cc:224] Handling call
0709 12:20:30.519316 (+4693420us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b540016dad4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:30.519516 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4684920064}
I20260709 12:20:30.708345 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1769) took 3094 ms. Trace:
I20260709 12:20:30.709014 25269 rpcz_store.cc:276] 0709 12:20:27.614141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.614276 (+   135us) service_pool.cc:224] Handling call
0709 12:20:27.614632 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.887822 (+273190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.708006 (+2820184us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540034eed4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:30.708266 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378819840}
I20260709 12:20:30.723167 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:30.510967 28162 consensus_meta.cc:287] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.002s
I20260709 12:20:30.723973 25120 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
W20260709 12:20:30.323776 28258 consensus_meta.cc:287] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.009s
I20260709 12:20:30.730175 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 828) took 1205 ms. Trace:
I20260709 12:20:30.741799 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:30.741823 25825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.014s	sys 0.013s
W20260709 12:20:30.730284 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 212849us
I20260709 12:20:30.743952 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 826) took 1219 ms. Trace:
W20260709 12:20:30.745839 25825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.014s	sys 0.013s
W20260709 12:20:30.746287 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 560158us
I20260709 12:20:30.747133 25271 raft_consensus.cc:2410] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:30.401382 28223 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.446897 28222 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.542687 28262 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.513407 28197 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:30.321787 28268 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:30.748512 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.401742 28333 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.411162 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:30.680294 27506 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:30.679085 28341 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:20:30.723477 28312 consensus_meta.cc:287] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.780s	user 0.003s	sys 0.007s
W20260709 12:20:30.757262 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.530823 28287 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:30.740479 25852 rpcz_store.cc:276] 0709 12:20:29.525236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.722972 (+1197736us) service_pool.cc:224] Handling call
0709 12:20:30.729424 (+  6452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.729675 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.729717 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:30.729780 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:30.729830 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.729923 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.730099 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:30.678764 28288 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:30.681227 28126 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.760303 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:30.752336 25200 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:30.757272 25120 raft_consensus.cc:2393] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:30.707176 28257 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.744371 25853 rpcz_store.cc:276] 0709 12:20:29.524679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.678679 (+1154000us) service_pool.cc:224] Handling call
0709 12:20:30.743406 (+ 64727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.743603 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.743629 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:30.743673 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:30.743711 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.743764 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.743880 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:30.795585 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.492981 28308 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.747782 28258 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:30.748001 27869 consensus_meta.cc:287] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
I20260709 12:20:30.524343 25122 rpcz_store.cc:276] 0709 12:20:27.490791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.490924 (+   133us) service_pool.cc:224] Handling call
0709 12:20:27.494534 (+  3610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.555653 (+ 61119us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:27.555861 (+   208us) log.cc:844] Serialized 14 byte log entry
0709 12:20:27.677122 (+121261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:27.677174 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:27.677230 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.924037 (+1246807us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b480033ffd8. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2108e37aa1 00007f2108e2eb37 00007f2108e2e9ca 00007f2108f2626f 00007f2108f25f37 00007f2108f3a55c 00007f2108f3a508 00007f2108f3a488 00007f2108f3a443 00007f2108f396ec 00007f2107e63a96
0709 12:20:30.523454 (+1599417us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b54002ae754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:30.523523 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.523708 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2688,"prepare.queue_time_us":1364701,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":3768,"raft.run_cpu_time_us":21719,"raft.run_wall_time_us":1245976,"spinlock_wait_cycles":142948992,"thread_start_us":118192,"threads_started":1,"wal-append.queue_time_us":225067,"wal-append.run_cpu_time_us":2165,"wal-append.run_wall_time_us":1222786}
I20260709 12:20:30.748366 28049 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.812384 28349 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.831898 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.832723 25122 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 7: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:30.833173 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 607) took 1176 ms. Trace:
I20260709 12:20:30.804611 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 647) took 1187 ms. Trace:
I20260709 12:20:30.804767 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:30.833473 25122 rpcz_store.cc:276] 0709 12:20:29.656854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.831630 (+1174776us) service_pool.cc:224] Handling call
0709 12:20:30.833107 (+  1477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:30.758864 28223 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:30.806559 25195 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:30.807860 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.772248 28341 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:30.770907 28333 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.760288 28262 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:30.810300 28312 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.811514 28257 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:30.819557 28270 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:30.827253 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.829520 28338 raft_consensus.cc:3055] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:30.817682 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 829) took 1292 ms. Trace:
I20260709 12:20:30.830832 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1775) took 5132 ms. Trace:
I20260709 12:20:30.740677 28343 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 12:20:30.769896 28222 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.839025 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.778119 25855 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:30.872761 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.838689 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2319) took 1118 ms. Trace:
I20260709 12:20:30.873515 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 833) took 1157 ms. Trace:
I20260709 12:20:30.873802 25120 rpcz_store.cc:276] 0709 12:20:29.720730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.807556 (+1086826us) service_pool.cc:224] Handling call
0709 12:20:30.838619 (+ 31063us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:30.776206 28292 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:30.833932 25201 rpcz_store.cc:276] 0709 12:20:29.616688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.639954 (+ 23266us) service_pool.cc:224] Handling call
0709 12:20:30.804362 (+1164408us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b54000a5854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:30.804529 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172002176}
I20260709 12:20:30.860296 25859 rpcz_store.cc:276] 0709 12:20:29.525556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.816379 (+1290823us) service_pool.cc:224] Handling call
0709 12:20:30.816803 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.817178 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.817220 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:30.817280 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:30.817338 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.817416 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.817605 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:30.880465 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 199068us
I20260709 12:20:30.831684 28126 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:30.873571 25122 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:30.881444 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2322) took 1084 ms. Trace:
I20260709 12:20:30.837702 28288 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:30.840096 25241 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:30.860477 25126 rpcz_store.cc:276] 0709 12:20:25.665651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.665759 (+   108us) service_pool.cc:224] Handling call
0709 12:20:25.673281 (+  7522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.633339 (+960058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.797402 (+4164063us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b540022b5d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:30.797668 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2206122240}
I20260709 12:20:30.874148 25855 rpcz_store.cc:276] 0709 12:20:29.715900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.872491 (+1156591us) service_pool.cc:224] Handling call
0709 12:20:30.872851 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.873104 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.873144 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:30.873203 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:30.873255 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.873325 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.873448 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:30.890610 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 50595us
I20260709 12:20:30.881901 25122 rpcz_store.cc:276] 0709 12:20:29.797132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.872432 (+1075300us) service_pool.cc:224] Handling call
0709 12:20:30.881378 (+  8946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:30.884017 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.891290 28270 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:30.891650 25120 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:30.891784 28270 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.891840 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.892236 28270 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:30.892731 25122 raft_consensus.cc:2410] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:20:30.893743 25859 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:20:30.894455 25854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.022s
W20260709 12:20:30.894773 25854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.008s	sys 0.022s
I20260709 12:20:30.895421 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 825) took 1371 ms. Trace:
I20260709 12:20:30.838634 28350 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:20:30.860174 28338 raft_consensus.cc:740] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:30.892171 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2333) took 1038 ms. Trace:
I20260709 12:20:30.852130 28341 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:30.850736 28138 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:20:30.853502 28354 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:20:30.844558 27869 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.850106 28049 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.859368 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:20:30.849697 28349 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:30.913969 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.922755 25124 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:20:30.946762 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:30.939587 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:30.973775 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 145376us
I20260709 12:20:30.974359 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:30.939240 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:30.975035 25856 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
W20260709 12:20:30.933810 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.902422 25201 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:30.976472 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:30.892705 25241 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:30.977150 25859 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
W20260709 12:20:30.977373 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 84728.3us
I20260709 12:20:30.898816 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:30.972609 25200 raft_consensus.cc:606] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:30.968194 25120 rpcz_store.cc:276] 0709 12:20:29.853717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.883652 (+1029935us) service_pool.cc:224] Handling call
0709 12:20:30.892120 (+  8468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:30.978066 25200 raft_consensus.cc:614] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:30.978132 25241 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:30.978724 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.980031 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.983196 25241 leader_election.cc:400] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9.
I20260709 12:20:31.000914 25241 leader_election.cc:403] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:30.895830 25854 rpcz_store.cc:276] 0709 12:20:29.524367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.941402 (+417035us) service_pool.cc:224] Handling call
0709 12:20:29.941789 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:29.942076 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:29.995135 (+ 53059us) log.cc:844] Serialized 14 byte log entry
0709 12:20:30.895034 (+899899us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:30.895089 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:30.895146 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.895228 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.895359 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69732,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":6541,"thread_start_us":936327,"threads_started":3,"wal-append.queue_time_us":889701}
I20260709 12:20:31.001416 25126 raft_consensus.cc:2410] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:30.972970 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 602) took 1348 ms. Trace:
I20260709 12:20:31.006088 25124 rpcz_store.cc:276] 0709 12:20:29.624798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.921907 (+1297109us) service_pool.cc:224] Handling call
0709 12:20:30.922302 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.969137 (+ 46835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.972914 (+  3777us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:30.977422 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.135802 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:30.911872 28126 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.136564 25125 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:30.875528 28294 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:30.881505 28197 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:31.357581 25825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.070s	sys 0.182s
I20260709 12:20:31.135792 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:31.802693 25825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.098s	sys 0.221s
W20260709 12:20:31.803510 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 1.05616e+06us
W20260709 12:20:31.651803 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 417649us
W20260709 12:20:31.474299 25119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 600) took 1863 ms (client timeout 1853 ms). Trace:
W20260709 12:20:31.737852 25197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 645) took 2121 ms (client timeout 2206 ms). Trace:
I20260709 12:20:31.474454 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 920) took 2692 ms. Trace:
W20260709 12:20:31.805209 25197 rpcz_store.cc:269] 0709 12:20:29.616160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.853684 (+237524us) service_pool.cc:224] Handling call
0709 12:20:31.737521 (+1883837us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b540001fed4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:31.737761 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26685824}
I20260709 12:20:31.141230 25195 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:20:31.141225 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 158193us
I20260709 12:20:31.501667 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2229) took 2836 ms. Trace:
I20260709 12:20:31.140280 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 605) took 1489 ms. Trace:
W20260709 12:20:31.665380 25822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.021s	sys 0.010s
I20260709 12:20:31.809595 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2316) took 2089 ms. Trace:
W20260709 12:20:31.141661 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.136703 28353 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.807883 25270 rpcz_store.cc:276] 0709 12:20:28.665620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.533552 (+867932us) service_pool.cc:224] Handling call
0709 12:20:29.533861 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:29.711515 (+177654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:29.711545 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:29.711591 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:29.711627 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.501297 (+1789670us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002be3d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:31.501369 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:31.501572 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408099072}
I20260709 12:20:31.819307 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.799815 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.824424 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:31.809597 25822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.029s	sys 0.010s
I20260709 12:20:31.805477 25271 rpcz_store.cc:276] 0709 12:20:28.749671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.770106 (+ 20435us) service_pool.cc:224] Handling call
0709 12:20:31.442169 (+2672063us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b5400027e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:31.442370 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4503070080}
I20260709 12:20:31.803577 28343 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:31.208308 28328 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.028s	user 0.011s	sys 0.000s
I20260709 12:20:31.829831 28343 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:31.830312 28328 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:31.833101 28328 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:31.808996 28272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.005s	sys 0.003s
W20260709 12:20:31.834303 28272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.006s	sys 0.003s
I20260709 12:20:31.810075 28222 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:31.440623 28338 consensus_queue.cc:260] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:31.839488 28338 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:31.839679 28353 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.387972 28356 consensus_queue.cc:1059] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.485s
I20260709 12:20:31.747561 28126 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:31.843247 28356 raft_consensus.cc:3055] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:30.902577 28288 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:31.843634 28356 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:31.844514 28356 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.845235 28343 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:31.845674 28356 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:30.900463 28333 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:31.846316 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.794557 27869 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:31.140316 28292 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:31.334774 28012 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:31.847594 28292 raft_consensus.cc:697] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:31.715938 28039 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:31.848579 28039 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.848871 28292 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.850922 28039 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:31.851334 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:31.138012 28249 consensus_meta.cc:287] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.721s	user 0.005s	sys 0.005s
W20260709 12:20:31.816257 25276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.043s	sys 0.040s
W20260709 12:20:31.460151 28262 consensus_meta.cc:287] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.588s	user 0.006s	sys 0.003s
I20260709 12:20:31.821568 25120 rpcz_store.cc:276] 0709 12:20:29.719933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.295138 (+1575205us) service_pool.cc:224] Handling call
0709 12:20:31.809019 (+513881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:31.809223 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:31.809246 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:31.809286 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:31.809322 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.809390 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:31.809522 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:31.824074 28325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.070s	sys 0.105s
W20260709 12:20:31.359174 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.901680 28308 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:31.185174 28109 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:31.852250 25268 raft_consensus.cc:2410] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:20:31.136838 28349 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:30.918757 28044 consensus_meta.cc:287] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.958s	user 0.006s	sys 0.006s
I20260709 12:20:31.380431 25858 raft_consensus.cc:2368] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8.
I20260709 12:20:31.817162 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:30.898662 28302 consensus_queue.cc:1059] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.959s
I20260709 12:20:31.259586 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2315) took 1539 ms. Trace:
I20260709 12:20:30.993883 28354 consensus_queue.cc:1243] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:31.854832 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:31.885277 25272 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:31.855742 25276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.044s	user 0.043s	sys 0.040s
I20260709 12:20:31.808432 25126 rpcz_store.cc:276] 0709 12:20:29.651106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.890761 (+1239655us) service_pool.cc:224] Handling call
0709 12:20:31.140199 (+249438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:31.139930 28346 raft_consensus.cc:3055] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:31.886921 28346 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:31.887370 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.887934 28346 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:30.915316 28312 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:30.911216 28168 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:30.956586 28257 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:31.184800 28316 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:31.140151 28223 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:31.855185 25124 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:31.864991 28294 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.861043 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:31.898677 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 91295.8us
I20260709 12:20:31.862869 25168 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:31.847836 27869 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.209216 28258 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9.
I20260709 12:20:31.896981 28257 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.866514 25275 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:31.874953 28350 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:31.841907 28353 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:31.879640 25274 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
W20260709 12:20:31.804471 25119 rpcz_store.cc:269] 0709 12:20:29.610687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.474052 (+1863365us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:31.474218 (+   166us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:31.880052 25120 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:20:31.937541 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2320) took 2208 ms. Trace:
I20260709 12:20:31.937749 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.937857 25120 rpcz_store.cc:276] 0709 12:20:29.729660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.858354 (+2128694us) service_pool.cc:224] Handling call
0709 12:20:31.859978 (+  1624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:31.937300 (+ 77322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.937487 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:31.938758 25119 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:31.940183 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.882922 25122 rpcz_store.cc:276] 0709 12:20:29.719668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.258442 (+1538774us) service_pool.cc:224] Handling call
0709 12:20:31.258901 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:31.259147 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:31.259183 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:31.259239 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:31.259289 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.259358 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:31.259506 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:31.941504 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.941691 28336 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.942301 25122 raft_consensus.cc:2393] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 8: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:31.942297 28336 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:31.859944 28325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.070s	sys 0.105s
I20260709 12:20:31.943159 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:31.863724 28270 consensus_meta.cc:287] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.971s	user 0.010s	sys 0.002s
I20260709 12:20:31.943974 25122 raft_consensus.cc:2410] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:31.943955 25241 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:31.944300 28270 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.945187 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:31.945714 25122 raft_consensus.cc:2376] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6. Re-sending same reply.
I20260709 12:20:31.888525 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.945822 25241 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:31.946523 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.946784 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:31.813727 28261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.329s	user 0.003s	sys 0.006s
W20260709 12:20:31.892565 25825 connection.cc:256] RPC call timeout handler was delayed by -1.4820593859999462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 12:20:31.947584 25825 connection.cc:256] RPC call timeout handler was delayed by -1.4329212239999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
I20260709 12:20:31.947615 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:31.948179 25825 connection.cc:256] RPC call timeout handler was delayed by -1.4329212239999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
W20260709 12:20:31.948552 25825 connection.cc:256] RPC call timeout handler was delayed by -1.3130264410001473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2655s for a response
W20260709 12:20:31.947479 28261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.469s	user 0.003s	sys 0.007s
I20260709 12:20:31.948966 28270 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:31.185034 28268 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:31.949823 28270 consensus_queue.cc:1059] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:31.950433 28268 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.948945 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.952884 28268 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:31.878914 28355 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.898636 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.919584 25271 raft_consensus.cc:1813] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Handling vote request from an unknown peer 897be935c42e41b995f177155b042be0
W20260709 12:20:31.922050 25823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.023s	sys 0.044s
I20260709 12:20:31.895395 28316 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:31.859299 28249 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.954339 25119 raft_consensus.cc:2410] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:20:31.956154 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.896173 28197 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:31.956790 25851 raft_consensus.cc:2368] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:31.954990 28316 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:31.863783 28262 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.960032 28262 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:31.864912 25118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1818) took 1918 ms (client timeout 1798 ms). Trace:
W20260709 12:20:31.960695 25118 rpcz_store.cc:269] 0709 12:20:29.946739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.158251 (+211512us) service_pool.cc:224] Handling call
0709 12:20:31.864718 (+1706467us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b54001c98d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:31.864847 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14636800}
I20260709 12:20:31.955083 25271 raft_consensus.cc:2410] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:31.885262 28044 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:31.948894 25825 connection.cc:256] RPC call timeout handler was delayed by -1.0616387600000508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26789999999999997s for a response
W20260709 12:20:31.965229 25825 connection.cc:256] RPC call timeout handler was delayed by -1.054761691000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3144s for a response
W20260709 12:20:31.965590 25825 connection.cc:256] RPC call timeout handler was delayed by -1.054268195000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3144s for a response
I20260709 12:20:31.929299 28126 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:31.929693 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 66909us
I20260709 12:20:31.931188 28346 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:31.970501 25168 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:31.882356 28109 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.962450 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.972231 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:31.963060 25274 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:31.972949 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.973474 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2241) took 1032 ms. Trace:
I20260709 12:20:31.915552 28039 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:31.963447 25119 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:20:31.954797 25823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.023s	sys 0.044s
I20260709 12:20:31.975613 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.954414 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.977169 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.978207 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:31.978873 25124 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:20:31.953570 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.980046 25122 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:31.981276 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.964184 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2238) took 1023 ms. Trace:
I20260709 12:20:31.966955 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:31.982362 25854 raft_consensus.cc:1813] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Handling vote request from an unknown peer 897be935c42e41b995f177155b042be0
I20260709 12:20:31.982208 25271 rpcz_store.cc:276] 0709 12:20:30.940576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.853070 (+912494us) service_pool.cc:224] Handling call
0709 12:20:31.964120 (+111050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:31.983006 25854 raft_consensus.cc:2410] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:31.967895 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:31.984086 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:31.984505 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.984625 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:31.985518 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.812209 25090 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:31.985811 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:31.986480 25853 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:31.986552 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.973899 25274 rpcz_store.cc:276] 0709 12:20:30.941235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.962331 (+1021096us) service_pool.cc:224] Handling call
0709 12:20:31.962749 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:31.973152 (+ 10403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.973390 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:31.975044 25275 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:31.969208 25859 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:20:31.936997 28223 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:31.933856 28350 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:31.988590 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2240) took 1047 ms. Trace:
I20260709 12:20:31.988300 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:31.987851 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:31.992537 25119 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:31.992870 25118 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:31.924588 28294 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.961642 28257 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.953748 28355 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.938288 27869 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:31.988160 25122 raft_consensus.cc:2393] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:20:32.139879 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 152136us
I20260709 12:20:32.390792 28361 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:32.164537 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.391341 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:32.391928 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 419753us
I20260709 12:20:32.392714 25241 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:32.392992 25092 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:32.139638 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 160691us
I20260709 12:20:32.393788 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:32.394640 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.394738 25092 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:32.019150 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:32.399667 27869 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:31.966920 28270 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:32.171262 28109 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:32.400784 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:32.402822 28376 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:31.991175 28039 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:32.391424 28361 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:32.405237 28039 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:32.405409 28288 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:31.987845 28370 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:32.406339 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:32.406584 28370 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:32.154079 28373 raft_consensus.cc:3055] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:32.017700 28249 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:32.407675 28373 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:32.410271 25197 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
W20260709 12:20:32.412154 25272 consensus_meta.cc:287] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.003s
I20260709 12:20:32.412497 25272 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:32.412945 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2236) took 1472 ms. Trace:
I20260709 12:20:32.413224 25272 rpcz_store.cc:276] 0709 12:20:30.940113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.813366 (+873253us) service_pool.cc:224] Handling call
0709 12:20:32.412892 (+599526us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:32.415568 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:31.976131 28341 consensus_meta.cc:287] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.837s	user 0.012s	sys 0.000s
W20260709 12:20:32.167330 28364 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 12:20:32.165056 27623 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:32.352252 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.991988 28223 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.395807 25165 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:32.403266 28376 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.407197 28370 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:32.453199 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.485574 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 89852.5us
W20260709 12:20:32.160771 28360 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 12:20:32.132248 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 44271.3us
W20260709 12:20:32.154706 28363 log.cc:927] Time spent T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 12:20:32.488286 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2234) took 1548 ms. Trace:
I20260709 12:20:31.991070 28302 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:31.989346 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:32.408720 28373 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:32.552023 25859 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:32.169224 28336 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:32.552943 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:32.490728 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:32.033289 25855 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:32.426950 25853 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:32.491997 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:31.992297 25275 rpcz_store.cc:276] 0709 12:20:30.941014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.961956 (+1020942us) service_pool.cc:224] Handling call
0709 12:20:31.974725 (+ 12769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:31.988339 (+ 13614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.988535 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:32.018074 28272 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:32.419402 28288 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:32.409529 28350 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:32.410311 28380 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:32.489308 28328 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.018s	sys 0.003s
W20260709 12:20:32.489161 28261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.012s	sys 0.010s
I20260709 12:20:32.139133 28353 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.356s
I20260709 12:20:32.527066 28262 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:32.551743 28302 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.488891 28109 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.147s
I20260709 12:20:32.580812 28373 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:32.424336 28341 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:32.572208 25854 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:32.489576 28298 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:32.489023 28223 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:32.487385 28376 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:32.410528 28222 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.577304 28206 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:32.576706 28272 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.422169 28039 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:31.987988 28126 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:32.592121 28328 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.019s	sys 0.003s
I20260709 12:20:32.621409 28302 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:32.623679 28316 consensus_meta.cc:287] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.666s	user 0.005s	sys 0.005s
I20260709 12:20:32.618898 28294 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:32.652390 28316 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:32.654680 28316 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:32.637054 28278 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.014s	sys 0.072s
W20260709 12:20:32.632643 28338 consensus_meta.cc:287] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.793s	user 0.012s	sys 0.000s
I20260709 12:20:32.656148 28341 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:32.659929 28257 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:32.658699 28355 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:32.661032 28355 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:32.661335 28374 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.496s	user 0.009s	sys 0.004s
I20260709 12:20:32.661513 28355 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:32.663888 28355 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:32.594537 28380 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:32.621235 28262 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:32.642556 28272 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:32.686739 28263 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:20:32.668430 28278 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.015s	sys 0.073s
W20260709 12:20:32.690109 28375 log.cc:927] Time spent T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.526s	user 0.007s	sys 0.005s
W20260709 12:20:32.691375 28371 log.cc:927] Time spent T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.533s	user 0.012s	sys 0.005s
I20260709 12:20:32.693086 28300 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:32.712621 28349 raft_consensus.cc:3055] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:32.713184 28349 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:32.714255 28361 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:32.719677 28356 consensus_meta.cc:287] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.000s
I20260709 12:20:32.720011 28380 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:32.728230 28372 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.574s	user 0.000s	sys 0.008s
I20260709 12:20:32.722254 28349 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:32.730244 28349 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:32.733101 28346 consensus_meta.cc:287] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.744s	user 0.004s	sys 0.002s
I20260709 12:20:32.751631 28376 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:32.753441 28376 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:32.397239 25121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 608) took 2706 ms (client timeout 2206 ms). Trace:
I20260709 12:20:32.134065 25126 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
W20260709 12:20:32.784025 25167 leader_election.cc:336] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.643s (SENT)
W20260709 12:20:32.783936 25121 rpcz_store.cc:269] 0709 12:20:29.690877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.728579 (+ 37702us) service_pool.cc:224] Handling call
0709 12:20:32.396972 (+2668393us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b540022a1d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:32.397154 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4842280832}
W20260709 12:20:31.994412 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 182300us
I20260709 12:20:32.423451 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:32.020633 25125 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:32.420934 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:31.998783 25093 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.940s (SENT) [suppressed 65 similar messages]
I20260709 12:20:32.791919 25200 raft_consensus.cc:2410] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:20:32.793080 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 397083us
W20260709 12:20:32.417116 25202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2174) took 4777 ms (client timeout 2076 ms). Trace:
W20260709 12:20:32.796362 25202 rpcz_store.cc:269] 0709 12:20:27.640035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.640203 (+   168us) service_pool.cc:224] Handling call
0709 12:20:32.416929 (+4776726us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400178754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:32.417052 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830263168}
W20260709 12:20:32.797084 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.797698 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.798063 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:32.798588 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.543453 25269 rpcz_store.cc:276] 0709 12:20:30.939421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.939771 (+   350us) service_pool.cc:224] Handling call
0709 12:20:30.940163 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:30.940479 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:30.940520 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:31.592470 (+651950us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b2c0003d328. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:20:31.592930 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:20:31.927516 (+334586us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:31.927572 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.927669 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:32.166936 (+239267us) raft_consensus.cc:1685] finished
0709 12:20:32.166954 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.488196 (+321242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81978240,"thread_start_us":334108,"threads_started":1,"wal-append.queue_time_us":339688}
I20260709 12:20:32.487849 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:32.574935 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.800585 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 927) took 2857 ms. Trace:
I20260709 12:20:32.801904 25271 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 8: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:32.803167 25201 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
W20260709 12:20:32.804078 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.801800 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2184) took 3184 ms. Trace:
I20260709 12:20:32.804908 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:32.802927 25276 rpcz_store.cc:276] 0709 12:20:29.942453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.958498 (+ 16045us) service_pool.cc:224] Handling call
0709 12:20:29.965734 (+  7236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:30.014108 (+ 48374us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:30.811392 (+797284us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b18000f2380. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2103ab64bc 00007f2100e0448b 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e1e455 00007f21079063c7 00007f2103f189a7 00007f2103f280bf
0709 12:20:30.811639 (+   247us) log.cc:844] Serialized 14 byte log entry
0709 12:20:30.925714 (+114075us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b18000f2380. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:20:31.963597 (+1037883us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:31.977835 (+ 14238us) log.cc:844] Serialized 26 byte log entry
0709 12:20:31.979046 (+  1211us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:31.979086 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.979150 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:32.799870 (+820720us) raft_consensus.cc:1685] finished
0709 12:20:32.799939 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.800274 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12797,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":101951,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":2795,"spinlock_wait_cycles":24215680,"thread_start_us":1211677,"threads_started":4,"wal-append.queue_time_us":1103332}
I20260709 12:20:32.628499 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:32.808482 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:32.804929 25193 rpcz_store.cc:276] 0709 12:20:29.617181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.025741 (+408560us) service_pool.cc:224] Handling call
0709 12:20:30.026145 (+   404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:30.035185 (+  9040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.035216 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:31.591389 (+1556173us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b2c0000e5c8. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:20:31.800872 (+209483us) log.cc:844] Serialized 52 byte log entry
0709 12:20:31.923563 (+122691us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:31.941898 (+ 18335us) log.cc:844] Serialized 14 byte log entry
0709 12:20:31.942364 (+   466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.942431 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:32.690833 (+748402us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:32.801137 (+110304us) raft_consensus.cc:1685] finished
0709 12:20:32.801188 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.801548 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8600,"prepare.queue_time_us":258004,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":9013,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":39969,"spinlock_wait_cycles":53964032,"thread_start_us":108099,"threads_started":2,"wal-append.queue_time_us":323808}
I20260709 12:20:32.811257 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:32.812330 25855 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:32.812604 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:32.792182 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.813648 25193 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:32.819695 25272 raft_consensus.cc:2410] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:20:32.819780 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.498725 27623 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:32.623482 28012 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.776s	user 0.009s	sys 0.001s
I20260709 12:20:32.687719 28223 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:32.794906 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:32.789831 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:32.813868 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:32.809458 25856 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:32.802039 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2239) took 1861 ms. Trace:
I20260709 12:20:32.013782 25119 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:32.821676 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:32.005342 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:32.843263 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 418309us
I20260709 12:20:32.847519 25274 raft_consensus.cc:2410] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:32.641563 28039 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.703238 28263 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:32.872711 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2317) took 3152 ms. Trace:
I20260709 12:20:32.429827 25124 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:32.890157 25125 rpcz_store.cc:276] 0709 12:20:29.720207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.825100 (+2104893us) service_pool.cc:224] Handling call
0709 12:20:31.825446 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.790531 (+965085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.872194 (+ 81663us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002ace54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:32.872473 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397900672}
I20260709 12:20:32.890970 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:32.892552 28206 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:32.892818 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2321) took 3129 ms. Trace:
I20260709 12:20:32.893064 25125 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:32.851341 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:32.798632 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 311832us
I20260709 12:20:32.852634 28262 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:32.852527 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:32.854442 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:32.638438 28222 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:32.872027 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:32.893302 25124 rpcz_store.cc:276] 0709 12:20:29.763145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.891147 (+3128002us) service_pool.cc:224] Handling call
0709 12:20:32.891833 (+   686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.892262 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:32.892289 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:32.892368 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:32.892409 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.892487 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.892612 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:32.858526 25090 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:32.859337 25194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2185) took 3241 ms (client timeout 3278 ms). Trace:
I20260709 12:20:32.871445 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2186) took 4151 ms. Trace:
I20260709 12:20:32.893870 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2326) took 3065 ms. Trace:
I20260709 12:20:32.926676 25125 rpcz_store.cc:276] 0709 12:20:29.828065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.891973 (+3063908us) service_pool.cc:224] Handling call
0709 12:20:32.892551 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.893568 (+  1017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.893810 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:32.873984 25127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 604) took 3232 ms (client timeout 1896 ms). Trace:
I20260709 12:20:32.864105 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2194) took 2718 ms. Trace:
W20260709 12:20:32.883054 25199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2189) took 4133 ms (client timeout 3130 ms). Trace:
I20260709 12:20:32.867125 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 646) took 3250 ms. Trace:
W20260709 12:20:32.928697 25127 rpcz_store.cc:269] 0709 12:20:29.641966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.681472 (+ 39506us) service_pool.cc:224] Handling call
0709 12:20:32.873499 (+3192027us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b54001c9dd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:32.873742 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059945344}
I20260709 12:20:32.910235 25268 rpcz_store.cc:276] 0709 12:20:30.940791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.875892 (+935101us) service_pool.cc:224] Handling call
0709 12:20:31.876302 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:31.876571 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:31.876613 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:31.877155 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:20:31.939965 (+ 62810us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:31.940001 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.940064 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:32.660783 (+720719us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:32.801173 (+140390us) raft_consensus.cc:1685] finished
0709 12:20:32.801241 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.801778 (+   537us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30563712,"thread_start_us":62358,"threads_started":1,"wal-append.queue_time_us":118109}
W20260709 12:20:32.925961 25194 rpcz_store.cc:269] 0709 12:20:29.617441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.009925 (+392484us) service_pool.cc:224] Handling call
0709 12:20:32.858913 (+2848988us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54004132d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:32.859102 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278813056}
W20260709 12:20:32.937675 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 56797.9us
W20260709 12:20:32.857918 25242 leader_election.cc:336] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.570s (SENT)
I20260709 12:20:32.869872 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:32.930800 25196 rpcz_store.cc:276] 0709 12:20:29.616425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.025024 (+408599us) service_pool.cc:224] Handling call
0709 12:20:32.417064 (+2392040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.417241 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:32.417264 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:32.417303 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:32.417339 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.417391 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.866595 (+449204us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b5400178750. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:32.866862 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5497623296}
W20260709 12:20:32.880786 25241 leader_election.cc:336] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.723s (SENT)
W20260709 12:20:32.930419 25199 rpcz_store.cc:269] 0709 12:20:28.749651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.754519 (+  4868us) service_pool.cc:224] Handling call
0709 12:20:32.882585 (+4128066us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54002db754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:32.882800 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3069477248}
I20260709 12:20:32.929265 25195 rpcz_store.cc:276] 0709 12:20:30.146521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.876400 (+729879us) service_pool.cc:224] Handling call
0709 12:20:30.896530 (+ 20130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:31.806480 (+909950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.863219 (+1056739us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54000a6254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:32.863758 (+   539us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561762176}
I20260709 12:20:32.926110 25198 rpcz_store.cc:276] 0709 12:20:28.719709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.719839 (+   130us) service_pool.cc:224] Handling call
0709 12:20:28.734283 (+ 14444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:28.776202 (+ 41919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.870601 (+4094399us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b54003615d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:32.871162 (+   561us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72037632}
I20260709 12:20:32.933218 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2355) took 1039 ms. Trace:
I20260709 12:20:32.868891 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:32.868232 28126 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:32.993285 25125 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:32.993247 25121 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9.
I20260709 12:20:32.995849 25201 raft_consensus.cc:2393] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:20:32.963378 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.882802 28350 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:32.996282 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 951810us
W20260709 12:20:32.981323 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 150479us
I20260709 12:20:32.992643 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2345) took 1067 ms. Trace:
I20260709 12:20:33.022935 25122 rpcz_store.cc:276] 0709 12:20:31.889353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.788919 (+899566us) service_pool.cc:224] Handling call
0709 12:20:32.928838 (+139919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:32.993462 25853 raft_consensus.cc:2376] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6. Re-sending same reply.
I20260709 12:20:33.034682 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2331) took 3196 ms. Trace:
I20260709 12:20:33.035221 25125 rpcz_store.cc:276] 0709 12:20:29.829447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.942055 (+3112608us) service_pool.cc:224] Handling call
0709 12:20:32.992998 (+ 50943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.025373 (+ 32375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.025594 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:32.942528 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.021277 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:33.033418 25119 rpcz_store.cc:276] 0709 12:20:31.874688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.988085 (+113397us) service_pool.cc:224] Handling call
0709 12:20:32.930063 (+941978us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:32.949241 25197 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 2.
I20260709 12:20:32.963799 25193 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:32.948837 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:33.035408 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2339) took 1162 ms. Trace:
I20260709 12:20:33.040253 25121 rpcz_store.cc:276] 0709 12:20:31.872863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.852160 (+979297us) service_pool.cc:224] Handling call
0709 12:20:33.035350 (+183190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.041047 28287 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:33.041697 25125 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:33.041625 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 161123us
I20260709 12:20:33.042649 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1813) took 3165 ms. Trace:
I20260709 12:20:33.043082 25125 rpcz_store.cc:276] 0709 12:20:29.877610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.040921 (+3163311us) service_pool.cc:224] Handling call
0709 12:20:33.041433 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.042290 (+   857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.042523 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:32.995229 27623 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:33.045274 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.046664 25199 raft_consensus.cc:1240] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:33.047221 25119 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:32.924266 28206 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 12:20:33.047849 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1814) took 3141 ms. Trace:
I20260709 12:20:33.047910 28350 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:33.048377 25119 rpcz_store.cc:276] 0709 12:20:29.906917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.046300 (+3139383us) service_pool.cc:224] Handling call
0709 12:20:33.046825 (+   525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.047627 (+   802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.047792 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:32.997179 28223 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:33.049501 25239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.021s	sys 0.006s
W20260709 12:20:33.049994 25239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.021s	sys 0.006s
W20260709 12:20:33.051729 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.992857 28039 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.056388 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:33.057224 28044 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:32.885380 28302 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:33.060441 28270 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:33.061064 28270 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:32.976442 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:32.949466 28268 raft_consensus.cc:2764] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:20:33.071228 25092 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:33.077072 25267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 906) took 4885 ms (client timeout 2967 ms). Trace:
W20260709 12:20:33.077381 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 127573us
W20260709 12:20:33.077657 25267 rpcz_store.cc:269] 0709 12:20:28.191458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.200965 (+  9507us) service_pool.cc:224] Handling call
0709 12:20:33.076639 (+4875674us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54002be8d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:33.076826 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574588800}
I20260709 12:20:33.079618 25090 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:33.081230 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.077072 28049 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:33.082841 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 61917.9us
I20260709 12:20:33.082940 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:32.865309 28370 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.081779 25090 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:33.085256 28206 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:33.089183 25854 raft_consensus.cc:2393] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 7: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:20:33.089421 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 231702us
I20260709 12:20:33.089687 28312 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.090571 28312 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:33.091533 25242 leader_election.cc:336] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.075s (SENT)
I20260709 12:20:33.092097 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:33.092666 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.092886 28034 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:33.093158 28312 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:33.089443 28206 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:33.089730 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1157) took 1113 ms. Trace:
I20260709 12:20:33.093520 28044 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:20:33.093611 25273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2242) took 2152 ms (client timeout 2746 ms). Trace:
I20260709 12:20:33.103305 25854 rpcz_store.cc:276] 0709 12:20:31.976737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.835358 (+858621us) service_pool.cc:224] Handling call
0709 12:20:33.089650 (+254292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.106685 25855 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:33.105007 25273 rpcz_store.cc:269] 0709 12:20:30.941485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.092170 (+2150685us) service_pool.cc:224] Handling call
0709 12:20:33.093522 (+  1352us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.111363 28376 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:33.125770 28376 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:33.125811 25857 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
W20260709 12:20:33.135161 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 43688.1us
I20260709 12:20:33.141932 28335 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.150964 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 615) took 1222 ms. Trace:
I20260709 12:20:33.151372 25122 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:33.152086 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1812) took 3291 ms. Trace:
I20260709 12:20:33.152581 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:33.152482 25122 rpcz_store.cc:276] 0709 12:20:29.861360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.070573 (+3209213us) service_pool.cc:224] Handling call
0709 12:20:33.123752 (+ 53179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.151829 (+ 28077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.152030 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.153461 25852 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:33.154284 25851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 869) took 3193 ms (client timeout 1801 ms). Trace:
I20260709 12:20:33.151417 25126 rpcz_store.cc:276] 0709 12:20:31.928803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.946578 (+ 17775us) service_pool.cc:224] Handling call
0709 12:20:33.150558 (+1203980us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400453154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:33.150730 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429251840}
W20260709 12:20:33.154872 25851 rpcz_store.cc:269] 0709 12:20:29.960618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.113131 (+152513us) service_pool.cc:224] Handling call
0709 12:20:33.153805 (+3040674us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400373054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:33.154048 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4141599488}
I20260709 12:20:33.156154 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:33.156154 28357 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.156872 28357 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.152895 25272 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:33.160189 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.162123 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:33.163326 25851 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:33.148699 28370 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:33.165354 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:33.127728 25123 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:33.114287 28302 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:33.169054 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 624) took 1204 ms. Trace:
W20260709 12:20:33.143558 25859 consensus_meta.cc:287] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.591s	user 0.016s	sys 0.004s
I20260709 12:20:33.170550 25123 rpcz_store.cc:276] 0709 12:20:31.964548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.857974 (+893426us) service_pool.cc:224] Handling call
0709 12:20:33.168985 (+311011us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.111330 28263 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.176954 25856 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
W20260709 12:20:33.174835 25857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 837) took 3053 ms (client timeout 1723 ms). Trace:
W20260709 12:20:33.178846 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 64710.3us
W20260709 12:20:33.179122 25857 rpcz_store.cc:269] 0709 12:20:30.121807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.146850 (+ 25043us) service_pool.cc:224] Handling call
0709 12:20:33.166298 (+3019448us) spinlock_profiling.cc:243] Waited 2.54 s on lock 0x7b5400750154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:33.174752 (+  8454us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5832186112}
I20260709 12:20:33.180995 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:33.183276 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 101632us
I20260709 12:20:33.129386 28312 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:33.183920 25859 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:33.210233 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:33.208350 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 623) took 1248 ms. Trace:
I20260709 12:20:33.214054 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 880) took 1242 ms. Trace:
I20260709 12:20:33.216233 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:33.214493 25859 rpcz_store.cc:276] 0709 12:20:31.968379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.989072 (+ 20693us) service_pool.cc:224] Handling call
0709 12:20:33.196203 (+1207131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.217010 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:33.219887 28051 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:33.218479 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1820) took 2320 ms. Trace:
I20260709 12:20:33.212809 25126 rpcz_store.cc:276] 0709 12:20:31.936246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.155412 (+1219166us) service_pool.cc:224] Handling call
0709 12:20:33.155840 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.180184 (+ 24344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.180229 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.184040 (+  3811us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:33.184097 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.184165 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.184287 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":160,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":8915}
I20260709 12:20:33.224998 25857 raft_consensus.cc:2376] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5. Re-sending same reply.
I20260709 12:20:33.226750 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.227775 25857 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 2.
I20260709 12:20:33.229261 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.230093 25857 raft_consensus.cc:2393] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 7: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:20:33.230170 28400 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:20:33.231525 25271 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:33.232283 25856 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:33.232334 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.233093 25857 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:33.222523 25119 rpcz_store.cc:276] 0709 12:20:30.893971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.084812 (+2190841us) service_pool.cc:224] Handling call
0709 12:20:33.150703 (+ 65891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.151078 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.151105 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.151167 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:33.151209 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.151261 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.214567 (+ 63306us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b5400453150. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:33.214690 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61580160}
I20260709 12:20:33.216619 25242 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:33.235055 25119 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:33.236889 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:33.234977 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.238634 25267 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:33.238761 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 883) took 1224 ms. Trace:
I20260709 12:20:33.239328 25859 rpcz_store.cc:276] 0709 12:20:32.014303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.234685 (+1220382us) service_pool.cc:224] Handling call
0709 12:20:33.238686 (+  4001us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.247206 28393 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.247993 28393 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.250507 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:33.251353 28222 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:33.251343 25859 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:33.254249 25165 leader_election.cc:400] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6.
I20260709 12:20:33.254590 25165 leader_election.cc:403] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:33.222090 28357 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:33.259200 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:33.261327 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 81569us
W20260709 12:20:33.261953 28197 consensus_meta.cc:287] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 1.305s	user 0.012s	sys 0.008s
I20260709 12:20:33.142621 28258 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 12:20:33.264041 28258 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:33.264441 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:33.265106 28206 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:33.265429 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:33.265995 28049 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:33.266302 25853 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:33.268260 28333 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6.
I20260709 12:20:33.268574 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.269658 25274 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:33.270081 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 827) took 3745 ms. Trace:
I20260709 12:20:33.270262 28249 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.270813 28249 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.272691 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:33.273404 25269 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:33.262356 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:33.275493 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.276134 25275 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:33.276986 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.277666 25275 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:33.278277 28197 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:33.278848 25858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 862) took 3324 ms (client timeout 2154 ms). Trace:
I20260709 12:20:33.278934 28197 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:33.279320 25858 rpcz_store.cc:269] 0709 12:20:29.955621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.080903 (+125282us) service_pool.cc:224] Handling call
0709 12:20:33.278448 (+3197545us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001d1fd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:33.278664 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2952341376}
I20260709 12:20:33.280404 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.282640 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.284473 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:33.287811 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:33.290362 28222 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:33.291934 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:33.293923 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.294902 25853 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:33.295892 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:33.296614 25853 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:33.297155 25241 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:33.299018 25241 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:33.300014 28249 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:33.300735 25241 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:33.302017 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.303118 25276 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:33.303551 28268 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:33.304774 25276 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:33.305241 25090 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:33.304768 28051 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:33.306434 28051 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:33.307719 28051 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:33.308597 25165 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:33.309408 28051 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:33.217521 25168 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:33.310220 28222 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:33.310868 28390 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:33.311578 28376 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:33.311637 25276 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:20:33.317058 28039 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.316541 25022 catalog_manager.cc:5697] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 4 to 8, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 8 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.280987 25858 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:33.333724 25852 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:33.331082 25856 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:33.334276 25855 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:33.338523 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1163) took 1348 ms. Trace:
I20260709 12:20:33.336285 25269 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:33.334532 25276 pending_rounds.cc:85] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 2
I20260709 12:20:33.340453 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:33.340453 25202 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:20:33.340835 25195 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:33.341118 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1170) took 1010 ms. Trace:
I20260709 12:20:33.372426 25858 rpcz_store.cc:276] 0709 12:20:32.326425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.280145 (+953720us) service_pool.cc:224] Handling call
0709 12:20:33.336940 (+ 56795us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.341425 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:33.270512 25860 rpcz_store.cc:276] 0709 12:20:29.524962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.679318 (+1154356us) service_pool.cc:224] Handling call
0709 12:20:33.185918 (+2506600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.224077 (+ 38159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.224129 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.224204 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:33.224289 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.224387 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.269754 (+ 45367us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b5400750150. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:33.269875 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13985,"raft.queue_time_us":8455,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":147,"spinlock_wait_cycles":5726963584}
I20260709 12:20:33.345476 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:33.347548 28393 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:33.347935 25118 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:33.348470 28376 raft_consensus.cc:697] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:33.349256 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:33.349517 28272 consensus_meta.cc:287] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.004s
I20260709 12:20:33.347551 28302 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:33.350401 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 204842us
I20260709 12:20:33.351298 25274 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:33.356267 28263 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:33.359076 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:33.388096 25857 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:33.359788 28039 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:33.380376 25276 pending_rounds.cc:107] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:20:33.362397 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:33.336098 28049 raft_consensus.cc:2764] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:20:33.344708 25022 catalog_manager.cc:5697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 6, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 6 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.339051 25855 rpcz_store.cc:276] 0709 12:20:31.989846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.082509 (+1092663us) service_pool.cc:224] Handling call
0709 12:20:33.338452 (+255943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.365960 25859 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:33.377825 25271 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
W20260709 12:20:33.378456 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 68410.8us
W20260709 12:20:33.379726 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 113690us
I20260709 12:20:33.382052 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1809) took 3546 ms. Trace:
I20260709 12:20:33.390866 25198 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:33.391252 25276 raft_consensus.cc:2889] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.386286 25241 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:33.388615 25851 raft_consensus.cc:2410] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:20:33.398351 25851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1168) took 1085 ms. Trace:
I20260709 12:20:33.398779 25851 rpcz_store.cc:276] 0709 12:20:32.312962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.161773 (+848811us) service_pool.cc:224] Handling call
0709 12:20:33.398283 (+236510us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.384651 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:33.400241 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:33.389941 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.402489 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.382974 28287 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:33.408722 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:33.410147 25855 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:33.411276 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:33.413216 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.413101 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 67862us
I20260709 12:20:33.414814 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.416219 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.404583 25854 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9.
I20260709 12:20:33.405877 25090 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:33.418300 25859 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:33.419332 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.425156 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:33.429334 25858 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:33.393492 25124 rpcz_store.cc:276] 0709 12:20:29.830256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.940941 (+3110685us) service_pool.cc:224] Handling call
0709 12:20:33.063113 (+122172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.063562 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:33.063927 (+   365us) log.cc:844] Serialized 14 byte log entry
0709 12:20:33.374868 (+310941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.374913 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:33.374958 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.375016 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.375119 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4103,"prepare.queue_time_us":3597,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":15335,"raft.queue_time_us":6377,"thread_start_us":306269,"threads_started":1}
I20260709 12:20:33.431310 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1823) took 2502 ms. Trace:
I20260709 12:20:33.408866 28197 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:33.441524 28403 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:20:33.442678 28270 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.443715 28393 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:33.444145 28393 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.444516 28393 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:33.419586 28390 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:33.445200 28390 raft_consensus.cc:697] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:33.445272 28270 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:33.437830 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.438920 25859 raft_consensus.cc:2368] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:33.446780 28287 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:33.438773 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:33.404850 28312 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:20:33.439857 28353 consensus_queue.cc:1059] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.219s
I20260709 12:20:33.450287 25241 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:33.443070 28222 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:33.446341 28390 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.446326 25852 raft_consensus.cc:2393] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:33.433156 25853 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:33.439306 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:33.433028 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.447634 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2207) took 1016 ms. Trace:
I20260709 12:20:33.446326 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2211) took 1013 ms. Trace:
I20260709 12:20:33.451035 25856 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:33.432411 25125 rpcz_store.cc:276] 0709 12:20:30.936729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.068693 (+2131964us) service_pool.cc:224] Handling call
0709 12:20:33.114205 (+ 45512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.178607 (+ 64402us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:33.231056 (+ 52449us) log.cc:844] Serialized 14 byte log entry
0709 12:20:33.430981 (+199925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.431035 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:33.431080 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.431145 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.431253 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":120890,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":6260,"thread_start_us":193250,"threads_started":1}
W20260709 12:20:33.461436 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 47441.3us
I20260709 12:20:33.463379 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.464282 25859 raft_consensus.cc:2410] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:33.464819 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1153) took 1489 ms. Trace:
I20260709 12:20:33.465245 25859 rpcz_store.cc:276] 0709 12:20:31.975792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.447203 (+1471411us) service_pool.cc:224] Handling call
0709 12:20:33.464744 (+ 17541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.403132 28333 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:20:33.394448 28272 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.451155 28287 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:33.469406 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:33.471592 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 55829.2us
I20260709 12:20:33.453507 25196 rpcz_store.cc:276] 0709 12:20:32.431510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.977024 (+545514us) service_pool.cc:224] Handling call
0709 12:20:32.996667 (+ 19643us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:32.997288 (+   621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:32.997323 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:32.998355 (+  1032us) log.cc:844] Serialized 52 byte log entry
0709 12:20:33.088153 (+ 89798us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:33.088205 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.088284 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:33.447343 (+359059us) raft_consensus.cc:1685] finished
0709 12:20:33.447361 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.447544 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":152,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":160,"thread_start_us":89279,"threads_started":1,"wal-append.queue_time_us":186467}
I20260709 12:20:33.472143 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:33.477643 25851 raft_consensus.cc:2410] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:20:33.480360 25126 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:33.453897 25197 rpcz_store.cc:276] 0709 12:20:32.432669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.070424 (+637755us) service_pool.cc:224] Handling call
0709 12:20:33.076746 (+  6322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:33.077487 (+   741us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:33.077896 (+   409us) log.cc:844] Serialized 14 byte log entry
0709 12:20:33.334892 (+256996us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:33.405492 (+ 70600us) log.cc:844] Serialized 26 byte log entry
0709 12:20:33.405621 (+   129us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:33.405654 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.405715 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:33.446103 (+ 40388us) raft_consensus.cc:1685] finished
0709 12:20:33.446120 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.446248 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7809,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":7215,"raft.queue_time_us":3250,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":12005,"thread_start_us":228262,"threads_started":1,"wal-append.queue_time_us":326408}
I20260709 12:20:33.487390 28299 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:33.489410 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 616) took 1560 ms. Trace:
I20260709 12:20:33.489892 25122 rpcz_store.cc:276] 0709 12:20:31.929119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.153667 (+1224548us) service_pool.cc:224] Handling call
0709 12:20:33.161342 (+  7675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:33.161950 (+   608us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:33.161980 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:33.162696 (+   716us) log.cc:844] Serialized 26 byte log entry
0709 12:20:33.373507 (+210811us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:33.373542 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.373600 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:33.489166 (+115566us) raft_consensus.cc:1685] finished
0709 12:20:33.489190 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.489340 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1658,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":204,"thread_start_us":210234,"threads_started":1,"wal-append.queue_time_us":289716}
W20260709 12:20:33.494479 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.496603 28049 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:33.497053 28049 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.497409 28049 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:33.498239 25860 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:33.499737 25860 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:33.500304 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1156) took 1523 ms. Trace:
I20260709 12:20:33.500617 25860 rpcz_store.cc:276] 0709 12:20:31.976514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.499060 (+1522546us) service_pool.cc:224] Handling call
0709 12:20:33.499405 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.500061 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.500229 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.502439 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:33.502848 25119 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:33.503897 25165 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:33.504906 28101 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:33.506299 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 118287us
I20260709 12:20:33.508397 25090 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:33.509676 28126 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:33.510293 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:33.511274 25242 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:33.512548 28109 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:33.517220 25856 raft_consensus.cc:1240] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:33.518076 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 881) took 1549 ms. Trace:
I20260709 12:20:33.518390 25856 rpcz_store.cc:276] 0709 12:20:31.968728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.478216 (+1509488us) service_pool.cc:224] Handling call
0709 12:20:33.516921 (+ 38705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.517725 (+   804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.517963 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.519589 25856 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:33.520100 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1161) took 1542 ms. Trace:
I20260709 12:20:33.520378 25856 rpcz_store.cc:276] 0709 12:20:31.977676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.519057 (+1541381us) service_pool.cc:224] Handling call
0709 12:20:33.519414 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.519904 (+   490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.520049 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.483723 25241 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:33.474324 28270 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:33.446856 28376 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.526921 25127 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 1. Current term is 3. Ops: []
W20260709 12:20:33.528465 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 66137.1us
I20260709 12:20:33.526878 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 610) took 1600 ms. Trace:
I20260709 12:20:33.530807 25859 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:33.530771 25118 rpcz_store.cc:276] 0709 12:20:31.926858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.993490 (+ 66632us) service_pool.cc:224] Handling call
0709 12:20:33.522902 (+1529412us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54002ae254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:33.526810 (+  3908us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938449664}
I20260709 12:20:33.540978 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 879) took 1563 ms. Trace:
I20260709 12:20:33.547537 25859 rpcz_store.cc:276] 0709 12:20:31.968145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.468607 (+1500462us) service_pool.cc:224] Handling call
0709 12:20:33.530644 (+ 62037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.531571 (+   927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.531765 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.521916 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1162) took 1534 ms. Trace:
I20260709 12:20:33.550201 25856 rpcz_store.cc:276] 0709 12:20:31.987257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.520996 (+1533739us) service_pool.cc:224] Handling call
0709 12:20:33.521329 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.521601 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.521625 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.521664 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:33.521722 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.521768 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.521854 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.469676 28302 consensus_queue.cc:1059] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:20:33.570716 28051 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:33.569517 25241 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:33.534703 28258 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:33.578914 25855 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:33.540022 28101 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:33.580084 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1819) took 3625 ms. Trace:
W20260709 12:20:33.595041 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 116747us
I20260709 12:20:33.617707 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 625) took 1646 ms. Trace:
I20260709 12:20:33.613889 25859 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:20:33.623471 25859 pending_rounds.cc:85] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 6
I20260709 12:20:33.623848 25859 pending_rounds.cc:107] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:20:33.595779 25854 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:20:33.624060 25859 raft_consensus.cc:2889] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.624250 25854 pending_rounds.cc:85] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 6
I20260709 12:20:33.624496 25854 pending_rounds.cc:107] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:20:33.624720 25854 raft_consensus.cc:2889] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.542874 25852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:33.577600 25200 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:33.528748 28039 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:20:33.595899 27803 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:33.595575 25120 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:33.600297 28263 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:33.596251 28380 consensus_queue.cc:1059] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:20:33.596902 28349 consensus_queue.cc:1059] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:20:33.594815 28257 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:33.615989 25853 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:20:33.616648 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 47259.9us
I20260709 12:20:33.631817 25093 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:33.634207 25241 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:33.620882 25119 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:33.576264 28370 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:33.612250 25851 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:33.625726 25852 raft_consensus.cc:606] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:33.622823 25123 rpcz_store.cc:276] 0709 12:20:31.971227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.173296 (+1202069us) service_pool.cc:224] Handling call
0709 12:20:33.244811 (+ 71515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:33.267305 (+ 22494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.267337 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:33.267927 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 12:20:33.454766 (+186839us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:33.454828 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.454924 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:33.617482 (+162558us) raft_consensus.cc:1685] finished
0709 12:20:33.617502 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.617648 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":382,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":126,"thread_start_us":161726,"threads_started":1,"wal-append.queue_time_us":298100}
I20260709 12:20:33.558751 28268 consensus_queue.cc:1059] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:20:33.633436 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1164) took 1495 ms. Trace:
I20260709 12:20:33.638401 25859 rpcz_store.cc:276] 0709 12:20:32.137915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.560422 (+1422507us) service_pool.cc:224] Handling call
0709 12:20:33.612984 (+ 52562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.633076 (+ 20092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.633361 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.639350 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1171) took 1305 ms. Trace:
I20260709 12:20:33.646004 25851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1154) took 1660 ms. Trace:
I20260709 12:20:33.646420 25851 rpcz_store.cc:276] 0709 12:20:31.976070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.484430 (+1508360us) service_pool.cc:224] Handling call
0709 12:20:33.566903 (+ 82473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.636232 (+ 69329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.636411 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.639727 25853 rpcz_store.cc:276] 0709 12:20:32.328398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.615284 (+1286886us) service_pool.cc:224] Handling call
0709 12:20:33.615723 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:33.633493 (+ 17770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.633733 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.650156 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1155) took 1673 ms. Trace:
I20260709 12:20:33.650702 25854 rpcz_store.cc:276] 0709 12:20:31.976294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.525297 (+1549003us) service_pool.cc:224] Handling call
0709 12:20:33.566500 (+ 41203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.649784 (+ 83284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.650089 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.635692 28126 raft_consensus.cc:2764] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:20:33.653023 28391 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.653630 28391 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:33.654309 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.656138 28391 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:33.657545 28349 consensus_queue.cc:1243] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:33.658214 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:33.659387 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:33.660668 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:33.660933 28353 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:33.661638 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40270 (request call id 10) took 1645 ms. Trace:
I20260709 12:20:33.661803 28353 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:33.662110 25852 rpcz_store.cc:276] 0709 12:20:32.016438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.472659 (+1456221us) service_pool.cc:224] Handling call
0709 12:20:33.661558 (+188899us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.661777 25022 catalog_manager.cc:5697] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 3 to 4, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.662770 25268 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:33.664039 25022 catalog_manager.cc:5697] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 4 to 7, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 7 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.621593 25121 rpcz_store.cc:276] 0709 12:20:29.955076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.066130 (+3111054us) service_pool.cc:224] Handling call
0709 12:20:33.082482 (+ 16352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.082953 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:33.223566 (+140613us) log.cc:844] Serialized 14 byte log entry
0709 12:20:33.579728 (+356162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.579785 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:33.579836 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.579925 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.580032 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32280,"prepare.queue_time_us":38088,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3976,"raft.queue_time_us":9648,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":332889,"threads_started":2,"wal-append.queue_time_us":275780}
I20260709 12:20:33.666713 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1172) took 1271 ms. Trace:
I20260709 12:20:33.667196 25859 rpcz_store.cc:276] 0709 12:20:32.395614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.639199 (+1243585us) service_pool.cc:224] Handling call
0709 12:20:33.666115 (+ 26916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.666368 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.666401 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.666452 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:33.666488 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.666553 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.666659 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.668903 25859 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:33.669863 25856 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:33.670610 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1165) took 1523 ms. Trace:
I20260709 12:20:33.671236 25856 rpcz_store.cc:276] 0709 12:20:32.147478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.577359 (+1429881us) service_pool.cc:224] Handling call
0709 12:20:33.647881 (+ 70522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.670339 (+ 22458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.670552 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.636235 27803 raft_consensus.cc:697] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:33.635936 28370 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:33.684265 25851 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:33.686394 25851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 846) took 1264 ms. Trace:
I20260709 12:20:33.686846 25851 rpcz_store.cc:276] 0709 12:20:32.421709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.647220 (+1225511us) service_pool.cc:224] Handling call
0709 12:20:33.674690 (+ 27470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.685969 (+ 11279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.686317 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.688323 25851 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:33.669200 28197 raft_consensus.cc:3055] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:33.692121 25126 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:33.692644 25857 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:33.693387 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 882) took 1724 ms. Trace:
I20260709 12:20:33.691731 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1817) took 3746 ms. Trace:
I20260709 12:20:33.692296 28197 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:33.698374 28197 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.699682 28197 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:33.673925 28268 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:33.695313 25857 rpcz_store.cc:276] 0709 12:20:31.969022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.244323 (+1275301us) service_pool.cc:224] Handling call
0709 12:20:33.693317 (+448994us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.695459 25120 rpcz_store.cc:276] 0709 12:20:29.945028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.064138 (+3119110us) service_pool.cc:224] Handling call
0709 12:20:33.106687 (+ 42549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.631341 (+524654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.686001 (+ 54660us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54001b71d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:33.691671 (+  5670us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870899456}
I20260709 12:20:33.707667 25268 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:33.690302 28370 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:33.706939 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.694664 25856 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:33.710142 25853 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:33.689800 28391 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:33.708833 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 179282us
I20260709 12:20:33.713018 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 848) took 1289 ms. Trace:
I20260709 12:20:33.713491 25853 rpcz_store.cc:276] 0709 12:20:32.423776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.669419 (+1245643us) service_pool.cc:224] Handling call
0709 12:20:33.702560 (+ 33141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:33.710621 (+  8061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.712952 (+  2331us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:33.711968 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 93844.6us
W20260709 12:20:33.716128 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 162924us
I20260709 12:20:33.718307 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:33.723415 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.724253 25273 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:20:33.736137 28044 consensus_queue.cc:1059] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:33.737696 28044 raft_consensus.cc:3055] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:33.738225 28044 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:33.738322 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.739275 25276 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:33.739617 28044 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.741233 28044 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:33.741901 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:33.745250 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.719138 25275 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
W20260709 12:20:33.771044 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 232253us
I20260709 12:20:33.704891 28268 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:33.791225 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 74405.8us
I20260709 12:20:33.794355 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1811) took 3942 ms. Trace:
I20260709 12:20:33.794889 25127 rpcz_store.cc:276] 0709 12:20:29.852207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.993617 (+3141410us) service_pool.cc:224] Handling call
0709 12:20:33.526761 (+533144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.527414 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.792811 (+265397us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b54002ae250. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:33.794288 (+  1477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225053056}
I20260709 12:20:33.788674 28380 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:33.709460 28312 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:33.804498 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:33.803584 25200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2214) took 1360 ms (client timeout 1607 ms). Trace:
W20260709 12:20:33.808780 25200 rpcz_store.cc:269] 0709 12:20:32.433632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.794147 (+360515us) service_pool.cc:224] Handling call
0709 12:20:33.793429 (+999282us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54002da354. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:33.793550 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495857536}
W20260709 12:20:33.803639 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 415663us
I20260709 12:20:33.815362 28234 raft_consensus.cc:3055] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:33.816026 28234 raft_consensus.cc:740] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:33.815454 28268 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.816712 28268 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:33.817062 28234 consensus_queue.cc:260] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.818257 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:33.819437 28312 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:33.819638 25093 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:33.820994 28335 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:33.821369 28039 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:33.821844 28039 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:33.822254 28039 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:33.807747 28272 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:33.805291 28380 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.824779 28380 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:33.824834 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 107935us
I20260709 12:20:33.826546 25825 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:33.826431 27803 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:33.827706 28234 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:33.831799 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.819846 28312 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.833483 25167 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:33.808607 25022 catalog_manager.cc:5697] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 5, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 5 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:20:33.844206 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:33.842667 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:33.845148 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.846061 25127 raft_consensus.cc:2410] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:20:33.846207 25825 leader_election.cc:336] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.504s (SENT)
I20260709 12:20:33.850656 25825 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:33.852891 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:33.853586 25120 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
W20260709 12:20:33.854816 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 62425.7us
I20260709 12:20:33.821409 28335 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:33.860430 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.840477 28391 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:33.840324 28312 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:33.832317 28270 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:33.869609 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.867053 25126 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:33.867559 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.875624 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:33.851578 28222 raft_consensus.cc:2764] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:20:33.890642 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:33.864887 28423 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:33.882575 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:33.890136 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:33.881575 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 247429us
I20260709 12:20:33.884274 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:33.898528 25119 raft_consensus.cc:2393] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:33.899528 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:33.918236 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:33.884969 28249 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:33.925114 25267 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:33.927196 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:33.927270 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:33.928875 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 95591.6us
I20260709 12:20:33.930418 25121 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:20:33.931097 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 108843us
I20260709 12:20:33.931149 25127 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:33.894971 28263 raft_consensus.cc:697] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:33.932911 25167 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:33.934126 25275 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
W20260709 12:20:33.934523 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 88343.4us
I20260709 12:20:33.933632 25118 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:33.934126 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:33.942675 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:33.943718 25276 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:33.945940 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.949753 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:33.950484 25119 raft_consensus.cc:2376] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7. Re-sending same reply.
I20260709 12:20:33.951961 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:33.937414 28424 raft_consensus.cc:3055] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:33.960654 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:33.967876 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1169) took 1649 ms. Trace:
W20260709 12:20:33.970237 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 97789.7us
I20260709 12:20:33.971191 25093 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:33.968449 25855 rpcz_store.cc:276] 0709 12:20:32.318620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.579690 (+1261070us) service_pool.cc:224] Handling call
0709 12:20:33.622877 (+ 43187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:33.692074 (+ 69197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.692104 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:33.697414 (+  5310us) log.cc:844] Serialized 26 byte log entry
0709 12:20:33.839749 (+142335us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:33.843898 (+  4149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.847634 (+  3736us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:33.967569 (+119935us) raft_consensus.cc:1685] finished
0709 12:20:33.967607 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.967781 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12079,"raft.queue_time_us":19467,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8538,"thread_start_us":141931,"threads_started":1,"wal-append.queue_time_us":202011}
I20260709 12:20:33.975629 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:33.976327 25122 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9.
I20260709 12:20:33.977547 25127 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
W20260709 12:20:33.978215 25023 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41752 (request call id 363) took 13785 ms (client timeout 15000 ms). Trace:
I20260709 12:20:33.978242 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:33.978672 25023 rpcz_store.cc:269] 0709 12:20:20.141384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.144237 (+  2853us) service_pool.cc:224] Handling call
0709 12:20:33.922241 (+13778004us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:24.242850 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:24.243596 (+   746us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:24.243655 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:20:24.243674 (+    19us) tablet.cc:662] Decoding operations
0709 12:20:24.541043 (+297369us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:24.541161 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:24.541190 (+    29us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:20:24.687274 (+146084us) tablet.cc:701] Row locks acquired
0709 12:20:24.687329 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:20:24.687519 (+   190us) write_op.cc:270] Start()
0709 12:20:24.687698 (+   179us) write_op.cc:276] Timestamp: P: 1783599624687451 usec, L: 0
0709 12:20:24.687715 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:20:24.688438 (+   723us) log.cc:844] Serialized 5674 byte log entry
0709 12:20:25.087122 (+398684us) op_driver.cc:464] REPLICATION: finished
0709 12:20:25.253325 (+166203us) write_op.cc:301] APPLY: starting
0709 12:20:25.253423 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:25.253717 (+   294us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:25.287894 (+ 34177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:25.336807 (+ 48913us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:25.337211 (+   404us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:20:25.337265 (+    54us) write_op.cc:312] APPLY: finished
0709 12:20:25.337685 (+   420us) log.cc:844] Serialized 101 byte log entry
0709 12:20:25.337879 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:25.344883 (+  7004us) write_op.cc:454] Released schema lock
0709 12:20:25.347569 (+  2686us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:25.362436 (+ 14867us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:25.362467 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":778489,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":143482,"apply.run_cpu_time_us":4872,"apply.run_wall_time_us":109096,"num_ops":14,"prepare.queue_time_us":105651,"prepare.run_cpu_time_us":22492,"prepare.run_wall_time_us":636082,"raft.queue_time_us":92113,"raft.run_cpu_time_us":17814,"raft.run_wall_time_us":148024,"replication_time_us":382693,"spinlock_wait_cycles":1884032,"thread_start_us":420495,"threads_started":4,"wal-append.queue_time_us":232809,"wal-append.run_cpu_time_us":21982,"wal-append.run_wall_time_us":1412017}]]}
I20260709 12:20:33.982820 25270 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:33.985569 25275 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:33.984459 25022 catalog_manager.cc:5697] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 6, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 6 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.993160 25126 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:33.956039 28101 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:33.996176 28051 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:34.018409 28051 raft_consensus.cc:697] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:33.997941 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:34.020376 25127 raft_consensus.cc:2410] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:33.999322 28263 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.000900 25125 pending_rounds.cc:85] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 6
I20260709 12:20:34.020869 25125 pending_rounds.cc:107] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:20:34.021152 25125 raft_consensus.cc:2889] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:34.003310 28419 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.307s	user 0.004s	sys 0.000s
I20260709 12:20:34.005518 25124 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:34.005771 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:34.006135 25168 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:34.006337 28349 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:33.963994 28424 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:34.007824 28302 consensus_queue.cc:1059] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:34.008862 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:34.007290 28380 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.012570 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:33.996925 28101 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.013334 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:33.999215 25167 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:34.045979 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:34.023175 25120 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:33.981576 28287 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:34.010411 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:34.038843 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:34.049830 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:33.948206 28335 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.064323 25202 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:34.044624 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.061981 28391 raft_consensus.cc:697] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:34.064114 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.050499 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:34.069451 25122 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:34.057241 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:34.068825 28335 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:34.068648 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.068359 28051 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.056288 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:34.079723 28424 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.080910 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:34.045158 28101 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.993863 27803 consensus_queue.cc:1059] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:20:34.020129 28353 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 12:20:34.066872 28049 consensus_meta.cc:287] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.006s
I20260709 12:20:34.079741 25119 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:34.041973 28333 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:34.086468 25124 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:34.075333 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:34.089049 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 83022.7us
I20260709 12:20:34.003489 28258 consensus_queue.cc:1059] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 12:20:34.090009 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 133456us
W20260709 12:20:34.098263 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 202729us
I20260709 12:20:34.108891 25197 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:34.082350 25022 catalog_manager.cc:5697] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.072734 28249 consensus_queue.cc:1059] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:20:34.092523 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.094308 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:34.094203 28370 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:34.095587 28299 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:34.128103 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.090451 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:34.118806 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.120756 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:34.121480 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.035431 28270 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.117323 28049 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:34.136250 25274 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:34.139710 25855 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 12:20:34.158504 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.137637 25022 catalog_manager.cc:5697] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 2 to 5, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 5 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.169862 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.170287 25272 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
W20260709 12:20:34.170819 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 50906.8us
I20260709 12:20:34.128206 28424 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:34.174506 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:34.172809 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 76624.4us
I20260709 12:20:34.116132 28423 raft_consensus.cc:697] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:34.131387 28299 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:34.178328 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:34.196354 25200 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:34.178329 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 854) took 1065 ms. Trace:
I20260709 12:20:34.202448 25858 rpcz_store.cc:276] 0709 12:20:33.112951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.666734 (+553783us) service_pool.cc:224] Handling call
0709 12:20:33.667125 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:33.667395 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.667419 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:33.667920 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:20:33.881852 (+213932us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:33.881887 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.881960 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:34.178093 (+296133us) raft_consensus.cc:1685] finished
0709 12:20:34.178120 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:34.178268 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":213525,"threads_started":1,"wal-append.queue_time_us":391934}
I20260709 12:20:34.161194 28349 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:34.225400 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:34.176162 28434 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 12:20:34.230415 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 119522us
I20260709 12:20:34.228258 25194 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:34.233659 25168 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:34.236969 25825 leader_election.cc:336] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.622s (SENT)
I20260709 12:20:34.237557 25825 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:34.240453 25167 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:34.231498 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 48883.2us
W20260709 12:20:34.242312 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.240267 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:34.224730 28299 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:34.176528 28380 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:34.251253 25200 raft_consensus.cc:2410] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:34.245711 28302 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:34.256004 28438 log.cc:927] Time spent T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:20:34.257429 28440 raft_consensus.cc:993] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:20:34.261531 28423 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.263160 28440 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:34.263994 28440 raft_consensus.cc:1081] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:20:34.266963 25197 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:34.236624 28249 raft_consensus.cc:3055] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:34.269227 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.269896 25194 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 4.
I20260709 12:20:34.274633 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:34.275305 25198 raft_consensus.cc:2376] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9. Re-sending same reply.
I20260709 12:20:34.280532 25201 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:34.282631 25092 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:34.175637 28391 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:34.293601 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 66677.8us
W20260709 12:20:34.276288 28393 consensus_meta.cc:287] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.831s	user 0.011s	sys 0.003s
I20260709 12:20:34.270387 28302 raft_consensus.cc:697] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:34.269183 28249 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:34.296728 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.298241 25273 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:34.307928 25825 leader_election.cc:336] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.664s (SENT)
W20260709 12:20:34.300009 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 65059.8us
I20260709 12:20:34.289326 28206 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:34.309250 25092 leader_election.cc:400] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6.
I20260709 12:20:34.309661 25168 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:34.294739 28370 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:34.311009 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.286964 28333 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:34.323769 28222 raft_consensus.cc:3055] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:34.324304 28234 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:20:34.324910 25825 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.779s (SENT)
I20260709 12:20:34.328191 25127 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:34.345207 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:34.332213 28302 consensus_queue.cc:237] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:34.335017 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:34.335443 28197 consensus_meta.cc:287] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.000s
W20260709 12:20:34.338284 28039 consensus_meta.cc:287] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.006s
W20260709 12:20:34.349354 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.349267 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.353752 25201 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 8: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:34.355755 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.357197 28049 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:34.359669 28287 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:34.361176 28299 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.312505 28206 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:34.375178 28206 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:34.345952 28222 raft_consensus.cc:740] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:34.377272 28445 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.268s	user 0.001s	sys 0.001s
I20260709 12:20:34.368710 25197 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
W20260709 12:20:34.372454 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 47565.8us
I20260709 12:20:34.302049 28393 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.368221 28353 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:34.380419 25198 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:34.386307 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.391719 25194 raft_consensus.cc:2393] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:20:34.390592 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 43767us
I20260709 12:20:34.394681 25201 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:34.394755 25860 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:34.396539 25274 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
W20260709 12:20:34.398077 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 96477.2us
W20260709 12:20:34.411393 28312 consensus_meta.cc:287] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 12:20:34.411665 28393 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:34.411962 28312 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:34.413403 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.414808 25092 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:34.429986 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.369217 28039 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:34.426831 25825 leader_election.cc:336] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.851s (SENT)
I20260709 12:20:34.434980 25118 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:20:34.434695 25825 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:34.437780 28312 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:34.439720 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.377975 28222 consensus_queue.cc:260] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:34.443450 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.388113 28333 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:20:34.444384 25197 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:34.451777 25201 raft_consensus.cc:2410] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:20:34.438506 28287 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:34.441795 28422 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:34.465900 25092 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:34.466216 28333 consensus_queue.cc:1243] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:34.466382 28312 consensus_queue.cc:1059] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:34.446446 28391 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:34.470523 25202 raft_consensus.cc:2410] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:20:34.475454 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.434001 28249 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.467398 28422 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:34.477891 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.469683 28333 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:34.487468 28333 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.488175 28101 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:34.490767 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 96307.5us
I20260709 12:20:34.494086 25196 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:20:34.494215 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 253861us
I20260709 12:20:34.493108 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:34.474373 28287 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.495133 25127 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 3: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:34.495047 25167 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:34.496233 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:34.496186 25012 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3552726c022345b394b69265b8f3b566 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897be935c42e41b995f177155b042be0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:34.496551 28287 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:34.497315 28249 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:34.456328 28462 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:20:34.500492 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.503098 25197 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:34.490535 28422 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:34.507069 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.508560 28039 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:34.509402 28469 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:34.509895 28469 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.510089 28126 raft_consensus.cc:3055] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:34.510308 28469 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:34.510551 28126 raft_consensus.cc:740] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:34.508669 28456 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:34.493806 28101 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:34.501617 28222 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:34.512251 25825 leader_election.cc:336] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.853s (SENT)
I20260709 12:20:34.485532 28465 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:34.521765 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.514348 28456 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:34.542490 25825 leader_election.cc:336] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.853s (SENT)
I20260709 12:20:34.543033 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:34.543442 25167 leader_election.cc:400] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9.
I20260709 12:20:34.509918 28462 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:34.546084 28462 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:34.544308 25167 leader_election.cc:403] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:20:34.519369 28126 consensus_queue.cc:260] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.550379 28126 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:34.552832 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.553566 25194 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9.
I20260709 12:20:34.513616 28333 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:34.554440 28333 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9.
I20260709 12:20:34.554524 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:34.555403 25198 raft_consensus.cc:1240] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:34.555835 25194 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:20:34.556317 25276 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:34.556936 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.557628 25200 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:34.557904 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:34.562620 25825 leader_election.cc:336] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.896s (SENT)
I20260709 12:20:34.547183 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.548007 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:34.546205 28391 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:34.570633 25198 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:34.571208 28430 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:34.572301 28430 raft_consensus.cc:3055] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:34.572681 28430 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:34.573812 28455 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.217s	user 0.002s	sys 0.000s
I20260709 12:20:34.576253 28466 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:34.573689 28430 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:34.578006 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 533315us
I20260709 12:20:34.578140 28430 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:34.567363 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.593928 25200 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:34.566131 25201 pending_rounds.cc:85] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 3
I20260709 12:20:34.594575 25201 pending_rounds.cc:107] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:20:34.594959 25201 raft_consensus.cc:2889] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:34.582394 28262 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:34.583560 28456 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:34.564563 25825 leader_election.cc:336] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 2.052s (SENT)
W20260709 12:20:34.582522 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 460162us
I20260709 12:20:34.587870 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:34.601027 25825 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:34.604122 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:34.604310 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:34.604784 25856 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:34.584962 28390 raft_consensus.cc:3055] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:34.616134 25120 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:34.606117 25121 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:20:34.610481 25822 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:34.546706 28465 raft_consensus.cc:697] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:34.604739 25273 raft_consensus.cc:2376] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6. Re-sending same reply.
I20260709 12:20:34.622089 28440 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:34.622599 28440 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.622972 28450 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:34.622998 28440 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:34.626609 25270 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:34.627873 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:34.631597 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:34.620714 25242 leader_election.cc:336] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.784s (SENT)
I20260709 12:20:34.632614 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.633450 25200 raft_consensus.cc:2410] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:20:34.633625 25197 raft_consensus.cc:1217] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 12:20:34.634106 25197 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:20:34.627693 25822 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:34.623916 28450 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:34.645385 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:34.646425 28472 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Append to log took a long time: real 0.103s	user 0.002s	sys 0.000s
I20260709 12:20:34.646628 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1160) took 2669 ms. Trace:
I20260709 12:20:34.648087 25198 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
W20260709 12:20:34.650454 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 85912.2us
I20260709 12:20:34.663972 25860 rpcz_store.cc:276] 0709 12:20:31.977444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.501375 (+1523931us) service_pool.cc:224] Handling call
0709 12:20:33.501709 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:34.397748 (+896039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.646321 (+248573us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b540054f454. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:34.646550 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053192064}
I20260709 12:20:34.646946 28456 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:34.615207 28390 raft_consensus.cc:740] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:34.699285 25202 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:34.701594 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:34.704589 25126 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:34.597952 28206 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.713212 25197 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:34.647831 28450 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.700969 28234 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:34.707235 28249 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:34.702474 25269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:20:34.703106 27803 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:34.562760 28462 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:34.744004 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 123317us
I20260709 12:20:34.728076 28450 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:34.707157 28302 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:20:34.750617 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.779376 25198 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
W20260709 12:20:34.754581 28451 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.468s	user 0.003s	sys 0.000s
I20260709 12:20:34.760389 28299 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:34.762579 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 239131us
I20260709 12:20:34.781852 28469 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.782877 25167 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:34.767184 28206 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:34.734707 28234 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:34.747473 27803 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.771140 28390 consensus_queue.cc:260] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.786060 28390 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:34.772444 28462 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:34.778177 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:34.646715 28465 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:34.778360 25242 leader_election.cc:336] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.784s (SENT)
I20260709 12:20:34.834198 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:34.798697 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.798519 25856 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
W20260709 12:20:34.836891 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 91364us
I20260709 12:20:34.838140 25197 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:34.838959 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:34.861898 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 83554.8us
I20260709 12:20:34.862516 25271 raft_consensus.cc:2393] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:34.843849 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.864511 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.840230 25241 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:34.845966 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.847332 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:34.854725 27803 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:34.855577 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.835124 28422 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.782650 28440 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:34.856979 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.849853 28197 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:34.844892 25126 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:34.834237 28249 raft_consensus.cc:697] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:34.870909 25195 raft_consensus.cc:2376] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6. Re-sending same reply.
I20260709 12:20:34.873039 25198 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:34.870107 25196 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:34.879873 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:34.882277 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.882757 25271 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:20:34.883949 25242 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 2.006s (SENT)
I20260709 12:20:34.885294 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:34.870968 28423 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:34.890800 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 107959us
I20260709 12:20:34.902635 25197 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:34.874821 28258 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:34.879163 28197 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.908727 25202 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:34.909467 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.911252 25194 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:20:34.883893 28299 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:34.925467 25855 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:34.889320 27803 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.929489 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:34.930207 25200 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:34.930601 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.925992 28469 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:34.932507 25242 leader_election.cc:336] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 2.076s (SENT)
I20260709 12:20:34.912628 28197 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:34.940550 25860 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:20:34.941636 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.918159 28258 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:34.949752 25242 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:34.951344 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:34.958446 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.030159 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.019079 25093 leader_election.cc:336] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.940s (SENT)
I20260709 12:20:35.030615 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:34.927572 28234 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:20:35.020431 25200 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:34.925804 28034 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:35.033270 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 107352us
I20260709 12:20:35.037720 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.038332 25198 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:34.936062 27803 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:34.932248 28391 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:20:35.040974 25269 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:35.041433 25269 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:35.045156 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.029983 28370 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:35.065099 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 132626us
I20260709 12:20:35.068300 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:35.064592 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:35.069929 25200 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:35.072504 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:35.073788 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:35.074762 25200 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:35.078617 25196 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:35.089298 25126 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:20:35.093381 28454 log.cc:927] Time spent T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:20:35.093750 28483 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:20:35.091179 25825 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:35.094003 28426 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:35.095531 25196 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:35.099586 28206 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.100173 28206 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:35.101030 25269 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.103499 28287 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.104063 28287 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.106192 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:35.106806 28206 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:35.108095 28287 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:35.108669 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:35.080008 28049 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.110836 28049 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.060675 28034 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:35.094703 28426 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:35.134969 28426 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:35.136217 25127 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:35.032874 28249 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.061610 28349 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:20:35.126947 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:35.094901 28486 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:20:35.143225 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 52138.4us
I20260709 12:20:35.132350 28197 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.146370 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:35.146518 28478 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:20:35.148898 28422 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:35.148113 28197 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:35.150249 28484 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:20:35.150413 28197 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:35.150810 28471 log.cc:927] Time spent T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.435s	user 0.003s	sys 0.000s
I20260709 12:20:35.154238 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1801) took 1102 ms. Trace:
W20260709 12:20:35.154847 28460 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.667s	user 0.005s	sys 0.000s
I20260709 12:20:35.122745 28039 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.155478 28039 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.155994 28450 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.138330 28257 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:35.158174 28257 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:35.158818 28257 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.154671 25275 rpcz_store.cc:276] 0709 12:20:34.051805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.051932 (+   127us) service_pool.cc:224] Handling call
0709 12:20:34.088358 (+ 36426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:34.708723 (+620365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:34.708755 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:34.730798 (+ 22043us) log.cc:844] Serialized 26 byte log entry
0709 12:20:34.851582 (+120784us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:34.866233 (+ 14651us) log.cc:844] Serialized 14 byte log entry
0709 12:20:34.866449 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.875778 (+  9329us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:35.153978 (+278200us) raft_consensus.cc:1685] finished
0709 12:20:35.154000 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:35.154154 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":529390,"prepare.queue_time_us":16097,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":538108,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":24499,"spinlock_wait_cycles":3341184,"thread_start_us":98884,"threads_started":1,"wal-append.queue_time_us":100597}
I20260709 12:20:35.121434 28258 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.154604 28049 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:35.142283 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:35.207109 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 44483.7us
I20260709 12:20:35.215909 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:20:35.204311 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 77511.1us
I20260709 12:20:35.213153 25202 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:35.220798 28312 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:35.221522 28424 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:35.221621 28456 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:35.222129 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:35.222187 28469 consensus_queue.cc:1059] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:35.222522 28051 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:35.223040 28469 consensus_queue.cc:1243] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:35.223116 25825 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:35.223592 28469 raft_consensus.cc:3055] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:35.223968 28469 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:35.223979 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:35.122212 28234 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:20:35.226917 25194 raft_consensus.cc:2410] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:20:35.227957 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 163553us
I20260709 12:20:35.230448 25242 leader_election.cc:400] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9.
I20260709 12:20:35.232249 25198 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:35.232466 25093 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:35.232563 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.144315 28263 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:35.236814 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:35.202050 28466 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.235949 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:35.236667 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:35.230129 28197 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:35.226538 28479 log.cc:927] Time spent T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 12:20:35.239580 25275 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:35.239796 25858 raft_consensus.cc:2410] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:20:35.218287 28440 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:35.234153 25242 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:35.234226 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:35.206301 28491 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:35.244046 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:35.233520 28353 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:35.245914 25200 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9.
I20260709 12:20:35.246740 25852 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:35.245630 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.201771 28101 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:20:35.244516 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.248054 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:35.266914 28495 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:35.269747 25860 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.270323 28428 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:35.269928 25242 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:35.271497 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:35.272114 25853 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:35.241475 28051 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:35.256770 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.250535 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:35.277503 25855 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:35.235054 28424 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:20:35.280743 25201 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:35.280678 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:35.281059 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.270936 28428 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:35.283406 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.285843 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.249361 28450 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:35.288450 25267 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:35.289021 25198 raft_consensus.cc:2410] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:20:35.288252 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:35.291149 25200 raft_consensus.cc:2376] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7. Re-sending same reply.
I20260709 12:20:35.247766 28390 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:35.245203 28466 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:35.293426 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.295858 25193 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:35.296154 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.296659 28333 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:35.296900 25201 raft_consensus.cc:1240] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:20:35.247802 28470 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:20:35.301178 28034 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:35.302462 25852 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:35.304085 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:35.330765 25855 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:35.332048 25276 raft_consensus.cc:1217] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Deduplicated request from leader. Original: 4.7->[6.8-6.8]   Dedup: 6.8->[]
I20260709 12:20:35.332695 25276 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:20:35.293442 25195 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:35.310596 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:35.334568 25196 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:35.308178 25194 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:35.273150 28353 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:35.318586 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 48737.8us
I20260709 12:20:35.326224 25858 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:35.326391 25853 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:35.327598 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.282471 27803 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:35.338738 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.340380 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.345952 25193 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:35.347756 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:35.348596 25201 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.353287 25856 raft_consensus.cc:1240] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:35.314700 28376 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:35.356395 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:35.358631 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:35.323338 28333 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:35.328899 28257 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.382684 28380 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:20:35.385735 28257 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:35.385728 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:35.386351 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:35.386941 25196 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:35.386883 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:35.387938 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:35.390544 27803 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:35.391358 28466 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:35.392362 25195 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:20:35.355157 28429 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:20:35.393776 25093 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:35.394707 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:35.394970 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:35.395470 25193 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:35.396734 25093 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:35.397677 25853 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:20:35.336222 28353 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:35.245471 28469 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.404273 25852 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:20:35.375263 28491 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.403461 28422 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:35.403599 27803 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:35.382409 28423 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:20:35.406843 25167 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:35.424036 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 46785.9us
W20260709 12:20:35.456707 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 49927us
W20260709 12:20:35.411934 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.458379 25167 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:35.410665 25093 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:35.492074 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 81555.3us
I20260709 12:20:35.490979 25860 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
W20260709 12:20:35.412823 28430 consensus_meta.cc:287] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.002s
W20260709 12:20:35.508757 25242 leader_election.cc:336] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.506s (SENT)
I20260709 12:20:35.509423 25242 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:35.510591 25267 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:35.424232 28426 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:35.512248 25822 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:35.409101 28312 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:35.430332 28049 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:20:35.514456 25242 leader_election.cc:336] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.601s (SENT)
I20260709 12:20:35.439124 28423 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:35.516302 25127 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:35.414994 28376 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:35.478152 28234 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:35.521291 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:35.477501 28299 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:35.505265 28458 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.419663 28302 consensus_queue.cc:1059] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:20:35.419514 28101 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:20:35.515446 28422 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:35.512076 27803 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:35.413463 28466 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
W20260709 12:20:35.549345 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.552112 28443 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:35.519035 28312 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:35.522891 28249 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:35.522675 28423 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:35.518878 28049 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:35.435252 28333 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:35.530615 28426 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:35.438169 28491 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.552393 28380 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.443091 28428 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:35.581001 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 66585.5us
W20260709 12:20:35.581876 25242 leader_election.cc:336] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.908s (SENT)
I20260709 12:20:35.582373 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:35.567246 28312 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:35.563634 28422 raft_consensus.cc:697] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:35.590435 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 366175us
I20260709 12:20:35.570741 28249 raft_consensus.cc:697] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:35.598842 25860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:35.602514 25860 raft_consensus.cc:606] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:35.602909 25860 raft_consensus.cc:614] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:35.604753 25275 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
W20260709 12:20:35.608275 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 190233us
I20260709 12:20:35.610986 25201 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:35.613131 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:35.550696 28458 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.593919 28370 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:35.584568 28380 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.571081 27803 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.614912 28258 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:35.664137 28499 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:20:35.668789 28380 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:35.641520 28376 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.643694 28299 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:35.643601 28234 raft_consensus.cc:697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:35.672389 28466 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:35.678670 28197 raft_consensus.cc:2764] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:20:35.688180 28505 consensus_queue.cc:1059] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:35.690682 28491 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:35.723331 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.723138 25012 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897be935c42e41b995f177155b042be0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:20:35.780215 25012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 57137.9us
I20260709 12:20:35.727231 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:35.728730 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 130145us
W20260709 12:20:35.659687 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.605957 28423 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:35.760928 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 110785us
I20260709 12:20:35.798777 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:35.763739 27803 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:35.804800 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:35.805712 25122 raft_consensus.cc:2410] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:20:35.807492 28507 log.cc:927] Time spent T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:35.662758 28426 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:35.809191 28423 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:35.809088 28234 consensus_queue.cc:237] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.810185 28051 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.773334 28312 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.812624 28466 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.813061 28312 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:35.815325 28458 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:35.757400 28380 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.816236 25127 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:35.816130 28380 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.756026 28422 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.818327 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:35.818487 28380 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:35.819075 25119 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 7: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:35.820438 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:35.764739 28299 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.774709 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:35.775601 28353 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.628530 28101 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 12:20:35.778311 25274 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:35.802017 25120 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:20:35.802870 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:35.803826 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:35.830567 25269 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:35.830880 25124 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.810729 28051 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:35.815459 28498 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.243s	user 0.003s	sys 0.001s
I20260709 12:20:35.773411 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:35.774147 28249 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.835740 25268 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
W20260709 12:20:35.838145 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 312467us
I20260709 12:20:35.821712 25165 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:35.825712 25272 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
W20260709 12:20:35.826171 25242 leader_election.cc:336] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 2.159s (SENT)
I20260709 12:20:35.832974 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:35.834100 25276 raft_consensus.cc:1240] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:35.835703 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:35.830401 25121 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:35.835279 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:43556 (request call id 958) took 1242 ms. Trace:
W20260709 12:20:35.841835 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 228784us
I20260709 12:20:35.828445 28034 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.815485 28466 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:35.841655 25269 rpcz_store.cc:276] 0709 12:20:34.612347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.620857 (+  8510us) service_pool.cc:224] Handling call
0709 12:20:35.797998 (+1177141us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b540002c454. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f05a3d 00007f2108ed5cd0 00007f210245a254 00007f210245a1e2 00007f210245a111 00007f210245a08c 00007f2102459342 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:35.831140 (+ 33142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697326336}
I20260709 12:20:35.839848 25273 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:35.831913 28222 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:35.843701 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:35.844699 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 384854us
I20260709 12:20:35.854699 25118 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:35.836812 28302 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:35.851331 25274 raft_consensus.cc:2393] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:35.847513 28506 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.151s	user 0.001s	sys 0.001s
I20260709 12:20:35.837700 28512 raft_consensus.cc:3055] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:35.650404 28049 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:35.909101 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.911545 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 59151.7us
W20260709 12:20:35.912402 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.912536 25167 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
W20260709 12:20:35.912880 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.909538 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 87923.7us
I20260709 12:20:35.913998 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:35.915299 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:35.917488 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:35.920115 25851 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:35.924950 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:35.850287 28034 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.930876 25860 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:35.911273 28101 raft_consensus.cc:2764] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:20:35.916613 28517 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.916183 28512 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:35.944013 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:35.923449 28465 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:35.952068 25825 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:35.939895 28510 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.954391 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:35.958289 28490 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:35.958734 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:35.959619 28490 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:35.960039 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:35.960971 28490 raft_consensus.cc:2764] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:20:35.961278 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:35.962090 28490 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:35.962523 28490 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:35.962862 28051 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:35.962953 28490 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:35.966370 28034 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:35.915266 28222 consensus_queue.cc:1059] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 12:20:35.974280 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 47638.3us
I20260709 12:20:35.975122 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:35.976316 25165 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:35.923213 28466 consensus_queue.cc:1059] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:20:35.946707 28302 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:35.945461 28458 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:35.949183 28465 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:35.966563 28503 log.cc:927] Time spent T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:20:35.988963 28353 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:35.989526 28477 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:35.989324 28512 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.990545 28512 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:35.987717 28465 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:35.991466 28511 raft_consensus.cc:3055] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:35.991878 28511 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:35.992836 28101 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:35.992734 28511 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.993630 28101 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:35.993777 28515 raft_consensus.cc:3055] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:35.994092 28101 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.994248 28515 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:35.994573 28101 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:35.995230 28511 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:35.995216 28515 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:35.997471 28034 raft_consensus.cc:3055] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:20:35.998193 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.946276 28263 consensus_queue.cc:1059] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:20:36.002377 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:35.994457 28458 raft_consensus.cc:697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:36.005491 25124 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:36.026671 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:36.027372 25197 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:36.028648 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.029495 28491 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:36.029908 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:36.030750 28491 raft_consensus.cc:2764] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:20:36.031320 25825 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.032140 28491 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:36.032500 28370 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.032562 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.033409 28491 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:36.033136 28370 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.003264 28034 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:36.037945 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:36.041707 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:36.033805 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:36.031337 28501 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.453s	user 0.000s	sys 0.001s
I20260709 12:20:36.050450 28039 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.052129 28469 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:36.052416 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 142287us
W20260709 12:20:36.053972 25092 leader_election.cc:336] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.801s (SENT)
I20260709 12:20:36.054472 25201 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
W20260709 12:20:36.054944 25092 leader_election.cc:336] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.818s (SENT)
I20260709 12:20:36.055347 25092 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.056064 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:36.014281 28393 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:36.048426 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:36.049098 25093 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.070072 25193 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:36.049402 28525 consensus_queue.cc:1059] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:36.049669 28370 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.038625 28263 raft_consensus.cc:3055] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:36.041836 28302 consensus_queue.cc:1059] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:20:36.062527 25275 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:36.071841 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:36.073894 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:36.078830 25197 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:35.953752 28517 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:36.087293 25092 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.840s (SENT)
I20260709 12:20:36.088058 25092 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.047487 28443 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:36.024148 28353 consensus_queue.cc:1059] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:20:36.107542 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:36.110349 25121 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:36.110389 25857 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:20:36.082501 28051 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:36.109551 25271 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:36.076460 28466 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:36.118219 25267 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:36.086771 28393 raft_consensus.cc:697] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:36.112756 28513 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.119917 28513 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.120473 28494 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:36.120270 28393 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:36.120316 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 144057us
I20260709 12:20:36.120782 28515 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:36.087718 28263 raft_consensus.cc:740] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:36.104789 28370 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.127657 25165 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:36.105129 28428 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:36.117103 28466 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:36.190790 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 53853.5us
I20260709 12:20:36.201056 25165 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:36.141492 28034 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:36.203004 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 169248us
I20260709 12:20:36.212019 25825 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:36.207631 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:36.259009 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 47072.8us
I20260709 12:20:36.259167 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2376) took 1610 ms. Trace:
I20260709 12:20:36.260130 25825 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.260248 25118 rpcz_store.cc:276] 0709 12:20:34.600342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.600461 (+   119us) service_pool.cc:224] Handling call
0709 12:20:34.624726 (+ 24265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.855100 (+1230374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.208735 (+353635us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002ace54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:36.210681 (+  1946us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2828215168}
I20260709 12:20:36.197570 28527 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:36.133435 28476 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:36.206736 28521 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:20:36.204927 28034 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:36.258772 25196 raft_consensus.cc:2376] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6. Re-sending same reply.
I20260709 12:20:36.133814 28370 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:36.281140 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 144175us
W20260709 12:20:36.207535 28523 log.cc:927] Time spent T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:20:36.141837 28302 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:36.142536 28312 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:36.206017 28525 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:36.266132 28466 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:36.210867 28510 raft_consensus.cc:697] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:36.203411 28513 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:36.311107 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.336663 25269 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:20:36.203284 28519 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.268492 28197 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:36.317667 28527 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:36.323593 28528 log.cc:927] Time spent T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.241s	user 0.000s	sys 0.004s
I20260709 12:20:36.323467 28530 consensus_queue.cc:1059] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.115s
I20260709 12:20:36.286535 28249 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:36.328485 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.136148 28428 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.329898 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.203425 28509 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.208s
I20260709 12:20:36.332829 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:36.287416 28476 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.366994 25196 raft_consensus.cc:2376] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10. Re-sending same reply.
I20260709 12:20:36.191782 28458 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:36.338260 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 237624us
I20260709 12:20:36.340785 25275 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:36.344198 25273 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:36.340648 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:36.371011 25195 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:36.345044 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:36.371861 25198 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
W20260709 12:20:36.372409 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 285137us
I20260709 12:20:36.369068 25271 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:36.342446 28197 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:36.375303 28197 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:36.375620 25196 raft_consensus.cc:3055] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:36.376014 25196 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:36.372781 28353 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:36.344812 28519 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:36.382598 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 61094.6us
I20260709 12:20:36.384433 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.384671 25201 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:36.384980 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.386451 25853 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:20:36.387605 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.388336 25851 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 3: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:36.390758 28234 raft_consensus.cc:3055] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:36.391304 28234 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:36.391666 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.392174 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.392072 28234 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.393636 28234 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:36.394392 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.395248 28510 consensus_queue.cc:237] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.341625 28517 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:36.396961 28535 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.398623 28370 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.402393 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.418459 25857 raft_consensus.cc:2376] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8. Re-sending same reply.
I20260709 12:20:36.417495 28534 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:36.403833 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.404098 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.420688 25851 raft_consensus.cc:2376] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7. Re-sending same reply.
W20260709 12:20:36.420811 25092 leader_election.cc:336] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.154s (SENT)
I20260709 12:20:36.405406 28101 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.405861 28476 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.406947 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.426944 25855 raft_consensus.cc:2376] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6. Re-sending same reply.
W20260709 12:20:36.427974 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.408279 25858 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:36.409642 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.369283 28299 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:36.411031 25195 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:36.409977 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.429843 25856 raft_consensus.cc:2393] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:36.413800 25852 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:36.381798 28519 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.345146 28538 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.346406 28312 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:36.403443 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.421422 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:36.421944 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 93558.2us
I20260709 12:20:36.436699 25853 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:36.437429 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:36.430831 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.438725 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.439466 25857 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:36.443439 25852 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:36.444722 28370 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:36.444981 28476 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:36.445205 28370 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:36.445664 28370 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:36.445609 28476 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.447772 28476 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.449393 25853 raft_consensus.cc:2410] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:20:36.449205 28465 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:36.416687 28462 consensus_queue.cc:1059] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:20:36.450861 28462 raft_consensus.cc:3055] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:36.451260 28462 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:36.451336 28544 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:36.452135 28462 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.452947 28535 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:36.453336 28462 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:36.453464 28535 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.454169 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:36.454269 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.443399 28312 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.456684 28312 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.456900 25199 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:36.456379 28535 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.458391 28101 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.459887 28527 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:36.463265 28465 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:36.466221 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:36.470558 28490 consensus_meta.cc:287] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 12:20:36.471109 28490 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.471263 28263 consensus_queue.cc:260] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.472322 28263 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:36.473501 28490 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:36.436599 28299 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:36.476063 28049 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:36.478312 28534 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:36.443210 28538 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.480425 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.481814 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:36.482513 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:36.483160 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:36.485061 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.485261 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.485970 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.486497 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.486406 28370 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:36.487193 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.482905 28197 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.490103 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.538933 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:36.493517 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.540151 25852 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:36.495450 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:36.541314 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 60959.4us
I20260709 12:20:36.542681 25242 leader_election.cc:400] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9.
I20260709 12:20:36.495920 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:36.496917 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:36.543658 25198 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:36.502940 28509 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.509729 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:36.515558 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.544765 25202 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:36.545259 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.545809 25851 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:36.524638 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.544090 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:36.548183 25194 raft_consensus.cc:2410] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:20:36.525620 25193 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:36.529763 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:36.535740 25275 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:36.532948 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 112173us
I20260709 12:20:36.536960 25855 raft_consensus.cc:2410] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:20:36.534281 25857 raft_consensus.cc:2368] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5.
I20260709 12:20:36.537917 25269 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:36.539749 25199 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:20:36.524703 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.549901 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:36.556825 25202 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:36.557087 25165 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.562223 28422 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.562777 28312 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.562889 28422 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.563571 28312 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.566202 28465 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:36.566327 28312 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.566977 28465 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.568023 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:36.568439 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:36.568915 25118 raft_consensus.cc:2410] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:36.569218 25121 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:36.565858 28422 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.569809 28465 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.575510 25202 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
W20260709 12:20:36.579429 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.527292 28349 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.576761 25195 raft_consensus.cc:2410] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:20:36.587539 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:36.589155 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:36.589493 25275 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:36.577667 25851 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:36.589797 25127 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:36.593459 25120 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:20:36.593889 25120 pending_rounds.cc:85] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 6
I20260709 12:20:36.594127 25120 pending_rounds.cc:107] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:20:36.594357 25120 raft_consensus.cc:2889] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:36.596226 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:36.596720 25124 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:36.607293 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:36.606755 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:36.608414 25119 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:36.610855 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:36.611521 25120 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:36.611660 25126 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:36.614478 25198 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:36.615229 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.604938 25121 raft_consensus.cc:2410] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:20:36.614593 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.598096 25270 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:20:36.538798 28477 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:36.528601 28466 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:36.617655 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 240839us
W20260709 12:20:36.619297 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 76716.4us
I20260709 12:20:36.620595 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:36.621167 25242 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.607160 28490 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:36.627862 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.592411 28476 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:36.620338 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:36.632616 25126 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:36.634793 25119 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:36.637825 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.638674 25854 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:36.644307 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.644522 25090 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:36.644925 25851 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:36.646396 25090 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.647477 25167 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:36.648550 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:36.643177 28490 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.664599 28376 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:36.665172 28376 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:36.665601 28376 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:36.678478 25167 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.636060 28465 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:36.681253 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:36.682667 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.690157 25851 raft_consensus.cc:3055] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:36.664028 25090 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.690630 25851 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:36.639559 28476 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:36.593531 28509 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.646539 28531 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:20:36.706600 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 69176.8us
I20260709 12:20:36.708220 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:36.597831 28349 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:36.708963 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 45034.7us
I20260709 12:20:36.710114 25269 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:36.710095 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.684828 28544 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:36.707500 28262 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:36.704515 25851 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.712374 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.713430 25851 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:36.681241 28515 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:36.684659 28051 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:36.713835 25854 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:36.715783 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.704236 28510 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:36.720112 25860 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:36.711694 28544 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.718947 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.705947 28476 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:36.681025 28422 consensus_queue.cc:1059] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:20:36.726779 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.736178 25167 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.735658 25851 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:36.737136 25167 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.737883 25092 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:36.737998 28101 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:36.738152 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.738523 28101 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.738775 25851 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:36.738945 28101 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:36.739655 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.740394 25851 raft_consensus.cc:2410] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:20:36.741684 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.742825 28535 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:36.743245 28535 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.743594 28535 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:36.718860 28423 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:36.714249 28549 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:36.721525 28542 raft_consensus.cc:2764] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:20:36.754529 25200 raft_consensus.cc:2410] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:20:36.759203 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:36.722137 28510 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:36.762382 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:36.793300 28552 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:20:36.712371 28376 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:36.794965 28509 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:36.795450 28376 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:36.796145 28510 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:36.724157 28544 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:36.788472 25855 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:36.774996 28370 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:36.796876 25199 raft_consensus.cc:1240] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:36.797590 28349 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.788641 28423 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:36.801440 28494 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:20:36.760061 25198 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:36.735630 28540 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:36.776672 28333 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:36.778780 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:36.850796 25195 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:36.851009 25198 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:36.779786 28465 consensus_queue.cc:1059] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:36.749222 28534 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:20:36.782711 28553 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:20:36.749701 28426 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:20:36.784040 28538 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:36.785876 28513 raft_consensus.cc:3055] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:36.787393 28466 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:36.775027 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.887514 25854 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
W20260709 12:20:36.888023 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 176940us
I20260709 12:20:36.888450 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.888749 25090 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.756753 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:36.890038 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:36.790225 25194 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:36.788275 28562 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:36.792333 28490 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:36.734076 28531 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:36.891953 28531 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:36.892379 28531 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:36.894398 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:36.770737 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:36.819026 25858 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:36.896377 25201 raft_consensus.cc:2376] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10. Re-sending same reply.
I20260709 12:20:36.889816 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.820501 25855 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:36.897212 25858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:36.898012 25858 raft_consensus.cc:606] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:20:36.898408 25858 raft_consensus.cc:614] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:36.819331 25193 pending_rounds.cc:85] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 7
I20260709 12:20:36.898939 25193 pending_rounds.cc:107] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:20:36.899261 25193 raft_consensus.cc:2889] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:36.820762 25852 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:36.818480 28197 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:36.823264 28430 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:36.825271 28376 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:36.816946 25199 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:36.817829 25202 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:36.826982 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:36.828253 25165 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.898949 25093 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:36.905395 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 77212.3us
I20260709 12:20:36.907264 25272 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:36.816859 25857 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:36.910152 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:36.817674 25196 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:36.788811 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 51010.8us
W20260709 12:20:36.844779 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.849406 25853 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:36.912031 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:36.912075 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:36.858462 28423 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:36.860074 28428 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:36.855331 28393 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:36.863811 28465 consensus_queue.cc:1243] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:36.942543 25196 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:36.943238 25852 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:36.849190 28540 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:36.864960 28537 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.538s	user 0.004s	sys 0.000s
I20260709 12:20:36.874334 25822 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:36.877516 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.879761 25275 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:36.881364 25267 raft_consensus.cc:1240] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:36.884219 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:36.888537 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:36.890677 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 134010us
I20260709 12:20:36.795863 28476 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:36.899998 25855 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:36.816653 28370 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:36.902621 25825 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:36.913636 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:36.916129 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 89236.4us
I20260709 12:20:36.968714 25201 raft_consensus.cc:2410] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:36.971451 25242 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.878597 28513 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:36.856235 28101 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.906736 28422 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:36.954768 25271 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:20:36.956756 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:36.957647 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:36.984766 25271 pending_rounds.cc:85] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 4
I20260709 12:20:36.958742 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.960311 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:36.984160 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:36.985832 25202 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:36.985967 25857 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
W20260709 12:20:36.961361 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 87110.4us
W20260709 12:20:36.961827 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 62956.1us
I20260709 12:20:36.988396 25093 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.962409 25269 raft_consensus.cc:2410] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:36.960315 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:36.896402 28518 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:20:36.943318 28380 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:36.921567 25241 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:36.923528 28462 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:36.980962 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 92939.2us
I20260709 12:20:37.000447 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:36.980418 25242 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.989794 25198 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:37.001482 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 80011us
I20260709 12:20:36.898480 28494 consensus_queue.cc:1059] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:20:36.991290 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:36.973124 28197 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:36.993098 25271 pending_rounds.cc:107] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:20:36.985292 25858 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:36.971740 28540 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:37.002548 25241 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:36.972514 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:37.035156 25195 raft_consensus.cc:1813] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Handling vote request from an unknown peer 897be935c42e41b995f177155b042be0
I20260709 12:20:36.989308 28422 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.031854 25167 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:36.954519 28530 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.967051 28428 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.012784 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:37.043769 25273 raft_consensus.cc:1813] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Handling vote request from an unknown peer 897be935c42e41b995f177155b042be0
I20260709 12:20:37.044405 25273 raft_consensus.cc:2393] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:37.014071 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:36.967247 28349 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:37.030539 25271 raft_consensus.cc:2889] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:36.978549 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:37.031404 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:37.035929 25195 raft_consensus.cc:2410] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:36.951854 28051 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:37.039924 25198 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:20:36.988786 28509 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:37.010049 28049 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:36.980559 28370 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:37.034225 28197 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.989034 28456 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:20:36.947494 28393 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:36.984103 28234 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:20:37.075621 28571 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:37.101904 28571 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.101889 28572 raft_consensus.cc:2764] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:20:37.102535 28571 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:37.103856 28526 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.065276 28376 consensus_queue.cc:1059] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:20:37.104382 28526 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.105446 28376 raft_consensus.cc:3055] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:37.105939 28376 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:37.106973 28376 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.108601 28376 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:37.045938 28422 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:37.050549 28535 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.048202 28469 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:37.111119 28469 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.111598 28469 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:37.085839 28370 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:37.087394 28101 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.089766 28513 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:37.091040 28490 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:37.036970 28380 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:37.034409 28462 raft_consensus.cc:697] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:37.075560 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:37.114982 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:37.044656 28258 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:37.076897 28542 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:37.126513 25858 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:37.082612 28197 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:37.135001 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 88991.5us
W20260709 12:20:37.116295 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.045761 28443 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:37.126772 25202 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:37.143013 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:37.048673 28428 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.076932 28423 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:20:37.076196 28426 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:20:37.077414 28349 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:37.188575 28550 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.129840 28258 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.132829 28542 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:37.200098 28393 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:37.205883 28542 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:37.206462 28535 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.150389 28370 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:20:37.193914 28513 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:37.115334 28544 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.202518 28380 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.204111 28476 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:37.204651 28258 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:37.207441 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 219119us
I20260709 12:20:37.264232 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:37.062592 28530 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.131994 28490 raft_consensus.cc:697] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:37.139963 28443 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.254321 28477 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:37.387151 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 117466us
I20260709 12:20:37.387993 25093 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:37.259838 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 347859us
I20260709 12:20:37.260772 28550 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:37.260052 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 259637us
I20260709 12:20:37.196028 28423 consensus_queue.cc:1243] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer b83c12959b9848b3b7bbc680f5ee6225 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:20:37.383105 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 380618us
W20260709 12:20:37.383805 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.192040 28510 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.389253 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:37.397935 25092 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:37.473882 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 76037us
I20260709 12:20:37.475240 25092 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:37.462857 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:37.478972 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:37.479875 25196 consensus_meta.cc:287] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.003s
I20260709 12:20:37.481154 25196 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:37.481900 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2237) took 1272 ms. Trace:
I20260709 12:20:37.482339 25196 rpcz_store.cc:276] 0709 12:20:36.209467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.372211 (+162744us) service_pool.cc:224] Handling call
0709 12:20:36.372593 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:36.804178 (+431585us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b4c0041d800. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f21021daa20 00007f21021eba29 00007f21021b1644 00007f21021d8f2d 00007f21021d8b93 00007f2103f0918b 00007f2103f09cb5 00007f2103f04f30 00007f2103f067de 00007f2103f10b49 00007f2103f11416
0709 12:20:37.481594 (+677416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.481856 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90983680}
I20260709 12:20:37.269383 28561 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:37.387521 28443 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:37.490788 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:37.496595 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:37.543571 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.454200 28051 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:37.465816 28531 consensus_meta.cc:287] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.001s
I20260709 12:20:37.468809 27803 raft_consensus.cc:3055] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:37.550673 28584 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:37.551059 27803 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:37.551461 28584 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:37.551946 28584 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:37.554889 28584 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:37.554821 28510 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.555342 28569 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:20:37.487463 28581 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:20:37.557075 28530 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.418175 28234 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.446934 28477 raft_consensus.cc:697] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:37.551923 27803 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.596562 28510 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:37.597307 27803 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:37.597930 28583 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:37.532860 28561 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.598724 28561 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:37.477221 28526 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.602463 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:37.603163 25124 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:37.480149 28466 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:37.395565 28476 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.606755 28476 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.609372 28476 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.614177 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:37.615177 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:37.615969 25119 raft_consensus.cc:2393] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:37.618057 25126 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:20:37.618422 25126 pending_rounds.cc:85] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 6
I20260709 12:20:37.618670 25126 pending_rounds.cc:107] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:20:37.618911 25126 raft_consensus.cc:2889] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:37.620929 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:37.621521 25121 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
W20260709 12:20:37.622841 28575 log.cc:927] Time spent T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:20:37.624084 25121 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:37.628556 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:37.629240 25124 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
W20260709 12:20:37.532420 28470 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:20:37.572199 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.487164 28572 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:37.557183 28349 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:37.683298 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:37.530966 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 49717.3us
I20260709 12:20:37.684083 25126 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:37.446434 28034 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.126s
I20260709 12:20:37.561374 25858 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:37.692690 25121 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:37.569844 28222 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:37.568743 28491 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:37.715175 28578 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:37.716097 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:37.736788 25198 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:37.717454 28577 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:37.736843 25119 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:37.699397 28333 consensus_meta.cc:287] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.843s	user 0.012s	sys 0.001s
I20260709 12:20:37.598745 28583 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:37.700593 28581 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:20:37.763072 28587 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:20:37.768744 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.779667 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 878) took 1276 ms. Trace:
I20260709 12:20:37.791028 25856 rpcz_store.cc:276] 0709 12:20:36.503260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.782663 (+279403us) service_pool.cc:224] Handling call
0709 12:20:36.783052 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:36.850247 (+ 67195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:36.850286 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:36.869011 (+ 18725us) log.cc:844] Serialized 52 byte log entry
0709 12:20:37.009004 (+139993us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b18003ed580. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae0d1 00007f2103ec9a0f
0709 12:20:37.122631 (+113627us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:37.122694 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.122791 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:37.779315 (+656524us) raft_consensus.cc:1685] finished
0709 12:20:37.779341 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:37.779591 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50283,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3341,"spinlock_wait_cycles":9651072,"thread_start_us":111710,"threads_started":1,"wal-append.queue_time_us":725950}
I20260709 12:20:37.550786 28531 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:37.393858 28462 consensus_queue.cc:237] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.594113 28234 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:37.597386 28510 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:37.807955 25195 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:37.857326 28456 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.858057 28456 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:37.864773 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 475545us
I20260709 12:20:37.866272 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:37.736282 28426 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:20:37.869917 25268 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:37.588070 28490 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:37.879041 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 181052us
I20260709 12:20:37.872720 28353 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:37.757110 28577 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.876468 28263 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.891508 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:37.890076 25198 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:20:37.876719 28578 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.894737 25198 pending_rounds.cc:85] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 6
I20260709 12:20:37.897524 25198 pending_rounds.cc:107] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:20:37.896776 25200 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:37.897866 25198 raft_consensus.cc:2889] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:37.903158 25119 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:37.913125 28353 raft_consensus.cc:697] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:37.914273 28353 consensus_queue.cc:237] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:37.915902 28542 consensus_meta.cc:287] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.709s	user 0.006s	sys 0.011s
I20260709 12:20:37.916457 28542 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.916666 28477 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.920250 28577 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:37.921378 28428 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.922084 28428 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.922509 28263 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.922677 28428 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.924784 28263 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.925290 28428 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.927382 28542 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.928341 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2250) took 1137 ms. Trace:
I20260709 12:20:37.928795 28550 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.928748 25193 rpcz_store.cc:276] 0709 12:20:36.790790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.798119 (+  7329us) service_pool.cc:224] Handling call
0709 12:20:36.819132 (+ 21013us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:36.906580 (+ 87448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:36.906611 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:36.915300 (+  8689us) log.cc:844] Serialized 26 byte log entry
0709 12:20:37.378704 (+463404us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:37.561228 (+182524us) log.cc:844] Serialized 14 byte log entry
0709 12:20:37.561761 (+   533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.561885 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:37.928132 (+366247us) raft_consensus.cc:1685] finished
0709 12:20:37.928156 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:37.928284 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":245222,"raft.queue_time_us":146,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":23724,"spinlock_wait_cycles":48295680,"thread_start_us":522480,"threads_started":2,"wal-append.queue_time_us":925383}
I20260709 12:20:37.934012 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:37.934660 25193 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:37.917209 28544 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.883559 28299 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:37.925067 28051 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:37.937081 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1815) took 1338 ms. Trace:
I20260709 12:20:37.938328 25272 rpcz_store.cc:276] 0709 12:20:36.598422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.598594 (+   172us) service_pool.cc:224] Handling call
0709 12:20:36.598880 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:36.907626 (+308746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.936767 (+1029141us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540034d5d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:37.936967 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708497280}
I20260709 12:20:37.942961 28299 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.943500 28299 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:37.946866 28590 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 12:20:37.948038 28469 consensus_meta.cc:287] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.822s	user 0.011s	sys 0.004s
I20260709 12:20:37.948485 28578 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:37.949522 28573 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.865s	user 0.000s	sys 0.011s
I20260709 12:20:37.951534 28578 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:37.951962 25127 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:37.925333 28263 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.954555 28263 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.957167 28263 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:37.957809 28428 consensus_queue.cc:1059] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:37.952306 25860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:37.959846 25860 raft_consensus.cc:606] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:20:37.960273 25860 raft_consensus.cc:614] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:37.922214 28562 consensus_meta.cc:287] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.031s	user 0.012s	sys 0.012s
I20260709 12:20:37.961499 28562 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:37.952893 28538 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:37.962314 28538 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:37.953356 28568 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.888s	user 0.000s	sys 0.006s
I20260709 12:20:37.958478 28511 raft_consensus.cc:3055] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:37.948537 28469 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:37.952407 28049 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:37.935657 28197 consensus_meta.cc:287] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.764s	user 0.023s	sys 0.003s
I20260709 12:20:37.964814 25860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:37.985067 25860 raft_consensus.cc:606] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:37.985564 25860 raft_consensus.cc:614] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:37.979298 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 482740us
I20260709 12:20:37.987110 25092 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:37.980912 25268 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
W20260709 12:20:37.894835 28494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.014s	sys 0.002s
I20260709 12:20:37.994414 25092 leader_election.cc:400] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 5.
W20260709 12:20:37.990350 28494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.015s	sys 0.002s
I20260709 12:20:37.982362 28511 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:37.983875 28263 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:37.989624 28049 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:37.983012 28299 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.006165 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:38.007795 28538 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:37.997721 28562 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:38.010484 28469 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.010880 28263 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:38.011269 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.011432 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1814) took 1493 ms. Trace:
I20260709 12:20:38.012132 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:38.014335 25271 rpcz_store.cc:276] 0709 12:20:36.517918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.518150 (+   232us) service_pool.cc:224] Handling call
0709 12:20:36.518534 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:37.065550 (+547016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.011204 (+945654us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54002fec54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:38.011375 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002366208}
I20260709 12:20:38.020557 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:38.024386 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:38.025133 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:37.992398 28197 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:38.018219 28422 consensus_meta.cc:287] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.908s	user 0.005s	sys 0.013s
I20260709 12:20:38.031505 25825 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:38.042955 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 163016us
I20260709 12:20:37.897861 28583 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:38.045899 25241 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:38.052124 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.052625 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:38.053197 25126 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:38.053349 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.054056 25120 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:38.040594 28249 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:20:38.046947 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:38.052870 25118 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 7: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:38.030918 28562 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.028996 28538 raft_consensus.cc:2764] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:20:38.055857 25822 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:38.062794 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:37.995214 28561 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:38.087641 25118 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:38.045583 28465 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.094798 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.100533 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:38.101253 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.118721 25858 raft_consensus.cc:2368] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:20:38.099951 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:38.078548 25126 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:38.118279 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:38.099499 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:38.055078 28597 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:38.062587 28540 consensus_meta.cc:287] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.995s	user 0.014s	sys 0.003s
I20260709 12:20:38.019764 28443 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.057839 28426 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:38.148352 25857 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:38.097632 28586 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:38.149068 25125 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:38.062914 28450 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:38.151310 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2258) took 1008 ms. Trace:
I20260709 12:20:38.158684 25195 rpcz_store.cc:276] 0709 12:20:37.142476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.142674 (+   198us) service_pool.cc:224] Handling call
0709 12:20:38.151077 (+1008403us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b5400412dd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:38.151233 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506852224}
I20260709 12:20:38.153544 25124 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:38.060352 28234 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:38.127585 28465 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:38.055305 28509 consensus_queue.cc:1059] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:20:38.117005 28531 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:38.164809 25855 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:38.121076 28510 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:38.138914 28597 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.043908 28494 consensus_queue.cc:1059] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:20:38.155323 28426 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:38.172078 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.179441 25122 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:20:38.179899 25122 pending_rounds.cc:85] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 6
I20260709 12:20:38.180195 25122 pending_rounds.cc:107] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:20:38.180466 25122 raft_consensus.cc:2889] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:38.146000 28598 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:38.147415 28595 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:38.058933 28422 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.140300 28393 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:20:38.177198 25267 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:38.119444 28263 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.184309 25123 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:38.093806 28562 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.177085 28531 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:38.182928 28426 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:38.185422 28598 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.192672 28197 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:38.193361 28595 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:38.195863 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:38.199576 25270 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:38.055706 28511 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.201843 25122 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:38.203446 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:38.154485 28540 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.177377 28597 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:38.211210 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.223711 25125 raft_consensus.cc:2393] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 5: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:38.177861 28578 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:38.218487 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:38.226418 25854 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:38.219204 25275 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:38.221930 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:38.218470 28353 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.232436 25273 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:38.236744 25275 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
W20260709 12:20:38.236984 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.242322 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:20:38.218315 28258 consensus_meta.cc:287] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.838s	user 0.005s	sys 0.005s
I20260709 12:20:38.241173 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:38.246330 25276 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:38.210620 28531 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:38.245236 25120 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:38.242646 25241 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:38.248519 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:38.217072 28263 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:38.231422 28494 consensus_queue.cc:1243] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:38.249877 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.268750 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:38.249509 28380 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:38.253340 28249 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:38.279480 28605 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:38.282675 28465 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:38.284520 28531 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:38.252948 28258 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.240518 28578 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.291666 28258 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.254314 28577 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:20:38.294494 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 986) took 1373 ms. Trace:
I20260709 12:20:38.295035 25267 rpcz_store.cc:276] 0709 12:20:36.921219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.987365 (+ 66146us) service_pool.cc:224] Handling call
0709 12:20:36.987660 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:38.198220 (+1210560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.294187 (+ 95967us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400026f54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:38.294416 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2735161088}
W20260709 12:20:38.296489 28596 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:20:38.253348 28561 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:38.298482 28561 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:38.298720 28603 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:20:38.298979 28561 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:38.303331 28563 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 1.262s	user 0.000s	sys 0.006s
I20260709 12:20:38.303583 28595 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:38.305259 25851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 877) took 1802 ms. Trace:
I20260709 12:20:38.307190 28598 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.305806 25851 rpcz_store.cc:276] 0709 12:20:36.503007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.742940 (+239933us) service_pool.cc:224] Handling call
0709 12:20:36.743449 (+   509us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:36.744143 (+   694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:36.744174 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:36.745096 (+   922us) log.cc:844] Serialized 52 byte log entry
0709 12:20:36.885676 (+140580us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:36.885733 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.885827 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:38.302627 (+1416800us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:38.304880 (+  2253us) raft_consensus.cc:1685] finished
0709 12:20:38.304912 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:38.305183 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":346,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":168338688,"thread_start_us":139999,"threads_started":1,"wal-append.queue_time_us":209379}
W20260709 12:20:38.309585 28376 consensus_meta.cc:287] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.200s	user 0.010s	sys 0.002s
I20260709 12:20:38.243108 28511 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:38.315021 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:38.317462 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:38.319880 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:38.324810 25127 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:38.320822 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:38.320959 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:38.322605 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:38.328459 25269 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:38.330694 25267 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:38.330564 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:38.265739 28494 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:20:38.295857 28602 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:20:38.342702 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:38.337867 25127 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:38.343799 25122 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:38.344931 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:38.345518 25125 raft_consensus.cc:2393] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:38.347910 25121 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:38.320546 28571 consensus_meta.cc:287] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.179s	user 0.010s	sys 0.009s
I20260709 12:20:38.352850 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.353631 25127 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:38.355861 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.356557 25127 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:38.357223 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.357530 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.291747 28578 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:38.365345 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 122769us
I20260709 12:20:38.257596 28538 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:20:38.282676 28562 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.371766 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:38.324757 28561 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.374835 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:38.375342 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:38.375492 25860 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:38.368475 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:38.376420 25854 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:38.366606 25822 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:38.377862 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:38.331441 28234 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:38.261483 28353 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.344672 28249 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.378906 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:38.388326 25121 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:38.344447 28469 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:38.331775 28510 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:20:38.382920 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.350863 28491 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:38.390226 25274 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:38.404204 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 156355us
I20260709 12:20:38.408028 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:38.409802 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:38.396878 25860 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:38.369204 28470 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.398216 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:38.353251 28577 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:38.352907 28197 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:38.355664 28443 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.381984 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.432099 25127 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:38.402086 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:38.433488 25275 raft_consensus.cc:2368] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:20:38.339630 28222 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:20:38.403613 25165 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:38.413718 25241 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:38.423381 25121 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:38.388222 28495 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:38.435086 28495 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:38.360736 28571 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.426163 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:38.405313 28561 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:38.439589 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 196133us
I20260709 12:20:38.404093 28299 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:38.440935 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:38.403668 28234 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:38.446297 28234 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:38.446852 28234 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:38.446913 25092 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:38.447353 28234 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:38.447772 28609 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:20:38.448091 28549 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.404273 28249 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.448973 28443 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:38.449553 28443 raft_consensus.cc:697] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:38.450165 28249 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:38.450487 28443 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.447820 28234 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.455068 28353 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:38.455845 28549 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:38.427381 28531 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:38.458788 25092 leader_election.cc:400] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:20:38.459157 25092 leader_election.cc:403] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:20:38.381673 28049 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.465060 25119 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:38.467837 25272 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:38.479492 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:38.414166 28258 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:20:38.459931 28549 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:38.484225 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 65586.7us
W20260709 12:20:38.490163 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 112270us
W20260709 12:20:38.488946 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 85412.5us
I20260709 12:20:38.488168 28611 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:38.436605 28197 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.430070 28470 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.436399 28577 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.503557 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:38.526520 25853 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:38.495625 25825 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.759s (SENT) [suppressed 45 similar messages]
I20260709 12:20:38.407840 28469 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.431559 28550 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:20:38.536919 25851 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:38.478495 28578 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:38.415226 28491 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:38.498224 25227 heartbeater.cc:646] Failed to heartbeat to 127.23.81.254:44087 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.23.81.254:44087 timed out after 15.000s (SENT)
I20260709 12:20:38.542552 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:38.478431 28101 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:38.483129 28376 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.440912 28490 consensus_queue.cc:1059] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:20:38.546358 25274 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:38.500562 28380 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:38.550562 25267 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:38.477545 28299 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.502367 28049 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.444060 28561 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:38.559919 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 64713.7us
I20260709 12:20:38.477699 28562 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:20:38.565693 25168 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:38.505260 28531 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:38.459389 28234 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:38.561465 28101 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:38.507469 28426 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:38.595098 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 131018us
I20260709 12:20:38.561551 28617 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:38.565261 28513 consensus_meta.cc:287] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 1.309s	user 0.012s	sys 0.001s
I20260709 12:20:38.565090 28490 consensus_queue.cc:1243] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 log is divergent from this leader: its last log entry 9.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:20:38.568120 28510 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.569674 28422 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:38.610905 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 120898us
W20260709 12:20:38.622644 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 57021.9us
I20260709 12:20:38.589748 25853 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:38.588788 28353 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.504437 28495 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.624223 25270 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:20:38.569803 28618 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:38.591431 28049 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:38.626529 25241 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:38.565347 28380 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:20:38.563040 28376 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:38.631536 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.627059 25168 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:38.565976 28597 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.588280 28531 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:38.567768 28619 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:20:38.625394 28550 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.628073 28513 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:38.649008 25854 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:38.628458 28540 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:38.686771 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 60317.5us
I20260709 12:20:38.691525 25857 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:38.692058 25241 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:38.693583 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:38.620123 28610 consensus_queue.cc:1059] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:20:38.687347 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:38.627525 28510 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.620187 28617 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.650816 28513 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:38.634805 28353 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.638796 28049 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:38.699389 28599 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:38.642962 28598 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
W20260709 12:20:38.721928 28563 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:20:38.704635 28571 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.704064 28604 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.733675 28197 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:38.639055 28618 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:38.687255 28550 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.754307 28641 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.724607 28629 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:38.755239 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 127942us
I20260709 12:20:38.727100 28513 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:38.729712 28258 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:38.769145 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:38.759548 28619 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:38.751139 28470 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.752944 28604 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:38.778180 28599 raft_consensus.cc:697] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:38.778468 28258 raft_consensus.cc:697] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:38.778626 28577 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:38.790541 28470 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:38.786541 28561 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:38.788516 28299 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.786249 28619 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:38.792294 28234 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:38.793727 28101 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:38.785876 28622 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:20:38.778875 28623 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:38.791899 28426 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.872288 28597 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:38.764209 28641 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.861619 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2303) took 1947 ms. Trace:
I20260709 12:20:38.878552 25825 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:38.879097 25268 rpcz_store.cc:276] 0709 12:20:36.908384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.994299 (+ 85915us) service_pool.cc:224] Handling call
0709 12:20:38.855859 (+1861560us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400120554. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:38.855981 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881841920}
W20260709 12:20:38.871510 28621 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
W20260709 12:20:38.839854 28626 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:20:38.870090 28561 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.887948 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:38.888434 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:38.888603 25851 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:38.875274 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:38.768069 28629 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.880075 25825 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:38.879973 28623 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:38.889519 25854 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:38.898924 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:38.899439 25854 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:38.878087 28299 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:38.877044 28511 consensus_meta.cc:287] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.000s
I20260709 12:20:38.904071 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:38.873517 28491 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:38.846379 28630 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:20:38.877405 28470 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:38.907317 25854 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:38.881513 28597 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:39.344969 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 464903us
I20260709 12:20:38.896100 28561 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:39.159674 28631 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 12:20:39.163581 28624 log.cc:927] Time spent T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 12:20:39.002678 28626 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:20:39.163704 28620 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:20:39.161144 28638 log.cc:927] Time spent T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
W20260709 12:20:39.374261 28598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.003s	sys 0.008s
I20260709 12:20:38.903306 28623 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:38.910128 28617 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:38.916165 28629 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.929621 28618 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:39.602044 28604 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:39.040741 28619 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:39.615918 28641 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:40.202111 28598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.444s	user 0.003s	sys 0.017s
I20260709 12:20:38.917079 28599 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.224411 28623 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:40.232424 28623 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:39.041299 28550 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.901803 28510 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:40.345000 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.345980 28510 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:40.346714 28618 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:40.346858 28641 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.347299 28618 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:40.347451 28641 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.349346 28619 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:40.358718 28619 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.361196 28619 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.361838 28619 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:40.347851 28629 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.362615 28629 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.364920 28629 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.365466 28629 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.346712 28510 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.349722 28641 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.368588 28510 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.349556 28618 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:40.365957 28629 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:40.373027 28629 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:40.374305 28619 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.375093 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 901) took 2165 ms. Trace:
I20260709 12:20:40.375494 25856 rpcz_store.cc:276] 0709 12:20:38.209612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.305455 (+ 95843us) service_pool.cc:224] Handling call
0709 12:20:38.305775 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:38.373596 (+ 67821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.373630 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:38.380707 (+  7077us) log.cc:844] Serialized 52 byte log entry
0709 12:20:38.565201 (+184494us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:38.565243 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.565314 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.374785 (+1809471us) raft_consensus.cc:1685] finished
0709 12:20:40.374807 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.374988 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50317,"raft.queue_time_us":50481,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":13896,"thread_start_us":139504,"threads_started":1,"wal-append.queue_time_us":218317}
I20260709 12:20:40.376684 28619 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.378618 28629 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:40.379393 28629 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:40.382575 28629 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:40.378907 28619 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.385535 28619 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:40.388230 28619 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:40.413203 28380 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.414s	user 0.009s	sys 0.022s
W20260709 12:20:40.413713 28380 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.485s	user 0.010s	sys 0.024s
W20260709 12:20:39.693953 28513 consensus_meta.cc:287] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.000s
I20260709 12:20:39.739611 28470 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.908142 28258 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.436355 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1826) took 1805 ms. Trace:
I20260709 12:20:40.436772 25274 rpcz_store.cc:276] 0709 12:20:38.631046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.631186 (+   140us) service_pool.cc:224] Handling call
0709 12:20:38.639182 (+  7996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:38.639593 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.639638 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:38.640189 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:20:38.786497 (+146308us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:38.786554 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.786661 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.436129 (+1649468us) raft_consensus.cc:1685] finished
0709 12:20:40.436150 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.436294 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":57270,"thread_start_us":63636,"threads_started":1,"wal-append.queue_time_us":216133}
I20260709 12:20:40.446420 28513 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:40.467736 28513 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:40.485316 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1824) took 1957 ms. Trace:
I20260709 12:20:40.485738 25271 rpcz_store.cc:276] 0709 12:20:38.528248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.528363 (+   115us) service_pool.cc:224] Handling call
0709 12:20:38.542753 (+ 14390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:38.765036 (+222283us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:38.765066 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:38.765933 (+   867us) log.cc:844] Serialized 26 byte log entry
0709 12:20:38.902659 (+136726us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:38.902696 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.902947 (+   251us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.485047 (+1582100us) raft_consensus.cc:1685] finished
0709 12:20:40.485090 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.485250 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1648,"raft.queue_time_us":21634,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":985,"thread_start_us":283387,"threads_started":2,"wal-append.queue_time_us":1686569}
I20260709 12:20:40.486871 28663 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.487574 28663 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.489905 28663 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.490509 28663 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.490973 28663 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.493765 28663 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:40.495708 25242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.729s	user 0.030s	sys 0.017s
W20260709 12:20:40.496078 25242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.729s	user 0.030s	sys 0.017s
W20260709 12:20:40.496340 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 1.75956e+06us
W20260709 12:20:40.496791 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1538963299999523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:20:40.502249 28653 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.502854 28653 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.505278 28653 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:40.505842 25167 connection.cc:256] RPC call timeout handler was delayed by -1.4606768579999425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 12:20:40.512966 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 655) took 2298 ms. Trace:
I20260709 12:20:40.524082 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.524798 25194 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:40.514277 25120 rpcz_store.cc:276] 0709 12:20:38.214733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.214867 (+   134us) service_pool.cc:224] Handling call
0709 12:20:38.215215 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:38.252046 (+ 36831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.512645 (+2260599us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b540009d654. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:40.512864 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62076672}
I20260709 12:20:40.528748 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.534343 25197 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:20:40.625560 25168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.855s	user 0.001s	sys 0.031s
W20260709 12:20:40.627300 25168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.857s	user 0.003s	sys 0.032s
W20260709 12:20:40.629683 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 1.85944e+06us
I20260709 12:20:40.642768 25168 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:40.644850 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.645203 28634 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:40.645656 28634 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.646004 28634 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:40.647667 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.648274 25195 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:40.650276 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.651736 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 894) took 2450 ms. Trace:
I20260709 12:20:40.653523 25202 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:40.654759 25195 raft_consensus.cc:1240] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:40.661933 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 131675us
I20260709 12:20:40.661583 25857 rpcz_store.cc:276] 0709 12:20:38.201726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.201866 (+   140us) service_pool.cc:224] Handling call
0709 12:20:38.202395 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:38.691990 (+489595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.651468 (+1959478us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b54007e0754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:40.651667 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116643072}
I20260709 12:20:39.158727 28049 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:40.655891 25168 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:40.666349 28470 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:40.666777 28470 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.667135 28470 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:40.671658 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2306) took 2333 ms. Trace:
I20260709 12:20:40.672039 25270 rpcz_store.cc:276] 0709 12:20:38.338665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.338840 (+   175us) service_pool.cc:224] Handling call
0709 12:20:38.352686 (+ 13846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:38.630757 (+278071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.671404 (+2040647us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400121e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:40.671597 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621132544}
I20260709 12:20:40.543304 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:40.676345 25194 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:40.675020 25168 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:40.678812 28657 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:40.680137 25168 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:20:40.683687 25090 connection.cc:256] RPC call timeout handler was delayed by -2.1191628870001296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 12:20:40.685096 25090 connection.cc:256] RPC call timeout handler was delayed by -1.9904628870001488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260709 12:20:40.685581 25090 connection.cc:256] RPC call timeout handler was delayed by -1.8302628870001172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 12:20:40.686192 28663 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.686669 28663 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:40.688777 28663 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:40.688773 28657 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:40.689500 28663 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:40.690233 28663 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.916934 28299 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.654819 28634 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.693089 28299 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.693177 28663 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.694865 28634 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.683048 28470 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:40.695596 25090 connection.cc:256] RPC call timeout handler was delayed by -1.7061778489999142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 12:20:40.697161 28664 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.698148 25860 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:40.698573 25860 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:40.698258 28664 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.700482 28664 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.697476 28470 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.697597 28663 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.701520 28663 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.703886 28663 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.703377 25194 raft_consensus.cc:2410] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:20:40.699425 25860 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.709270 25860 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:40.714051 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.715088 25270 raft_consensus.cc:2410] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:20:40.716348 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:40.716895 25860 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 12:20:40.717555 28450 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:20:40.718199 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.719099 25275 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:40.719362 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 906) took 2272 ms. Trace:
I20260709 12:20:40.719798 25860 rpcz_store.cc:276] 0709 12:20:38.446957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.465011 (+ 18054us) service_pool.cc:224] Handling call
0709 12:20:38.465307 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:40.698015 (+2232708us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400643aa0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e85dc0 00007f2103f101c0 00007f2103f11231 00007f2103f0dd8f 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c
0709 12:20:40.717338 (+ 19323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.719299 (+  1961us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357378432}
I20260709 12:20:40.720453 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:40.726750 28469 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.727169 25194 pending_rounds.cc:85] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 5
I20260709 12:20:40.727511 25194 pending_rounds.cc:107] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:20:40.727753 25194 raft_consensus.cc:2889] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:40.727994 25090 connection.cc:256] RPC call timeout handler was delayed by -1.2941909829999076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 12:20:40.728412 25090 connection.cc:256] RPC call timeout handler was delayed by -1.1318628870001248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29460000000000003s for a response
W20260709 12:20:40.728778 25090 connection.cc:256] RPC call timeout handler was delayed by -1.1308919709999827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 12:20:40.729105 25090 connection.cc:256] RPC call timeout handler was delayed by -1.122289579000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 12:20:40.729432 25090 connection.cc:256] RPC call timeout handler was delayed by -1.1006895790001181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 12:20:40.729737 25090 connection.cc:256] RPC call timeout handler was delayed by -1.0754895790000774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
I20260709 12:20:40.729957 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:40.730459 28663 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.730738 25199 raft_consensus.cc:2368] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8.
I20260709 12:20:40.731035 28663 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.732177 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.733398 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.733601 28663 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.734460 25090 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:40.734710 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.735316 25197 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:40.737776 25090 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:40.747720 25090 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:40.748126 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.748867 25268 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:40.749863 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.751493 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.751746 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:40.752451 25197 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:40.752887 25242 leader_election.cc:400] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8.
I20260709 12:20:40.753232 25242 leader_election.cc:403] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:20:40.747731 28664 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:40.754998 28664 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:40.757136 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.735327 28663 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:40.760901 25242 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:40.761816 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:40.763926 25193 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:40.764235 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.761620 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:40.765355 25268 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:40.766059 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:40.762689 25275 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:40.766822 25202 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:40.769529 25855 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 926) took 2670 ms (client timeout 1846 ms). Trace:
I20260709 12:20:40.765383 28423 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8.
I20260709 12:20:40.772668 25268 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:40.772872 25195 raft_consensus.cc:2393] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:40.776278 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41024 (request call id 98) took 2633 ms. Trace:
W20260709 12:20:40.769968 25855 rpcz_store.cc:269] 0709 12:20:38.099089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.099209 (+   120us) service_pool.cc:224] Handling call
0709 12:20:40.769342 (+2670133us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b540054f454. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:40.769460 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94681856}
I20260709 12:20:40.778561 25242 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:40.779299 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.783591 25269 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:40.779498 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.784334 25195 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:40.785270 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.782430 25193 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:40.786655 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.787741 25193 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:40.788642 25200 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:40.789674 25126 rpcz_store.cc:276] 0709 12:20:38.142447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.142567 (+   120us) service_pool.cc:224] Handling call
0709 12:20:40.775996 (+2633429us) spinlock_profiling.cc:243] Waited 72.5 ms on lock 0x7b540009d654. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f14735 00007f2103f0c9fa 00007f2108ed44c9 00007f2102450c54 00007f2102450be2 00007f2102450b11 00007f2102450a8c 00007f210244fd42 00007f210224948c 00007f21022488c6
0709 12:20:40.776188 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166805760}
I20260709 12:20:40.791117 28649 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:40.791756 28649 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.920469 28549 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:20:40.794698 28049 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:40.795192 28049 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:40.795595 28049 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:40.788337 28423 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:40.803213 25195 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:40.804167 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.805017 25270 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 8: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:40.805819 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.806298 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.806931 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.807433 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.808113 25274 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:40.809072 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.810537 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.811210 25269 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:40.807554 25270 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:40.812073 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.814586 25197 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:40.788772 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:40.818337 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:40.820338 25119 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:20:40.825012 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:40.826623 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:40.830579 28649 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.831542 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.786494 25202 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:40.833707 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.833251 28423 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:40.835070 28649 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:40.835553 28649 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.836112 28649 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:40.835508 28423 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:40.842273 28423 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:40.843233 28561 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:38.922291 28353 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:40.844388 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 96749.6us
I20260709 12:20:40.849818 28669 consensus_queue.cc:1059] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:40.851446 25198 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:40.851912 28561 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:40.852937 28669 raft_consensus.cc:3055] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:40.853554 28669 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:40.854398 28669 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:40.855592 28669 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:40.855713 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 995) took 2327 ms. Trace:
I20260709 12:20:40.856118 25272 rpcz_store.cc:276] 0709 12:20:38.528126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.528272 (+   146us) service_pool.cc:224] Handling call
0709 12:20:38.528604 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:38.528964 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.528997 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:38.529460 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:20:38.623280 (+ 93820us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:38.623326 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.623400 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.855479 (+2232079us) raft_consensus.cc:1685] finished
0709 12:20:40.855499 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.855646 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18752,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3871,"thread_start_us":61545,"threads_started":1,"wal-append.queue_time_us":186127}
I20260709 12:20:40.857285 28549 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:40.857659 28549 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:40.858497 28549 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:40.859413 28549 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:40.860409 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:40.861213 25194 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:40.862102 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.862972 25270 raft_consensus.cc:2410] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:40.863183 25168 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:40.864593 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.866469 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.867383 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:40.868018 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.868378 25274 raft_consensus.cc:2376] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10. Re-sending same reply.
I20260709 12:20:40.869007 25197 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:40.869848 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.873991 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.874719 25198 raft_consensus.cc:2410] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:20:40.874682 25272 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:40.871286 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:40.876312 25194 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:40.879163 25093 connection.cc:256] RPC call timeout handler was delayed by -1.794047940999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 12:20:40.880328 25193 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:40.881937 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.882266 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.882730 25197 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:40.880946 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:40.886790 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:40.887006 25202 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:40.887509 25195 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:40.883701 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:40.891021 28657 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:40.891441 25165 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:40.891728 28657 raft_consensus.cc:697] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:40.892419 28653 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.892921 28653 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:40.893667 28634 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:40.894088 28634 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:40.894456 28634 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:40.895114 28653 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:40.896184 28653 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:40.896920 28653 raft_consensus.cc:697] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:40.897850 28653 consensus_queue.cc:237] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:40.892750 28657 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.899005 25194 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:40.902963 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:40.903961 28469 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:40.905102 25090 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:40.905706 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.872255 28664 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.909780 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:40.888275 28462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.875s	user 0.019s	sys 0.009s
I20260709 12:20:40.912357 25090 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:40.913017 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.914402 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.914734 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:40.915529 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 70534.6us
I20260709 12:20:40.918819 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:40.908933 28618 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:40.906911 28469 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:40.921809 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.922266 25269 raft_consensus.cc:2410] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:20:40.908349 28561 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:40.925452 28561 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:38.908560 28490 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:40.927796 28561 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:40.928331 28561 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:40.928988 28561 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:40.929446 28561 raft_consensus.cc:697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:40.936175 28531 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:40.917625 28462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.913s	user 0.019s	sys 0.009s
I20260709 12:20:40.881811 28049 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.907181 28671 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:40.916844 28676 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:40.907773 25165 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:40.939049 25859 raft_consensus.cc:3055] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:40.959642 25859 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:40.938815 28469 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:40.961720 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 54033.8us
I20260709 12:20:40.962713 25165 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:40.960693 25859 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.968451 25859 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:40.968792 28653 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:40.973760 28653 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.967327 28299 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:40.974200 28653 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:40.974437 28299 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.974866 28299 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:40.917490 28664 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:40.972240 25165 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:40.980490 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:40.958431 28531 consensus_queue.cc:1059] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:20:40.983940 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:40.981649 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 69558.7us
I20260709 12:20:40.991287 25090 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:40.956707 28649 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:40.994073 28657 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:40.981709 28641 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:40.969596 28654 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:20:40.971302 28648 consensus_queue.cc:1059] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:20:40.987926 28470 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:41.006278 25274 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:41.010946 25274 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:41.006227 25859 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:41.012871 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 925) took 2914 ms. Trace:
I20260709 12:20:41.013258 25859 rpcz_store.cc:276] 0709 12:20:38.098746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.098880 (+   134us) service_pool.cc:224] Handling call
0709 12:20:38.140036 (+ 41156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:40.938895 (+2798859us) spinlock_profiling.cc:243] Waited 95.1 ms on lock 0x7b54008bc7a0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e85dc0 00007f2103f101c0 00007f2103f11231 00007f2103f0dd8f 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c
0709 12:20:41.012538 (+ 73643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.012807 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218642176}
I20260709 12:20:41.012567 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:41.018687 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:41.020254 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:41.021500 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:41.023506 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:41.024353 25270 raft_consensus.cc:2368] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:20:40.966089 28671 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.011790 25274 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.031842 25274 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:41.030658 25090 leader_election.cc:400] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:20:41.026754 25242 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:40.967670 28676 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.007668 28682 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:20:41.025605 28440 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:20:40.992098 28663 consensus_queue.cc:1059] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:20:41.025380 28641 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:41.017333 28648 raft_consensus.cc:3055] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:41.042582 25200 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:20:41.017557 28470 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:41.039222 28640 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:41.041918 28681 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.009681 28657 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.042074 28605 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:41.008034 28561 consensus_queue.cc:237] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.054781 28682 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.066685 28470 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:41.057842 28648 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:41.093652 25274 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:41.079463 28605 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:41.083321 28682 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:41.111900 28641 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.079586 28681 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.107277 28605 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:41.106413 28649 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:41.134393 28681 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:41.139532 28680 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:20:41.110895 28049 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:41.161043 25056 debug-util.cc:398] Leaking SignalData structure 0x7b080033e220 after lost signal to thread 23879
W20260709 12:20:41.193759 25056 debug-util.cc:398] Leaking SignalData structure 0x7b080008bf60 after lost signal to thread 23882
I20260709 12:20:41.174468 28664 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:41.226559 25093 connection.cc:256] RPC call timeout handler was delayed by -1.5546479409999847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 12:20:41.227682 25093 connection.cc:256] RPC call timeout handler was delayed by -1.2028755559999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 12:20:41.139559 28634 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:41.216192 28679 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:20:41.233893 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.236577 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:41.237540 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.243216 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.243983 25118 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:41.246817 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.246902 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.247561 28663 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.248004 25125 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 9: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:41.248941 28663 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.249825 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.252842 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.253760 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.254426 25127 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
W20260709 12:20:41.255688 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.256582 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:41.257259 25125 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:41.265229 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 163308us
I20260709 12:20:41.268159 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:41.268831 25270 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
W20260709 12:20:41.268175 25092 connection.cc:256] RPC call timeout handler was delayed by -1.4368279749999147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 12:20:41.270138 25092 connection.cc:256] RPC call timeout handler was delayed by -1.10337278399993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
I20260709 12:20:41.268157 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:41.273908 25092 connection.cc:256] RPC call timeout handler was delayed by -1.0045353729999533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
I20260709 12:20:41.296597 28701 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.297277 28701 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.170516 28648 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.213502 28690 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:20:41.258450 28671 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:41.317958 28694 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.317405 28605 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.320266 28694 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:41.322592 28692 log.cc:927] Time spent T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:20:41.322721 28663 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:41.310611 28676 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:41.310256 28690 consensus_queue.cc:1243] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:41.323531 28701 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:41.317539 28657 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:41.328101 25118 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:41.328747 25093 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:41.332419 28470 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.334087 28694 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:41.341477 28634 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:41.342315 28648 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:41.347095 28664 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.347791 28664 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.351958 28299 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.353118 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 660) took 2869 ms. Trace:
I20260709 12:20:41.353554 25121 rpcz_store.cc:276] 0709 12:20:38.483629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.483771 (+   142us) service_pool.cc:224] Handling call
0709 12:20:38.484093 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:38.484776 (+   683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.484821 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:38.485416 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 12:20:38.595724 (+110308us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:38.595784 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.595874 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:41.352845 (+2756971us) raft_consensus.cc:1685] finished
0709 12:20:41.352873 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:41.353037 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":109923,"threads_started":1,"wal-append.queue_time_us":149800,"wal-append.run_cpu_time_us":15262,"wal-append.run_wall_time_us":2575905}
I20260709 12:20:41.355755 28653 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.333822 25825 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:41.358897 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:41.365571 28549 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.005s
I20260709 12:20:41.365762 28702 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:41.368932 25122 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:41.366382 28702 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.382148 25125 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:41.390094 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.391296 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:41.366521 28664 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:41.394207 25093 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:41.384151 28671 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.383854 28676 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:41.381701 28640 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:41.383625 28702 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:41.400794 25093 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:41.394297 25125 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:41.404078 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:41.402966 28671 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.397763 28700 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:41.396302 28696 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:41.410645 28653 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:41.411900 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:41.418283 25241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.718s	user 0.025s	sys 0.011s
W20260709 12:20:41.418762 25241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.718s	user 0.025s	sys 0.011s
I20260709 12:20:41.419308 25093 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:41.392342 28701 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 12:20:41.419051 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 2.7186e+06us
I20260709 12:20:41.420981 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:41.422803 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:41.423588 25269 raft_consensus.cc:2393] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:41.425931 28696 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:41.426287 28694 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:41.391817 28682 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.400254 28299 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:41.392743 28469 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.430003 25270 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:41.430791 25268 pending_rounds.cc:85] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 6
I20260709 12:20:41.432157 25268 pending_rounds.cc:107] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:20:41.432538 25268 raft_consensus.cc:2889] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:41.432224 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:41.428117 25090 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:41.433233 25202 raft_consensus.cc:2393] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:41.396328 28669 consensus_queue.cc:1059] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:20:41.435189 25168 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:41.395577 28549 consensus_queue.cc:1059] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:20:41.436084 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:41.436877 25196 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:41.438141 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:41.429183 28676 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:20:41.385800 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 343356us
I20260709 12:20:41.441521 28649 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.444864 28649 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.446370 28676 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.446864 28676 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:41.449118 28649 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:41.457967 25012 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3552726c022345b394b69265b8f3b566 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897be935c42e41b995f177155b042be0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:20:41.438117 28423 consensus_meta.cc:287] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.000s
I20260709 12:20:41.433354 28470 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:41.462518 28710 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:41.464279 28710 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:41.464674 28710 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:41.465355 28561 raft_consensus.cc:3055] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:41.465747 28561 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:41.466466 28640 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.466684 28561 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.470228 28531 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.460165 28707 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.470827 28531 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.471135 28707 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.472575 28423 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.473731 25274 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:41.461725 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.475023 28423 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:41.774003 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.774796 25120 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:41.775219 28682 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:41.775884 28645 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:41.775820 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:41.776693 28645 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:41.777683 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:41.808911 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:41.778654 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 336049us
I20260709 12:20:41.779476 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.837989 25272 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:20:41.838331 25125 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:41.839195 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:41.839566 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.779805 28645 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:41.658296 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.840806 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:41.839244 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2389) took 3786 ms. Trace:
W20260709 12:20:41.669198 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.782079 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 935) took 2904 ms. Trace:
I20260709 12:20:41.842949 25854 rpcz_store.cc:276] 0709 12:20:38.877798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.355878 (+478080us) service_pool.cc:224] Handling call
0709 12:20:39.356304 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:41.357311 (+2001007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:41.357345 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:41.366243 (+  8898us) log.cc:844] Serialized 26 byte log entry
0709 12:20:41.453716 (+ 87473us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:41.453777 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.453874 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:41.781821 (+327947us) raft_consensus.cc:1685] finished
0709 12:20:41.781840 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:41.781978 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2000542,"thread_start_us":77752,"threads_started":1,"wal-append.queue_time_us":413821}
I20260709 12:20:41.800568 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:41.801047 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:41.844799 25200 raft_consensus.cc:2393] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:41.800604 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:41.845180 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:41.802994 28707 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:41.519217 28695 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:41.849128 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:41.849918 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:41.778189 28561 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:41.851177 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:41.851830 25125 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:41.813410 28549 raft_consensus.cc:3055] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:41.853816 28549 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:41.820225 28540 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:20:41.826285 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:41.856303 25268 raft_consensus.cc:2393] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:41.857055 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:41.832412 25270 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:41.833886 25269 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:41.859608 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:41.860819 25268 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:41.861637 25270 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:41.862789 25200 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:41.842159 25124 rpcz_store.cc:276] 0709 12:20:38.052598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.054997 (+  2399us) service_pool.cc:224] Handling call
0709 12:20:38.055290 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:38.160238 (+104948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.839025 (+3678787us) spinlock_profiling.cc:243] Waited 98 ms on lock 0x7b540009d154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:41.839182 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225400192}
I20260709 12:20:41.845266 25196 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:41.802475 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:41.845897 25197 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:41.840584 28469 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:41.846520 28263 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:41.865916 28263 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:41.866343 28263 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:41.853423 28531 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:41.870573 25125 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:41.874769 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:41.830092 28710 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.851552 25272 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:20:41.877853 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.864961 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.879382 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:41.879474 25197 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:20:41.883221 28534 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.884250 28534 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.886585 28534 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:41.881954 28531 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:41.882310 25242 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:41.880879 28540 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.893687 25124 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 8: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:41.893010 28540 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:41.893465 28707 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:41.893167 28696 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:20:41.890651 28531 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:41.860085 28669 consensus_queue.cc:1059] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:20:41.899197 28531 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:41.904047 28618 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:41.910472 28618 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:41.909835 28263 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:41.922796 28710 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:41.972842 25197 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:41.964349 28618 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:42.009203 28676 consensus_meta.cc:287] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 12:20:42.016789 28676 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.019192 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:42.020011 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 1834) took 1216 ms. Trace:
I20260709 12:20:42.020403 25275 rpcz_store.cc:276] 0709 12:20:40.803105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.018890 (+1215785us) service_pool.cc:224] Handling call
0709 12:20:42.019949 (+  1059us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:42.014896 28531 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:42.025976 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 910) took 3479 ms. Trace:
I20260709 12:20:42.034900 25853 rpcz_store.cc:276] 0709 12:20:38.546188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.625589 (+ 79401us) service_pool.cc:224] Handling call
0709 12:20:38.625866 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:38.738289 (+112423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.738318 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:38.738361 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:38.738394 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.025638 (+3287244us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54005a3a54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:42.025699 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.025890 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258102656}
I20260709 12:20:42.027797 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.016619 25024 catalog_manager.cc:5697] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 5, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 5 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:41.844188 28682 consensus_queue.cc:1059] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 12:20:42.060333 28702 consensus_meta.cc:287] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.002s
I20260709 12:20:42.061102 28702 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.063423 28702 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:42.064054 25127 raft_consensus.cc:2393] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 9: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:42.065442 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.069695 25120 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:42.060415 28676 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:42.071300 25056 debug-util.cc:398] Leaking SignalData structure 0x7b0800035d40 after lost signal to thread 25059
W20260709 12:20:42.075403 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 68312.5us
I20260709 12:20:42.075691 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:42.076395 25275 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:42.079664 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:42.080245 25194 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:42.090477 25194 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:42.068436 28707 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:20:42.066293 28681 raft_consensus.cc:3055] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:42.068567 28049 consensus_queue.cc:1059] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:20:42.094826 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.114681 25126 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:42.115409 25275 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:42.116628 25090 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:42.098261 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.118367 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:42.119565 25194 raft_consensus.cc:2393] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:42.080181 28263 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:42.121943 25853 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:42.122946 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.124771 25854 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:42.125113 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:42.126399 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:42.127673 25126 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:42.123219 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.129062 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.129549 25118 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:42.129659 25126 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:42.118126 28710 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:42.100082 28681 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:42.132360 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.135128 25126 raft_consensus.cc:2393] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 8: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:42.136129 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.133677 28681 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.132395 28618 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:42.131621 28714 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:42.131477 28049 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:42.128367 28380 raft_consensus.cc:3055] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:42.141338 25854 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:42.124429 28531 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:42.137900 28710 raft_consensus.cc:697] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:42.154806 28710 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.155344 28540 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:42.160223 28491 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:42.160845 28491 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.162246 28597 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.162822 28597 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.164973 28597 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:42.165454 28597 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:42.166193 28617 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.166682 28681 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:42.166836 28577 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:42.167483 28577 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.168542 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.169167 25124 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:42.169548 28577 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:42.170008 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.170800 25242 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:42.175709 25242 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:42.184662 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.185494 25854 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:42.185633 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.189620 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.191018 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.191886 25855 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:42.193832 25194 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:42.194494 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.190232 25853 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:42.170348 28380 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:42.204171 28456 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:42.206368 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.207018 25124 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:42.207991 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.209022 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:42.209510 25056 debug-util.cc:398] Leaking SignalData structure 0x7b080038f160 after lost signal to thread 25151
I20260709 12:20:42.184320 28707 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:42.210670 25056 debug-util.cc:398] Leaking SignalData structure 0x7b08002753e0 after lost signal to thread 25226
I20260709 12:20:42.211720 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.212751 25853 raft_consensus.cc:2410] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:42.195400 28531 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:42.165889 28597 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.214649 25118 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
W20260709 12:20:42.215691 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 881901us
I20260709 12:20:42.213883 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:42.218104 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.218643 25854 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:42.221542 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.222201 25854 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:42.222463 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.224880 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.228961 25854 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:42.229049 25858 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:42.166702 28617 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.231773 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.232337 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.234067 25854 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:42.234278 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.235271 25124 raft_consensus.cc:2393] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:42.236786 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.238626 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:42.238986 25275 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:20:42.213887 28531 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:42.220466 28458 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:42.241164 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.235689 28440 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:42.243911 28597 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:42.245735 25056 debug-util.cc:398] Leaking SignalData structure 0x7b080023e8a0 after lost signal to thread 25300
I20260709 12:20:42.235913 28517 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.253316 28440 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.254776 28517 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.256242 28440 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:42.256749 28517 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:42.257150 28393 raft_consensus.cc:3055] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:42.245862 28531 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:42.257575 28393 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:42.240309 28391 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.263017 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.263794 28491 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:42.230741 28353 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:42.264465 28353 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.264606 28491 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:42.249688 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:42.258482 28393 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.266264 25858 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:42.267643 28353 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:42.268278 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 991) took 4070 ms. Trace:
I20260709 12:20:42.268617 28617 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:42.268797 25276 rpcz_store.cc:276] 0709 12:20:38.197697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.197817 (+   120us) service_pool.cc:224] Handling call
0709 12:20:38.206167 (+  8350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:38.246808 (+ 40641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.268043 (+4021235us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b54002be8d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:42.268209 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91788160}
I20260709 12:20:42.247999 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.266322 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.263590 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:42.271001 25124 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:42.250005 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.267022 28393 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:42.272876 25860 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:42.273226 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1896) took 1021 ms. Trace:
I20260709 12:20:42.248730 28490 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:20:42.273598 25127 rpcz_store.cc:276] 0709 12:20:41.252179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.027466 (+775287us) service_pool.cc:224] Handling call
0709 12:20:42.273041 (+245575us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b540021e3d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:42.273167 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61995904}
I20260709 12:20:42.272336 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2332) took 1004 ms. Trace:
W20260709 12:20:42.271263 25123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2398) took 4170 ms (client timeout 2975 ms). Trace:
I20260709 12:20:42.274892 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.276441 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.282644 25858 raft_consensus.cc:2410] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:20:42.275978 25274 rpcz_store.cc:276] 0709 12:20:41.267419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.269274 (+  1855us) service_pool.cc:224] Handling call
0709 12:20:41.269554 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.474116 (+204562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.272125 (+798009us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54002bedd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:42.272281 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469076864}
I20260709 12:20:42.286501 25854 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 9: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:42.275182 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.288681 25127 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:42.263113 28391 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:42.276762 25123 rpcz_store.cc:269] 0709 12:20:38.100673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.100929 (+   256us) service_pool.cc:224] Handling call
0709 12:20:42.271045 (+4170116us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b540026c854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:42.271184 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139342592}
I20260709 12:20:42.290822 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.290684 28549 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:42.291271 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.291455 25123 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:42.291805 28391 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:42.291895 28549 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.292563 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.292999 25851 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:42.293272 25120 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:42.293617 28376 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:42.293682 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2409) took 1003 ms. Trace:
I20260709 12:20:42.294452 25120 rpcz_store.cc:276] 0709 12:20:41.290509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.292328 (+1001819us) service_pool.cc:224] Handling call
0709 12:20:42.293625 (+  1297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:42.295159 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.296130 25123 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:42.301290 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.301597 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.302786 25120 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
W20260709 12:20:42.304615 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 66605.2us
I20260709 12:20:42.303756 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.304847 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:42.305557 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.305639 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.306576 25120 raft_consensus.cc:2368] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8.
I20260709 12:20:42.310657 28651 raft_consensus.cc:3055] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:42.311681 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.312310 25860 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:42.318751 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.321103 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.327240 25118 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:42.300642 28491 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:20:42.321844 25119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 658) took 3843 ms (client timeout 1697 ms). Trace:
I20260709 12:20:42.322624 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.338047 25127 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:42.338339 25855 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
W20260709 12:20:42.338104 25119 rpcz_store.cc:269] 0709 12:20:38.478827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.479244 (+   417us) service_pool.cc:224] Handling call
0709 12:20:42.321675 (+3842431us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b540022abd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:42.321776 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5319482624}
I20260709 12:20:42.339089 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.339285 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.322821 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1884) took 1086 ms. Trace:
I20260709 12:20:42.339723 25127 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:20:42.323292 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.301966 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:42.332216 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.339740 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:42.340590 25825 connection.cc:256] RPC call timeout handler was delayed by -2.3135449590001826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
I20260709 12:20:42.327181 25120 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:42.340891 25119 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
I20260709 12:20:42.339905 25122 rpcz_store.cc:276] 0709 12:20:41.236505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.237236 (+   731us) service_pool.cc:224] Handling call
0709 12:20:42.322673 (+1085437us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400452c54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:42.322766 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265398016}
I20260709 12:20:42.317638 25124 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:42.345431 25124 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:42.347460 25123 raft_consensus.cc:2368] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11.
I20260709 12:20:42.347754 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.347759 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.368175 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:42.369195 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.369798 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:42.351150 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1897) took 1044 ms. Trace:
I20260709 12:20:42.352236 25127 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:42.370850 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2411) took 1063 ms. Trace:
I20260709 12:20:42.371289 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2399) took 1084 ms. Trace:
I20260709 12:20:42.371721 25127 rpcz_store.cc:276] 0709 12:20:41.287373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.351616 (+1064243us) service_pool.cc:224] Handling call
0709 12:20:42.351992 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.371043 (+ 19051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.371232 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:42.315227 28651 raft_consensus.cc:740] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:42.353991 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.376559 25860 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:42.376829 25123 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:42.372933 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.378846 25127 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:42.380604 25127 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:42.381283 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1901) took 1053 ms. Trace:
I20260709 12:20:42.358441 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:42.358913 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:42.337483 28249 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:42.362737 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:42.364573 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:42.385102 25270 raft_consensus.cc:2393] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:42.364924 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.385538 25118 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:42.387786 25860 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:42.365994 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2285) took 1352 ms. Trace:
I20260709 12:20:42.348815 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.390089 25854 raft_consensus.cc:2393] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 8: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:42.370467 25119 rpcz_store.cc:276] 0709 12:20:41.307118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.341576 (+1034458us) service_pool.cc:224] Handling call
0709 12:20:42.343836 (+  2260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.350764 (+  6928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.350796 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:42.350844 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:42.350888 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.350982 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.351093 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3083,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7130}
I20260709 12:20:42.371215 25124 rpcz_store.cc:276] 0709 12:20:41.308008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.344797 (+1036789us) service_pool.cc:224] Handling call
0709 12:20:42.345183 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.367076 (+ 21893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.370794 (+  3718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:42.337790 28491 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:42.347100 28617 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.375303 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:42.395470 25272 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:20:42.382885 25123 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:20:42.362651 28577 consensus_queue.cc:1059] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:20:42.370136 25858 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 3.
I20260709 12:20:42.391295 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.400364 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.400763 25119 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:42.400997 25858 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:42.346450 28490 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:20:42.364300 28684 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:42.397773 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2413) took 1080 ms. Trace:
I20260709 12:20:42.401772 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.401772 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.410669 25123 rpcz_store.cc:276] 0709 12:20:41.317032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.377596 (+1060564us) service_pool.cc:224] Handling call
0709 12:20:42.377949 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.397419 (+ 19470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.397696 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:42.411320 25119 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:42.411698 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.403379 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:42.405408 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 83363.4us
I20260709 12:20:42.412292 25123 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:42.412911 25118 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:20:42.413501 25123 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:42.381672 25127 rpcz_store.cc:276] 0709 12:20:41.328006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.379655 (+1051649us) service_pool.cc:224] Handling call
0709 12:20:42.380224 (+   569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.381010 (+   786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.381218 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:42.417853 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:42.418185 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 982968us
I20260709 12:20:42.361734 28694 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:20:42.420229 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:42.424667 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.425494 25858 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:42.403883 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.419759 25127 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:42.427063 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.427393 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2420) took 1030 ms. Trace:
I20260709 12:20:42.427803 25123 rpcz_store.cc:276] 0709 12:20:41.396972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.412910 (+1015938us) service_pool.cc:224] Handling call
0709 12:20:42.413184 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.413857 (+   673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.427316 (+ 13459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:42.428391 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.428936 25858 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.420888 25119 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:20:42.395933 28491 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.367709 28597 consensus_queue.cc:1059] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:20:42.450629 25168 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:42.425509 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:42.452131 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:42.435683 25167 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:42.453318 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.453537 25168 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:42.445079 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.389503 25195 rpcz_store.cc:276] 0709 12:20:41.013640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.013780 (+   140us) service_pool.cc:224] Handling call
0709 12:20:41.039759 (+ 25979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.039993 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:41.059618 (+ 19625us) log.cc:844] Serialized 14 byte log entry
0709 12:20:41.077062 (+ 17444us) log.cc:844] Serialized 14 byte log entry
0709 12:20:42.323749 (+1246687us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b180006fdc0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287 00007f2103f29208
0709 12:20:42.362917 (+ 39168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:42.362972 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:42.363020 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.363608 (+   588us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.365922 (+  2314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1249281,"prepare.queue_time_us":74013,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":1300291,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":26018,"spinlock_wait_cycles":5011840,"thread_start_us":44038,"threads_started":2}
I20260709 12:20:42.459152 25242 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:42.422829 28723 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:20:42.460738 25012 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897be935c42e41b995f177155b042be0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:42.461689 25127 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:42.471163 28428 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:42.471449 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.471657 28428 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.443370 28299 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:42.472105 28428 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:42.472292 28722 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:20:42.472174 28299 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.473014 28299 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.474377 28714 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:42.474864 28714 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:42.475225 28721 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.324s	user 0.004s	sys 0.000s
I20260709 12:20:42.475731 28707 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:42.476253 28707 raft_consensus.cc:697] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:42.466892 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:42.396705 28249 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.489077 25123 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:20:42.423969 28376 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:42.424238 28706 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:42.399842 28617 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.447569 28720 raft_consensus.cc:3055] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:42.477180 28707 consensus_queue.cc:237] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:42.475240 28714 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:42.422509 28685 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:20:42.422631 28684 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.452979 28651 consensus_queue.cc:260] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:42.466531 28630 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:20:42.489454 25056 debug-util.cc:398] Leaking SignalData structure 0x7b0800254060 after lost signal to thread 25884
I20260709 12:20:42.494522 25127 raft_consensus.cc:1217] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Deduplicated request from leader. Original: 4.6->[6.7-6.7]   Dedup: 6.7->[]
W20260709 12:20:42.535161 25056 debug-util.cc:398] Leaking SignalData structure 0x7b080012a9a0 after lost signal to thread 25885
I20260709 12:20:42.535342 25127 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:20:42.535492 25056 debug-util.cc:398] Leaking SignalData structure 0x7b080039fa20 after lost signal to thread 28051
W20260709 12:20:42.535784 25056 debug-util.cc:398] Leaking SignalData structure 0x7b08004134e0 after lost signal to thread 28234
W20260709 12:20:42.495311 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 59706.4us
W20260709 12:20:42.536563 25056 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1520 after lost signal to thread 28511
W20260709 12:20:42.536900 25056 debug-util.cc:398] Leaking SignalData structure 0x7b080031fde0 after lost signal to thread 28529
W20260709 12:20:42.537266 25056 debug-util.cc:398] Leaking SignalData structure 0x7b080011b880 after lost signal to thread 28562
W20260709 12:20:42.537549 25056 debug-util.cc:398] Leaking SignalData structure 0x7b0800395240 after lost signal to thread 28570
I20260709 12:20:42.537410 25167 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:42.537796 25056 debug-util.cc:398] Leaking SignalData structure 0x7b080040b1e0 after lost signal to thread 28571
W20260709 12:20:42.538112 25056 debug-util.cc:398] Leaking SignalData structure 0x7b080011b7e0 after lost signal to thread 28579
I20260709 12:20:42.495716 25168 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:42.538534 25056 debug-util.cc:398] Leaking SignalData structure 0x7b0800373f40 after lost signal to thread 28590
I20260709 12:20:42.496582 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 895) took 4279 ms. Trace:
I20260709 12:20:42.495764 25858 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:42.505682 25123 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:42.507329 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 102637us
I20260709 12:20:42.519692 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2286) took 1505 ms. Trace:
I20260709 12:20:42.531529 25126 raft_consensus.cc:2410] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:20:42.532631 25854 raft_consensus.cc:2410] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:20:42.532123 25269 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:42.514760 25125 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:42.492974 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:42.542507 25201 rpcz_store.cc:276] 0709 12:20:41.013966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.014109 (+   143us) service_pool.cc:224] Handling call
0709 12:20:41.014438 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:41.014815 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:41.054694 (+ 39879us) log.cc:844] Serialized 14 byte log entry
0709 12:20:42.337531 (+1282837us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:42.351018 (+ 13487us) log.cc:844] Serialized 26 byte log entry
0709 12:20:42.415772 (+ 64754us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:42.415809 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.415871 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:42.519470 (+103599us) raft_consensus.cc:1685] finished
0709 12:20:42.519489 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.519627 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1235522,"prepare.queue_time_us":28867,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1260095,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":13863,"spinlock_wait_cycles":13811968,"thread_start_us":67885,"threads_started":2,"wal-append.queue_time_us":289057,"wal-append.run_cpu_time_us":2010,"wal-append.run_wall_time_us":1108861}
W20260709 12:20:42.546766 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 53873.2us
I20260709 12:20:42.530840 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.548034 25853 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:42.548242 25093 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:42.548985 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.549706 25853 raft_consensus.cc:2376] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8. Re-sending same reply.
I20260709 12:20:42.549779 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:42.547567 25242 leader_election.cc:400] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11.
I20260709 12:20:42.553414 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:42.549067 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.498566 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.564735 25851 raft_consensus.cc:2376] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7. Re-sending same reply.
I20260709 12:20:42.551239 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.565994 25853 raft_consensus.cc:2393] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:42.567049 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.568524 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.546875 25123 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:42.494099 25121 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:42.542192 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:42.554286 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 58654.4us
I20260709 12:20:42.571728 25858 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:42.571851 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:42.558368 25092 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:42.569828 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.573642 25092 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:42.559465 25822 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:42.539191 25852 rpcz_store.cc:276] 0709 12:20:38.202145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.203788 (+  1643us) service_pool.cc:224] Handling call
0709 12:20:38.221384 (+ 17596us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:38.239295 (+ 17911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.239327 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:38.239945 (+   618us) log.cc:844] Serialized 52 byte log entry
0709 12:20:42.023223 (+3783278us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b18004438c0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae0d1 00007f2103ec9a0f
0709 12:20:42.121876 (+ 98653us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:42.121912 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.122126 (+   214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:42.474606 (+352480us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:42.481652 (+  7046us) raft_consensus.cc:1685] finished
0709 12:20:42.481673 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.481813 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19870,"raft.queue_time_us":20082,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":5024,"spinlock_wait_cycles":83284480,"thread_start_us":98424,"threads_started":1,"wal-append.queue_time_us":3897244}
I20260709 12:20:42.575280 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.583673 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.581367 25825 leader_election.cc:400] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8.
I20260709 12:20:42.523118 28651 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:42.494799 28376 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.506315 28634 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:42.526103 28494 raft_consensus.cc:3055] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:20:42.599771 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 46459.2us
I20260709 12:20:42.499452 28049 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:20:42.614235 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.607627 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.615106 25851 raft_consensus.cc:2410] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:20:42.615928 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.501596 28654 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 12:20:42.616498 25851 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:42.617328 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.576162 28625 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.599364 25127 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:42.618192 28625 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:42.611157 28458 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:42.620448 28625 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:42.611433 28682 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:42.561187 28514 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:42.502483 28720 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:42.604961 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.622327 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.617878 25851 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:42.612519 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.561182 28263 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:42.517664 28671 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:42.555727 28513 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:42.561617 28540 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:42.531075 28595 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:20:42.608945 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:42.623137 25853 raft_consensus.cc:2393] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:42.613075 25167 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:42.599900 25825 leader_election.cc:403] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:42.626766 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.621934 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.583083 28630 raft_consensus.cc:697] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:42.629856 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:42.507776 28698 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 12:20:42.561059 28597 consensus_queue.cc:1059] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:20:42.560866 28681 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:42.513763 28428 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:42.599653 25822 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:42.513906 28531 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.598505 28549 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:42.611536 28634 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.600325 28685 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:42.561266 28391 consensus_queue.cc:1059] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:20:42.611384 28705 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:42.611093 28376 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:42.670918 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.670833 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:42.687011 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 121797us
I20260709 12:20:42.622452 28049 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:42.688330 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 79530.8us
I20260709 12:20:42.524214 28380 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.713593 25168 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:42.670833 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:42.601698 28689 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:42.635227 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:42.581707 28534 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:20:42.692950 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:42.718468 25200 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 3.
W20260709 12:20:42.692588 25273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 992) took 4494 ms (client timeout 2205 ms). Trace:
W20260709 12:20:42.719314 25273 rpcz_store.cc:269] 0709 12:20:38.199851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.199986 (+   135us) service_pool.cc:224] Handling call
0709 12:20:42.692399 (+4492413us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b5400419454. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:42.692510 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4694912}
I20260709 12:20:42.692528 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:42.694046 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 94432.6us
I20260709 12:20:42.704181 28490 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:42.601080 28561 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:42.695457 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:42.698241 28428 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:42.698954 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:42.764132 25198 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:42.701675 25194 raft_consensus.cc:1217] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-6.7]   Dedup: 6.7->[]
W20260709 12:20:42.602993 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 53274.6us
I20260709 12:20:42.765082 25194 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:42.765654 25093 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:42.704668 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 91691.1us
I20260709 12:20:42.767370 25167 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:42.768385 28550 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:42.772850 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.773521 25860 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 3.
I20260709 12:20:42.773763 25198 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:42.777518 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.611856 28494 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:42.627085 28684 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:42.616508 28617 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:42.711779 25858 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:42.712303 25851 raft_consensus.cc:2376] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9. Re-sending same reply.
I20260709 12:20:42.712405 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:42.693198 28458 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:20:42.714588 25196 raft_consensus.cc:2368] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8.
W20260709 12:20:42.784780 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 72438.9us
I20260709 12:20:42.785406 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:42.785703 25825 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:42.786056 25196 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:42.692605 28514 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:42.716054 25168 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:42.800557 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 84568.8us
I20260709 12:20:42.801506 25168 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:42.802301 25168 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:42.716502 25201 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:42.717257 25202 raft_consensus.cc:2368] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5.
I20260709 12:20:42.702275 28549 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.690047 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:42.808422 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.723521 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:42.714866 28049 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:42.727556 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:42.729159 28249 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:42.709932 28612 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:20:42.731810 28714 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.732268 28689 raft_consensus.cc:697] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:42.731686 28376 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:42.830271 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:42.830698 28714 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:42.813165 28353 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:42.831533 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:42.831924 28353 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.832229 25194 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:42.813299 28617 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:42.833005 28617 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:42.833194 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:42.833426 28617 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:42.631332 28263 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.725785 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2410) took 1435 ms. Trace:
I20260709 12:20:42.818984 28653 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:20:42.706743 28634 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:42.834643 28653 consensus_queue.cc:1243] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:42.835346 28263 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:42.836724 28689 consensus_queue.cc:237] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:42.841482 28376 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:42.735956 28630 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:42.842792 28736 log.cc:927] Time spent T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.125s	user 0.003s	sys 0.000s
I20260709 12:20:42.710052 28686 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:42.844807 28686 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:42.845244 28686 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:42.846387 28494 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.847638 28494 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:42.737282 28380 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:42.738267 28490 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.738633 28509 consensus_queue.cc:1059] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:42.743074 28491 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.743932 25852 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:42.721725 28685 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:42.744474 28299 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:42.710848 28540 raft_consensus.cc:697] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:42.754407 28605 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:42.714330 28705 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:42.761617 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:42.777518 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:42.779318 25167 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:42.955034 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 193489us
W20260709 12:20:42.955205 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 175968us
I20260709 12:20:42.956501 25167 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:42.786913 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:42.786895 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 188569us
I20260709 12:20:42.804667 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:42.805212 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 241338us
I20260709 12:20:42.790587 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2313) took 2078 ms. Trace:
I20260709 12:20:42.959156 25271 rpcz_store.cc:276] 0709 12:20:40.712295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.715536 (+  3241us) service_pool.cc:224] Handling call
0709 12:20:42.692663 (+1977127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.692865 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.692925 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:42.692973 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:42.693022 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.693078 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.790341 (+ 97263us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b5400419450. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:42.790503 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4546186112}
I20260709 12:20:42.808521 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:42.961501 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 153049us
I20260709 12:20:42.962517 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:42.811895 25200 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:20:42.819595 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.964300 25851 raft_consensus.cc:2393] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:42.810635 28618 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:42.821058 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.968640 25860 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:42.821650 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.823964 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2285) took 1020 ms. Trace:
I20260709 12:20:42.969681 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:42.824925 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2418) took 1437 ms. Trace:
I20260709 12:20:42.970708 25825 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:42.970888 25119 rpcz_store.cc:276] 0709 12:20:41.387151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.411943 (+1024792us) service_pool.cc:224] Handling call
0709 12:20:42.420654 (+  8711us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:42.430224 (+  9570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.824685 (+394461us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b5400351950. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:42.824867 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19287424}
I20260709 12:20:42.834470 25120 rpcz_store.cc:276] 0709 12:20:41.290796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.352404 (+1061608us) service_pool.cc:224] Handling call
0709 12:20:42.352831 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:42.364835 (+ 12004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.364864 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:42.365472 (+   608us) log.cc:844] Serialized 52 byte log entry
0709 12:20:42.500919 (+135447us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:42.500983 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.501077 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:42.725566 (+224489us) raft_consensus.cc:1685] finished
0709 12:20:42.725587 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.725729 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11480,"raft.queue_time_us":11583,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":17493,"thread_start_us":99165,"threads_started":1,"wal-append.queue_time_us":226047}
I20260709 12:20:42.810702 28550 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:42.832378 28353 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.810768 28456 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:42.888788 28490 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:43.001247 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:42.892858 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1898) took 1576 ms. Trace:
I20260709 12:20:42.810649 28549 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:42.903518 28728 log.cc:927] Time spent T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.430s	user 0.002s	sys 0.000s
W20260709 12:20:42.915966 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.889117 28653 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:43.003947 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 45052.6us
I20260709 12:20:42.979337 28685 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:42.946650 25199 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:42.972582 25855 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.996503 28586 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:42.967540 25269 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:20:42.978647 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:42.987046 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:42.990012 25127 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:20:42.976387 25167 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:42.992781 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:42.994050 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:42.969887 25193 rpcz_store.cc:276] 0709 12:20:41.803697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.804587 (+   890us) service_pool.cc:224] Handling call
0709 12:20:41.804934 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:42.407316 (+602382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.407366 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:42.416389 (+  9023us) log.cc:844] Serialized 52 byte log entry
0709 12:20:42.691631 (+275242us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:42.691668 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.691733 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:42.823738 (+132005us) raft_consensus.cc:1685] finished
0709 12:20:42.823758 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.823906 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":627586,"raft.queue_time_us":597477,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":18945,"thread_start_us":218047,"threads_started":1,"wal-append.queue_time_us":351236}
I20260709 12:20:43.000548 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:43.007320 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:43.009929 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:43.010442 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:43.009624 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:43.011096 25272 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:42.978746 28513 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:43.003242 25122 rpcz_store.cc:276] 0709 12:20:41.316987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.360119 (+1043132us) service_pool.cc:224] Handling call
0709 12:20:42.375638 (+ 15519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:42.386671 (+ 11033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.386719 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:42.394750 (+  8031us) log.cc:844] Serialized 26 byte log entry
0709 12:20:42.610501 (+215751us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:42.612142 (+  1641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.612217 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:42.842262 (+230045us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:42.889446 (+ 47184us) raft_consensus.cc:1685] finished
0709 12:20:42.889492 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.892786 (+  3294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6277,"raft.queue_time_us":7366,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":10382,"spinlock_wait_cycles":5784448,"thread_start_us":193392,"threads_started":1,"wal-append.queue_time_us":313070}
I20260709 12:20:42.997216 28514 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:43.001853 28393 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:42.991539 25092 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:43.002067 28582 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:43.001328 28456 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:43.008081 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:43.012171 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:42.968036 28705 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:43.008960 25125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2407) took 1719 ms (client timeout 1938 ms). Trace:
I20260709 12:20:43.101668 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:43.020642 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:42.996622 28391 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:43.108734 25268 raft_consensus.cc:2393] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:43.109162 25198 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:43.114851 25120 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:43.115607 25119 raft_consensus.cc:2376] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11. Re-sending same reply.
I20260709 12:20:43.109712 25274 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:43.116070 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:43.125336 25193 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:43.128357 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:43.127790 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:43.118980 25125 rpcz_store.cc:269] 0709 12:20:41.289897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.877539 (+587642us) service_pool.cc:224] Handling call
0709 12:20:43.008781 (+1131242us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b5400323cd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:43.008901 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1462865664}
I20260709 12:20:43.120978 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:43.127897 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:43.113348 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 137048us
I20260709 12:20:43.131368 25242 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:43.132856 25167 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:43.132877 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:43.119410 25275 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:43.134323 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:43.135560 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:43.136621 28299 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:43.142729 25274 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:43.144264 25855 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:43.144582 25274 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:43.004686 28618 raft_consensus.cc:697] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:43.008729 28550 raft_consensus.cc:697] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:43.148814 25267 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:43.154830 25274 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:20:43.103097 28514 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:43.157516 28514 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.157820 25268 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:43.105952 28582 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.004343 28450 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 12:20:43.168610 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:43.108364 28456 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:43.163050 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:43.160962 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:43.106495 28586 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:43.135645 28689 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:43.012750 28577 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 12:20:43.004072 28249 consensus_queue.cc:1059] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
I20260709 12:20:43.176517 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:43.102843 28509 consensus_queue.cc:1059] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:20:43.146008 28714 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:43.099632 28653 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:43.124161 28391 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:43.105085 28605 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:20:43.015487 28743 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
I20260709 12:20:43.151350 28299 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:20:43.189617 28745 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:20:43.168699 28645 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:43.193336 28617 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.194765 28743 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:43.195173 28743 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:43.195708 28550 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.195984 28743 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:43.197088 28743 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:43.198864 28509 consensus_queue.cc:1243] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:43.199409 28509 consensus_queue.cc:1059] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:43.183115 28597 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:20:43.200038 28440 consensus_queue.cc:1059] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:43.201045 28618 consensus_queue.cc:237] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:43.151306 28587 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:43.202229 28587 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.202605 28587 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:43.146273 28513 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:20:43.178655 28734 log.cc:927] Time spent T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.453s	user 0.007s	sys 0.001s
I20260709 12:20:43.122010 28049 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.171657 28582 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:43.173177 28586 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:43.189693 28299 raft_consensus.cc:697] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:43.207202 28714 raft_consensus.cc:697] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:43.195619 28458 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8.
I20260709 12:20:43.212297 28531 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:43.183447 28689 raft_consensus.cc:697] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:43.170265 28517 consensus_queue.cc:1059] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:20:43.187445 28391 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:43.166379 28634 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.151891 28540 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.234056 28393 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:43.238202 28491 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:43.239598 28494 raft_consensus.cc:3055] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:43.456666 28744 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:43.457008 28494 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:43.457254 28744 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:20:43.416275 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 247598us
I20260709 12:20:43.458853 28494 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.460732 28494 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:43.418001 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 241375us
I20260709 12:20:43.433658 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:43.321965 28705 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:43.439467 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:43.432039 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:43.339819 28586 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.235141 28686 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.480247 28705 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:43.480675 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:43.444347 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.250531 28617 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:43.417629 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:43.255456 28634 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:43.351435 28587 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:43.351266 28582 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.457808 28744 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:43.404117 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:43.420475 28299 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.477972 25195 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:20:43.413232 25197 raft_consensus.cc:2368] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8.
W20260709 12:20:43.404831 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 271824us
I20260709 12:20:43.481083 25202 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:43.441664 25270 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:43.432000 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:43.435214 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:43.446962 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 919) took 1221 ms. Trace:
I20260709 12:20:43.427065 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1214) took 1303 ms. Trace:
I20260709 12:20:43.425395 28049 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:43.432729 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 929) took 1036 ms. Trace:
W20260709 12:20:43.429473 25126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2412) took 2117 ms (client timeout 2158 ms). Trace:
I20260709 12:20:43.330880 28549 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.513952 25825 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:43.515188 28765 log.cc:927] Time spent T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:20:43.517078 28353 consensus_meta.cc:287] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.011s
I20260709 12:20:43.267607 28653 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:43.545419 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:43.545212 28353 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.520358 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:43.522172 28514 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.522745 28263 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:43.523494 28582 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:43.262458 28689 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.529294 28586 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:43.266624 28714 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.531920 25857 raft_consensus.cc:1240] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:43.532392 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:43.533169 25199 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
W20260709 12:20:43.520081 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.531347 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2421) took 2131 ms. Trace:
I20260709 12:20:43.571779 25194 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:20:43.572952 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.578277 28263 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:43.579221 28671 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.579988 28671 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:43.581568 28263 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:43.583738 28681 raft_consensus.cc:697] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:43.539093 25856 rpcz_store.cc:276] 0709 12:20:42.225259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.226337 (+  1078us) service_pool.cc:224] Handling call
0709 12:20:42.226663 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.253874 (+ 27211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.253933 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:42.253990 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:42.254090 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.446402 (+1192312us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54004e2854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:43.446489 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.446768 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61955456}
I20260709 12:20:43.588384 25201 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:20:43.598577 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:43.598933 25201 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:43.599347 25856 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:43.600673 25201 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:43.586169 25271 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:43.586553 28701 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:43.603041 28701 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:43.603502 28701 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:43.606631 28681 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.585834 28671 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:43.583043 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:43.588557 25242 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.938s (SENT) [suppressed 27 similar messages]
I20260709 12:20:43.584779 25272 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 12:20:43.541337 25126 rpcz_store.cc:269] 0709 12:20:41.311416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.135824 (+824408us) service_pool.cc:224] Handling call
0709 12:20:43.428643 (+1292819us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54002ace54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:43.429072 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":905558784}
I20260709 12:20:43.582825 28676 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:43.584702 25196 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:20:43.591106 25275 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:43.541206 25852 rpcz_store.cc:276] 0709 12:20:42.395664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.626522 (+230858us) service_pool.cc:224] Handling call
0709 12:20:43.432276 (+805754us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b5400373054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:43.432487 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133458688}
I20260709 12:20:43.614923 25856 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:43.622404 25201 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:43.628567 25860 raft_consensus.cc:3055] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:43.629097 25860 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:43.630342 25860 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.631796 25860 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:43.634186 28767 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 12:20:43.636413 28735 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.919s	user 0.001s	sys 0.004s
I20260709 12:20:43.636510 28514 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:43.454833 28393 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:43.639114 25198 consensus_meta.cc:287] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.010s
W20260709 12:20:43.639564 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 236105us
I20260709 12:20:43.539397 25859 rpcz_store.cc:276] 0709 12:20:42.123595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.123720 (+   125us) service_pool.cc:224] Handling call
0709 12:20:42.124017 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:42.249014 (+124997us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:42.366574 (+117560us) log.cc:844] Serialized 14 byte log entry
0709 12:20:42.598336 (+231762us) log.cc:844] Serialized 14 byte log entry
0709 12:20:42.607287 (+  8951us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:42.611266 (+  3979us) log.cc:844] Serialized 26 byte log entry
0709 12:20:42.611450 (+   184us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:42.611485 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.611551 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:42.926088 (+314537us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b18004480c0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e21522 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:20:43.161685 (+235597us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b240031c9b8. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100ca79c4 00007f2100ca5acb 00007f2100e60dc9 00007f2100e60a55 00007f2100e6009d 00007f2103a9210e 00007f2103aa988c 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221
0709 12:20:43.426326 (+264641us) raft_consensus.cc:1685] finished
0709 12:20:43.426383 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.426735 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133299,"prepare.queue_time_us":246672,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":3095,"raft.queue_time_us":158777,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":14973,"spinlock_wait_cycles":34698752,"thread_start_us":246064,"threads_started":2,"wal-append.queue_time_us":293500}
I20260709 12:20:43.591850 28587 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:43.639617 25198 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
W20260709 12:20:43.652351 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 886586us
I20260709 12:20:43.654879 25093 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:43.560667 25118 rpcz_store.cc:276] 0709 12:20:41.400527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.413572 (+1013045us) service_pool.cc:224] Handling call
0709 12:20:42.413816 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.413998 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:42.560814 (+146816us) log.cc:844] Serialized 14 byte log entry
0709 12:20:42.623840 (+ 63026us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.530264 (+906424us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b1800381700. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287 00007f2103f29208
0709 12:20:43.530579 (+   315us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.530694 (+   115us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:43.530829 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.530970 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.531121 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9402,"prepare.queue_time_us":58707,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":928537,"raft.run_wall_time_us":3214,"spinlock_wait_cycles":97972864,"thread_start_us":152322,"threads_started":2,"wal-append.queue_time_us":172435}
I20260709 12:20:43.644728 28705 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:43.659729 25272 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:20:43.647078 28049 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:43.674381 28049 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:43.677095 25200 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:43.677350 28049 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:43.680246 25859 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:43.664036 28490 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.008s
I20260709 12:20:43.682418 28490 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.683162 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2417) took 2297 ms. Trace:
I20260709 12:20:43.684592 28490 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:43.683574 25124 rpcz_store.cc:276] 0709 12:20:41.385269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.390969 (+1005700us) service_pool.cc:224] Handling call
0709 12:20:42.414944 (+ 23975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.415144 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:42.415396 (+   252us) log.cc:844] Serialized 14 byte log entry
0709 12:20:42.698451 (+283055us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b18003e15e0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2103ab64bc 00007f2100e0448b 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae23a
0709 12:20:43.635444 (+936993us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:43.649000 (+ 13556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.664373 (+ 15373us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:43.682688 (+ 18315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.682785 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.682985 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":854099,"prepare.queue_time_us":1212,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":885831,"spinlock_wait_cycles":103231488,"thread_start_us":88606,"threads_started":2,"wal-append.queue_time_us":289682}
I20260709 12:20:43.685297 28686 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:43.686115 28705 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:43.686568 25851 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
W20260709 12:20:43.687330 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 657645us
I20260709 12:20:43.687245 28705 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.690162 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:43.691126 25273 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 8: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:43.691835 28391 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.672560 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 932) took 1189 ms. Trace:
I20260709 12:20:43.689136 25092 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:43.673030 25195 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:43.699549 25859 raft_consensus.cc:1240] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:43.697585 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 109060us
I20260709 12:20:43.700194 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 704) took 1050 ms. Trace:
I20260709 12:20:43.704561 28772 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:43.704874 25276 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:43.705222 28353 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:43.706082 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:43.707633 25201 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:43.708002 25200 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:43.708736 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:43.709951 25271 raft_consensus.cc:2410] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:20:43.711711 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 62979.8us
W20260709 12:20:43.713300 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.714325 28586 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:43.714727 28586 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:43.715133 28586 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.716277 25273 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:43.703357 25195 rpcz_store.cc:276] 0709 12:20:42.645984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.568614 (+922630us) service_pool.cc:224] Handling call
0709 12:20:43.672621 (+104007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.696188 (+ 23567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.696388 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:43.695291 25855 rpcz_store.cc:276] 0709 12:20:42.467661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.193186 (+725525us) service_pool.cc:224] Handling call
0709 12:20:43.193524 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:43.434667 (+241143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:43.434741 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:43.435999 (+  1258us) log.cc:844] Serialized 26 byte log entry
0709 12:20:43.505273 (+ 69274us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:43.505327 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.510757 (+  5430us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:43.641622 (+130865us) raft_consensus.cc:1685] finished
0709 12:20:43.641648 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.656825 (+ 15177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40827,"spinlock_wait_cycles":4501248,"thread_start_us":308834,"threads_started":2,"wal-append.queue_time_us":67737}
I20260709 12:20:43.731331 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:43.703822 28391 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:43.734536 25272 raft_consensus.cc:2368] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9.
I20260709 12:20:43.737015 28766 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:20:43.737035 28582 consensus_queue.cc:1059] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:43.743615 28772 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:43.748696 28772 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:43.749222 28772 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.767324 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 931) took 1316 ms. Trace:
I20260709 12:20:43.767604 28549 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:43.767802 25854 rpcz_store.cc:276] 0709 12:20:42.451049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.187753 (+736704us) service_pool.cc:224] Handling call
0709 12:20:43.187974 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.188127 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:43.213688 (+ 25561us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.710771 (+497083us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.743985 (+ 33214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.747104 (+  3119us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:43.752017 (+  4913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.754916 (+  2899us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.767147 (+ 12231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80292,"prepare.queue_time_us":83530,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":69625,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6994,"spinlock_wait_cycles":22775296,"thread_start_us":337632,"threads_started":1,"wal-append.queue_time_us":375070}
I20260709 12:20:43.768924 28772 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.774004 25860 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:20:43.776429 28617 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 12:20:43.776674 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 263035us
I20260709 12:20:43.777846 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:43.779628 25853 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
W20260709 12:20:43.779546 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:43.796849 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 142118us
W20260709 12:20:43.798573 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 138291us
I20260709 12:20:43.803771 28586 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.804005 28694 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:43.805344 28694 raft_consensus.cc:3055] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:43.805752 28694 raft_consensus.cc:740] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:43.806931 28694 consensus_queue.cc:260] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:43.809098 25195 raft_consensus.cc:3055] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:43.809490 25195 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:43.810555 25195 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:43.811283 25093 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:43.811673 25195 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:43.812690 25093 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:43.773558 28353 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:43.778703 28744 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.826308 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:43.826725 28754 raft_consensus.cc:3055] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:43.829447 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:43.845144 25854 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:43.778927 28701 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.842617 28754 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:43.819377 28694 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:43.855481 28689 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.856300 28754 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.856353 28689 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.858094 28714 consensus_queue.cc:1059] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.101s
W20260709 12:20:43.859030 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 85439.1us
I20260709 12:20:43.859200 28714 raft_consensus.cc:3055] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:43.859573 28714 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:43.859812 25241 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:43.860499 28689 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:43.860811 28049 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:43.861542 28049 raft_consensus.cc:697] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:43.862874 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 173967us
I20260709 12:20:43.862718 28049 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.863720 25092 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:43.865638 28676 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:43.866259 28676 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.866792 28676 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:43.867197 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 89526.5us
I20260709 12:20:43.868171 25825 leader_election.cc:400] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8.
I20260709 12:20:43.868741 28772 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:43.869553 25825 leader_election.cc:400] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5.
I20260709 12:20:43.866418 25201 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:43.872323 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:43.872499 28698 consensus_queue.cc:1059] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:43.873704 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:43.873842 28698 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:43.874264 28698 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:43.875417 28698 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.876149 25167 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:43.876770 28774 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:20:43.877009 28698 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:43.853981 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:43.851783 28681 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:43.880061 28509 raft_consensus.cc:3055] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:43.880463 28509 raft_consensus.cc:740] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:20:43.880728 28456 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.696s	user 0.005s	sys 0.011s
I20260709 12:20:43.881239 28456 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:43.882148 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 69530.1us
W20260709 12:20:43.883016 28764 log.cc:927] Time spent T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.352s	user 0.000s	sys 0.002s
I20260709 12:20:43.883081 25093 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:43.885267 25093 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:43.869580 28771 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:43.854564 28353 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.886683 28771 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.887058 28771 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:43.888378 28353 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:43.844663 28391 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:43.895377 28701 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:43.897152 25242 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:43.899398 28698 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:43.899451 28744 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:43.869706 28682 consensus_queue.cc:1059] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:20:43.900259 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 698) took 1266 ms. Trace:
I20260709 12:20:43.900578 28549 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:43.901235 28549 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:43.902040 25194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 702) took 1256 ms. Trace:
I20260709 12:20:43.902379 28770 consensus_queue.cc:1059] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:43.900794 25197 rpcz_store.cc:276] 0709 12:20:42.633514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.633652 (+   138us) service_pool.cc:224] Handling call
0709 12:20:43.900024 (+1266372us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54000a5354. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:43.900175 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1500731776}
I20260709 12:20:43.904074 28671 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:43.902777 28769 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:43.905038 28769 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:43.905982 28769 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.908015 28720 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.909204 25195 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:43.909528 28641 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:43.878755 25241 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:43.904381 28561 raft_consensus.cc:3055] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:43.865600 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:43.869913 25825 leader_election.cc:403] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:43.910394 25193 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:43.877900 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:43.912375 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 102416us
W20260709 12:20:43.935808 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:43.936568 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.931484 25201 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:43.919063 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:43.938776 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 60102.7us
I20260709 12:20:43.939394 25093 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:43.902561 25194 rpcz_store.cc:276] 0709 12:20:42.645389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.832942 (+187553us) service_pool.cc:224] Handling call
0709 12:20:43.901724 (+1068782us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54004132d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:43.901939 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1639101696}
I20260709 12:20:43.909808 28720 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:43.857870 28754 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:43.910477 28682 raft_consensus.cc:3055] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:43.944751 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:43.911793 28586 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:43.916299 28701 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:43.962373 25199 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:20:43.941596 28561 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:43.941725 28641 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:43.971374 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 708) took 1324 ms. Trace:
I20260709 12:20:43.881676 28509 consensus_queue.cc:260] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.860783 28714 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:43.958729 28682 raft_consensus.cc:740] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:43.985263 25199 rpcz_store.cc:276] 0709 12:20:42.647163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.897368 (+1250205us) service_pool.cc:224] Handling call
0709 12:20:43.897973 (+   605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:43.971079 (+ 73106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.971314 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:43.990367 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:43.972860 28698 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:43.970184 28772 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:43.998356 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2299) took 1278 ms. Trace:
I20260709 12:20:43.902383 28549 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:43.947180 28771 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:43.990437 28353 consensus_queue.cc:1175] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" responder_term: 9 status { last_received { term: 9 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:44.043710 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 957) took 1536 ms. Trace:
W20260709 12:20:44.011162 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 141797us
I20260709 12:20:44.015110 28682 consensus_queue.cc:260] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:44.034582 25276 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:20:44.011361 28719 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 4. Current term is 5.
I20260709 12:20:44.043007 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:43.988044 28456 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:44.016165 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.011809 28517 raft_consensus.cc:3055] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:44.047853 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2290) took 1359 ms. Trace:
W20260709 12:20:44.040664 28781 log.cc:927] Time spent T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.304s	user 0.003s	sys 0.000s
I20260709 12:20:44.065086 25193 rpcz_store.cc:276] 0709 12:20:42.689151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.571871 (+882720us) service_pool.cc:224] Handling call
0709 12:20:43.910138 (+338267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.940367 (+ 30229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.047589 (+107222us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54004132d0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:44.047774 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776833408}
W20260709 12:20:44.028069 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 162574us
I20260709 12:20:44.067123 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:44.068259 28772 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:44.068709 28772 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.069070 28772 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:44.051301 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:43.981868 28770 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:44.001322 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 104356us
W20260709 12:20:44.054003 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 124325us
I20260709 12:20:44.054178 25201 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:44.054749 25853 rpcz_store.cc:276] 0709 12:20:42.507087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.689736 (+182649us) service_pool.cc:224] Handling call
0709 12:20:44.043444 (+1353708us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b540068f6d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:44.043635 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410411392}
I20260709 12:20:44.058125 25273 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:44.059579 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 49445us
I20260709 12:20:43.982733 28701 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:44.028259 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 150489us
I20260709 12:20:44.050619 25198 rpcz_store.cc:276] 0709 12:20:42.716430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.674340 (+957910us) service_pool.cc:224] Handling call
0709 12:20:43.674683 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.675031 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:43.783364 (+108333us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.994215 (+210851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.994349 (+   134us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:43.994490 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.994641 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.994961 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":725,"prepare.queue_time_us":139539,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":8887,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2477,"thread_start_us":277261,"threads_started":2,"wal-append.queue_time_us":229159}
I20260709 12:20:44.070494 25272 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:44.056131 28698 raft_consensus.cc:697] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:44.071372 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:44.074409 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.092567 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.076742 25167 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:44.083424 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:44.064957 28517 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:44.085142 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:44.106240 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.104602 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 934) took 1136 ms. Trace:
W20260709 12:20:44.108152 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.106982 25858 rpcz_store.cc:276] 0709 12:20:42.962600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.203782 (+241182us) service_pool.cc:224] Handling call
0709 12:20:43.204184 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:43.566769 (+362585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:43.569583 (+  2814us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:43.694169 (+124586us) log.cc:844] Serialized 52 byte log entry
0709 12:20:43.735364 (+ 41195us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:43.801700 (+ 66336us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.823959 (+ 22259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.848760 (+ 24801us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:44.039730 (+190970us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:44.099034 (+ 59304us) raft_consensus.cc:1685] finished
0709 12:20:44.099159 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:44.099323 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16254,"prepare.queue_time_us":82478,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":80266,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":14673,"spinlock_wait_cycles":4653312,"thread_start_us":350144,"threads_started":3,"wal-append.queue_time_us":41820}
I20260709 12:20:44.110807 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:44.111281 28744 consensus_queue.cc:1059] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:44.111580 25268 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:44.112563 28263 raft_consensus.cc:3055] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:44.113090 28263 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:44.113227 28698 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.115144 28710 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:44.090140 28772 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.115875 28710 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:44.117564 28772 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:44.119824 25165 leader_election.cc:400] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9.
I20260709 12:20:44.120186 25165 leader_election.cc:403] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:20:44.120764 28686 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:44.122540 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.123800 28509 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:42.823989 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:44.130198 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.131528 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:44.132469 28689 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:44.131871 25024 catalog_manager.cc:5697] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 6 to 7, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 7 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:44.133029 25168 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:44.133869 28689 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:44.134248 28612 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:44.105540 28456 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:44.136693 28458 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.137260 28458 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.112627 28682 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:44.138198 28686 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9.
I20260709 12:20:44.139537 28458 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:44.140383 25859 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:44.143479 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 940) took 1137 ms. Trace:
I20260709 12:20:44.143929 25852 rpcz_store.cc:276] 0709 12:20:43.006473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.620483 (+614010us) service_pool.cc:224] Handling call
0709 12:20:43.621018 (+   535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:43.661459 (+ 40441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:43.661506 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:43.701350 (+ 39844us) log.cc:844] Serialized 26 byte log entry
0709 12:20:43.947701 (+246351us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:43.947766 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.947857 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:44.143266 (+195409us) raft_consensus.cc:1685] finished
0709 12:20:44.143287 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:44.143422 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60984,"raft.queue_time_us":39183,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":34629,"thread_start_us":204129,"threads_started":1,"wal-append.queue_time_us":261297}
I20260709 12:20:44.146953 28263 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.148403 28263 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:44.150579 25090 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:44.151666 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:44.152100 28728 log.cc:927] Time spent T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:20:44.152181 28772 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:44.152765 28772 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:44.153244 28772 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:44.158402 25825 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:44.159936 25825 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:44.160598 28509 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:44.161302 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:44.161767 28561 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:44.163293 28561 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:44.163569 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:44.164736 28440 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:44.165122 28440 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:44.165547 28440 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:44.165597 28509 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:44.133682 25024 catalog_manager.cc:5697] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 3, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:44.167789 28772 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.069981 25092 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:44.169176 28671 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:44.169384 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 99518.4us
I20260709 12:20:44.171288 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:44.076207 28701 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:44.070698 28770 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:44.165140 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:44.174939 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.072659 28694 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:44.179714 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.187619 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.184149 28694 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.195951 28694 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:44.190375 28686 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.196947 28686 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.199707 28686 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:44.200521 25270 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:44.176350 28540 consensus_queue.cc:1059] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:20:44.201858 28540 raft_consensus.cc:3055] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:44.202250 28540 raft_consensus.cc:740] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:44.203408 28458 consensus_queue.cc:1059] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:44.182739 28770 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.208693 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:44.211742 25024 catalog_manager.cc:5697] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.105031 28641 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 12:20:44.129765 28676 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.217396 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:44.216742 25273 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
W20260709 12:20:44.217618 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 141003us
I20260709 12:20:44.216706 25168 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:44.223182 25090 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:44.211978 28701 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.203296 28540 consensus_queue.cc:260] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.209859 28694 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.219549 28509 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:44.251327 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.259845 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 94778.1us
I20260709 12:20:44.262271 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:44.266260 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60588.4us
I20260709 12:20:44.245505 28772 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:44.249675 28705 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:44.278836 28769 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:44.301102 25859 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:44.287926 28769 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:44.308040 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:44.291011 28540 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.294152 28049 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:44.270167 28440 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.313153 25268 raft_consensus.cc:2368] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8.
I20260709 12:20:44.281430 28694 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:44.305305 28772 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.244902 28517 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:44.315907 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 126109us
W20260709 12:20:44.301369 28775 consensus_queue.cc:1175] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 9 index: 6 } }
W20260709 12:20:44.325700 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.283514 28701 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.313510 28049 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.348274 28049 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:44.343370 28509 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:44.346287 25852 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:44.308202 28587 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.307782 28353 consensus_queue.cc:1059] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:20:44.360349 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:44.360987 25273 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
W20260709 12:20:44.362241 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 135909us
W20260709 12:20:44.364548 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 56796.2us
I20260709 12:20:44.365008 25092 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:44.367827 28792 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:20:44.370896 28676 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:44.359654 28772 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.373606 25825 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:44.374797 25270 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:44.373687 28772 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:44.379087 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.357095 28669 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:44.344350 28376 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.149s
W20260709 12:20:44.395498 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 172395us
W20260709 12:20:44.410881 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.402853 28772 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:44.417519 28801 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:44.418742 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.422832 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 939) took 1420 ms. Trace:
I20260709 12:20:44.423568 25126 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:44.423784 28440 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:44.427774 28744 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:44.430907 28694 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:44.383927 28587 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.433116 28587 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:44.433405 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 73347.2us
I20260709 12:20:44.433804 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:44.434756 28376 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:44.435266 25276 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:44.435388 28376 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.418757 25118 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:44.437635 28376 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:44.383925 28769 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.438738 25124 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:44.423259 25857 rpcz_store.cc:276] 0709 12:20:43.002805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.577764 (+574959us) service_pool.cc:224] Handling call
0709 12:20:43.578346 (+   582us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:43.649558 (+ 71212us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:43.668490 (+ 18932us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.891423 (+222933us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b18002aaba0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae23a 00007f2103f18a2a
0709 12:20:43.894131 (+  2708us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b4800060258. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2108e37aa1 00007f2108e2eb37 00007f2108e2e9ca 00007f2108f2626f 00007f2108f25f37 00007f2108f3a55c 00007f2108f3a508 00007f2108f3a488 00007f2108f3a443 00007f2108f396ec 00007f2107e63a96
0709 12:20:44.064225 (+170094us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:44.093738 (+ 29513us) log.cc:844] Serialized 26 byte log entry
0709 12:20:44.093898 (+   160us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:44.093928 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.094004 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:44.394319 (+300315us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b240031c928. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100ca79c4 00007f2100ca5acb 00007f2100e60dc9 00007f2100e60a55 00007f2100e5ffb0 00007f2103ad6488 00007f2103ad6be8 00007f2103aae398 00007f2103aa976a 00007f2103aa8bb6
0709 12:20:44.422625 (+ 28306us) raft_consensus.cc:1685] finished
0709 12:20:44.422646 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:44.422770 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40337,"prepare.queue_time_us":17679,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":81582,"raft.run_cpu_time_us":2375,"raft.run_wall_time_us":241568,"spinlock_wait_cycles":152117888,"thread_start_us":158770,"threads_started":1,"wal-append.queue_time_us":411976}
I20260709 12:20:44.441177 25272 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:20:44.443315 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:44.455251 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:44.458695 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:44.457432 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:44.465909 25118 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:44.465711 28049 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:44.466948 28701 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:44.468017 28049 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:44.469664 25274 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:20:44.442011 28801 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:44.474433 25274 pending_rounds.cc:85] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 9
I20260709 12:20:44.474918 25274 pending_rounds.cc:107] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:20:44.475206 25274 raft_consensus.cc:2889] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:44.471637 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:44.476006 28801 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:44.465471 28800 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.476511 25276 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:44.476388 28770 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.476866 28800 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:44.472275 25855 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:44.480073 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:44.480427 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:44.481158 28710 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:44.481334 25201 raft_consensus.cc:2410] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:20:44.482116 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.474424 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:44.465749 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 110815us
I20260709 12:20:44.488807 25241 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:44.492663 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:44.500957 25118 pending_rounds.cc:85] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 6
I20260709 12:20:44.501565 25118 pending_rounds.cc:107] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:20:44.501922 25118 raft_consensus.cc:2889] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:44.503052 25200 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:44.500944 28802 consensus_queue.cc:1059] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:20:44.505672 28802 raft_consensus.cc:3055] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:44.506119 28802 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:44.507005 28802 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:44.508420 28802 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:44.508965 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:44.511010 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.487322 28800 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:44.514467 25121 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:44.514681 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:44.515503 25119 raft_consensus.cc:2393] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:44.516893 25120 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:44.518322 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:44.518970 25127 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:44.522984 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 943) took 1510 ms. Trace:
I20260709 12:20:44.531755 25276 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:44.532770 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 44082.7us
I20260709 12:20:44.538280 25165 leader_election.cc:400] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8.
I20260709 12:20:44.541286 25165 leader_election.cc:403] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:20:44.521716 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:44.536921 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:44.542222 25122 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:44.544786 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:44.546574 25200 raft_consensus.cc:2368] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8.
W20260709 12:20:44.556607 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.534466 28393 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:44.558771 25274 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:44.549772 25090 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:20:44.557034 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.531589 28769 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.537287 28587 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:44.559859 25822 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:44.542919 28681 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:44.566699 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:44.544847 28049 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.587574 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:44.595996 25121 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 4: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:44.558561 28458 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:44.592247 28807 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:44.592370 28769 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.593191 28353 raft_consensus.cc:3055] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:44.593343 28805 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8.
I20260709 12:20:44.594300 28719 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:44.599153 25860 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:44.626974 25274 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:44.601540 28458 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.602054 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:44.581182 28587 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:44.602627 28440 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:44.608067 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:44.597518 28681 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.612527 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:44.612641 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 239109us
I20260709 12:20:44.613662 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:44.618687 25127 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
W20260709 12:20:44.621237 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.553380 28801 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:20:44.624353 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:44.624868 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.587877 28800 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:44.630628 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:44.598769 28770 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:44.643471 25124 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:44.646522 25121 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:44.646549 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 79013.1us
I20260709 12:20:44.625387 28353 raft_consensus.cc:740] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:20:44.657603 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.628356 28049 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:44.644857 28440 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:44.658831 25855 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:20:44.659848 25860 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:44.629732 28587 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:44.651518 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:44.618808 28754 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:20:44.628340 28719 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:44.644640 28800 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.670627 25127 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:44.664876 25858 raft_consensus.cc:2376] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6. Re-sending same reply.
I20260709 12:20:44.669809 25121 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:20:44.664187 28586 raft_consensus.cc:3055] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:44.669780 28719 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:44.694439 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:44.698177 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.698606 25124 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:44.698714 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:44.700168 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:44.700953 25200 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:44.701766 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:44.704700 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:44.704957 25198 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:44.674659 28800 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:44.705355 25200 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:44.702391 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:44.708153 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:44.708788 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.709004 25121 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:44.711452 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:44.711764 25201 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:44.715080 25860 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:44.716984 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:44.718056 25127 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:44.689440 28586 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:44.723124 25199 raft_consensus.cc:2393] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:44.726836 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:44.728081 28714 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:44.727826 28440 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.730510 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:44.731132 25860 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:44.731384 25123 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:44.731747 25267 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:44.731969 25269 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:44.732928 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:44.733620 25198 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:44.523522 25856 rpcz_store.cc:276] 0709 12:20:43.012563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.657798 (+645235us) service_pool.cc:224] Handling call
0709 12:20:43.728239 (+ 70441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.748933 (+ 20694us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:43.981788 (+232855us) log.cc:844] Serialized 14 byte log entry
0709 12:20:44.287322 (+305534us) log.cc:844] Serialized 14 byte log entry
0709 12:20:44.521754 (+234432us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b18003f79c0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287 00007f2103f29208
0709 12:20:44.521974 (+   220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:44.522581 (+   607us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:44.522664 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.522765 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:44.522910 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":283664,"prepare.queue_time_us":83208,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"raft.queue_time_us":278770,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6772,"spinlock_wait_cycles":3110272,"thread_start_us":447748,"threads_started":2,"wal-append.queue_time_us":260189}
I20260709 12:20:44.744464 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:44.745085 25856 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:44.723421 25126 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:44.745966 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:44.758671 25856 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:20:44.722096 28806 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:20:44.763833 25860 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:44.698660 28456 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:20:44.762279 28759 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:20:44.769389 28049 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:44.770529 28809 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 12:20:44.784754 28813 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:20:44.786103 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:44.786900 25851 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:44.787995 25851 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:44.709323 28805 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:20:44.717808 28641 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:20:44.715308 28807 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:20:44.799655 25118 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 12:20:44.800261 28804 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:44.800691 28804 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:44.804797 25852 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:44.775401 25825 leader_election.cc:400] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8.
I20260709 12:20:44.810325 25825 leader_election.cc:403] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:20:44.816363 25168 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:44.819033 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:44.824012 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.801566 28804 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:44.840627 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:44.841459 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:44.847679 25118 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:44.851293 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:44.753485 28353 consensus_queue.cc:260] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.833905 28805 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:44.869165 25126 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:44.871295 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:44.832477 28759 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8.
I20260709 12:20:44.872130 25123 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:44.878410 28376 consensus_queue.cc:1059] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:44.879501 28771 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:44.881058 28458 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:44.873724 28801 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:20:44.883455 28769 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:44.862388 28710 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:44.826448 28705 consensus_queue.cc:1059] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:20:44.885011 28353 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.885187 28586 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.882436 25120 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:44.886273 28586 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:44.887965 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.888950 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 113720us
W20260709 12:20:44.887959 28814 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:20:44.889842 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:44.892669 28458 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:44.892937 28517 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:44.893473 28681 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:44.892880 25024 catalog_manager.cc:5697] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 6, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 6 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.895207 25024 catalog_manager.cc:5697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 7, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 7 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.896844 25024 catalog_manager.cc:5697] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 1 to 5, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 5 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.902207 25268 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:44.909399 25126 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
W20260709 12:20:44.915522 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 46318.9us
I20260709 12:20:44.916368 28719 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.919267 25093 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:44.919881 25118 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
W20260709 12:20:44.929091 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 52042.8us
I20260709 12:20:44.930282 25167 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:44.931989 25123 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:44.933825 25093 leader_election.cc:400] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8.
I20260709 12:20:44.934298 25093 leader_election.cc:403] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:20:44.936031 25093 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:44.829447 28587 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:44.939416 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.941658 28705 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:44.944844 25858 raft_consensus.cc:2410] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:44.946213 28710 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:44.947072 28701 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:44.871495 28805 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:44.947546 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 55631.7us
I20260709 12:20:44.948246 28458 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:44.950841 25024 catalog_manager.cc:5697] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 5, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 5 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:44.951452 25167 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:44.951607 28719 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:44.951776 28641 raft_consensus.cc:3055] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:44.971189 28641 raft_consensus.cc:740] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:44.971395 25090 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:44.971838 28771 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.972337 25090 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:44.972132 28641 consensus_queue.cc:260] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.972532 28771 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:44.973352 28641 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:44.945964 28769 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8.
W20260709 12:20:44.953377 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.974498 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.974578 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:44.975580 25276 raft_consensus.cc:2393] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:44.976971 25268 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:20:44.978729 28393 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:44.979226 28393 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:44.979707 28370 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:44.981931 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:44.963095 28807 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:44.962764 25093 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:44.965932 28682 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:44.966712 28805 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:44.965721 28800 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:44.939518 28694 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:44.937903 28804 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:44.981787 28370 raft_consensus.cc:3055] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:44.971446 25024 catalog_manager.cc:5697] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 5 to 6, VOTER 897be935c42e41b995f177155b042be0 (127.23.81.193) evicted. New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:20:44.997094 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.998092 25860 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:44.964561 28701 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.005980 28701 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:45.006389 25855 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:45.007975 28456 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:45.008786 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:45.002542 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:45.000514 28370 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:45.003989 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 52631.3us
I20260709 12:20:45.004722 28710 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:44.993014 28686 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:44.990540 28775 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:45.008723 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:44.994105 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:45.004572 25024 catalog_manager.cc:5697] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 5 to 8, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 8 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:45.013777 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:45.020516 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:44.992631 28769 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:45.026129 25272 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:45.028067 25271 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:45.030334 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:45.030889 25123 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:45.004596 28705 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:45.036782 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:45.013370 28686 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:45.036957 28370 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.019919 28802 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:20:45.045238 25118 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:45.046891 25024 catalog_manager.cc:5697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 2 to 3, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:45.017347 28775 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:45.031559 28799 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:45.052769 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:45.025626 28771 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:45.025841 28769 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:45.010555 28689 consensus_queue.cc:1059] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:20:45.053584 25199 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:20:45.053862 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 275320us
I20260709 12:20:45.017028 28682 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:20:45.105213 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:45.104843 25024 catalog_manager.cc:5697] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 5, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 5 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:45.108280 25024 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:45.110786 28826 log.cc:927] Time spent T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:45.112360 28800 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:45.116602 25012 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897be935c42e41b995f177155b042be0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:45.118305 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:45.118130 28705 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:45.119431 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:45.119729 25022 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41756 (request call id 374) took 22102 ms (client timeout 15000 ms). Trace:
I20260709 12:20:45.120102 28807 consensus_queue.cc:1059] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:45.121071 28370 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:45.122653 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:45.123991 28822 raft_consensus.cc:3055] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:45.124507 28822 raft_consensus.cc:740] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:45.125890 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:45.053409 28775 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:45.129173 25125 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:20:45.131912 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.134701 28686 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.120095 25121 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
W20260709 12:20:45.138340 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 258683us
I20260709 12:20:45.139073 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:45.145617 25123 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:45.147459 25024 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 3 to 5, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 5 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:45.136179 28686 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:45.104931 28769 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:45.149895 28376 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:20:45.120095 25022 rpcz_store.cc:269] 0709 12:20:23.017783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.019771 (+  1988us) service_pool.cc:224] Handling call
0709 12:20:45.119464 (+22099693us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:34.400222 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:34.410917 (+ 10695us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:34.410972 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:20:34.410993 (+    21us) tablet.cc:662] Decoding operations
0709 12:20:34.426159 (+ 15166us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:34.433560 (+  7401us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:34.433605 (+    45us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:20:34.437395 (+  3790us) tablet.cc:701] Row locks acquired
0709 12:20:34.437458 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:20:34.437674 (+   216us) write_op.cc:270] Start()
0709 12:20:34.437817 (+   143us) write_op.cc:276] Timestamp: P: 1783599634437601 usec, L: 0
0709 12:20:34.437837 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:20:34.450738 (+ 12901us) log.cc:844] Serialized 3233 byte log entry
0709 12:20:35.150530 (+699792us) op_driver.cc:464] REPLICATION: finished
0709 12:20:35.248552 (+ 98022us) write_op.cc:301] APPLY: starting
0709 12:20:35.248672 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:35.248907 (+   235us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:35.249051 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:35.292179 (+ 43128us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:35.292506 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:20:35.292552 (+    46us) write_op.cc:312] APPLY: finished
0709 12:20:35.292889 (+   337us) log.cc:844] Serialized 65 byte log entry
0709 12:20:35.293086 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:35.293201 (+   115us) write_op.cc:454] Released schema lock
0709 12:20:35.293262 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:35.293669 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:35.293694 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1767097,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":97704,"apply.run_cpu_time_us":3666,"apply.run_wall_time_us":45095,"num_ops":8,"prepare.queue_time_us":105548,"prepare.run_cpu_time_us":22839,"prepare.run_wall_time_us":119019,"raft.queue_time_us":334483,"raft.run_cpu_time_us":23943,"raft.run_wall_time_us":163048,"replication_time_us":657863,"thread_start_us":505280,"threads_started":4,"wal-append.queue_time_us":91692,"wal-append.run_cpu_time_us":42006,"wal-append.run_wall_time_us":1774406}]]}
W20260709 12:20:45.171977 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 146470us
W20260709 12:20:45.172995 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 187100us
I20260709 12:20:45.143054 28393 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.227185 28393 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:45.228530 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:45.254153 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 60574.7us
I20260709 12:20:45.255527 25167 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:45.256659 25167 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:45.258472 28803 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:45.258960 28803 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:45.259873 28803 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.236754 28827 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:45.273072 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:45.276006 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.301981 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:45.302824 25858 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:45.232162 28376 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:45.282989 28818 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:20:45.191172 28830 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 12:20:45.204929 28705 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 12:20:45.239300 28587 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:45.261000 28803 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:45.343291 28807 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:45.220768 28701 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:45.351153 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 94561.5us
W20260709 12:20:45.353024 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:45.356451 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.352100 25167 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:45.275012 28805 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:45.349154 28689 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:20:45.365784 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 252592us
I20260709 12:20:45.354225 28807 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.346623 28370 consensus_queue.cc:1059] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 12:20:45.368040 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 201636us
I20260709 12:20:45.269960 28827 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:45.373071 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:45.376439 25276 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:45.377722 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:45.265471 28822 consensus_queue.cc:260] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.379386 25272 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
W20260709 12:20:45.384357 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.370501 28807 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:45.387259 28689 raft_consensus.cc:697] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:45.363940 28775 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.399442 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:45.422494 28775 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:45.424542 28456 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:45.415858 28834 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:45.389655 28848 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:45.425875 28834 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.437525 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:45.442747 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:45.445325 25120 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:20:45.450670 25200 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:45.428666 28822 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:45.454171 25123 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:20:45.458755 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:45.459299 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:45.458841 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:45.462771 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:45.463745 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:45.463878 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:45.464697 25126 raft_consensus.cc:2368] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6.
I20260709 12:20:45.459792 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:45.449162 28825 log.cc:927] Time spent T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.511s	user 0.004s	sys 0.000s
I20260709 12:20:45.466377 25122 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:45.460194 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:45.467947 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:45.470774 25126 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:45.468909 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:45.471437 25193 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:45.472298 28841 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:20:45.474013 28833 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:20:45.439325 28834 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:45.478720 25124 raft_consensus.cc:1217] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Deduplicated request from leader. Original: 5.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 12:20:45.469043 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:45.479223 25124 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:20:45.477406 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:45.480667 25123 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 4: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:45.481510 25202 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:45.478485 28844 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:20:45.479516 25197 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:20:45.404006 28376 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:45.452796 28848 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:45.487057 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:45.493919 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 125663us
W20260709 12:20:45.493885 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 124993us
I20260709 12:20:45.499332 25122 raft_consensus.cc:2410] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:20:45.498934 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:45.501468 25167 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:45.504796 25272 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
W20260709 12:20:45.507836 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 61296.2us
I20260709 12:20:45.498883 28848 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:45.511184 28832 log.cc:927] Time spent T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:20:45.486934 28689 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:45.512543 28641 consensus_meta.cc:287] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.008s
I20260709 12:20:45.512794 28848 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:45.509487 25090 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:45.528007 25272 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:20:45.507545 28847 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.529285 25272 pending_rounds.cc:85] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 6
I20260709 12:20:45.530341 25272 pending_rounds.cc:107] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 10.7
W20260709 12:20:45.530563 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.530644 25272 raft_consensus.cc:2889] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:45.538600 25167 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:45.521452 28705 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:45.544263 25193 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:45.545997 25168 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:45.550513 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:45.551360 25271 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:45.554013 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:45.535599 28775 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:45.565595 25858 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:45.570248 25242 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:45.571535 25242 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:45.572340 28802 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:45.572728 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:45.572834 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.573350 28612 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:45.573964 28612 raft_consensus.cc:697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:45.582440 28850 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:20:45.582275 28612 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:45.583909 28855 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:20:45.586131 28801 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:45.572923 28802 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:45.580717 25276 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:45.577528 28370 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:45.563813 28686 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:20:45.588012 28641 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:45.610244 28705 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:45.616701 28843 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:45.617221 28843 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.617573 28843 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:45.618127 28851 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.618696 28744 raft_consensus.cc:3055] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:45.577216 28698 consensus_queue.cc:1059] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:20:45.622232 28744 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:45.627562 28744 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:45.631698 28831 log.cc:927] Time spent T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:20:45.620853 28370 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:45.613018 28701 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:45.523237 28842 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:20:45.666766 28801 raft_consensus.cc:697] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:45.669716 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 123832us
I20260709 12:20:45.676471 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:45.676851 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:45.676188 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 96438.4us
I20260709 12:20:45.677390 28370 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:45.678606 28759 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.679133 28759 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.681172 28759 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:45.622543 28802 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.681479 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:45.615734 28682 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:20:45.634299 28827 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:45.539137 28847 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:45.687422 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.688793 25196 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:45.694186 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:45.616801 28705 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.663552 28719 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:45.676697 28862 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:20:45.697523 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 118619us
I20260709 12:20:45.689023 28509 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.684324 28775 raft_consensus.cc:697] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:45.700250 25090 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:45.701064 28759 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:45.691280 28698 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:20:45.702203 28754 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.699743 28827 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.735742 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:45.707764 28701 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:45.749358 28865 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:45.750299 25122 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 12:20:45.752164 25125 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:45.738286 28586 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.758277 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:45.735741 28641 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:20:45.618721 28851 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.764986 28851 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:45.731442 28509 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:45.765981 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:45.771824 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.731317 28719 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.789697 25124 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:20:45.745128 28393 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:45.753902 28701 raft_consensus.cc:697] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:45.801676 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:45.740691 28759 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.744660 28754 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.755852 28842 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:20:45.789196 28587 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:45.748653 28827 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.805621 28803 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.809088 28862 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.776883 28586 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.809374 28851 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.817402 28844 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.858078 28509 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:45.858495 28867 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.800865 28393 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:45.913122 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:45.922147 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:45.924542 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.926700 25271 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
W20260709 12:20:45.929234 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 171073us
W20260709 12:20:45.861817 28804 consensus_meta.cc:287] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.851s	user 0.008s	sys 0.006s
I20260709 12:20:45.917438 25123 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:45.775525 28801 consensus_queue.cc:237] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:45.936506 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:45.937291 25123 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:45.938561 28509 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:45.913058 28799 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.808s	user 0.010s	sys 0.003s
I20260709 12:20:45.806237 28775 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.845481 28587 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:45.918740 28698 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:45.853391 28803 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:45.940367 28870 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.855803 28862 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.870455 28807 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.869565 28851 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:45.962345 28800 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.961767 28799 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:45.992071 28705 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:45.994421 28869 log.cc:927] Time spent T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:20:45.994966 28586 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:45.995677 28586 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:45.996616 28719 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:45.996368 28586 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.998668 28759 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:45.964495 28865 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:20:45.946522 28509 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.995994 28827 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:45.928925 28844 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:45.967038 28867 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:46.000003 28769 consensus_meta.cc:287] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.797s	user 0.009s	sys 0.001s
I20260709 12:20:46.008002 25196 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:20:46.042500 25123 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:45.986310 28829 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:46.046389 28829 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:46.047310 28829 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:46.048326 28829 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:46.049516 28851 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:46.050148 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:46.050513 25851 raft_consensus.cc:1240] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:46.050894 25859 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:46.052207 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:46.052330 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:46.040381 28769 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:46.052891 25858 raft_consensus.cc:2368] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8.
I20260709 12:20:45.940675 28701 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:46.053891 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:46.055119 28866 log.cc:927] Time spent T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:20:46.056543 28805 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:46.064688 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:46.065929 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:46.066288 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:46.044858 28509 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:46.045543 28867 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:45.990288 28800 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:45.981096 28870 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:46.399353 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.053910 25118 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:46.405980 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:46.406507 25124 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:46.407099 25271 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 8: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:46.347396 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:46.071344 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 219607us
W20260709 12:20:46.117509 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:46.408073 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:46.408350 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:46.385154 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:46.129099 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.263192 25127 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
W20260709 12:20:46.443615 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:46.444149 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.446336 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:46.447772 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:46.448412 25200 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:46.449255 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:46.458907 25200 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:46.074008 28799 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:46.460126 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:46.460314 25270 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:20:46.460515 25168 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:46.463912 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:46.464162 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:46.471244 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:46.407120 28370 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:46.465363 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:46.466086 28883 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:46.467016 28587 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:46.468118 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:46.468568 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.469269 25201 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:46.071990 28864 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.433s
I20260709 12:20:46.499244 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:46.471926 25860 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:46.936249 28843 consensus_meta.cc:287] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 1.314s	user 0.008s	sys 0.004s
W20260709 12:20:46.951885 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 452682us
I20260709 12:20:46.952150 28843 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:46.952857 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:46.381884 28834 consensus_meta.cc:287] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.878s	user 0.005s	sys 0.007s
I20260709 12:20:46.360647 28882 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:46.954082 28834 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:46.954602 28882 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:46.956748 28834 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:46.957013 25267 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:46.957484 28882 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:46.667636 28854 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.958402 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:46.506443 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:46.958827 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:46.323055 28705 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:46.510838 28870 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:46.197918 28851 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.959721 28370 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:46.406308 28586 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:46.378129 28807 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:46.960803 28799 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:46.507469 25859 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:20:46.963151 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.025207 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.508098 25851 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:47.025751 25860 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:46.508378 28844 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:46.964753 28881 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.027621 28587 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:47.028437 28881 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:47.029093 28851 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:47.031118 28881 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:46.471954 25241 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:46.508520 28838 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 1.121s	user 0.008s	sys 0.003s
I20260709 12:20:47.032768 28800 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:46.196832 28822 consensus_meta.cc:287] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.735s	user 0.009s	sys 0.000s
I20260709 12:20:46.407017 28049 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:47.033944 28049 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:46.968226 25269 raft_consensus.cc:2368] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8.
W20260709 12:20:47.035321 28829 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.987s	user 0.011s	sys 0.000s
I20260709 12:20:47.036325 28049 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:47.018808 28705 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:47.036957 28049 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:47.037487 28049 raft_consensus.cc:697] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:47.031989 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 560066us
I20260709 12:20:47.018570 28854 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:46.972342 25271 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:47.040570 28854 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:47.019011 28882 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.041642 28882 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:47.042691 28049 consensus_queue.cc:237] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:46.974229 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:47.009399 28883 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:47.045056 25270 raft_consensus.cc:2410] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:20:47.013114 28865 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:47.046646 28865 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:46.830888 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.444563 28828 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.047129 28865 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:47.047492 28828 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:47.049446 28881 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.050305 28828 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:47.049995 28881 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:46.976169 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:47.000329 25855 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:47.051355 25854 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:46.341565 28871 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:47.044183 28882 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:46.746109 28874 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:20:46.471467 28754 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:47.027491 28799 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:46.550472 28804 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.410398 28801 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:46.669252 28852 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.671089 28802 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:47.052934 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.670956 28769 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:47.031936 28851 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:47.052071 28871 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:47.067004 28843 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:47.061504 28804 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:47.062685 28801 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:47.065779 28802 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:47.073169 28370 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:47.110895 28883 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:47.138878 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 99494.4us
I20260709 12:20:47.095626 28705 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:47.064697 28852 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:47.147931 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 122452us
I20260709 12:20:47.148774 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:47.144145 28877 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:20:47.154755 28899 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:20:47.155684 28852 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:47.157744 28802 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:47.159204 28802 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:47.159710 28802 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:47.160517 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2315) took 1476 ms. Trace:
W20260709 12:20:47.163435 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 702926us
I20260709 12:20:47.164383 28705 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:47.166992 28881 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:47.171450 28801 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:47.178170 28900 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:20:47.180099 28804 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:47.161139 25195 rpcz_store.cc:276] 0709 12:20:45.689686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.694596 (+  4910us) service_pool.cc:224] Handling call
0709 12:20:45.701826 (+  7230us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:45.764574 (+ 62748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.764605 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:45.765180 (+   575us) log.cc:844] Serialized 52 byte log entry
0709 12:20:45.814137 (+ 48957us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:45.814193 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.159903 (+1345710us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b540001fed4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:47.159975 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:47.160039 (+    64us) raft_consensus.cc:1685] finished
0709 12:20:47.160061 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:47.160393 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":992,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"spinlock_wait_cycles":143405440,"thread_start_us":48566,"threads_started":1,"wal-append.queue_time_us":168713,"wal-append.run_cpu_time_us":2077,"wal-append.run_wall_time_us":1057366}
W20260709 12:20:47.197764 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 49029.2us
I20260709 12:20:47.175518 28705 raft_consensus.cc:697] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:47.221593 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:47.203289 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 51939.6us
I20260709 12:20:47.261276 28744 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:47.264319 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:47.265195 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2460) took 1344 ms. Trace:
I20260709 12:20:47.265502 25126 rpcz_store.cc:276] 0709 12:20:45.921164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.262187 (+1341023us) service_pool.cc:224] Handling call
0709 12:20:47.265134 (+  2947us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:47.264221 28913 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:47.268865 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:47.270630 25855 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:47.270848 28827 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:47.271018 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:47.267285 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 64292us
I20260709 12:20:47.271838 25126 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:47.271111 28910 consensus_queue.cc:1059] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:47.271059 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:47.274581 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2456) took 1352 ms. Trace:
I20260709 12:20:47.275067 25126 rpcz_store.cc:276] 0709 12:20:45.920081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.266415 (+1346334us) service_pool.cc:224] Handling call
0709 12:20:47.272785 (+  6370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:47.276221 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:47.266048 28612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.680s	user 0.027s	sys 0.009s
I20260709 12:20:47.276821 25822 leader_election.cc:400] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8.
I20260709 12:20:47.279577 25822 leader_election.cc:403] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:47.275022 25851 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:47.276940 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2453) took 1357 ms. Trace:
W20260709 12:20:47.223142 28839 log.cc:927] Time spent T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 1.835s	user 0.004s	sys 0.010s
I20260709 12:20:47.271747 28828 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:47.282569 25126 rpcz_store.cc:276] 0709 12:20:45.919251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.275970 (+1356719us) service_pool.cc:224] Handling call
0709 12:20:47.276889 (+   919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:47.242652 28871 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:47.265882 28804 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:47.265976 28851 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.271835 28843 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:47.289803 28902 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:20:47.290288 28843 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:47.292460 28843 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:47.288570 28881 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:20:47.280984 28612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.694s	user 0.028s	sys 0.009s
I20260709 12:20:47.214560 28705 consensus_queue.cc:237] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:47.456236 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:47.467962 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.469473 25241 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:47.425194 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:47.470050 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.423028 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:47.471161 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1941) took 1469 ms. Trace:
I20260709 12:20:47.471176 25270 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:47.261341 28802 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:47.424444 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:47.424819 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:47.471740 25126 rpcz_store.cc:276] 0709 12:20:46.043384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.285828 (+1242444us) service_pool.cc:224] Handling call
0709 12:20:47.471103 (+185275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:47.475205 25241 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:47.284111 28828 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:47.479074 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.477569 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 204684us
I20260709 12:20:47.498137 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:47.505079 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:47.473217 28827 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.511031 25126 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:47.511814 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2462) took 1578 ms. Trace:
I20260709 12:20:47.516010 25126 rpcz_store.cc:276] 0709 12:20:45.933829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.497624 (+1563795us) service_pool.cc:224] Handling call
0709 12:20:47.511748 (+ 14124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:47.396337 28865 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:47.519549 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1041) took 2534 ms. Trace:
I20260709 12:20:47.305215 28804 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:47.499209 28828 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:47.520002 25268 rpcz_store.cc:276] 0709 12:20:44.980017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.990337 (+ 10320us) service_pool.cc:224] Handling call
0709 12:20:45.007574 (+ 17237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:45.013454 (+  5880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.013502 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:45.014104 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 12:20:45.301830 (+287726us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:45.301861 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.301918 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:47.222376 (+1920458us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:47.504405 (+282029us) raft_consensus.cc:1685] finished
0709 12:20:47.504428 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:47.514358 (+  9930us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5478,"raft.queue_time_us":6385,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":9859,"spinlock_wait_cycles":32395648,"thread_start_us":257432,"threads_started":1,"wal-append.queue_time_us":323956}
I20260709 12:20:47.303156 28851 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:47.548506 25126 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:47.549481 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2454) took 1630 ms. Trace:
I20260709 12:20:47.549961 25126 rpcz_store.cc:276] 0709 12:20:45.919493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.531797 (+1612304us) service_pool.cc:224] Handling call
0709 12:20:47.547733 (+ 15936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:47.549154 (+  1421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.549409 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:47.552762 25126 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:47.562392 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2455) took 1634 ms. Trace:
I20260709 12:20:47.530629 28827 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:47.615229 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.682765 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 184728us
I20260709 12:20:47.563621 25126 rpcz_store.cc:276] 0709 12:20:45.919781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.552114 (+1632333us) service_pool.cc:224] Handling call
0709 12:20:47.552412 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:47.553545 (+  1133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.554495 (+   950us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:47.554142 28913 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:47.766124 28921 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:47.541095 28920 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:20:47.768648 28916 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.265s	user 0.013s	sys 0.008s
I20260709 12:20:47.787869 25126 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:20:47.790100 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1940) took 1789 ms. Trace:
W20260709 12:20:47.783288 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1403586719998202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 12:20:47.768297 28928 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:47.792438 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1160586720000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
I20260709 12:20:47.791630 25126 rpcz_store.cc:276] 0709 12:20:46.000989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.785500 (+1784511us) service_pool.cc:224] Handling call
0709 12:20:47.785873 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:47.789730 (+  3857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.790007 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:47.784945 28918 log.cc:927] Time spent T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.249s	user 0.001s	sys 0.006s
W20260709 12:20:47.785897 28917 log.cc:927] Time spent T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.232s	user 0.009s	sys 0.005s
I20260709 12:20:47.780493 28902 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8.
I20260709 12:20:47.766214 28926 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:47.798667 28926 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:47.798185 25242 connection.cc:256] RPC call timeout handler was delayed by -1.0035586719998264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 12:20:47.799744 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.782622 28913 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:47.803704 25126 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 12:20:47.804901 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2466) took 1789 ms. Trace:
I20260709 12:20:47.805269 25126 rpcz_store.cc:276] 0709 12:20:46.015378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.795535 (+1780157us) service_pool.cc:224] Handling call
0709 12:20:47.795962 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:47.804597 (+  8635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.804836 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:47.786770 28920 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:47.810575 25202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.349s	user 0.005s	sys 0.008s
W20260709 12:20:47.811012 25202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.350s	user 0.005s	sys 0.008s
I20260709 12:20:47.785959 28921 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.815033 28920 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:47.848757 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.811260 28913 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:47.915273 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:48.007093 25241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.038s	sys 0.046s
W20260709 12:20:48.007553 25241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.038s	sys 0.046s
I20260709 12:20:47.799911 28928 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:48.157284 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.999866 28744 consensus_meta.cc:287] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.735s	user 0.016s	sys 0.000s
I20260709 12:20:48.179024 25271 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:48.003461 28804 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:47.893168 28921 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:48.007376 28865 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:48.124027 28923 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:48.307785 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.124058 28902 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:48.166761 28881 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:48.182138 28919 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.818915 28828 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:48.387871 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:48.353556 25202 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.002s	sys 0.019s
W20260709 12:20:48.435348 25202 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.003s	sys 0.019s
W20260709 12:20:48.354708 28705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.023s
W20260709 12:20:48.433508 28868 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.015s	sys 0.019s
W20260709 12:20:48.530215 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:48.526072 28927 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.526s	user 0.001s	sys 0.001s
W20260709 12:20:48.528149 28705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.000s	sys 0.024s
I20260709 12:20:48.480397 28926 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:48.532795 28868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.015s	sys 0.019s
I20260709 12:20:48.353581 28923 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.353729 28902 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.437561 28881 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.438261 28919 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:48.547422 25241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.016s
W20260709 12:20:48.547901 25241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.006s	sys 0.016s
W20260709 12:20:48.548214 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 532530us
W20260709 12:20:48.551323 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.549568 25822 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:48.553725 25851 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:20:48.560431 25239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.012s	sys 0.022s
W20260709 12:20:48.564128 25239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.012s	sys 0.022s
I20260709 12:20:48.565235 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:48.569052 25854 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:48.547237 28926 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.566118 25851 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:48.585366 25202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2333) took 2133 ms. Trace:
I20260709 12:20:48.575528 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:48.559046 28935 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:48.576582 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 990) took 1119 ms. Trace:
I20260709 12:20:48.587334 25855 rpcz_store.cc:276] 0709 12:20:47.457187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.457400 (+   213us) service_pool.cc:224] Handling call
0709 12:20:47.457919 (+   519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:47.459685 (+  1766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:47.459735 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:47.468995 (+  9260us) log.cc:844] Serialized 26 byte log entry
0709 12:20:47.551149 (+ 82154us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:47.551189 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.551254 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:48.576325 (+1025071us) raft_consensus.cc:1685] finished
0709 12:20:48.576352 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:48.576513 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":741,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5064,"thread_start_us":81443,"threads_started":1,"wal-append.queue_time_us":374020}
W20260709 12:20:48.584055 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 582728us
I20260709 12:20:48.592056 25856 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:48.598315 28937 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:48.598980 28937 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:48.600622 28881 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:48.601047 28937 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:48.601198 28881 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:48.601562 28881 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.601887 28881 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:48.612272 28881 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:48.613292 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 63824us
I20260709 12:20:48.620874 28935 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.625939 28935 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.621006 28928 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.627116 28828 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:48.627538 28923 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:48.629338 28913 consensus_meta.cc:287] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.635s	user 0.004s	sys 0.004s
I20260709 12:20:48.629824 28913 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.632164 28913 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.595922 28926 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.638577 28902 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:48.639603 28926 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.640393 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1053) took 1185 ms. Trace:
I20260709 12:20:48.641825 25271 rpcz_store.cc:276] 0709 12:20:47.455551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.455783 (+   232us) service_pool.cc:224] Handling call
0709 12:20:48.640206 (+1184423us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b5400123754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:48.640310 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630494592}
I20260709 12:20:48.650701 28921 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.653944 28921 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:48.645144 28920 consensus_meta.cc:287] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.798s	user 0.011s	sys 0.000s
I20260709 12:20:48.654889 28920 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:48.656278 25197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.583s	user 0.030s	sys 0.033s
W20260709 12:20:48.656724 25197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.584s	user 0.030s	sys 0.033s
I20260709 12:20:48.657034 28920 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.657393 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2319) took 2671 ms. Trace:
I20260709 12:20:48.657764 25197 rpcz_store.cc:276] 0709 12:20:45.986400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.986531 (+   131us) service_pool.cc:224] Handling call
0709 12:20:45.994452 (+  7921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:46.072429 (+ 77977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:46.072463 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:46.072911 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 12:20:48.657047 (+2584136us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:48.657077 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.657151 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:48.657190 (+    39us) raft_consensus.cc:1685] finished
0709 12:20:48.657200 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:48.657313 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160525,"raft.queue_time_us":78606,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8850,"thread_start_us":2583769,"threads_started":1,"wal-append.queue_time_us":1071027,"wal-append.run_cpu_time_us":1905,"wal-append.run_wall_time_us":1017093}
I20260709 12:20:48.660318 28714 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:48.665222 28881 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:48.663789 28714 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:48.671583 28714 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.673013 28714 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:48.707196 28862 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.685818 25194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2331) took 2238 ms. Trace:
I20260709 12:20:48.712740 25194 rpcz_store.cc:276] 0709 12:20:46.447066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.447218 (+   152us) service_pool.cc:224] Handling call
0709 12:20:48.685082 (+2237864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:48.685344 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:48.685386 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:48.685447 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:48.685501 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.685582 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:48.685740 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:48.724360 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1931) took 2964 ms. Trace:
I20260709 12:20:48.724957 25125 rpcz_store.cc:276] 0709 12:20:45.760366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.760559 (+   193us) service_pool.cc:224] Handling call
0709 12:20:45.788682 (+ 28123us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:46.014471 (+225789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:46.014514 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:46.436209 (+421695us) log.cc:844] Serialized 26 byte log entry
0709 12:20:48.722462 (+2286253us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:48.722508 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.722593 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:48.724080 (+  1487us) raft_consensus.cc:1685] finished
0709 12:20:48.724103 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:48.724256 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4778,"raft.queue_time_us":61478,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":208890,"threads_started":2,"wal-append.queue_time_us":2210729}
I20260709 12:20:48.808183 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:48.808887 25123 raft_consensus.cc:2376] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8. Re-sending same reply.
W20260709 12:20:48.809413 25123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2463) took 2859 ms (client timeout 1876 ms). Trace:
W20260709 12:20:48.809720 25123 rpcz_store.cc:269] 0709 12:20:45.950176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.474466 (+524290us) service_pool.cc:224] Handling call
0709 12:20:48.809327 (+2334861us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:48.815464 25168 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.642s (SENT) [suppressed 10 similar messages]
I20260709 12:20:48.824100 28851 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.825984 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2444) took 3873 ms. Trace:
I20260709 12:20:48.826447 25119 rpcz_store.cc:276] 0709 12:20:44.952787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.960839 (+  8052us) service_pool.cc:224] Handling call
0709 12:20:44.996920 (+ 36081us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:45.029515 (+ 32595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.029547 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:45.033715 (+  4168us) log.cc:844] Serialized 26 byte log entry
0709 12:20:45.233470 (+199755us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:45.238734 (+  5264us) log.cc:844] Serialized 14 byte log entry
0709 12:20:45.239002 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.239104 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:46.507901 (+1268797us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:48.825691 (+2317790us) raft_consensus.cc:1685] finished
0709 12:20:48.825795 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:48.825923 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11882,"prepare.queue_time_us":5555,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":17700,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":9663,"spinlock_wait_cycles":16396672,"thread_start_us":199326,"threads_started":1,"wal-append.queue_time_us":319355,"wal-append.run_cpu_time_us":28098,"wal-append.run_wall_time_us":2766517}
I20260709 12:20:48.860885 25122 raft_consensus.cc:2410] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 4 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:20:48.864065 25122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2452) took 2945 ms (client timeout 1938 ms). Trace:
W20260709 12:20:48.864564 25122 rpcz_store.cc:269] 0709 12:20:45.918932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.463907 (+544975us) service_pool.cc:224] Handling call
0709 12:20:48.863974 (+2400067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:48.866174 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2335) took 2417 ms. Trace:
I20260709 12:20:48.866544 25201 rpcz_store.cc:276] 0709 12:20:46.448715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.468803 (+ 20088us) service_pool.cc:224] Handling call
0709 12:20:46.469078 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:48.865875 (+2396797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.866115 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:48.866910 28906 raft_consensus.cc:3055] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:48.867341 28906 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:48.868330 28906 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.869589 28906 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:48.876950 28851 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.877516 28851 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.879629 28851 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.885393 28803 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:48.895923 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:48.898550 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.900352 28837 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:48.900851 28837 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:48.901810 28851 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.902343 28851 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.902833 28837 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:48.903402 28837 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:48.903849 28837 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.904629 28851 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.906844 28837 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.910571 28803 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.911132 28803 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:48.915688 28851 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:48.916239 28851 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:48.918814 28851 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:48.913765 28803 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:48.919659 28803 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:48.920238 28803 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.922951 28803 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.923502 28803 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:48.924296 28803 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.921129 28851 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.925977 28851 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.928653 28851 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.929137 28851 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.929728 28851 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.942638 28845 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.943262 28845 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:48.944198 28851 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.945663 28803 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.947839 28845 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:48.948540 25124 raft_consensus.cc:2393] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 9: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:20:48.949120 25124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2459) took 3028 ms (client timeout 1776 ms). Trace:
W20260709 12:20:48.949630 25124 rpcz_store.cc:269] 0709 12:20:45.920876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.454902 (+534026us) service_pool.cc:224] Handling call
0709 12:20:48.949019 (+2494117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:48.956653 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2317) took 3258 ms. Trace:
W20260709 12:20:48.960392 25167 connection.cc:256] RPC call timeout handler was delayed by -1.3647762300001887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 12:20:48.964016 25167 connection.cc:256] RPC call timeout handler was delayed by -1.1889877820001402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
I20260709 12:20:48.966133 25196 rpcz_store.cc:276] 0709 12:20:45.698787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.698930 (+   143us) service_pool.cc:224] Handling call
0709 12:20:45.707146 (+  8216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:46.041409 (+334263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.956372 (+2914963us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400220954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:48.956584 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677326720}
W20260709 12:20:48.977013 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:48.980623 25121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2457) took 3060 ms (client timeout 1907 ms). Trace:
W20260709 12:20:48.981073 25121 rpcz_store.cc:269] 0709 12:20:45.920347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.459835 (+539488us) service_pool.cc:224] Handling call
0709 12:20:48.980541 (+2520706us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:48.988461 25853 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:48.997635 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1889) took 2591 ms. Trace:
W20260709 12:20:49.001075 28907 log.cc:927] Time spent T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 1.860s	user 0.004s	sys 0.006s
I20260709 12:20:49.010398 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.011271 25853 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:49.012123 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:49.012737 25853 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 4: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:49.013396 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:49.014132 25276 rpcz_store.cc:276] 0709 12:20:46.405914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.447676 (+ 41762us) service_pool.cc:224] Handling call
0709 12:20:46.447965 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:47.145676 (+697711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:47.145708 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:47.145746 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:47.145785 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.997388 (+1851603us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b540034d5d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:48.997438 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:48.997579 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604097408}
I20260709 12:20:49.015964 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.017128 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:49.019716 28837 consensus_queue.cc:1059] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:49.019932 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:49.020745 25196 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:49.021639 28837 raft_consensus.cc:3055] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:49.030182 28837 raft_consensus.cc:740] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:49.031260 28837 consensus_queue.cc:260] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:49.032436 28837 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:49.021754 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:49.022564 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:49.034338 25194 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:49.023239 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:49.035363 25197 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:49.034673 25853 raft_consensus.cc:2410] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:20:49.048511 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:49.049192 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:49.049635 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:49.028218 25127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2450) took 3913 ms (client timeout 2064 ms). Trace:
I20260709 12:20:49.072482 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:49.073673 25859 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:49.074788 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.075685 25859 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:49.076560 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.090899 25858 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:49.091415 25856 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:49.093595 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.094305 25856 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:49.095041 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:49.095716 25856 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:49.091943 25855 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:49.096093 28945 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.097252 28945 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.097549 28682 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.097685 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:49.098341 25855 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:49.098197 28682 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:49.099308 28945 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:49.096545 28868 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.099592 28905 raft_consensus.cc:3055] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:20:49.052697 25127 rpcz_store.cc:269] 0709 12:20:45.115056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.117929 (+  2873us) service_pool.cc:224] Handling call
0709 12:20:49.028059 (+3910130us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b5400452c54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:49.028157 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045839232}
I20260709 12:20:48.585721 25202 rpcz_store.cc:276] 0709 12:20:46.448212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.448337 (+   125us) service_pool.cc:224] Handling call
0709 12:20:46.460080 (+ 11743us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:46.460440 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:46.460471 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:46.461068 (+   597us) log.cc:844] Serialized 52 byte log entry
0709 12:20:47.811430 (+1350362us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:48.435920 (+624490us) log.cc:844] Serialized 14 byte log entry
0709 12:20:48.580987 (+145067us) log.cc:844] Serialized 14 byte log entry
0709 12:20:48.581258 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.581346 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:48.581396 (+    50us) raft_consensus.cc:1685] finished
0709 12:20:48.581415 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:48.581559 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":759088,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":3684,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":4788,"spinlock_wait_cycles":22784,"thread_start_us":2109421,"threads_started":3,"wal-append.queue_time_us":544809,"wal-append.run_cpu_time_us":2463,"wal-append.run_wall_time_us":1009214}
I20260709 12:20:49.100042 28868 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.091761 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.101224 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 966) took 3047 ms. Trace:
I20260709 12:20:49.101862 28682 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:49.102011 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:49.110369 25856 raft_consensus.cc:2376] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8. Re-sending same reply.
I20260709 12:20:49.112994 28827 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:49.114744 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.106204 28905 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:49.120024 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:49.122452 28682 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.123334 28953 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.129702 28955 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.106590 25860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 963) took 3061 ms (client timeout 3135 ms). Trace:
I20260709 12:20:49.108423 28868 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:49.145522 25860 rpcz_store.cc:269] 0709 12:20:46.044970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.053631 (+  8661us) service_pool.cc:224] Handling call
0709 12:20:49.106410 (+3052779us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400376754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:49.106509 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":959835392}
I20260709 12:20:49.152141 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.153169 25860 raft_consensus.cc:2410] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:20:49.109004 25859 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:49.132939 25855 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:20:49.133211 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:49.133965 28393 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:49.135358 25822 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:49.142242 25857 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:49.143458 25275 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:20:49.132789 28945 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:49.156342 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.157039 25860 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:49.159173 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:49.159725 25855 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:49.109143 25858 rpcz_store.cc:276] 0709 12:20:46.055685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.071958 (+3016273us) service_pool.cc:224] Handling call
0709 12:20:49.090522 (+ 18564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.101002 (+ 10480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.101177 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:49.143978 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:49.165123 25856 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:49.162571 25822 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:49.174954 28945 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.221586 28945 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:49.213135 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:49.222653 25201 raft_consensus.cc:2410] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:20:49.211290 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:49.212713 25242 connection.cc:256] RPC call timeout handler was delayed by -1.2375041319999127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 12:20:49.223694 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.224531 25858 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:49.189095 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.227932 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.229137 25860 raft_consensus.cc:2410] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:20:49.231527 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.232371 25857 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:49.158866 28868 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:49.225841 25859 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:49.218382 28905 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.241143 28905 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:49.151154 28682 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:49.219091 28942 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:49.246541 28942 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:49.247035 28942 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:49.247649 28682 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:49.166316 28393 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:49.259778 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:49.261010 25860 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:20:49.262953 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.156186 28955 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.257216 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.226945 28827 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:49.265973 25093 connection.cc:256] RPC call timeout handler was delayed by -1.4484101589998772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2296s for a response
I20260709 12:20:49.166136 28877 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 12:20:49.258126 28393 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.165853 28953 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } attrs { replace: true } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.274356 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:49.270466 25093 connection.cc:256] RPC call timeout handler was delayed by -1.2202280059998429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
I20260709 12:20:49.275203 25858 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:49.258889 28868 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.272476 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.266700 28682 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:49.278705 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 54430.8us
I20260709 12:20:49.271564 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.280110 25857 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:20:49.268723 25859 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:49.237491 25855 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
W20260709 12:20:49.271622 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60428.4us
I20260709 12:20:49.166261 28941 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
W20260709 12:20:49.290817 25242 leader_election.cc:336] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.700s (SENT)
I20260709 12:20:49.291296 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:49.292598 25242 leader_election.cc:336] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.876s (SENT)
I20260709 12:20:49.292730 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.293170 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.293442 25860 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:49.293741 25858 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
W20260709 12:20:49.293825 25242 leader_election.cc:336] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.938s (SENT)
I20260709 12:20:49.294699 25855 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:20:49.295542 25856 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:49.295656 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.296314 25855 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:49.274348 28393 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:49.299671 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:49.273123 28827 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.303900 25859 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:49.301079 28587 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:49.324791 25242 leader_election.cc:336] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.158s (SENT)
I20260709 12:20:49.326627 25242 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:49.289928 28682 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:49.301158 28955 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:49.329450 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.330698 25859 raft_consensus.cc:2410] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:49.331756 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.333413 25859 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:20:49.339819 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.337543 28929 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:49.338124 28877 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:49.408015 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.372031 25167 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:49.438479 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:49.348528 25242 leader_election.cc:336] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.064s (SENT)
W20260709 12:20:49.382937 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 91175.8us
I20260709 12:20:49.442018 25271 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:49.442188 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 70225.3us
I20260709 12:20:49.443137 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:49.442299 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 93794.9us
I20260709 12:20:49.337733 28958 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:49.348613 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.368299 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:49.365309 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 64765.2us
I20260709 12:20:49.455153 25271 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:49.457091 25859 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:49.382714 28956 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.459260 28830 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:49.461063 28393 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.364883 28827 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:49.448719 28686 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:49.372987 28837 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:20:49.464542 25167 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:49.467052 25822 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:49.434350 28962 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.496061 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.481231 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.496634 25853 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:49.486771 25167 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:49.448530 28958 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:49.488153 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.494979 25825 leader_election.cc:400] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6.
I20260709 12:20:49.411337 28868 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:49.372786 28862 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 12:20:49.500186 25825 leader_election.cc:403] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:20:49.497701 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.438334 28942 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.480490 28830 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:49.503631 25851 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:49.483053 28961 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:49.507472 25167 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:49.483760 28686 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.485030 28964 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.517324 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.514449 25167 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:49.519330 25167 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:49.494477 28837 consensus_queue.cc:1243] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:49.503922 28966 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.525823 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.499230 28804 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:49.531560 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.510417 28456 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:49.534374 28456 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:49.534832 28456 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:49.502920 28958 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:49.482602 28956 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:49.512977 28830 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:49.521971 28686 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:49.527238 28803 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:49.526943 28851 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:49.532444 28804 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.523494 28951 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:49.515429 28868 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:20:49.503656 28962 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.544335 28967 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:20:49.570623 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 84125.5us
W20260709 12:20:49.572026 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 86335.6us
I20260709 12:20:49.572882 25093 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:49.554793 28851 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:49.566537 28804 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:49.568028 28951 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.523864 28961 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.577768 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:49.566213 28845 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:20:49.566641 28803 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:49.543023 28966 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.596870 28962 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:49.597157 28966 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:49.598448 28979 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:49.599062 28979 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:49.599483 28942 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:49.599885 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.600199 28393 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:49.531205 28964 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.581157 28951 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:49.601754 28868 raft_consensus.cc:3055] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:49.602162 28587 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:49.579357 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 84575.8us
I20260709 12:20:49.580734 28851 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:49.612557 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:49.613327 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.614046 25855 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:49.615175 25855 pending_rounds.cc:85] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 7
I20260709 12:20:49.615442 25855 pending_rounds.cc:107] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:20:49.615749 25855 raft_consensus.cc:2889] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:49.612021 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:49.616930 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 44135us
I20260709 12:20:49.617414 28803 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.619954 25093 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:49.621915 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.624173 28393 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:49.624548 28456 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.630833 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:20:49.629962 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 3.10476e+06us
I20260709 12:20:49.627373 28977 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:49.611562 28966 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 5. Current term is 6.
I20260709 12:20:49.602169 28868 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:49.638300 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.611332 28942 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:49.642741 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:49.643018 28979 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:49.643778 25193 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 11: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:49.644237 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:49.644639 28956 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:49.709208 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:49.645395 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:49.645694 28456 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:49.612257 28837 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:49.649969 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:49.685968 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.706943 25127 raft_consensus.cc:2410] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 12:20:49.707315 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 84598us
I20260709 12:20:49.713207 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:49.620954 28970 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:49.709466 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:49.711417 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:49.715662 25119 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:49.711898 25124 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:49.713326 25825 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:49.709837 25859 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:49.717876 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:49.718536 25125 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:49.723081 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:49.723635 25825 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:49.647544 28977 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:49.738122 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:49.738886 25121 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:49.739609 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:49.725185 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:49.725525 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:49.741339 25165 connection.cc:256] RPC call timeout handler was delayed by -1.5477840280000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 12:20:49.741391 25090 connection.cc:256] RPC call timeout handler was delayed by -1.7536687950000669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2296s for a response
W20260709 12:20:49.741822 25165 connection.cc:256] RPC call timeout handler was delayed by -1.3609453569999914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
I20260709 12:20:49.647953 28964 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:49.742203 25165 connection.cc:256] RPC call timeout handler was delayed by -1.1364840280000408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2631s for a response
I20260709 12:20:49.711512 28972 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:49.750535 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:49.749102 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:49.751434 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:49.744144 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:49.716782 28970 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.716181 28837 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:49.770529 25854 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 12:20:49.760016 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:49.803210 25241 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:49.836444 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:49.759418 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.527245 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:51.562491 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 1.75916e+06us
W20260709 12:20:51.562891 25197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2345) took 1805 ms (client timeout 2023 ms). Trace:
W20260709 12:20:51.563256 25197 rpcz_store.cc:269] 0709 12:20:49.757451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.526945 (+769494us) service_pool.cc:224] Handling call
0709 12:20:51.562835 (+1035890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.563572 25241 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:51.564296 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:51.564610 25241 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:51.564889 25197 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:51.565815 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:51.309769 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:51.567250 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:51.567755 25127 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:51.568460 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:51.569414 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:51.312906 28997 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.569896 29014 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:51.570322 28997 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.573145 28997 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:51.324218 25168 connection.cc:256] RPC call timeout handler was delayed by -1.2984832929998902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3159s for a response
I20260709 12:20:51.573763 28801 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:20:51.574146 25168 connection.cc:256] RPC call timeout handler was delayed by -1.1121832930000437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3366s for a response
W20260709 12:20:51.574515 25168 connection.cc:256] RPC call timeout handler was delayed by -1.0352671650000502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 12:20:51.574828 25168 connection.cc:256] RPC call timeout handler was delayed by -1.0325671650000459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 12:20:51.575146 25168 connection.cc:256] RPC call timeout handler was delayed by -1.0138875350000944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 12:20:51.575222 28827 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:51.575606 28827 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.575935 28827 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:51.324524 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1271) took 2298 ms. Trace:
W20260709 12:20:51.340342 25855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.691s	user 0.034s	sys 0.022s
I20260709 12:20:51.577266 25858 rpcz_store.cc:276] 0709 12:20:49.025946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.294330 (+268384us) service_pool.cc:224] Handling call
0709 12:20:49.294589 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:49.521397 (+226808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:49.521449 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:49.522267 (+   818us) log.cc:844] Serialized 26 byte log entry
0709 12:20:49.587906 (+ 65639us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:49.587946 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.588033 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:51.324292 (+1736259us) raft_consensus.cc:1685] finished
0709 12:20:51.324314 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.324454 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57146,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":241162,"threads_started":2,"wal-append.queue_time_us":166125,"wal-append.run_cpu_time_us":1927,"wal-append.run_wall_time_us":1074189}
I20260709 12:20:51.578860 28932 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:51.579166 25855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.930s	user 0.035s	sys 0.022s
I20260709 12:20:51.579319 28932 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:51.579689 28932 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:51.341414 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:51.577898 28962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.967s	user 0.006s	sys 0.022s
W20260709 12:20:51.384128 25859 consensus_meta.cc:287] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 1.667s	user 0.006s	sys 0.018s
W20260709 12:20:51.580749 28962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.977s	user 0.007s	sys 0.023s
I20260709 12:20:51.581004 25859 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
W20260709 12:20:51.581521 25859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 1007) took 1954 ms (client timeout 1938 ms). Trace:
W20260709 12:20:51.581866 25859 rpcz_store.cc:269] 0709 12:20:49.626649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.708952 (+ 82303us) service_pool.cc:224] Handling call
0709 12:20:51.581452 (+1872500us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.583225 25859 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:20:51.583515 25859 pending_rounds.cc:85] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 10
I20260709 12:20:51.583757 25859 pending_rounds.cc:107] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:20:51.583973 25859 raft_consensus.cc:2889] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:51.584520 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.584600 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1008) took 1957 ms. Trace:
I20260709 12:20:51.584992 25859 rpcz_store.cc:276] 0709 12:20:49.626907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.582608 (+1955701us) service_pool.cc:224] Handling call
0709 12:20:51.582894 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.584384 (+  1490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.584552 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:49.754596 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:51.586306 25194 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
W20260709 12:20:51.586797 25194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2341) took 1832 ms (client timeout 1941 ms). Trace:
W20260709 12:20:51.587128 25194 rpcz_store.cc:269] 0709 12:20:49.754133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.754275 (+   142us) service_pool.cc:224] Handling call
0709 12:20:51.586742 (+1832467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.588032 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:49.755393 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:51.588721 28981 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:51.588972 25195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2342) took 1834 ms (client timeout 2207 ms). Trace:
W20260709 12:20:51.589352 25195 rpcz_store.cc:269] 0709 12:20:49.754940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.755091 (+   151us) service_pool.cc:224] Handling call
0709 12:20:51.588913 (+1833822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.589231 28981 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.590261 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:51.403529 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:51.590955 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.591295 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:49.753250 25201 raft_consensus.cc:2393] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:51.593489 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:51.424219 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.574182 28801 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:51.593994 25201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2336) took 1846 ms (client timeout 1918 ms). Trace:
I20260709 12:20:51.594305 28801 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:49.752457 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:51.594434 25201 rpcz_store.cc:269] 0709 12:20:49.747806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.748833 (+  1027us) service_pool.cc:224] Handling call
0709 12:20:51.593940 (+1845107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:51.595181 25124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1955) took 1870 ms (client timeout 1640 ms). Trace:
I20260709 12:20:51.595376 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:51.595676 25124 rpcz_store.cc:269] 0709 12:20:49.724930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.725284 (+   354us) service_pool.cc:224] Handling call
0709 12:20:51.595089 (+1869805us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:51.596731 25168 leader_election.cc:336] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.640s (SENT)
I20260709 12:20:51.597014 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:51.597357 25168 leader_election.cc:336] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.642s (SENT)
I20260709 12:20:51.597504 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:51.445153 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:51.601873 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.602169 25860 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:20:51.602810 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 1005) took 1976 ms. Trace:
I20260709 12:20:51.603217 25860 rpcz_store.cc:276] 0709 12:20:49.626116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.444819 (+1818703us) service_pool.cc:224] Handling call
0709 12:20:51.602736 (+157917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.604135 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:51.604482 28802 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:51.605062 25860 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:49.756284 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:51.607105 25196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2343) took 1851 ms (client timeout 2163 ms). Trace:
W20260709 12:20:51.448387 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.451445 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2448) took 6337 ms. Trace:
I20260709 12:20:51.607646 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:51.610190 25118 rpcz_store.cc:276] 0709 12:20:45.114282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.121788 (+  7506us) service_pool.cc:224] Handling call
0709 12:20:45.122172 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:46.405304 (+1283132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.451140 (+5045836us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b540022b5d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:51.451378 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142384896}
I20260709 12:20:51.611575 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:51.612156 25118 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:51.612999 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:51.613629 25118 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:49.807200 28830 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.771380 28837 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:49.781236 28686 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:51.622673 25168 leader_election.cc:336] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.653s (SENT)
I20260709 12:20:51.624301 28686 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:49.739748 28845 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.627022 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.626897 28845 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:51.627734 25269 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:20:51.628695 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.629238 28845 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:51.629264 25269 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:49.752480 28862 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:51.630391 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.630616 28862 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:51.631006 25270 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:51.631836 28830 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:51.631979 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.632906 25270 raft_consensus.cc:2410] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:20:51.633153 28862 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:51.633391 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.633667 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:49.805644 28919 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:51.376965 28953 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:49.743752 28966 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:49.785545 28951 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.654178 28951 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:51.654765 25856 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:51.655598 25274 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
W20260709 12:20:51.451597 28975 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 1.864s	user 0.008s	sys 0.010s
I20260709 12:20:49.760679 28983 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:51.673532 28983 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.739933 28456 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:51.676040 28456 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.678153 25194 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:20:49.841711 28682 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:49.812935 28804 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.683395 25856 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:51.683914 28456 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:51.684800 28804 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:49.811461 28851 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.687379 28851 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:49.761077 28868 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.798175 28958 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.697079 28932 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.698647 28958 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:49.786736 28961 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:51.700268 25859 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:51.702745 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1009) took 2075 ms. Trace:
I20260709 12:20:51.703051 25859 rpcz_store.cc:276] 0709 12:20:49.627170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.585644 (+1958474us) service_pool.cc:224] Handling call
0709 12:20:51.585898 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.700705 (+114807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.702505 (+  1800us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54005b2a54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:51.702690 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262607744}
W20260709 12:20:49.780401 28974 log.cc:927] Time spent T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:20:49.747097 28977 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:49.752311 28980 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:49.773608 28985 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.712229 28985 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.738312 28987 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.714883 28987 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:51.717235 28987 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:51.463348 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1297) took 1881 ms. Trace:
I20260709 12:20:51.717777 25857 rpcz_store.cc:276] 0709 12:20:49.581769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.581983 (+   214us) service_pool.cc:224] Handling call
0709 12:20:49.588123 (+  6140us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:49.611036 (+ 22913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:49.611068 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:49.628199 (+ 17131us) log.cc:844] Serialized 26 byte log entry
0709 12:20:49.747157 (+118958us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:49.747203 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.747285 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:51.463071 (+1715786us) raft_consensus.cc:1685] finished
0709 12:20:51.463094 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.463275 (+   181us) inbound_call.cc:177] Queueing success response
0709 12:20:51.571562 (+108287us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b4800060258. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2108e37aa1 00007f2108e2eb37 00007f2108e2e9ca 00007f2108f2626f 00007f2108f25f37 00007f2108f3a55c 00007f2108f3a508 00007f2108f3a488 00007f2108f3a443 00007f2108f396ec 00007f2107e63a96
Metrics: {"mutex_wait_us":6365,"raft.queue_time_us":33299,"raft.run_cpu_time_us":12268,"raft.run_wall_time_us":1949975,"spinlock_wait_cycles":18843392,"thread_start_us":118569,"threads_started":1,"wal-append.queue_time_us":169629,"wal-append.run_cpu_time_us":1711,"wal-append.run_wall_time_us":1001742}
I20260709 12:20:51.720278 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:51.464365 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:51.721238 25121 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
W20260709 12:20:51.721737 25121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1958) took 1968 ms (client timeout 1708 ms). Trace:
W20260709 12:20:51.722141 25121 rpcz_store.cc:269] 0709 12:20:49.753488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.753671 (+   183us) service_pool.cc:224] Handling call
0709 12:20:51.721672 (+1968001us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.723135 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:51.723726 25121 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
W20260709 12:20:51.724658 25856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 1006) took 2098 ms (client timeout 2107 ms). Trace:
W20260709 12:20:51.725211 25856 rpcz_store.cc:269] 0709 12:20:49.626380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.751217 (+124837us) service_pool.cc:224] Handling call
0709 12:20:51.724502 (+1973285us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b540008cd54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:51.724603 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4375938432}
I20260709 12:20:51.473296 25014 maintenance_manager.cc:419] P 2d05ccaaf1604ba0be2f6d54385e7ce3: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033720
I20260709 12:20:51.726254 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:51.727039 25856 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:51.727946 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:51.730512 25857 raft_consensus.cc:2368] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8.
W20260709 12:20:51.509294 25851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1293) took 2160 ms (client timeout 1700 ms). Trace:
W20260709 12:20:51.518332 25198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.765s	user 0.010s	sys 0.018s
W20260709 12:20:51.731251 25198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.980s	user 0.011s	sys 0.018s
W20260709 12:20:51.731045 25851 rpcz_store.cc:269] 0709 12:20:49.349107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.367958 (+ 18851us) service_pool.cc:224] Handling call
0709 12:20:51.509011 (+2141053us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b54005a3a54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:51.509197 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105026432}
I20260709 12:20:51.732074 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2338) took 1983 ms. Trace:
I20260709 12:20:51.536453 28978 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:51.732316 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:51.733071 25851 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:51.732875 28978 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.532215 28955 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.734308 28955 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:51.734850 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:51.736483 28955 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:51.538393 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1269) took 2549 ms. Trace:
I20260709 12:20:51.737103 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:51.737041 25854 rpcz_store.cc:276] 0709 12:20:48.988466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.738250 (+749784us) service_pool.cc:224] Handling call
0709 12:20:49.770233 (+ 31983us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:51.538016 (+1767783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.538321 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.737735 25857 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:51.738206 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:51.738772 25854 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:49.757174 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:51.545874 28803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.901s	user 0.013s	sys 0.012s
W20260709 12:20:51.741544 28803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.097s	user 0.014s	sys 0.012s
I20260709 12:20:51.548205 29009 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:51.552161 25092 connection.cc:256] RPC call timeout handler was delayed by -5.4138249620000352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260709 12:20:51.742372 29009 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:51.743256 25092 connection.cc:256] RPC call timeout handler was delayed by -5.2833249620000515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 12:20:51.743624 25092 connection.cc:256] RPC call timeout handler was delayed by -5.2437249619999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 12:20:51.743911 25092 connection.cc:256] RPC call timeout handler was delayed by -5.23922496199998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 12:20:51.744449 25092 connection.cc:256] RPC call timeout handler was delayed by -5.0988249619999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
I20260709 12:20:51.744719 29009 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:51.744947 25092 connection.cc:256] RPC call timeout handler was delayed by -5.0761668500001633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 12:20:51.741568 25200 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
W20260709 12:20:51.745846 25200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2344) took 1989 ms (client timeout 1670 ms). Trace:
W20260709 12:20:51.555920 25193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2318) took 5821 ms (client timeout 2296 ms). Trace:
W20260709 12:20:51.746800 25193 rpcz_store.cc:269] 0709 12:20:45.734107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.734250 (+   143us) service_pool.cc:224] Handling call
0709 12:20:51.555677 (+5821427us) spinlock_profiling.cc:243] Waited 3.9 s on lock 0x7b54003610d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:51.555826 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8975110016}
I20260709 12:20:51.748025 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:51.748728 28978 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:51.749157 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:51.562544 25271 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:51.732446 25198 rpcz_store.cc:276] 0709 12:20:49.748414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.748538 (+   124us) service_pool.cc:224] Handling call
0709 12:20:49.748869 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.731715 (+1982846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:51.731745 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:51.731792 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:51.731830 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.731895 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.732017 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1970,"raft.queue_time_us":53033,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":1041,"thread_start_us":1980467,"threads_started":1}
W20260709 12:20:51.261217 25223 debug-util.cc:398] Leaking SignalData structure 0x7b080032ece0 after lost signal to thread 23882
W20260709 12:20:51.754968 25223 debug-util.cc:398] Leaking SignalData structure 0x7b08003185c0 after lost signal to thread 25059
I20260709 12:20:51.756007 28932 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:51.756217 25223 debug-util.cc:398] Leaking SignalData structure 0x7b08001c8aa0 after lost signal to thread 25151
W20260709 12:20:51.756697 25223 debug-util.cc:398] Leaking SignalData structure 0x7b080012cc80 after lost signal to thread 25152
W20260709 12:20:51.545466 28967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.945s	user 0.018s	sys 0.024s
I20260709 12:20:51.579525 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:51.757743 25858 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:51.758661 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:51.598958 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:51.624778 25168 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.836s (SENT)
I20260709 12:20:51.344158 28998 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:51.759346 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 134594us
W20260709 12:20:51.759905 25168 leader_election.cc:336] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.876s (SENT)
I20260709 12:20:51.760010 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.759769 28998 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:51.598373 25276 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:49.714771 28942 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.761545 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:51.763221 28998 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:51.763361 28942 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:51.630401 25202 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:20:51.634182 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.763973 25202 pending_rounds.cc:85] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 6
I20260709 12:20:51.764238 25202 pending_rounds.cc:107] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:20:51.764178 25269 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:20:51.764571 25202 raft_consensus.cc:2889] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:51.765113 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.765638 28985 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:51.765726 25202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2337) took 2017 ms. Trace:
I20260709 12:20:51.766180 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:51.766737 25269 raft_consensus.cc:2376] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10. Re-sending same reply.
I20260709 12:20:51.767189 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 998) took 2163 ms. Trace:
I20260709 12:20:51.605252 28802 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:51.767544 25853 rpcz_store.cc:276] 0709 12:20:49.604001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.604126 (+   125us) service_pool.cc:224] Handling call
0709 12:20:49.618375 (+ 14249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.766382 (+2148007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:51.766412 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:51.766453 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:51.766488 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.766970 (+   482us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54001d1fd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:51.767024 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.767118 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4939441536}
I20260709 12:20:51.769037 28802 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:51.634703 25201 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:51.769665 28967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.181s	user 0.019s	sys 0.024s
I20260709 12:20:51.769946 28967 raft_consensus.cc:697] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:51.767546 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.771350 25269 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:51.772240 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:51.757863 25223 debug-util.cc:398] Leaking SignalData structure 0x7b0800165620 after lost signal to thread 25226
I20260709 12:20:51.773485 25854 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
W20260709 12:20:51.773727 25223 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1080 after lost signal to thread 25300
I20260709 12:20:51.634912 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.635700 25199 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:51.607627 25196 rpcz_store.cc:269] 0709 12:20:49.755825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.756012 (+   187us) service_pool.cc:224] Handling call
0709 12:20:51.607027 (+1851015us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.635924 28981 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:51.597829 25124 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:51.863062 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:51.647363 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1010) took 2020 ms. Trace:
I20260709 12:20:51.863786 25860 rpcz_store.cc:276] 0709 12:20:49.627431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.605812 (+1978381us) service_pool.cc:224] Handling call
0709 12:20:51.646859 (+ 41047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.647044 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:51.647068 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:51.647109 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:51.647150 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.647203 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.647308 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.864717 25167 leader_election.cc:400] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8.
I20260709 12:20:51.865031 25167 leader_election.cc:403] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:51.607117 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:51.649504 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:49.771056 28970 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:51.904327 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1948) took 2255 ms. Trace:
I20260709 12:20:51.663437 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1298) took 2050 ms. Trace:
I20260709 12:20:51.904834 25123 rpcz_store.cc:276] 0709 12:20:49.648792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.648897 (+   105us) service_pool.cc:224] Handling call
0709 12:20:49.712448 (+ 63551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:49.726114 (+ 13666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:49.726153 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:49.750211 (+ 24058us) log.cc:844] Serialized 26 byte log entry
0709 12:20:51.873702 (+2123491us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:51.873731 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.873781 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:51.904109 (+ 30328us) raft_consensus.cc:1685] finished
0709 12:20:51.904130 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.904267 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13246,"raft.queue_time_us":27438,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":9734,"thread_start_us":392380,"threads_started":1,"wal-append.queue_time_us":421269}
I20260709 12:20:51.905586 25855 rpcz_store.cc:276] 0709 12:20:49.613746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.614617 (+   871us) service_pool.cc:224] Handling call
0709 12:20:49.614924 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:49.630603 (+ 15679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:49.630641 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:49.631159 (+   518us) log.cc:844] Serialized 52 byte log entry
0709 12:20:51.579593 (+1948434us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:51.651816 (+ 72223us) log.cc:844] Serialized 14 byte log entry
0709 12:20:51.662612 (+ 10796us) log.cc:844] Serialized 14 byte log entry
0709 12:20:51.663131 (+   519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.663198 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:51.663243 (+    45us) raft_consensus.cc:1685] finished
0709 12:20:51.663253 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.663380 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2491,"prepare.queue_time_us":73147,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":94,"raft.queue_time_us":976,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":63890,"spinlock_wait_cycles":11648,"thread_start_us":2012002,"threads_started":3,"wal-append.queue_time_us":165027,"wal-append.run_cpu_time_us":1700,"wal-append.run_wall_time_us":1012849}
I20260709 12:20:51.909252 25123 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:51.667953 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.910349 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.911453 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:51.668814 28837 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.669065 28801 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.918334 25090 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:51.670840 25241 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:51.690371 28983 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:51.691208 25194 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
W20260709 12:20:51.691840 25274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1061) took 1891 ms (client timeout 1878 ms). Trace:
I20260709 12:20:51.699966 28827 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:49.746974 28979 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.952418 28979 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:51.494007 25852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 1013) took 1865 ms (client timeout 2140 ms). Trace:
I20260709 12:20:51.735345 25127 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
W20260709 12:20:51.958290 25852 rpcz_store.cc:269] 0709 12:20:49.628259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.750311 (+122052us) service_pool.cc:224] Handling call
0709 12:20:51.493937 (+1743626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.959867 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:51.960520 25127 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
W20260709 12:20:51.745332 25092 connection.cc:256] RPC call timeout handler was delayed by -4.8646668500000487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 12:20:51.961393 25092 connection.cc:256] RPC call timeout handler was delayed by -4.8151668499999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:20:51.961735 25092 connection.cc:256] RPC call timeout handler was delayed by -4.7208249620000515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26520000000000005s for a response
W20260709 12:20:51.962006 25092 connection.cc:256] RPC call timeout handler was delayed by -4.5136668500001633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
W20260709 12:20:51.962544 25092 connection.cc:256] RPC call timeout handler was delayed by -4.4290668500000265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
I20260709 12:20:51.962656 28985 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:51.962955 25092 connection.cc:256] RPC call timeout handler was delayed by -4.3537326860000576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
W20260709 12:20:51.963299 25092 connection.cc:256] RPC call timeout handler was delayed by -4.2861249620000308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3135s for a response
W20260709 12:20:51.963603 25092 connection.cc:256] RPC call timeout handler was delayed by -4.2466326860001118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
W20260709 12:20:51.963871 25092 connection.cc:256] RPC call timeout handler was delayed by -4.02982076499984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 12:20:51.964129 25092 connection.cc:256] RPC call timeout handler was delayed by -3.9595326860001023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2296s for a response
W20260709 12:20:51.964394 25092 connection.cc:256] RPC call timeout handler was delayed by -3.8282207649999691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 12:20:51.964669 25092 connection.cc:256] RPC call timeout handler was delayed by -3.7399326859999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.254s for a response
W20260709 12:20:51.964931 25092 connection.cc:256] RPC call timeout handler was delayed by -3.5285207649999393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260709 12:20:51.965014 28979 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:51.554680 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1953) took 1834 ms. Trace:
I20260709 12:20:51.965644 25119 rpcz_store.cc:276] 0709 12:20:49.720392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.721074 (+   682us) service_pool.cc:224] Handling call
0709 12:20:49.742887 (+ 21813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.743076 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:51.393341 (+1650265us) log.cc:844] Serialized 14 byte log entry
0709 12:20:51.554260 (+160919us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:51.554323 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:51.554384 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.554476 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.554607 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94749,"prepare.queue_time_us":1651586,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":104700,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":65611,"threads_started":2,"wal-append.queue_time_us":1307}
W20260709 12:20:51.746300 25200 rpcz_store.cc:269] 0709 12:20:49.756820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.756926 (+   106us) service_pool.cc:224] Handling call
0709 12:20:51.745765 (+1988839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.967854 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:51.968433 25200 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:20:51.969261 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:51.760624 25275 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:51.970709 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.971290 25275 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:51.972069 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:51.760926 25168 leader_election.cc:336] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.149s (SENT)
W20260709 12:20:51.973059 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 212139us
I20260709 12:20:51.974443 25168 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:51.976187 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:51.592305 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:51.978196 25195 raft_consensus.cc:2410] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:20:49.752719 28847 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:51.963315 28985 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.982803 28456 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:20:51.980398 25090 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:51.759397 25858 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:51.769176 25276 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:51.771328 28967 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:51.860824 25201 raft_consensus.cc:2410] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:20:51.982347 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1300) took 2349 ms. Trace:
I20260709 12:20:51.766196 25202 rpcz_store.cc:276] 0709 12:20:49.748138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.749175 (+  1037us) service_pool.cc:224] Handling call
0709 12:20:51.356805 (+1607630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.765034 (+408229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.765535 (+   501us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b540016d5d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:51.765679 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628085632}
I20260709 12:20:51.774348 25267 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:20:51.861640 25851 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:51.704174 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:51.993424 25859 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:51.775002 25223 debug-util.cc:398] Leaking SignalData structure 0x7b0800395ba0 after lost signal to thread 25884
W20260709 12:20:51.994254 25223 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5f60 after lost signal to thread 25885
I20260709 12:20:51.994833 25090 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:51.646365 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:51.865141 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1011) took 2237 ms. Trace:
I20260709 12:20:51.995776 25118 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:20:51.995716 25853 rpcz_store.cc:276] 0709 12:20:49.627716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.768643 (+2140927us) service_pool.cc:224] Handling call
0709 12:20:51.768947 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:51.769329 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:51.769356 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:51.769858 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:20:51.864796 (+ 94938us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:51.864831 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.864931 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:51.864971 (+    40us) raft_consensus.cc:1685] finished
0709 12:20:51.864982 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.865092 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1395,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":93228,"threads_started":1,"wal-append.queue_time_us":89411}
I20260709 12:20:51.865592 25197 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:51.866874 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 1952) took 2146 ms. Trace:
I20260709 12:20:51.868165 25857 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:51.870154 25271 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
W20260709 12:20:51.998979 25271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1062) took 2196 ms (client timeout 2827 ms). Trace:
I20260709 12:20:51.753815 25025 catalog_manager.cc:5697] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 7 to 8, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 8 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.999766 29011 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:51.872591 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:51.877359 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 2.11719e+06us
I20260709 12:20:52.001566 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.878702 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:51.881376 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:52.003511 25276 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:51.891376 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:51.892287 25024 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33480 (request call id 270) took 18062 ms (client timeout 15000 ms). Trace:
I20260709 12:20:52.006392 25270 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:52.006649 25859 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
W20260709 12:20:51.666170 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 101189us
I20260709 12:20:51.913368 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:52.007820 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.913529 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:51.919250 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 248486us
I20260709 12:20:51.992497 25860 rpcz_store.cc:276] 0709 12:20:49.632708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.864675 (+2231967us) service_pool.cc:224] Handling call
0709 12:20:51.864939 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.865117 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:51.877602 (+ 12485us) log.cc:844] Serialized 14 byte log entry
0709 12:20:51.982041 (+104439us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:51.982091 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:51.982134 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.982196 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.982297 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7364,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":904,"thread_start_us":103910,"threads_started":1}
W20260709 12:20:51.919557 25274 rpcz_store.cc:269] 0709 12:20:49.800441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.341172 (+1540731us) service_pool.cc:224] Handling call
0709 12:20:51.691752 (+350580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.924153 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:51.999511 25271 rpcz_store.cc:269] 0709 12:20:49.802682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.836073 (+ 33391us) service_pool.cc:224] Handling call
0709 12:20:51.998881 (+2162808us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.934401 28837 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:51.921042 28803 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8.
I20260709 12:20:51.938514 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:52.014976 25194 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
W20260709 12:20:52.015057 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 142531us
I20260709 12:20:52.015419 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:51.939204 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:51.930341 29013 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:51.943271 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.016367 25124 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:51.925824 29017 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:51.946246 28827 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:51.965238 25092 connection.cc:256] RPC call timeout handler was delayed by -3.5123207649999131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 12:20:52.025955 25092 connection.cc:256] RPC call timeout handler was delayed by -3.5024207649998971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
W20260709 12:20:52.026331 25092 connection.cc:256] RPC call timeout handler was delayed by -3.2266668500001288s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.35550000000000004s for a response
W20260709 12:20:52.026755 25092 connection.cc:256] RPC call timeout handler was delayed by -3.1108326860000943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3239s for a response
W20260709 12:20:52.027051 25092 connection.cc:256] RPC call timeout handler was delayed by -2.8238207649999367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2924s for a response
W20260709 12:20:52.006325 25024 rpcz_store.cc:269] 0709 12:20:33.830103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.888132 (+ 58029us) service_pool.cc:224] Handling call
0709 12:20:51.892205 (+18004073us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:45.615986 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:45.629717 (+ 13731us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:45.629787 (+    70us) write_op.cc:435] Acquired schema lock
0709 12:20:45.629815 (+    28us) tablet.cc:662] Decoding operations
0709 12:20:45.631738 (+  1923us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:45.631857 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:45.631897 (+    40us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:20:45.633410 (+  1513us) tablet.cc:701] Row locks acquired
0709 12:20:45.633462 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:20:45.633647 (+   185us) write_op.cc:270] Start()
0709 12:20:45.635492 (+  1845us) write_op.cc:276] Timestamp: P: 1783599645633572 usec, L: 0
0709 12:20:45.635508 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:20:45.766319 (+130811us) log.cc:844] Serialized 5579 byte log entry
0709 12:20:46.956634 (+1190315us) op_driver.cc:464] REPLICATION: finished
0709 12:20:47.071424 (+114790us) write_op.cc:301] APPLY: starting
0709 12:20:47.079783 (+  8359us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:47.151337 (+ 71554us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:47.156179 (+  4842us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:47.158066 (+  1887us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:47.158423 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:20:47.158473 (+    50us) write_op.cc:312] APPLY: finished
0709 12:20:47.158885 (+   412us) log.cc:844] Serialized 101 byte log entry
0709 12:20:47.159753 (+   868us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:47.159966 (+   213us) write_op.cc:454] Released schema lock
0709 12:20:47.160037 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:48.709453 (+1549416us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b54002ef754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f09e28 00007f2107944581 00007f2107943d58 00007f21079489f1 00007f21079489a9 00007f2107948939 00007f2107948901 00007f2107947b2d 0000000000388634 0000000000388479
0709 12:20:48.709693 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:48.709723 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6920072,"reported_tablets":32,"spinlock_wait_cycles":12544,"child_traces":[["op",{"apply.queue_time_us":104287,"apply.run_cpu_time_us":4759,"apply.run_wall_time_us":94218,"num_ops":14,"prepare.queue_time_us":126823,"prepare.run_cpu_time_us":42663,"prepare.run_wall_time_us":3095318,"raft.queue_time_us":450792,"raft.run_cpu_time_us":8287,"raft.run_wall_time_us":77885,"replication_time_us":1320938,"spinlock_wait_cycles":48605952,"thread_start_us":728816,"threads_started":4,"wal-append.queue_time_us":673466,"wal-append.run_cpu_time_us":22389,"wal-append.run_wall_time_us":1704573}]]}
W20260709 12:20:52.027336 25092 connection.cc:256] RPC call timeout handler was delayed by -2.6564207649998934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.311s for a response
W20260709 12:20:52.027763 25092 connection.cc:256] RPC call timeout handler was delayed by -2.1857207649998145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3633s for a response
I20260709 12:20:51.303123 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:51.981743 25200 raft_consensus.cc:2410] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:20:51.984126 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.988399 28985 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:51.761497 28868 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:51.990935 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:52.031945 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.032557 25275 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:52.033385 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.841044 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2339) took 2092 ms. Trace:
I20260709 12:20:51.982491 28851 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:52.034055 25199 rpcz_store.cc:276] 0709 12:20:49.748723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.566338 (+1817615us) service_pool.cc:224] Handling call
0709 12:20:51.566648 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.774840 (+208192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.840804 (+ 65964us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b54000a5d54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:51.840973 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158206720}
I20260709 12:20:52.037132 25199 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:52.009452 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.038884 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.039894 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.040439 25274 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 4.
I20260709 12:20:52.041203 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.041469 25120 raft_consensus.cc:2410] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:20:52.042534 25110 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c305b34a0c54275af750c832f52691f with delete_type TABLET_DATA_TOMBSTONED (TS 897be935c42e41b995f177155b042be0 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41024
I20260709 12:20:52.010962 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:52.045053 25202 raft_consensus.cc:2410] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:20:52.011140 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.998202 25125 rpcz_store.cc:276] 0709 12:20:49.720034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.721145 (+  1111us) service_pool.cc:224] Handling call
0709 12:20:49.743087 (+ 21942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.743269 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:51.398000 (+1654731us) log.cc:844] Serialized 14 byte log entry
0709 12:20:51.866540 (+468540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:51.866593 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:51.866650 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.866718 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.866822 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1749517,"prepare.queue_time_us":1654562,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":104867,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":372975,"threads_started":2,"wal-append.queue_time_us":1228}
I20260709 12:20:52.011705 25269 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:52.000286 29011 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:52.046365 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.971578 28977 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:52.046475 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.047083 25267 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:52.047839 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:51.944613 28801 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:52.016472 25025 catalog_manager.cc:5697] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 6 to 7, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 7 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:20:52.046425 29011 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:52.048856 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:52.049854 25126 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:52.047830 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.050290 25025 catalog_manager.cc:5697] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 4 to 9, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 9 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.051530 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.052253 25269 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:52.022820 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.053033 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.053471 25271 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:52.010083 25196 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:52.054230 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.054886 25198 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:20:52.055361 25269 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:52.055894 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.056452 25119 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
I20260709 12:20:52.057845 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.058524 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:52.061369 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:52.061908 25127 raft_consensus.cc:2376] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8. Re-sending same reply.
I20260709 12:20:52.052582 25025 catalog_manager.cc:5697] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 6 to 8, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 8 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:52.069190 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.068938 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.058506 25274 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:52.071203 25269 raft_consensus.cc:1240] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:52.077364 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:52.077973 25851 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:52.082942 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.002193 28955 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:52.088824 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 785716us
I20260709 12:20:52.086477 25269 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:20:52.089861 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:52.084383 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 59727.8us
I20260709 12:20:52.091159 25168 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:52.094099 25272 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:52.093556 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 79035us
I20260709 12:20:52.099256 25090 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:52.099426 25242 leader_election.cc:336] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.595s (SENT)
W20260709 12:20:52.100363 25242 leader_election.cc:336] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.622s (SENT)
W20260709 12:20:52.101498 25242 leader_election.cc:336] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.624s (SENT)
W20260709 12:20:52.102973 25242 leader_election.cc:336] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.651s (SENT)
W20260709 12:20:52.104349 25242 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.670s (SENT)
I20260709 12:20:52.022485 28802 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.023092 28932 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:52.115177 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.115515 25272 raft_consensus.cc:1240] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:52.115931 25825 connection.cc:256] RPC call timeout handler was delayed by -5.7525906559999385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 12:20:52.116288 25825 connection.cc:256] RPC call timeout handler was delayed by -5.5266906559998006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 12:20:52.116575 25825 connection.cc:256] RPC call timeout handler was delayed by -5.4186906559998533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 12:20:52.116911 25269 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:52.106406 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:52.108304 25165 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:52.025084 28845 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:52.124181 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:52.116855 25825 connection.cc:256] RPC call timeout handler was delayed by -5.3232906559999265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
I20260709 12:20:52.106055 25201 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:52.113490 25851 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:52.109808 25168 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:52.075799 28956 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.125916 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.126199 25025 catalog_manager.cc:5697] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 6 to 7, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 7 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.135459 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:52.084491 29017 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:52.081303 28837 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 12:20:52.110844 25242 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.670s (SENT)
I20260709 12:20:52.081418 28847 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:20:52.081035 28698 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:20:52.087955 28801 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 12:20:52.025007 28919 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.175127 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.279649 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:52.279116 25120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1957) took 2535 ms (client timeout 1642 ms). Trace:
I20260709 12:20:52.299404 25125 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:52.281280 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.299808 25123 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
W20260709 12:20:52.261320 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.298641 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:52.298808 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1302) took 2584 ms. Trace:
I20260709 12:20:52.276371 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:52.301750 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 190999us
W20260709 12:20:52.302563 25242 leader_election.cc:336] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.776s (SENT)
I20260709 12:20:52.301420 25855 rpcz_store.cc:276] 0709 12:20:49.714598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.907579 (+2192981us) service_pool.cc:224] Handling call
0709 12:20:51.907894 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:51.908254 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:51.908282 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:51.908845 (+   563us) log.cc:844] Serialized 52 byte log entry
0709 12:20:51.997192 (+ 88347us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:52.097684 (+100492us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.098136 (+   452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.098204 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:52.298569 (+200365us) raft_consensus.cc:1685] finished
0709 12:20:52.298589 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.298748 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16904,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":10392,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":15838,"thread_start_us":187605,"threads_started":2,"wal-append.queue_time_us":171706}
I20260709 12:20:52.302977 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:52.299576 25120 rpcz_store.cc:269] 0709 12:20:49.743518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.743924 (+   406us) service_pool.cc:224] Handling call
0709 12:20:52.270822 (+2526898us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b54003237d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:52.279033 (+  8211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5263762176}
I20260709 12:20:52.118646 28686 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:52.156874 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:52.374079 25825 connection.cc:256] RPC call timeout handler was delayed by -4.893090655999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.246s for a response
W20260709 12:20:52.172398 25126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1950) took 2463 ms (client timeout 1653 ms). Trace:
W20260709 12:20:52.315697 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 205971us
I20260709 12:20:52.302240 25124 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:52.192305 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.115025 28985 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:52.122953 28997 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:52.316146 25242 leader_election.cc:336] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.907s (SENT)
W20260709 12:20:52.375051 25825 connection.cc:256] RPC call timeout handler was delayed by -4.7310906559998784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.264s for a response
W20260709 12:20:52.375530 25126 rpcz_store.cc:269] 0709 12:20:49.708942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.709240 (+   298us) service_pool.cc:224] Handling call
0709 12:20:52.138503 (+2429263us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b54001b71d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:52.172322 (+ 33819us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5368705920}
I20260709 12:20:52.377427 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:52.134047 25090 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:52.118543 28456 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:52.437192 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 303204us
W20260709 12:20:52.434993 25825 connection.cc:256] RPC call timeout handler was delayed by -4.6736593910000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:20:52.397854 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:52.286679 28845 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:52.436388 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 120263us
I20260709 12:20:52.436524 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:52.136318 28979 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:52.449604 25125 raft_consensus.cc:2376] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9. Re-sending same reply.
I20260709 12:20:52.451412 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:52.288218 28977 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:52.447322 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.451205 25198 raft_consensus.cc:1240] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:52.439237 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:52.230643 28804 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:52.406960 25025 catalog_manager.cc:5697] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 7, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 7 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.398171 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:52.300252 28970 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:52.446666 28987 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:20:52.449124 25242 leader_election.cc:336] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.975s (SENT)
I20260709 12:20:52.391847 28997 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.461983 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:52.448402 25825 connection.cc:256] RPC call timeout handler was delayed by -4.3224906559999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3094s for a response
I20260709 12:20:52.174849 29015 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:52.244436 29011 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:52.610886 25127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.008s	sys 0.010s
I20260709 12:20:52.478973 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.133185 28802 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:52.504907 25881 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7bc0 after lost signal to thread 23882
W20260709 12:20:52.615953 25881 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7140 after lost signal to thread 25059
W20260709 12:20:52.616576 25241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.009s	sys 0.008s
W20260709 12:20:52.617089 25241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.009s	sys 0.008s
W20260709 12:20:52.584653 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.504964 28979 consensus_queue.cc:1059] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 12:20:52.540107 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.618376 25119 raft_consensus.cc:2393] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 9: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:52.619107 29011 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:52.619480 29013 raft_consensus.cc:3055] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:52.619839 29013 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:52.620664 29013 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:52.621629 29013 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:52.623086 29030 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:20:52.624219 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1012) took 2996 ms. Trace:
I20260709 12:20:52.624565 25854 rpcz_store.cc:276] 0709 12:20:49.628002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.774607 (+2146605us) service_pool.cc:224] Handling call
0709 12:20:51.774893 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:51.858315 (+ 83422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:51.858349 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:51.862978 (+  4629us) log.cc:844] Serialized 26 byte log entry
0709 12:20:52.184091 (+321113us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:52.184131 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.184197 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:52.624025 (+439828us) raft_consensus.cc:1685] finished
0709 12:20:52.624044 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.624164 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88459,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2401,"thread_start_us":320729,"threads_started":1,"wal-append.queue_time_us":639825}
W20260709 12:20:52.628183 29026 log.cc:927] Time spent T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.352s	user 0.000s	sys 0.002s
I20260709 12:20:52.543879 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.592721 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2346) took 2835 ms. Trace:
W20260709 12:20:52.559190 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 450952us
I20260709 12:20:52.378104 28827 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:52.382544 28985 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:52.480664 28686 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:52.608446 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 159326us
W20260709 12:20:52.610185 25825 connection.cc:256] RPC call timeout handler was delayed by -3.2739906559997962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.42590000000000006s for a response
I20260709 12:20:52.452718 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:52.374402 29033 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:52.639746 25242 leader_election.cc:336] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.059s (SENT)
I20260709 12:20:52.610886 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:52.640194 25242 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:52.640089 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 631254us
I20260709 12:20:52.528448 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:52.642236 25200 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:52.608139 28987 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:52.451911 29034 tablet_replica.cc:333] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:20:52.611567 25125 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
W20260709 12:20:52.611804 25852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.010s	sys 0.007s
I20260709 12:20:52.509487 25167 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:52.453464 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:52.611321 25127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.008s	sys 0.010s
I20260709 12:20:52.377833 28830 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:52.613867 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.653419 25201 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 11: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:52.613751 25025 catalog_manager.cc:5697] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 4, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 4 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:52.617157 25881 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7f60 after lost signal to thread 25151
I20260709 12:20:52.133078 28932 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:52.631107 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:52.595592 29029 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
W20260709 12:20:52.592872 25197 consensus_meta.cc:287] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.000s
I20260709 12:20:52.655951 25126 raft_consensus.cc:2393] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 8: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:52.656194 25197 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:52.635803 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:52.518283 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.656750 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2358) took 1356 ms. Trace:
I20260709 12:20:52.657119 25120 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
W20260709 12:20:52.646700 25012 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897be935c42e41b995f177155b042be0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:52.657404 25197 rpcz_store.cc:276] 0709 12:20:51.300534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.606819 (+306285us) service_pool.cc:224] Handling call
0709 12:20:52.656692 (+1049873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.635751 25124 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:52.629185 25193 rpcz_store.cc:276] 0709 12:20:49.757696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.015049 (+2257353us) service_pool.cc:224] Handling call
0709 12:20:52.080054 (+ 65005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.080240 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:52.095726 (+ 15486us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.263338 (+167612us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b18001fc660. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae23a 00007f2103f18a2a
0709 12:20:52.592188 (+328850us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.592285 (+    97us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:52.592370 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.592465 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.592634 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9983,"prepare.queue_time_us":12721,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":46916,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3080,"spinlock_wait_cycles":25606912,"thread_start_us":288058,"threads_started":1}
W20260709 12:20:52.636898 25858 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.006s	sys 0.011s
W20260709 12:20:52.658553 25858 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.007s	sys 0.011s
I20260709 12:20:52.514703 28977 consensus_queue.cc:1059] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260709 12:20:52.479871 28955 consensus_queue.cc:1059] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.155s
I20260709 12:20:52.638281 28985 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:52.569904 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:52.663692 25198 raft_consensus.cc:2368] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10.
I20260709 12:20:52.610718 28997 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:52.435401 28956 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:52.651077 28987 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:52.637331 28905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.006s	sys 0.012s
W20260709 12:20:52.612135 25268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.003s	sys 0.014s
W20260709 12:20:52.670879 25268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.004s	sys 0.015s
W20260709 12:20:52.654079 25881 debug-util.cc:398] Leaking SignalData structure 0x7b0800377c20 after lost signal to thread 25152
I20260709 12:20:52.636479 25122 raft_consensus.cc:2393] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:20:52.455067 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 77717.6us
I20260709 12:20:52.671440 25165 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:52.669478 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:52.672500 25881 debug-util.cc:398] Leaking SignalData structure 0x7b0800357b00 after lost signal to thread 25226
I20260709 12:20:52.672840 25121 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:52.674003 25881 debug-util.cc:398] Leaking SignalData structure 0x7b080040a680 after lost signal to thread 25300
I20260709 12:20:52.667971 25025 catalog_manager.cc:5697] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.668589 29037 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:52.557983 28845 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:52.555599 29017 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:52.479663 28973 consensus_queue.cc:1059] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.160s
I20260709 12:20:52.661707 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.629205 29015 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:52.664909 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:52.645668 28801 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:52.689275 29037 raft_consensus.cc:697] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:52.502988 28868 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 12:20:52.644874 28686 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:52.667948 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 158542us
I20260709 12:20:52.669106 25274 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:52.392176 28919 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:52.678946 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
W20260709 12:20:52.675196 25881 debug-util.cc:398] Leaking SignalData structure 0x7b08003cafe0 after lost signal to thread 25884
W20260709 12:20:52.728878 25881 debug-util.cc:398] Leaking SignalData structure 0x7b08003431a0 after lost signal to thread 25885
I20260709 12:20:52.660151 25241 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:52.679195 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1902) took 1077 ms. Trace:
I20260709 12:20:52.668738 29011 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:52.683142 25025 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 7 to 8, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 8 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:52.742887 29011 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:52.743788 29011 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:52.743968 25025 catalog_manager.cc:5697] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 5 to 6, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 6 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.744864 29011 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:52.685544 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.687963 28456 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:52.677326 28905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.006s	sys 0.012s
I20260709 12:20:52.677603 28955 raft_consensus.cc:3055] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:52.751825 28955 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:52.752938 28955 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:52.677175 28837 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:52.685158 29031 log.cc:927] Time spent T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 12:20:52.694944 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 215388us
I20260709 12:20:52.755035 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.755767 25125 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:52.723711 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.756747 25126 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:52.756821 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:52.676868 29041 consensus_queue.cc:1059] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:20:52.727733 25167 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:52.758805 29041 raft_consensus.cc:3055] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:52.758977 25167 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:52.760577 28803 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:20:52.760687 25122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 1946) took 3112 ms (client timeout 3366 ms). Trace:
I20260709 12:20:52.761245 28803 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:52.739329 29035 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:52.762986 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:52.740262 25275 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:52.729655 25268 rpcz_store.cc:276] 0709 12:20:51.593667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.599498 (+  5831us) service_pool.cc:224] Handling call
0709 12:20:51.599831 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.600092 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:51.864267 (+264175us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.671257 (+806990us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.671306 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:52.671356 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.671416 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.671536 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":262514,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":5746,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3031,"thread_start_us":1070523,"threads_started":2,"wal-append.queue_time_us":746426}
I20260709 12:20:52.742370 28744 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:52.757767 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:52.771901 25126 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:52.772862 25093 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:52.759253 29041 raft_consensus.cc:740] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:52.761412 28804 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:20:52.778115 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 342999us
I20260709 12:20:52.779278 25093 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:52.781105 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:52.783491 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2389) took 1079 ms. Trace:
I20260709 12:20:52.783972 25274 rpcz_store.cc:276] 0709 12:20:51.703534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.091565 (+388031us) service_pool.cc:224] Handling call
0709 12:20:52.135103 (+ 43538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.722721 (+587618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.783196 (+ 60475us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b5400121e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:52.783412 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1227343744}
I20260709 12:20:52.763789 25127 raft_consensus.cc:2368] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11.
W20260709 12:20:52.763934 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.726222 28686 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:52.732060 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 71975.5us
I20260709 12:20:52.735129 25121 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
W20260709 12:20:52.761170 25122 rpcz_store.cc:269] 0709 12:20:49.647822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.648064 (+   242us) service_pool.cc:224] Handling call
0709 12:20:52.760477 (+3112413us) spinlock_profiling.cc:243] Waited 2.92 s on lock 0x7b5400189f54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:52.760625 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6706829184}
I20260709 12:20:52.767870 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.790788 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.791114 25125 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:52.791581 25121 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:52.740226 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.792696 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:52.793403 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:52.762344 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:52.738705 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 59867.7us
I20260709 12:20:52.794924 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:52.795488 25165 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:52.795878 25198 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:52.781361 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:52.796352 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 146584us
I20260709 12:20:52.794952 25120 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:52.793736 25121 raft_consensus.cc:2410] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:20:52.798535 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1309) took 1138 ms. Trace:
I20260709 12:20:52.782559 28862 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:52.774636 28973 consensus_queue.cc:1243] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:52.771420 28744 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.803140 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:52.811416 25092 leader_election.cc:336] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.858s (SENT)
I20260709 12:20:52.830859 25092 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:52.812189 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:52.768869 29035 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:52.802047 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.834194 25119 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:20:52.784232 28868 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:52.817466 25126 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5.
I20260709 12:20:52.827225 28997 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:52.829136 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.798056 28804 raft_consensus.cc:697] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:52.813671 28955 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:52.805615 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.851207 25121 raft_consensus.cc:2376] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 5. Re-sending same reply.
I20260709 12:20:52.852404 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.853181 25121 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:20:52.854424 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.837113 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:52.838290 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.857012 25122 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:52.840042 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:52.800328 25858 rpcz_store.cc:276] 0709 12:20:51.660047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.989346 (+329299us) service_pool.cc:224] Handling call
0709 12:20:51.989639 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.989825 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:51.990139 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.798178 (+808039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.798236 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:52.798287 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.798355 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.798478 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1339,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":807656,"threads_started":2,"wal-append.queue_time_us":678573}
I20260709 12:20:52.835408 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.785809 28919 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:52.833004 28951 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:52.856962 25121 raft_consensus.cc:2376] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9. Re-sending same reply.
I20260709 12:20:52.881757 25121 raft_consensus.cc:3055] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:52.841758 28973 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:52.830421 28970 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:52.799665 29044 log.cc:927] Time spent T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:20:52.882138 25121 raft_consensus.cc:740] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:52.879312 29043 log.cc:927] Time spent T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:20:52.836337 28744 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:52.884027 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:52.896482 25126 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:52.887200 25198 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:20:52.841387 29047 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:52.837216 29035 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:52.895645 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1312) took 1210 ms. Trace:
I20260709 12:20:52.901144 25856 rpcz_store.cc:276] 0709 12:20:51.685127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.727726 (+ 42599us) service_pool.cc:224] Handling call
0709 12:20:52.895434 (+1167708us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400726854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:52.895588 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2424478080}
I20260709 12:20:52.882685 28951 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.880798 28868 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:52.911417 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 246558us
I20260709 12:20:52.911850 25127 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:52.912578 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:52.913408 25127 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:20:52.915007 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 133975us
I20260709 12:20:52.916131 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:52.897957 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 208220us
I20260709 12:20:52.856379 28967 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:52.893261 25121 consensus_queue.cc:260] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:52.797684 28803 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:52.924299 25825 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:52.899117 29047 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.957664 25121 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:52.957868 25242 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 3.011s (SENT)
W20260709 12:20:52.960038 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 148644us
I20260709 12:20:52.907037 28951 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:52.963701 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:52.846154 29037 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:52.996532 25092 leader_election.cc:336] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.540s (SENT)
W20260709 12:20:53.002795 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 173588us
I20260709 12:20:52.996025 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:53.006457 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 166526us
I20260709 12:20:52.924036 28970 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:53.009708 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.010468 25856 raft_consensus.cc:2368] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10.
I20260709 12:20:53.010897 28998 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:53.011312 28998 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:53.011407 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.011705 28998 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:53.012140 25858 raft_consensus.cc:2393] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:53.012984 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.014189 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.014408 28983 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:53.014793 25851 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:20:53.015316 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2363) took 1713 ms. Trace:
I20260709 12:20:53.015941 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.016654 25855 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:53.015702 25199 rpcz_store.cc:276] 0709 12:20:51.301868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.037765 (+735897us) service_pool.cc:224] Handling call
0709 12:20:52.038005 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.087376 (+ 49371us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:52.607518 (+520142us) log.cc:844] Serialized 14 byte log entry
0709 12:20:53.014128 (+406610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:53.014178 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:53.014239 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.015165 (+   926us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.015268 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34451,"prepare.queue_time_us":75401,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":50,"raft.queue_time_us":27454,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":25719,"spinlock_wait_cycles":61184,"thread_start_us":810237,"threads_started":3,"wal-append.queue_time_us":285544}
I20260709 12:20:52.956696 28837 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:53.014868 25121 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:53.019151 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:53.020913 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.021178 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.021626 25860 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:20:53.022347 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.022940 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.023653 25859 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:20:53.023904 25860 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:52.964373 29047 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:53.017591 29038 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:20:53.052256 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:53.258051 25857 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:53.259163 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:53.259846 25857 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:53.055109 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.261041 25124 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:53.261653 25852 raft_consensus.cc:2410] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:20:53.074703 29046 log.cc:927] Time spent T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:20:53.052203 29054 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:53.097904 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:53.167629 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:53.265609 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:53.217746 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 292190us
I20260709 12:20:53.266676 25093 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:53.258164 28985 consensus_meta.cc:287] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.003s
I20260709 12:20:53.267671 28956 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:53.267539 28985 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:53.268100 25093 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:53.228201 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.269095 25860 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:53.269603 28985 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:53.229494 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.269949 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:53.270533 25859 raft_consensus.cc:2393] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:53.270716 28973 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:53.270545 25860 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:53.230880 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:53.233353 25092 leader_election.cc:336] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 3.239s (SENT)
I20260709 12:20:53.272809 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:53.239226 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.273217 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:53.240186 29064 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:53.240566 28686 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:53.242476 25853 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:53.244261 25123 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:20:53.246670 28997 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:53.247167 29056 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:53.248019 29015 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:53.248656 29048 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.340s	user 0.004s	sys 0.006s
I20260709 12:20:53.249261 25822 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:53.249378 28802 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:52.996413 29052 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.996309 28967 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:53.252439 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 233786us
I20260709 12:20:53.319849 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:53.322660 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:53.324259 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:52.955596 28804 consensus_queue.cc:237] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.019361 28868 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:20:53.262650 25120 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:53.268718 29069 consensus_queue.cc:1059] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:53.236997 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:53.337546 25858 raft_consensus.cc:2368] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10.
I20260709 12:20:53.338601 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.232089 25122 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:53.275156 25857 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:53.277897 25093 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:53.303987 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:53.341615 25852 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:53.314790 29057 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:53.343592 29011 consensus_meta.cc:287] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.006s
W20260709 12:20:53.346202 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 97001us
I20260709 12:20:53.346333 25199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "392ec479375b41bbb38793a0c207912d"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:20:53.305362 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:53.346676 29035 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:53.348869 29015 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:53.349035 28979 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:53.106633 28862 raft_consensus.cc:697] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:53.316090 28973 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:53.308218 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:53.265079 28744 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.313120 25860 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:53.332129 25165 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:53.309670 29051 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.261s	user 0.003s	sys 0.006s
I20260709 12:20:53.332592 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:53.333508 25274 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 10: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:53.280475 28956 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:53.307195 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:53.331876 29056 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:53.362212 25271 raft_consensus.cc:2376] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8. Re-sending same reply.
I20260709 12:20:53.351919 25275 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:53.361506 25852 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:20:53.353816 25273 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:53.310777 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 77448.7us
I20260709 12:20:53.349568 28979 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:53.341631 25168 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:53.321641 29054 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:53.359848 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 82038.1us
I20260709 12:20:53.365458 25093 leader_election.cc:400] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10.
I20260709 12:20:53.365926 25093 leader_election.cc:403] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:20:53.350806 28837 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:53.359473 25268 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:53.369385 25852 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:53.360445 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2468) took 1316 ms. Trace:
W20260709 12:20:53.369011 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 52684.1us
I20260709 12:20:53.367229 25093 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:53.367978 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:53.349038 29035 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:53.369992 25118 rpcz_store.cc:276] 0709 12:20:52.044437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.048161 (+  3724us) service_pool.cc:224] Handling call
0709 12:20:52.048458 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:52.233628 (+185170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.233674 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:52.271589 (+ 37915us) log.cc:844] Serialized 26 byte log entry
0709 12:20:52.661415 (+389826us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:52.661455 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.801257 (+139802us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b540009e554. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:52.801302 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:53.354600 (+553298us) raft_consensus.cc:1685] finished
0709 12:20:53.354619 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.360384 (+  5765us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44976,"raft.queue_time_us":45680,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":24679,"spinlock_wait_cycles":321141504,"thread_start_us":212329,"threads_started":1,"wal-append.queue_time_us":471298}
I20260709 12:20:53.374430 28979 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:53.374818 28951 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:53.375835 28979 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:53.377012 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.377239 28951 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:53.378185 29071 log.cc:927] Time spent T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:20:53.379416 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:53.380966 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:53.381631 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:53.383205 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:53.383091 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.381722 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:53.370462 29056 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.382294 28997 raft_consensus.cc:2764] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:20:53.370620 29054 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.382359 25822 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:53.384088 28987 consensus_meta.cc:287] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.701s	user 0.013s	sys 0.000s
I20260709 12:20:53.366052 28803 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:53.407399 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:53.408516 28862 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.384680 29066 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:53.407804 28803 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:53.369625 28837 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:53.372988 28973 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10.
I20260709 12:20:53.410571 28686 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:53.366691 29011 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:53.410778 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:53.430065 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.429916 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.385689 25118 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:53.386670 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:53.431526 25123 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:53.432703 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 50405.4us
I20260709 12:20:53.387099 25193 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:53.413285 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.434520 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.435249 28801 consensus_queue.cc:1059] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:53.435422 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:53.435738 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.436159 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:53.430140 29011 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.392946 28997 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:53.395364 25168 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:53.384055 29057 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:53.434687 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:53.436270 28801 raft_consensus.cc:3055] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:53.391894 29054 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:53.427663 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:53.428248 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:53.466224 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.428376 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:53.467406 25272 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:53.435812 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.468987 25200 raft_consensus.cc:2393] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:53.468806 25118 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:20:53.438843 25274 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:53.434605 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.436796 25270 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:53.384665 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:53.470901 25852 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:53.403368 28744 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:53.426492 28837 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:53.384541 29080 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:53.437080 29011 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:53.439833 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 44585.1us
I20260709 12:20:53.487144 25168 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:53.436913 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.487918 25196 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:53.464685 25267 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:53.441099 25822 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:53.416517 28951 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:20:53.472534 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.489913 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:53.490433 25197 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:53.419523 29066 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.388742 29056 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:53.419711 28803 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:53.483464 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:53.491770 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 50766.8us
I20260709 12:20:53.492301 25193 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:53.465170 28686 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:53.494205 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:53.494504 25123 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:20:53.493868 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:53.494529 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.495388 25269 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:53.465382 29015 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:53.494791 25201 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:20:53.437469 28997 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.496635 25852 raft_consensus.cc:2410] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:53.496843 25196 raft_consensus.cc:2393] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:53.496984 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.496941 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:53.500456 25272 raft_consensus.cc:2368] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9.
I20260709 12:20:53.500262 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:53.464176 28801 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:53.463546 29070 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:53.395668 28987 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.501150 25853 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:53.503466 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:53.498972 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.431183 29033 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:20:53.510149 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:53.507958 25193 raft_consensus.cc:2368] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11.
I20260709 12:20:53.508704 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.437469 29069 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:20:53.510237 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.511771 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:53.473709 29057 raft_consensus.cc:697] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:53.515153 29057 consensus_queue.cc:237] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:53.437974 29017 consensus_queue.cc:1059] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:20:53.518961 29017 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:53.499821 29052 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:53.519444 29017 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:53.519861 29052 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:53.520280 29052 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.520462 29017 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.493726 28830 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:53.528213 28998 consensus_meta.cc:287] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.001s
I20260709 12:20:53.513291 29015 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.529213 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:53.529942 25269 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:53.530786 25274 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:53.480876 29058 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:20:53.465792 28973 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:20:53.498907 28686 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.521829 29017 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:53.543438 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.541769 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.495484 29066 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:53.568943 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2474) took 1503 ms. Trace:
I20260709 12:20:53.561842 25822 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:53.569523 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:53.574550 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 78592.6us
I20260709 12:20:53.574301 25126 rpcz_store.cc:276] 0709 12:20:52.065901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.857518 (+791617us) service_pool.cc:224] Handling call
0709 12:20:52.857784 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.896869 (+ 39085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.568690 (+671821us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b54000f2654. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:53.568883 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15561472}
I20260709 12:20:53.505388 28997 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:53.504606 29060 raft_consensus.cc:3055] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:53.576090 25193 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:53.584612 25168 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:53.585882 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.481180 29079 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:20:53.536231 29070 raft_consensus.cc:697] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:53.569599 28686 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:53.589177 25168 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:53.594880 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.654177 25825 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:53.655614 25825 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:53.595264 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:53.658529 25165 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:53.658641 25276 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:53.660015 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:53.660769 25276 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:53.541946 29064 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:53.562793 28998 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:53.490052 29080 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.597501 28830 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:53.602794 29082 log.cc:927] Time spent T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:20:53.605665 25090 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:53.614449 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 176642us
I20260709 12:20:53.665462 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.724315 25276 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:20:53.756000 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:53.756335 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:53.665617 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 76528.9us
I20260709 12:20:53.666541 25853 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
W20260709 12:20:53.671074 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.662686 25196 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:20:53.757691 25196 pending_rounds.cc:85] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 10
I20260709 12:20:53.692006 28837 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.758090 25196 pending_rounds.cc:107] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:20:53.758369 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:53.759464 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 153938us
I20260709 12:20:53.758395 25196 raft_consensus.cc:2889] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:53.694978 25274 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:53.695138 25165 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:53.661043 25825 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:53.566267 29047 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:53.589279 29086 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:53.698148 28802 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.771432 25242 leader_election.cc:400] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11.
I20260709 12:20:53.771781 25242 leader_election.cc:403] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:53.772174 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 111168us
I20260709 12:20:53.772944 25825 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:53.699222 25201 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:53.759562 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.585767 29060 raft_consensus.cc:740] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:53.593973 28804 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.128s
I20260709 12:20:53.764304 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.809634 25197 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:53.764645 25200 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:53.766739 29069 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:53.817919 29069 raft_consensus.cc:697] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:53.767351 28932 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:53.768241 28837 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:53.774130 25199 raft_consensus.cc:606] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:20:53.665819 29056 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:20:53.806912 25242 leader_election.cc:336] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.918s (SENT)
I20260709 12:20:53.808969 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:53.811060 29013 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:20:53.759366 29081 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:53.813848 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:53.609375 28801 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.833293 25193 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:53.715446 28951 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:53.820564 25201 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:53.819543 25199 raft_consensus.cc:614] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:53.821593 25242 leader_election.cc:336] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.941s (SENT)
I20260709 12:20:53.838619 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:53.772475 29086 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.762081 29085 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:20:53.812731 29087 log.cc:927] Time spent T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:20:53.796981 29054 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:53.842895 25270 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:53.865630 25272 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:53.842486 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:53.866422 25267 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:20:53.823076 28987 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:53.820149 29056 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:53.852412 29011 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:53.854120 29084 log.cc:927] Time spent T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:20:53.855412 28998 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:53.803246 28802 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.858507 29070 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.859722 29047 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:53.817989 29083 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:20:53.717891 28744 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.862385 28830 raft_consensus.cc:697] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:53.863354 28951 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:53.846856 28932 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:53.886334 29011 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:53.870651 29058 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11.
I20260709 12:20:53.843688 29086 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:53.819060 29069 consensus_queue.cc:237] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:53.921813 29080 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:53.927893 29052 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.929723 29066 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:54.008793 29052 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:53.903834 28744 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:54.012496 28979 consensus_meta.cc:287] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.636s	user 0.012s	sys 0.000s
W20260709 12:20:53.964795 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.966214 25119 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:53.964795 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:53.800987 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 43855.2us
I20260709 12:20:53.977553 25195 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:54.021082 29047 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.811583 25196 raft_consensus.cc:2376] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8. Re-sending same reply.
I20260709 12:20:53.978868 25201 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:53.979851 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 284618us
W20260709 12:20:53.980839 25242 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.520s (SENT) [suppressed 90 similar messages]
I20260709 12:20:54.025926 29081 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.026343 28998 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:54.026855 29081 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:53.866520 25274 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:54.032214 25165 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:54.031816 28830 consensus_queue.cc:237] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:53.984612 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 211560us
I20260709 12:20:53.985436 25270 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:54.039211 25825 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:54.038956 28951 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:53.985571 25853 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:54.043198 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:53.927860 29086 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.044101 28744 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:54.009189 28983 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:54.064610 25853 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:20:54.062565 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 81647.9us
I20260709 12:20:54.062614 29066 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:54.067842 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:54.074440 25090 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:54.066087 28983 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:54.068310 29052 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:54.045568 29047 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.094182 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:54.099036 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 67084.2us
I20260709 12:20:54.103273 29081 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:54.104176 28955 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:54.115873 25122 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:54.116755 25125 pending_rounds.cc:85] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 7
I20260709 12:20:54.106057 29086 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:54.110132 25855 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:54.120518 28955 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:54.128600 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 44226.4us
I20260709 12:20:54.134895 28956 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:54.126122 25125 pending_rounds.cc:107] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:20:54.117839 28998 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:54.138365 25859 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:54.117393 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:54.117547 28802 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:54.146292 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:54.147373 25118 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:54.115561 28983 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:54.150050 28985 raft_consensus.cc:3055] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:54.150549 28985 raft_consensus.cc:740] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:54.151214 28955 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:54.151871 28985 consensus_queue.cc:260] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.153007 28955 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:54.153514 28985 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:54.146333 29069 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:54.137718 25274 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:20:54.138106 25165 leader_election.cc:400] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9.
W20260709 12:20:54.155505 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 116637us
I20260709 12:20:54.159179 25165 leader_election.cc:403] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:54.162142 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:54.163074 28862 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:54.163774 28862 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.168045 29069 raft_consensus.cc:697] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:54.169267 29069 consensus_queue.cc:237] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:54.171057 25199 raft_consensus.cc:1240] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:54.171773 25825 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:54.173121 29090 log.cc:927] Time spent T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.362s	user 0.002s	sys 0.001s
I20260709 12:20:54.174016 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:54.174353 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:54.174719 25201 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:54.175282 25195 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:54.179028 25196 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:54.180055 29086 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:54.180531 29086 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:54.173663 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:54.173244 25198 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:54.138672 25125 raft_consensus.cc:2889] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:54.188397 28956 consensus_queue.cc:1059] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:54.190016 28956 raft_consensus.cc:3055] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:54.190431 28956 raft_consensus.cc:740] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:54.190878 29103 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.191648 29103 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.192137 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:54.193475 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:54.193792 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:54.194216 25273 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:54.194757 25276 raft_consensus.cc:2368] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
I20260709 12:20:54.197564 25271 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:54.201997 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2488) took 1958 ms. Trace:
W20260709 12:20:54.202266 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 63084.5us
I20260709 12:20:54.202502 25119 rpcz_store.cc:276] 0709 12:20:52.243290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.884385 (+641095us) service_pool.cc:224] Handling call
0709 12:20:52.884688 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.065347 (+1180659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.201633 (+136286us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400453b54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:54.201875 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485615872}
I20260709 12:20:54.207408 29041 consensus_queue.cc:260] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.208653 29047 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:54.209029 29041 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:54.181007 29086 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:54.215637 29060 consensus_queue.cc:260] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:54.210551 29078 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.913s	user 0.007s	sys 0.009s
I20260709 12:20:54.247808 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:54.230276 25090 leader_election.cc:400] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
I20260709 12:20:54.248378 25194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2343) took 1798 ms. Trace:
I20260709 12:20:54.248605 25090 leader_election.cc:403] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:20:54.248826 25194 rpcz_store.cc:276] 0709 12:20:52.449760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.449952 (+   192us) service_pool.cc:224] Handling call
0709 12:20:52.505610 (+ 55658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:53.432779 (+927169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.432822 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:53.432877 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:53.432928 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.247834 (+814906us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b5400360e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:54.247912 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.248169 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2131653504}
I20260709 12:20:54.249742 28979 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:54.239218 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:54.243417 25241 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:54.244458 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:54.245519 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:54.246474 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:54.216933 29060 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:54.255741 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 82297.5us
I20260709 12:20:54.182904 28983 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:54.271778 29080 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:54.272210 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 135058us
I20260709 12:20:54.273247 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:54.274242 25272 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:54.275990 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.276862 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:54.277580 25856 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:20:54.278326 25860 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:54.279557 28977 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:54.282388 25858 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:54.210453 28956 consensus_queue.cc:260] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:54.218369 28862 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:54.284080 28956 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:54.292145 25273 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
W20260709 12:20:54.296237 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:54.298262 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 55066.4us
I20260709 12:20:54.299889 25241 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:54.301281 25241 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:54.302094 25275 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:20:54.284600 29103 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:54.333086 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:20:54.338246 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 47507.6us
W20260709 12:20:54.343365 28997 consensus_meta.cc:287] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.011s
I20260709 12:20:54.343966 28997 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:54.345108 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.302129 28998 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9.
W20260709 12:20:54.347967 29017 consensus_meta.cc:287] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.768s	user 0.009s	sys 0.009s
I20260709 12:20:54.350347 25272 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
W20260709 12:20:54.348917 25242 leader_election.cc:336] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 2.023s (SENT)
I20260709 12:20:54.355264 25123 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:54.331300 28830 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:20:54.363299 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 50314.8us
W20260709 12:20:54.364575 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.368208 25127 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:54.348563 28744 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:54.369414 28744 raft_consensus.cc:697] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:54.370234 29065 consensus_queue.cc:1059] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:20:54.371587 28744 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.372547 28802 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:54.373338 28802 raft_consensus.cc:697] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:54.374814 28802 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:54.379735 28686 consensus_meta.cc:287] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.687s	user 0.014s	sys 0.003s
I20260709 12:20:54.380205 28686 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:54.382181 28905 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:54.382799 28905 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:54.383894 28905 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:54.388113 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 54001.3us
I20260709 12:20:54.388186 25201 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:54.398845 25118 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
W20260709 12:20:54.410871 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 137768us
I20260709 12:20:54.418265 29037 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 12:20:54.419977 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 54233.3us
W20260709 12:20:54.420783 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.422876 25168 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:20:54.424327 29111 log.cc:927] Time spent T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:20:54.426349 29034 raft_consensus.cc:2243] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.428261 29034 raft_consensus.cc:2272] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.438308 25241 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:54.439574 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 77474.9us
I20260709 12:20:54.441310 25825 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:54.446542 25202 raft_consensus.cc:2368] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11.
I20260709 12:20:54.451304 28845 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:20:54.454128 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:54.454793 25124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2505) took 1844 ms (client timeout 2072 ms). Trace:
W20260709 12:20:54.455363 25124 rpcz_store.cc:269] 0709 12:20:52.610580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.802895 (+192315us) service_pool.cc:224] Handling call
0709 12:20:54.454340 (+1651445us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54003d5254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:54.454548 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964225408}
I20260709 12:20:54.457012 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:54.457729 25126 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:54.458907 28851 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:54.459414 28851 raft_consensus.cc:697] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:54.460448 28851 consensus_queue.cc:237] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:54.407560 28686 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:54.416183 28997 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:54.464411 28827 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:54.465047 28827 raft_consensus.cc:697] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:54.473073 28801 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:54.473567 25241 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:54.474459 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 134426us
I20260709 12:20:54.474596 29017 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:54.475163 29017 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.475538 29017 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:54.476917 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 51173.5us
W20260709 12:20:54.477720 25242 leader_election.cc:336] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.631s (SENT)
I20260709 12:20:54.485540 28932 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:54.483433 29017 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.493125 28827 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.484933 28979 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
I20260709 12:20:54.485954 29052 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:54.415313 29065 consensus_queue.cc:1243] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:20:54.483376 29086 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:54.484421 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.479480 25200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 736) took 1052 ms. Trace:
I20260709 12:20:54.490929 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:54.583642 25853 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:20:54.584161 29086 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:54.481261 25090 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:54.585688 28985 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:54.518988 28803 consensus_meta.cc:287] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 1.013s	user 0.012s	sys 0.008s
I20260709 12:20:54.586247 28985 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.586663 28985 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:54.586499 28803 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.589121 28803 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:54.550698 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.548508 29097 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:54.554265 25822 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:54.557058 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 115912us
I20260709 12:20:54.564586 25126 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:20:54.574978 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:54.583292 25200 rpcz_store.cc:276] 0709 12:20:53.427252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.484068 (+ 56816us) service_pool.cc:224] Handling call
0709 12:20:54.479092 (+995024us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54004132d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:54.479251 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608028544}
I20260709 12:20:54.478313 25167 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:54.482827 25202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 727) took 1070 ms. Trace:
W20260709 12:20:54.585599 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 104414us
I20260709 12:20:54.551291 25123 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:54.599334 25202 rpcz_store.cc:276] 0709 12:20:53.412332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.412475 (+   143us) service_pool.cc:224] Handling call
0709 12:20:54.482592 (+1070117us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54002db254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:54.482754 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113700224}
W20260709 12:20:54.602813 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 124568us
W20260709 12:20:54.602903 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 48864.7us
I20260709 12:20:54.605551 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:54.608750 25118 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:54.610751 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:54.611265 25090 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:54.613345 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:54.596031 29097 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:54.619715 25168 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:54.590590 29034 ts_tablet_manager.cc:1916] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:54.610819 29065 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:54.623463 25119 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:20:54.626515 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:54.622716 28803 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:54.620270 29097 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:54.635170 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 157512us
W20260709 12:20:54.635639 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 44440.8us
I20260709 12:20:54.636826 29035 raft_consensus.cc:3055] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:54.624963 29065 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.643203 25851 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:54.643608 29017 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:54.643990 25857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.038s	sys 0.066s
I20260709 12:20:54.643986 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:54.646276 28985 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.653782 25860 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:54.665191 25852 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:54.656777 25125 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:54.650796 25123 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:20:54.664685 25857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.038s	sys 0.066s
I20260709 12:20:54.649886 29103 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.655536 28955 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:20:54.675359 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 46799.9us
I20260709 12:20:54.662238 29065 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:54.655615 29035 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:54.683027 29037 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:54.667201 28951 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:54.663534 28803 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:54.705880 25093 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:54.696358 25118 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:20:54.700942 29035 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:54.719981 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.720647 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:54.712074 28956 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:54.722765 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:54.723337 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.722643 28803 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:54.723733 25825 connection.cc:256] RPC call timeout handler was delayed by -1.0533542660000421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
I20260709 12:20:54.722604 28956 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:54.724449 25825 connection.cc:256] RPC call timeout handler was delayed by -1.0299542660000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 12:20:54.679821 29103 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.726562 28956 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:54.727246 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 1.34012e+06us
I20260709 12:20:54.729537 29103 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:54.731637 25242 leader_election.cc:336] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.663s (SENT)
I20260709 12:20:54.733279 25853 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:20:54.733357 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1029) took 1419 ms. Trace:
I20260709 12:20:54.702296 28955 raft_consensus.cc:697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:54.745991 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:54.720719 29070 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:54.720669 29089 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:54.750324 25272 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:20:54.748001 28985 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:54.779731 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 54718.5us
I20260709 12:20:54.751893 28956 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:54.754683 29035 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:54.781950 25241 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:54.781947 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 69181.6us
W20260709 12:20:54.784955 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 45880.2us
I20260709 12:20:54.757248 29070 raft_consensus.cc:697] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:54.828986 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:20:54.819587 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 128249us
I20260709 12:20:54.830634 25853 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:54.792729 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:54.827209 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 123334us
I20260709 12:20:54.733970 25857 rpcz_store.cc:276] 0709 12:20:53.314308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.875123 (+560815us) service_pool.cc:224] Handling call
0709 12:20:53.899551 (+ 24428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:53.899816 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:54.087142 (+187326us) log.cc:844] Serialized 14 byte log entry
0709 12:20:54.673698 (+586556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:54.673765 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:54.695468 (+ 21703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.704665 (+  9197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.733279 (+ 28614us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":100718,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":69,"raft.queue_time_us":4870,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":17314,"thread_start_us":663549,"threads_started":2,"wal-append.queue_time_us":624874}
I20260709 12:20:54.828774 25090 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:54.759845 29089 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:54.833671 25851 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:54.828197 28827 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:54.847963 25242 leader_election.cc:336] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.793s (SENT)
I20260709 12:20:54.831781 28744 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.826543 29069 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:54.837815 28956 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:20:54.844419 28985 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:54.781666 28951 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:54.861155 25241 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:54.874197 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:54.871022 25852 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:20:54.902602 25860 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:20:54.907780 25852 pending_rounds.cc:85] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 5
I20260709 12:20:54.908088 25852 pending_rounds.cc:107] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:20:54.908331 25852 raft_consensus.cc:2889] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:54.873234 25267 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:54.866973 25858 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:54.858626 28827 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:54.911468 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 64157.1us
W20260709 12:20:54.912511 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 50876.9us
I20260709 12:20:54.886660 25276 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:20:54.864658 29116 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:20:54.870721 29119 log.cc:927] Time spent T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:20:54.904933 28985 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:54.922411 29118 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:20:54.922250 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 70866.2us
I20260709 12:20:54.923177 29037 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:20:54.926138 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 78217us
I20260709 12:20:54.915135 29041 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:54.915130 28827 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:54.862351 29060 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:20:54.933109 25167 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:54.930962 28985 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:54.937826 28951 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:54.942484 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:54.861410 28744 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.945708 25274 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:20:54.954113 28979 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.962671 28979 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:54.966436 25852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:54.967271 25852 raft_consensus.cc:606] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:20:54.967707 25852 raft_consensus.cc:614] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:54.933990 29041 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.968895 29041 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:54.971105 25858 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:54.972396 29127 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:54.973021 29127 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.974159 28983 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:54.875834 28955 consensus_queue.cc:237] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:54.979496 29065 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.961615 29086 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.982803 29086 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.985625 29086 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:54.981632 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:54.987044 25274 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:20:54.958755 25165 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:54.987759 29097 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:54.888859 29069 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:54.991766 29069 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:54.992260 29037 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:54.993302 29037 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:54.995314 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:54.996523 28979 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:54.997572 25859 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:55.000250 29066 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:55.001713 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.002171 29066 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:54.994401 29041 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.002381 25202 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
W20260709 12:20:54.944756 29124 log.cc:927] Time spent T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:20:55.011994 29041 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:54.943223 28985 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:55.019611 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:55.020366 25274 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:54.945286 28744 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:55.041338 25242 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.876s (SENT)
W20260709 12:20:55.045125 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 86463.6us
W20260709 12:20:55.052040 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 90066.3us
I20260709 12:20:55.053194 28997 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:55.054108 29097 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:55.054630 28997 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:55.055176 29081 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:55.058629 29066 consensus_queue.cc:1059] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:55.059855 29066 raft_consensus.cc:3055] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:55.060277 29066 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:55.061311 29066 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:55.029299 28983 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:55.077603 25200 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:55.069481 25853 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:20:55.062166 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:54.944377 29138 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 12:20:55.087381 25123 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:55.088737 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:55.043046 28956 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:55.089865 25273 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:55.092162 25274 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
W20260709 12:20:55.092739 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 58197.5us
I20260709 12:20:55.100016 25267 raft_consensus.cc:2368] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12.
I20260709 12:20:55.046602 28977 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.045466 28830 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:55.105930 25272 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.071480 28985 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:55.079792 29139 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.122803 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:55.144042 25242 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.876s (SENT)
W20260709 12:20:55.165776 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 60530.4us
I20260709 12:20:55.167570 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:55.168278 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 225860us
I20260709 12:20:55.144833 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:55.078500 28979 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:55.174126 25275 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:20:55.165102 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:55.029788 29089 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:55.178356 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:55.179032 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.180226 25118 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:55.180546 28983 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.181429 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:55.189107 25123 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:55.195888 25267 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:20:55.201367 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:55.202587 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 58596.8us
I20260709 12:20:55.176110 29065 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:55.050868 29070 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.216986 25092 leader_election.cc:400] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10.
I20260709 12:20:55.205905 29041 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:55.226336 29066 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.121649 28977 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.191893 29127 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:55.237099 25274 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:20:55.241710 25242 leader_election.cc:336] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.163s (SENT)
I20260709 12:20:55.198273 28979 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:55.254559 25853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:55.253940 25272 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:55.256747 25853 raft_consensus.cc:606] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:20:55.257202 25853 raft_consensus.cc:614] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:55.260923 29127 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:55.199908 29139 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.264462 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:55.266355 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.266909 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.267144 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:55.267729 25202 raft_consensus.cc:2393] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:55.268105 25194 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:55.268721 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:55.269430 25196 raft_consensus.cc:2376] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9. Re-sending same reply.
W20260709 12:20:55.270663 25242 leader_election.cc:336] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 2.163s (SENT)
I20260709 12:20:55.271095 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:55.272274 25242 leader_election.cc:336] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 2.207s (SENT)
I20260709 12:20:55.266474 25193 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:55.275030 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.275370 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:55.275828 25198 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:55.264508 29139 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:55.278668 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.281534 25194 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:55.286291 28827 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.304152 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:55.308840 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.312345 29037 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.312937 29037 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.315773 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:55.316572 25274 raft_consensus.cc:2368] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12.
I20260709 12:20:55.244048 29141 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:20:55.266491 28862 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:55.319948 28862 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.320597 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:55.322398 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:55.329391 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2427) took 1047 ms. Trace:
I20260709 12:20:55.315802 25127 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:55.329845 25268 rpcz_store.cc:276] 0709 12:20:54.282266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.282416 (+   150us) service_pool.cc:224] Handling call
0709 12:20:54.282751 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:54.283162 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.283202 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:54.283807 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 12:20:54.607495 (+323688us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:54.607543 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.609741 (+  2198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:55.328300 (+718559us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b24001e2078. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100ca79c4 00007f2100ca5acb 00007f2100e60dc9 00007f2100e60a55 00007f2100e5ffb0 00007f2103ad6488 00007f2103ad6be8 00007f2103aae398 00007f2103aa976a 00007f2103aa8bb6
0709 12:20:55.329043 (+   743us) raft_consensus.cc:1685] finished
0709 12:20:55.329073 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.329322 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1759,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":39727,"spinlock_wait_cycles":54087552,"thread_start_us":323238,"threads_started":1,"wal-append.queue_time_us":462127}
I20260709 12:20:55.339200 28979 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:55.340544 25126 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:55.346837 25275 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:55.349234 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.267100 25118 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
W20260709 12:20:55.333935 29136 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:20:55.358286 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.361012 25201 raft_consensus.cc:2410] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:20:55.364471 25855 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:55.359262 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:55.371881 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.372910 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.315019 29037 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:55.379928 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:55.382123 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:55.375702 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:55.346267 29103 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.384434 25193 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:55.384068 25194 raft_consensus.cc:2368] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9.
I20260709 12:20:55.364619 28851 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:20:55.315016 28977 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:55.391083 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.391737 25199 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:20:55.392175 25860 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:20:55.392495 25855 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:55.392594 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:55.393153 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:55.393714 25860 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:55.395485 29142 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:20:55.396064 29103 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.353863 29052 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:20:55.402395 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.403537 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.403704 25825 leader_election.cc:400] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11.
I20260709 12:20:55.402691 25852 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:55.404088 25825 leader_election.cc:403] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:55.404140 25195 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:20:55.405113 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.406323 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:55.406843 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.406935 25857 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:55.407473 25194 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
I20260709 12:20:55.408007 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:55.408025 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:55.408479 25194 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:55.408993 25852 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
W20260709 12:20:55.409183 29140 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.325s	user 0.002s	sys 0.000s
I20260709 12:20:55.409729 25194 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:55.411648 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.393648 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:55.411214 25860 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:55.407936 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.416898 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.416939 25193 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:20:55.418691 25198 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:20:55.413162 25199 raft_consensus.cc:2376] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5. Re-sending same reply.
I20260709 12:20:55.452869 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:55.381516 28862 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:55.459295 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.467640 25126 raft_consensus.cc:2368] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11.
I20260709 12:20:55.459594 28827 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:55.459764 25276 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
W20260709 12:20:55.464134 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 50422us
I20260709 12:20:55.460719 25200 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
W20260709 12:20:55.469492 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 89795.4us
I20260709 12:20:55.367872 29097 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:20:55.455435 25167 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:55.474782 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:55.479601 25202 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:20:55.378149 29065 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:20:55.481349 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.425112 29103 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:55.484879 25195 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:20:55.441905 29052 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11.
I20260709 12:20:55.483947 25193 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:20:55.482661 25090 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:55.483793 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.457260 28977 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.496623 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:55.502688 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 56577.7us
W20260709 12:20:55.474488 29146 log.cc:927] Time spent T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:20:55.505264 25090 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:55.506505 25168 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:55.516801 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.517503 25090 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:55.517518 25200 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:55.482988 28801 raft_consensus.cc:2764] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:20:55.524802 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.527282 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.527419 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.457597 29037 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:20:55.475016 28979 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:20:55.537782 25195 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:55.544622 25272 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:20:55.520481 29139 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:55.523180 28985 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:55.540778 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:55.544258 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:55.525422 28845 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:55.484687 29141 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:20:55.568073 25193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c305b34a0c54275af750c832f52691f"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:20:55.554944 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.556434 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:55.558842 25200 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:55.557730 25121 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:55.529920 29138 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:55.565565 25198 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:55.575801 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.577396 25267 raft_consensus.cc:3055] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:55.577858 25267 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:55.571225 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:55.568866 25193 raft_consensus.cc:606] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:55.581982 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 232460us
I20260709 12:20:55.594926 25123 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:55.549418 29139 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.528154 28977 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.569278 28845 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:55.561689 29088 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:55.598580 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.574280 29138 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:55.611387 29150 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:20:55.622134 29062 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 12:20:55.626381 25197 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:20:55.629220 29149 log.cc:927] Time spent T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:55.634742 28977 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:55.635465 25267 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:55.636500 25267 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:55.598500 25271 raft_consensus.cc:1240] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:55.604133 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:55.622589 29148 log.cc:927] Time spent T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:20:55.642725 25200 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:20:55.655287 25855 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:55.599563 29139 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:55.655210 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 52408.4us
I20260709 12:20:55.641935 29138 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.601709 28845 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.674707 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.675057 25165 leader_election.cc:400] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12.
I20260709 12:20:55.695981 25165 leader_election.cc:403] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:20:55.599785 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:55.697257 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 101811us
I20260709 12:20:55.699194 25242 leader_election.cc:400] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9.
I20260709 12:20:55.700500 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:55.701508 28932 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:55.701925 28932 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:55.702332 28932 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:55.703867 29088 consensus_queue.cc:1059] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:55.705349 29088 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:55.706250 29161 raft_consensus.cc:3055] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:55.706784 29161 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:55.707885 29161 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.709510 29161 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:55.710465 28932 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.705791 29088 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:55.712646 28932 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:55.712939 29088 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:55.724198 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:55.727752 25124 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:55.732918 25127 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:55.674160 28977 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:55.737718 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.671854 29035 consensus_queue.cc:1059] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:20:55.756958 29035 raft_consensus.cc:3055] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:55.757368 29035 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:55.758298 29035 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.759639 29035 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.766278 29160 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:55.740833 28997 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:20:55.745224 29152 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:20:55.730314 28985 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:55.745586 29147 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.739511 28983 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12.
W20260709 12:20:55.777161 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 103658us
I20260709 12:20:55.782434 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:55.780767 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 44052.1us
I20260709 12:20:55.778256 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.765785 29034 ts_tablet_manager.cc:1929] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:20:55.785562 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:55.780241 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:55.787142 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:55.791368 25273 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:55.793572 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:55.796396 25271 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:55.799306 25165 leader_election.cc:400] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12.
I20260709 12:20:55.799703 25165 leader_election.cc:403] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:20:55.800603 25119 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:55.744069 28977 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:55.802045 29063 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:55.810320 28985 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:55.836298 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:55.838553 29162 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:55.839293 28845 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.841341 28845 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:55.841745 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.842491 25123 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:55.835155 25267 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:20:55.791168 29147 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.843745 25272 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:55.810354 29164 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.822479 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.844873 29147 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:55.845408 25121 raft_consensus.cc:2410] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:20:55.844995 29164 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:55.822379 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:55.846343 25124 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.848551 29139 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:55.823267 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:55.793431 29034 log.cc:1199] T 9c305b34a0c54275af750c832f52691f P 897be935c42e41b995f177155b042be0: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/wals/9c305b34a0c54275af750c832f52691f
I20260709 12:20:55.823809 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.824559 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.825100 28977 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:55.860296 25126 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:55.860754 25124 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:55.826413 29065 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:55.862227 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 63052.3us
I20260709 12:20:55.814482 28983 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:20:55.846357 28997 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:55.867934 28997 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:55.870609 29034 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41024 (request call id 105) took 3837 ms. Trace:
I20260709 12:20:55.872560 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:55.874958 29037 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:55.880919 29065 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.843029 29127 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:55.823154 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.851274 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.850935 25267 pending_rounds.cc:85] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 4
I20260709 12:20:55.825380 29070 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:55.862198 25856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40270
I20260709 12:20:55.829212 28830 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.864156 25242 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:55.861757 29088 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.895963 25272 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:20:55.908732 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:20:55.910655 25267 pending_rounds.cc:107] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:20:55.910727 25825 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:55.915189 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.914772 29138 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.915881 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:55.927716 25854 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.910295 25856 raft_consensus.cc:606] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:55.922644 25267 raft_consensus.cc:2889] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:55.924160 25127 raft_consensus.cc:2393] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:55.918927 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.939262 25090 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:55.940209 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.909348 29139 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:55.941047 25127 raft_consensus.cc:2393] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:55.979313 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:55.947605 25120 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:55.946449 25121 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:20:55.997277 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.986840 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:56.014091 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 48058.8us
W20260709 12:20:55.976428 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 472154us
W20260709 12:20:55.968999 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 60360.4us
I20260709 12:20:55.986295 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.987056 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:55.987085 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 172489us
W20260709 12:20:55.946318 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 82394.6us
I20260709 12:20:56.000242 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:55.941059 25119 raft_consensus.cc:2368] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12.
I20260709 12:20:55.969151 25271 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:56.029994 25272 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:55.998936 25241 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:56.000159 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:55.934356 25860 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:56.035035 25274 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.871058 29034 rpcz_store.cc:276] 0709 12:20:52.029043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.042242 (+ 13199us) service_pool.cc:224] Handling call
0709 12:20:52.258551 (+216309us) ts_tablet_manager.cc:1151] Deleting tablet 9c305b34a0c54275af750c832f52691f
0709 12:20:52.307858 (+ 49307us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:20:55.583351 (+3275493us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:55.765638 (+182287us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:55.865900 (+100262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1262000,"tablet-delete.queue_time_us":143969,"thread_start_us":47035,"threads_started":1}
I20260709 12:20:56.033728 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:56.033566 25118 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:55.946288 25125 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:56.040143 25854 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:20:56.032172 25124 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:56.071180 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:55.929348 28830 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:56.091890 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:56.092185 28830 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:56.092660 25121 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:20:56.093015 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:56.093734 25125 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:20:56.094820 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:56.095585 25125 raft_consensus.cc:2368] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12.
I20260709 12:20:56.096426 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:56.097347 25125 raft_consensus.cc:2410] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:20:56.071921 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:56.093720 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:56.098222 25121 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:56.073477 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:56.099450 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 122992us
I20260709 12:20:56.100637 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:56.101490 25272 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:20:56.097934 25127 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
W20260709 12:20:56.102906 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 70753.2us
I20260709 12:20:56.103042 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:56.089973 25270 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
W20260709 12:20:56.104003 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 70338.3us
I20260709 12:20:56.103580 25119 raft_consensus.cc:2376] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8. Re-sending same reply.
I20260709 12:20:56.109596 28801 consensus_queue.cc:1059] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:55.929363 29127 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:56.110868 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:55.988099 29164 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:55.995270 29088 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:55.946396 28977 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:56.178328 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:56.179474 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 65313.6us
I20260709 12:20:55.946720 29063 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:56.112269 25125 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:20:56.112677 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:56.186268 25124 raft_consensus.cc:2368] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11.
I20260709 12:20:55.998744 29161 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.167s
I20260709 12:20:55.926865 29070 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:55.989462 29037 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12.
I20260709 12:20:55.938709 29147 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:55.947407 29041 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:56.113235 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 54250.8us
I20260709 12:20:55.945822 28997 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:56.191323 25119 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:56.189458 28830 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:56.196462 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 91613.3us
I20260709 12:20:56.220922 25165 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:56.142454 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 107383us
I20260709 12:20:56.113533 28827 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:56.110342 28932 consensus_queue.cc:1059] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.102s
W20260709 12:20:56.212960 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.209060 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:56.214527 25126 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:55.997336 29138 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:56.216225 25242 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:56.113442 29169 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 12:20:56.231050 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:56.231530 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.232460 25267 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:56.220357 28977 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.211939 29063 raft_consensus.cc:697] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:56.259841 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:56.269846 25274 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:56.312726 29097 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:20:56.322592 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.337366 25118 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:56.339555 25121 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:20:56.352473 29080 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:56.353133 29080 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:56.355867 29080 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:56.364117 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:56.368525 25271 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:56.372829 25274 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:56.375603 25271 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:56.401865 25271 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:56.402642 25271 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:56.404769 25271 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:56.415772 29062 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:56.427736 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:56.428606 25269 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:56.432713 25194 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
W20260709 12:20:56.434942 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 322060us
I20260709 12:20:56.439839 25167 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:56.228511 29081 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:56.408166 25271 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:56.258612 28955 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:56.251525 28845 consensus_queue.cc:1059] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.218s
I20260709 12:20:56.267591 28977 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:56.258100 29060 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.195s
I20260709 12:20:56.450451 28803 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:56.231858 28827 raft_consensus.cc:697] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:56.468755 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:56.442049 29138 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:56.500185 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.464112 28932 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:20:56.514807 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 292874us
I20260709 12:20:56.530717 25090 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:56.531975 25090 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:20:56.453260 28955 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:56.540421 25825 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:56.470767 29065 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:56.501796 29164 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:56.522243 29171 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:56.455804 29088 consensus_queue.cc:1059] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:20:56.502393 29080 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.552220 29080 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:56.559613 29177 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:20:56.560691 28827 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:56.472335 29035 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:20:56.618683 29041 raft_consensus.cc:3055] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:56.619203 29041 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:56.570695 29164 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:56.542991 28956 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:56.622900 28956 raft_consensus.cc:697] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:20:56.624109 28956 consensus_queue.cc:237] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:56.626399 29127 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:56.627204 29127 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:56.627712 29127 raft_consensus.cc:697] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:56.628871 29127 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:56.570503 29063 consensus_queue.cc:237] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:56.572468 28830 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:56.642792 28830 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:56.590732 29172 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 12:20:56.598011 29070 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:56.599166 28997 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:56.611768 29097 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:56.661180 29097 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:56.661679 29081 raft_consensus.cc:3055] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:56.662096 29081 raft_consensus.cc:740] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:56.662948 29081 consensus_queue.cc:260] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:56.663616 29097 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:56.613739 28744 raft_consensus.cc:3055] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:56.664394 29081 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.664443 28744 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:56.664837 28830 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:56.651005 29080 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:56.543484 28845 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:20:56.538427 29069 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:56.667219 29069 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.667589 29069 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:56.665455 28744 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:56.671712 28744 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:56.546888 28955 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:56.686656 29176 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.235s	user 0.000s	sys 0.004s
I20260709 12:20:56.690932 29041 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:56.715216 29180 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.715966 29180 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:56.718735 29180 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:56.720021 25276 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.008s	sys 0.024s
W20260709 12:20:56.720618 25276 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.008s	sys 0.024s
W20260709 12:20:56.723537 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 517636us
I20260709 12:20:56.724671 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:56.725653 28932 raft_consensus.cc:2764] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:20:56.726408 28932 consensus_queue.cc:1059] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:56.727237 28932 raft_consensus.cc:3055] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:56.727592 28932 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:56.728440 28932 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:56.735416 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:20:56.735492 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.737680 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:56.742743 25269 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:56.738101 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:56.730016 28932 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:56.746682 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:56.756513 29180 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:56.758944 29180 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:56.761121 29180 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:56.763113 25165 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:56.765007 29180 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:56.765453 29180 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.765872 29180 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:56.779640 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:56.781287 28801 raft_consensus.cc:2764] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:20:56.782186 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.695192 29080 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:56.702580 28862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.058s	sys 0.078s
I20260709 12:20:56.782639 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:20:56.799531 25241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.021s	sys 0.079s
W20260709 12:20:56.813011 25241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.021s	sys 0.079s
W20260709 12:20:56.813478 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 703688us
I20260709 12:20:56.815019 25271 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:20:56.816009 25271 pending_rounds.cc:85] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 6
I20260709 12:20:56.822163 29164 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:56.815001 28862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.058s	sys 0.079s
I20260709 12:20:56.828178 25271 pending_rounds.cc:107] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:20:56.828919 25271 raft_consensus.cc:2889] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:56.830344 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 293613us
W20260709 12:20:56.872195 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 477553us
I20260709 12:20:56.800256 29069 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:56.870867 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 397855us
W20260709 12:20:56.876654 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.873899 25241 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:56.837515 28827 raft_consensus.cc:2764] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:20:56.894920 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.900555 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:56.904476 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:56.825500 29080 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:56.902372 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:56.914625 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 132148us
I20260709 12:20:56.910089 25193 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:20:56.919831 25241 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:56.858156 28845 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.926625 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:56.949851 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:56.950603 25193 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:56.907262 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:56.946807 29097 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.871502 29164 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:56.965447 25858 raft_consensus.cc:2393] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:20:56.973634 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:56.975662 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:56.976388 25201 raft_consensus.cc:2393] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:56.869593 28801 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 12:20:56.985183 25195 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:20:56.987809 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 68106us
I20260709 12:20:56.881843 29188 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.121s
I20260709 12:20:56.948089 29186 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:56.978889 29143 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:20:56.977141 28803 raft_consensus.cc:697] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:57.009440 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 265888us
I20260709 12:20:56.981419 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:57.012219 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:57.017970 25201 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:56.976895 29185 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:57.023357 25825 leader_election.cc:336] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.504s (SENT)
I20260709 12:20:57.091712 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:57.035861 25193 raft_consensus.cc:2410] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:20:56.912464 29187 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 12:20:56.963001 29097 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:56.971673 28845 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:57.096038 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 86434.4us
W20260709 12:20:57.089469 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 76674.3us
I20260709 12:20:57.006117 28827 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:57.116557 25193 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:57.139175 29160 raft_consensus.cc:3055] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:57.139858 29160 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:57.155680 29041 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:57.160765 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 149577us
I20260709 12:20:57.161296 29138 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:20:57.162357 29181 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.293s	user 0.005s	sys 0.010s
I20260709 12:20:57.165407 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:57.166018 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:57.167342 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:57.166097 25198 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:20:57.168520 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2039) took 1061 ms. Trace:
I20260709 12:20:57.168936 25127 rpcz_store.cc:276] 0709 12:20:56.107655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.107818 (+   163us) service_pool.cc:224] Handling call
0709 12:20:56.108229 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:56.177900 (+ 69671us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:56.183873 (+  5973us) log.cc:844] Serialized 14 byte log entry
0709 12:20:56.274137 (+ 90264us) log.cc:844] Serialized 14 byte log entry
0709 12:20:56.434424 (+160287us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:56.449935 (+ 15511us) log.cc:844] Serialized 26 byte log entry
0709 12:20:56.450135 (+   200us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:56.450182 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.450271 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:56.606494 (+156223us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b480033ffd8. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2108e37aa1 00007f2108e2eb37 00007f2108e2e9ca 00007f2108f2626f 00007f2108f25f37 00007f2108f3a55c 00007f2108f3a508 00007f2108f3a488 00007f2108f3a443 00007f2108f396ec 00007f2107e63a96
0709 12:20:56.616396 (+  9902us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b180037cf60. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e21522 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:20:57.161730 (+545334us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:57.168312 (+  6582us) raft_consensus.cc:1685] finished
0709 12:20:57.168333 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.168449 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160054,"prepare.queue_time_us":5910,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":4471,"raft.queue_time_us":387162,"raft.run_cpu_time_us":3104,"raft.run_wall_time_us":189915,"spinlock_wait_cycles":55149312,"thread_start_us":84758,"threads_started":1,"wal-append.queue_time_us":520993}
I20260709 12:20:57.153081 25023 catalog_manager.cc:5697] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.176002 25023 catalog_manager.cc:5697] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 6 to 7, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 7 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.205907 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:57.222568 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.996114 29060 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 12:20:57.084537 29070 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.011967 29200 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:57.084049 29185 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:57.227488 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 128727us
I20260709 12:20:57.011039 28851 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 12:20:57.086889 28997 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:57.006783 29164 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:57.239814 29190 log.cc:927] Time spent T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:20:57.240341 29164 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:57.242671 29183 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 12:20:57.011361 29186 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:57.234534 29179 log.cc:927] Time spent T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
I20260709 12:20:57.231391 28827 raft_consensus.cc:697] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:57.250792 25201 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:20:57.252028 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:57.256472 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:57.248579 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:57.234926 29185 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:57.326001 25093 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:57.328164 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:57.234579 29070 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:57.344702 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:57.245802 28997 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:57.359783 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.326412 29069 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:57.334419 28956 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:20:57.374547 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 385786us
I20260709 12:20:57.313087 29164 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:20:57.244745 29200 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:57.368036 29191 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.439476 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:57.439535 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:57.442842 25193 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
W20260709 12:20:57.444886 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 421543us
I20260709 12:20:57.314407 28803 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:57.408044 28956 raft_consensus.cc:697] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:57.447829 25825 leader_election.cc:336] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.529s (SENT)
W20260709 12:20:57.462842 25090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.000s	sys 0.019s
I20260709 12:20:57.423892 28951 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:57.463416 25090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.000s	sys 0.019s
W20260709 12:20:57.465238 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 931529us
W20260709 12:20:57.459724 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 146170us
W20260709 12:20:57.466483 25242 connection.cc:256] RPC call timeout handler was delayed by -1.661716123999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30160000000000003s for a response
W20260709 12:20:57.467039 25242 connection.cc:256] RPC call timeout handler was delayed by -1.548266945000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 12:20:57.467425 25242 connection.cc:256] RPC call timeout handler was delayed by -1.5325528010000653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 12:20:57.467823 25242 connection.cc:256] RPC call timeout handler was delayed by -1.4758528009999736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260709 12:20:57.468781 25242 connection.cc:256] RPC call timeout handler was delayed by -1.4551528009999402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 12:20:57.472527 29204 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:20:57.479255 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:57.479959 25242 connection.cc:256] RPC call timeout handler was delayed by -1.4506528009999329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 12:20:57.482825 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1722882489998483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 12:20:57.489262 28977 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.011s	user 0.011s	sys 0.001s
I20260709 12:20:57.490720 28977 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:57.491262 28997 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:57.490223 28744 consensus_meta.cc:287] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.002s
I20260709 12:20:57.503790 25201 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:57.422930 28827 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:57.445475 29191 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:57.481284 28845 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:57.496033 25168 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:57.515583 25276 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:57.516131 25168 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:57.473511 28951 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:57.511157 29193 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
W20260709 12:20:57.539899 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 91817.6us
I20260709 12:20:57.522680 29062 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:57.522459 28983 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:57.546715 29202 log.cc:927] Time spent T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
W20260709 12:20:57.547887 29147 consensus_meta.cc:287] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 1.330s	user 0.011s	sys 0.002s
W20260709 12:20:57.563715 29201 log.cc:927] Time spent T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:20:57.570814 29063 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.574072 29147 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:57.575513 28997 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:57.542747 28956 consensus_queue.cc:237] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:57.642900 25825 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.619s (SENT)
I20260709 12:20:57.643554 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:57.645886 25851 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:57.652222 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 757) took 1424 ms. Trace:
I20260709 12:20:57.655264 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:57.655835 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:57.655853 25853 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:57.651707 29192 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 12:20:57.659042 29231 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:20:57.659981 29211 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:20:57.660447 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2043) took 1332 ms. Trace:
I20260709 12:20:57.661522 29220 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:57.662078 29197 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:20:57.660930 25119 rpcz_store.cc:276] 0709 12:20:56.328207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.342708 (+ 14501us) service_pool.cc:224] Handling call
0709 12:20:56.343071 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:56.453623 (+110552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.453672 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:56.505353 (+ 51681us) log.cc:844] Serialized 52 byte log entry
0709 12:20:56.828278 (+322925us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:56.870408 (+ 42130us) log.cc:844] Serialized 14 byte log entry
0709 12:20:56.871069 (+   661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.871142 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.160317 (+289175us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b1800338200. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2107de258f 00007f2100e21571 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd
0709 12:20:57.660126 (+499809us) raft_consensus.cc:1685] finished
0709 12:20:57.660232 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.660380 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103045,"prepare.queue_time_us":40646,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4039,"raft.queue_time_us":121185,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":26684,"spinlock_wait_cycles":72659328,"thread_start_us":249759,"threads_started":1,"wal-append.queue_time_us":465364}
I20260709 12:20:57.672636 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:57.673265 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:57.674374 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1954) took 1268 ms. Trace:
I20260709 12:20:57.674908 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:57.675523 25118 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:57.675832 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2042) took 1567 ms. Trace:
I20260709 12:20:57.674770 25125 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:20:57.676221 25124 rpcz_store.cc:276] 0709 12:20:56.208600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.208984 (+   384us) service_pool.cc:224] Handling call
0709 12:20:56.209398 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:56.258059 (+ 48661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.258095 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:56.268143 (+ 10048us) log.cc:844] Serialized 26 byte log entry
0709 12:20:56.834757 (+566614us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:56.834800 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.834866 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.675636 (+840770us) raft_consensus.cc:1685] finished
0709 12:20:57.675657 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.675776 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27153,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":9234,"thread_start_us":383273,"threads_started":1,"wal-append.queue_time_us":782908}
I20260709 12:20:57.674758 25274 rpcz_store.cc:276] 0709 12:20:56.397350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.397660 (+   310us) service_pool.cc:224] Handling call
0709 12:20:56.398078 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:56.398486 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.398528 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:56.399144 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 12:20:56.839734 (+440590us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:56.888130 (+ 48396us) log.cc:844] Serialized 14 byte log entry
0709 12:20:56.911833 (+ 23703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.911929 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.663283 (+751354us) raft_consensus.cc:1685] finished
0709 12:20:57.663699 (+   416us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.664868 (+  1169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42093,"prepare.queue_time_us":49207,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1075,"raft.queue_time_us":235279,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":17301,"thread_start_us":440142,"threads_started":1,"wal-append.queue_time_us":973533}
W20260709 12:20:57.670271 29225 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:20:57.686548 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:57.594172 29063 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:57.652603 25197 rpcz_store.cc:276] 0709 12:20:56.228223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.228571 (+   348us) service_pool.cc:224] Handling call
0709 12:20:56.259957 (+ 31386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:56.260401 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.260445 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:56.447438 (+186993us) log.cc:844] Serialized 26 byte log entry
0709 12:20:56.867104 (+419666us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:56.910844 (+ 43740us) log.cc:844] Serialized 14 byte log entry
0709 12:20:56.911062 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.911129 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.164030 (+252901us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b18001a9aa0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:20:57.647936 (+483906us) raft_consensus.cc:1685] finished
0709 12:20:57.651998 (+  4062us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.652160 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89202,"prepare.queue_time_us":44449,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":898,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":166877,"spinlock_wait_cycles":79287040,"thread_start_us":395818,"threads_started":1,"wal-append.queue_time_us":637941}
W20260709 12:20:57.690291 29218 log.cc:927] Time spent T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:20:57.690793 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:57.691179 29210 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:20:57.691318 29209 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
W20260709 12:20:57.684185 29212 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 12:20:57.692337 29221 log.cc:927] Time spent T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 12:20:57.695941 29206 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.324s	user 0.003s	sys 0.000s
I20260709 12:20:57.697052 29186 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:57.703943 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:57.797924 29097 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:57.705189 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:57.798907 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1959) took 1062 ms. Trace:
W20260709 12:20:57.710541 29222 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 12:20:57.712829 25025 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41770 (request call id 327) took 31861 ms (client timeout 15000 ms). Trace:
I20260709 12:20:57.799301 25267 rpcz_store.cc:276] 0709 12:20:56.736041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.736160 (+   119us) service_pool.cc:224] Handling call
0709 12:20:56.736502 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:56.736865 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.736892 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:56.737325 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 12:20:57.096216 (+358891us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:57.096256 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.096327 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.695249 (+598922us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:20:57.798628 (+103379us) raft_consensus.cc:1685] finished
0709 12:20:57.798648 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.798849 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1427,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":5776768,"thread_start_us":358519,"threads_started":1,"wal-append.queue_time_us":576331}
I20260709 12:20:57.801363 29200 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:57.715014 25023 catalog_manager.cc:5697] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 5 to 8, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 8 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:57.803104 25023 catalog_manager.cc:5697] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 8 to 11, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 11 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:57.800360 25025 rpcz_store.cc:269] 0709 12:20:25.850851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.851054 (+   203us) service_pool.cc:224] Handling call
0709 12:20:27.627271 (+1776217us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b54002ef754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e78090 00007f2103f16f3a 00007f2109ccce9c 00007f2109dcb04e 00007f210828c2a4 00007f210828c232 00007f210828c161 00007f210828c0dc 00007f210828b392 00007f210224948c 00007f21022488c6
0709 12:20:57.712586 (+30085315us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:53.240791 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:53.241423 (+   632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:53.241456 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:20:53.241473 (+    17us) tablet.cc:662] Decoding operations
0709 12:20:53.243095 (+  1622us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:53.243144 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:53.243172 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:20:53.243977 (+   805us) tablet.cc:701] Row locks acquired
0709 12:20:53.243991 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:20:53.244117 (+   126us) write_op.cc:270] Start()
0709 12:20:53.244210 (+    93us) write_op.cc:276] Timestamp: P: 1783599653244073 usec, L: 0
0709 12:20:53.244226 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:20:53.244795 (+   569us) log.cc:844] Serialized 3996 byte log entry
0709 12:20:54.177780 (+932985us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b1800404aa0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:20:54.581803 (+404023us) op_driver.cc:464] REPLICATION: finished
0709 12:20:54.878576 (+296773us) write_op.cc:301] APPLY: starting
0709 12:20:54.878728 (+   152us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:54.879841 (+  1113us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:54.879888 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:54.881115 (+  1227us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:54.881554 (+   439us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:20:54.881610 (+    56us) write_op.cc:312] APPLY: finished
0709 12:20:54.914548 (+ 32938us) log.cc:844] Serialized 77 byte log entry
0709 12:20:54.914765 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:54.964333 (+ 49568us) write_op.cc:454] Released schema lock
0709 12:20:54.964407 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:54.965004 (+   597us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:54.965040 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":305733,"reported_tablets":44,"spinlock_wait_cycles":4927744,"child_traces":[["op",{"apply.queue_time_us":296382,"apply.run_cpu_time_us":5016,"apply.run_wall_time_us":86389,"num_ops":10,"prepare.queue_time_us":360829,"prepare.run_cpu_time_us":5159,"prepare.run_wall_time_us":62382,"raft.queue_time_us":400500,"raft.run_cpu_time_us":42936,"raft.run_wall_time_us":238623,"replication_time_us":1337327,"spinlock_wait_cycles":25432320,"thread_start_us":653843,"threads_started":4,"wal-append.queue_time_us":74441,"wal-append.run_cpu_time_us":62306,"wal-append.run_wall_time_us":1789468}]]}
I20260709 12:20:57.680696 29220 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:57.596746 28997 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:57.730394 25853 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
W20260709 12:20:57.692137 29217 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:20:57.780408 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:57.811661 28997 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:57.780694 29160 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:57.783115 29070 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:57.783380 29081 consensus_meta.cc:287] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 1.118s	user 0.011s	sys 0.002s
I20260709 12:20:57.793751 29127 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:57.794173 29205 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.782s	user 0.003s	sys 0.001s
W20260709 12:20:57.797596 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.805291 25023 catalog_manager.cc:5697] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 4 to 6, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 6 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:57.713817 28955 consensus_meta.cc:287] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.012s	user 0.011s	sys 0.001s
I20260709 12:20:57.823208 25118 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
W20260709 12:20:57.824074 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 50083.5us
I20260709 12:20:57.774220 25270 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
W20260709 12:20:57.847084 25242 leader_election.cc:336] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.520s (SENT)
W20260709 12:20:57.829999 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 187140us
W20260709 12:20:57.733419 29180 consensus_meta.cc:287] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.967s	user 0.008s	sys 0.005s
I20260709 12:20:57.838335 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 1956) took 1084 ms. Trace:
W20260709 12:20:57.848817 25825 leader_election.cc:336] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.638s (SENT)
I20260709 12:20:57.850886 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:57.687248 29187 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.153s
I20260709 12:20:57.843866 29127 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:57.848443 25276 rpcz_store.cc:276] 0709 12:20:56.731414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.746413 (+ 14999us) service_pool.cc:224] Handling call
0709 12:20:57.809976 (+1063563us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54002bf2d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:57.815951 (+  5975us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766819584}
W20260709 12:20:57.857275 25242 leader_election.cc:336] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.635s (SENT)
W20260709 12:20:57.859112 25242 leader_election.cc:336] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.896s (SENT)
I20260709 12:20:57.811691 29220 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:57.855558 28955 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:57.864296 29080 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:57.865918 25242 leader_election.cc:336] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.016s (SENT)
I20260709 12:20:57.866793 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1964) took 1026 ms. Trace:
I20260709 12:20:57.867157 25271 rpcz_store.cc:276] 0709 12:20:56.840406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.840566 (+   160us) service_pool.cc:224] Handling call
0709 12:20:56.882789 (+ 42223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:56.906264 (+ 23475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.906295 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:56.928530 (+ 22235us) log.cc:844] Serialized 26 byte log entry
0709 12:20:57.223688 (+295158us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:57.223770 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.223910 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.866549 (+642639us) raft_consensus.cc:1685] finished
0709 12:20:57.866593 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.866731 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38938,"raft.queue_time_us":28594,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":41826,"thread_start_us":214850,"threads_started":1,"wal-append.queue_time_us":421670}
I20260709 12:20:57.839507 29169 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:20:57.872822 25023 catalog_manager.cc:5697] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.849556 29219 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:57.877156 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1962) took 1056 ms. Trace:
I20260709 12:20:57.880771 25023 catalog_manager.cc:5697] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 6 to 7, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 7 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.869454 29220 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:57.879900 25268 rpcz_store.cc:276] 0709 12:20:56.821001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.821144 (+   143us) service_pool.cc:224] Handling call
0709 12:20:56.821547 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:56.839194 (+ 17647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.839229 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:56.870917 (+ 31688us) log.cc:844] Serialized 26 byte log entry
0709 12:20:57.315274 (+444357us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:57.315352 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.315489 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.876959 (+561470us) raft_consensus.cc:1685] finished
0709 12:20:57.876981 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.877110 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35576,"raft.queue_time_us":36478,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3624,"thread_start_us":333305,"threads_started":1,"wal-append.queue_time_us":480869}
I20260709 12:20:57.856369 29180 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:57.868827 29191 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:57.912778 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 64040.9us
W20260709 12:20:57.913693 25825 leader_election.cc:336] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.711s (SENT)
I20260709 12:20:57.889415 29160 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:57.869773 28744 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:20:57.910881 25023 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 5 to 6, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 6 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:57.919845 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:57.893695 28955 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:20:57.922679 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 46606.9us
I20260709 12:20:57.923797 25241 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:57.924605 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 58706.9us
W20260709 12:20:57.927336 25242 leader_election.cc:336] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.072s (SENT)
I20260709 12:20:57.926262 25023 catalog_manager.cc:5697] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 5 to 6, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 6 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.936179 25194 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:57.937310 25012 catalog_manager.cc:5028] TS 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): tablet 9c305b34a0c54275af750c832f52691f (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:20:57.938932 28977 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:57.931802 28827 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:57.945159 25023 catalog_manager.cc:5697] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
W20260709 12:20:57.955762 25825 leader_election.cc:336] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.782s (SENT)
I20260709 12:20:57.932713 29247 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:57.960021 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:57.949829 28951 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:57.964701 29070 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:57.990969 29127 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:57.993474 29180 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:57.953496 29187 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:57.994405 29187 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:57.995116 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 530308us
I20260709 12:20:57.996464 29187 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:57.997116 25242 leader_election.cc:336] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.102s (SENT)
I20260709 12:20:57.997563 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:57.998175 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 505570us
W20260709 12:20:58.006074 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 50300.9us
W20260709 12:20:58.006706 25825 leader_election.cc:336] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.852s (SENT)
I20260709 12:20:58.007210 25273 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:57.956027 28827 raft_consensus.cc:697] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:58.009001 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:58.009316 25825 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:58.010394 25822 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:58.016366 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.016963 25118 raft_consensus.cc:2393] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 9: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:58.018894 28827 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.022174 29162 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:58.022584 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.022724 29162 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.023156 25123 raft_consensus.cc:2376] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9. Re-sending same reply.
I20260709 12:20:58.023783 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.024868 29162 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:58.025494 29162 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:58.015574 29063 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:58.014732 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.027127 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.028489 25168 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:58.034514 25200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 756) took 1806 ms. Trace:
I20260709 12:20:58.035096 25855 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:58.038087 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:58.041426 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:58.027417 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.047715 25126 raft_consensus.cc:2368] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12.
I20260709 12:20:58.044415 25200 rpcz_store.cc:276] 0709 12:20:56.227955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.228075 (+   120us) service_pool.cc:224] Handling call
0709 12:20:56.228400 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:56.266307 (+ 37907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.266359 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:56.441839 (+175480us) log.cc:844] Serialized 26 byte log entry
0709 12:20:56.972511 (+530672us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:57.473261 (+500750us) log.cc:844] Serialized 14 byte log entry
0709 12:20:57.475746 (+  2485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.033193 (+557447us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b18003c4900. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100def2a6 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419
0709 12:20:58.034195 (+  1002us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b54000a7654. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:20:58.034252 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:58.034293 (+    41us) raft_consensus.cc:1685] finished
0709 12:20:58.034308 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:58.034452 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2148,"prepare.queue_time_us":36554,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":3329,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":10675,"spinlock_wait_cycles":60833408,"thread_start_us":967723,"threads_started":2,"wal-append.queue_time_us":779111}
I20260709 12:20:58.048707 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.049420 25126 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:58.050760 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:58.039355 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:58.026818 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.054535 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:58.054916 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 44633.4us
I20260709 12:20:58.060369 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:58.061038 25857 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:58.061479 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.062249 25126 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:20:58.060293 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:58.060316 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:58.060559 25127 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
W20260709 12:20:58.072098 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.072499 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:58.030519 29185 consensus_meta.cc:287] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.002s
I20260709 12:20:58.074055 25122 raft_consensus.cc:2368] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13.
W20260709 12:20:58.075261 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 46865.9us
I20260709 12:20:58.078915 25121 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:20:58.082383 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:58.042352 29187 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:58.086398 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:58.087107 25196 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 12: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:58.087558 25822 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:58.092042 25822 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:58.093554 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 127843us
I20260709 12:20:58.096203 25822 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:58.097219 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.098064 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.061327 29127 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:58.102166 29097 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:58.097904 25126 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:58.106714 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:58.073515 29219 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:58.106480 25122 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:58.113256 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:20:58.113430 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 106736us
I20260709 12:20:58.113673 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.031401 29191 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:20:58.016124 29247 consensus_queue.cc:1059] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 12:20:58.118710 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:58.118078 25825 leader_election.cc:336] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.878s (SENT)
I20260709 12:20:58.121941 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:58.126734 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:58.090929 28983 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.128835 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:58.026013 29162 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:58.098337 29199 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:58.074935 29080 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:20:58.112881 29070 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:58.130703 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:58.129565 25121 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:58.091110 29081 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:58.131306 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:58.131335 25122 raft_consensus.cc:2368] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12.
I20260709 12:20:58.134333 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:58.164638 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 63833.1us
I20260709 12:20:58.114533 29089 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.141058 29162 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:58.103610 29252 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:20:58.142232 25125 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:58.142781 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:58.134333 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:58.084590 29147 consensus_queue.cc:1059] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:20:58.104491 29230 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:58.146701 25272 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:58.129441 25118 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
W20260709 12:20:58.252070 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 123591us
I20260709 12:20:58.165874 25165 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:58.252822 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:58.253320 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 87525.7us
I20260709 12:20:58.115429 29219 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.206796 25276 raft_consensus.cc:2393] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 5: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:20:58.173724 25242 leader_election.cc:336] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.107s (SENT)
I20260709 12:20:58.210002 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:58.255020 25268 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:20:58.084625 29185 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.084403 29255 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 12:20:58.168567 29070 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:58.212622 29097 raft_consensus.cc:3055] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:20:58.259152 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 145099us
I20260709 12:20:58.163045 28983 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.262624 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:58.265703 25118 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:58.256004 29219 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:58.266651 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:58.268337 25825 leader_election.cc:336] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.962s (SENT)
I20260709 12:20:58.268801 25825 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:58.209625 29240 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:58.273259 29187 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:58.273705 28744 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.273849 29187 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:58.274207 28744 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:58.276017 29187 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:58.276129 28744 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:58.277359 25271 raft_consensus.cc:2393] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:58.280951 25273 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:20:58.252187 29162 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.271642 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.282994 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:58.174579 29081 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.287549 25198 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:20:58.263159 29070 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:58.263393 29097 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:58.265067 29199 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:58.283337 29241 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
W20260709 12:20:58.334816 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.335333 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:58.335976 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 72113.9us
I20260709 12:20:58.282195 29240 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:20:58.358067 25825 leader_election.cc:336] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.005s (SENT)
I20260709 12:20:58.285480 25122 raft_consensus.cc:2376] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9. Re-sending same reply.
I20260709 12:20:58.270464 28830 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:58.270872 29230 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:58.341521 29185 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:58.342846 29259 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:20:58.342993 29257 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:20:58.345396 25092 leader_election.cc:336] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.500s (SENT)
I20260709 12:20:58.213111 29089 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.362210 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.544365 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:58.361936 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 188210us
I20260709 12:20:58.363734 25118 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:20:58.364665 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:58.365411 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:20:58.364707 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 198518us
I20260709 12:20:58.546268 25122 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:20:58.172613 29226 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 12:20:58.362095 29230 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:58.482003 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:58.286280 28744 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:58.597496 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:58.487912 25120 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:58.290488 29162 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.376406 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:58.606547 25273 raft_consensus.cc:2410] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:20:58.361937 28830 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:20:58.433888 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 155383us
I20260709 12:20:58.347301 29238 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:58.540306 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.472872 25857 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
W20260709 12:20:58.560199 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 75944.8us
I20260709 12:20:58.402552 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:58.598263 25851 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:58.599963 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:58.602569 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 120644us
I20260709 12:20:58.611332 25120 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:58.482928 29147 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:58.625622 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:58.626315 25270 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:58.627771 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:58.628621 25275 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:20:58.622880 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:58.623611 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 339707us
I20260709 12:20:58.616894 25123 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:20:58.506685 29035 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:58.636859 25276 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:58.643046 25123 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:58.644244 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:20:58.639297 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 281259us
W20260709 12:20:58.650048 25825 leader_election.cc:336] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.022s (SENT)
I20260709 12:20:58.650183 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:58.650671 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:58.631107 25269 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
W20260709 12:20:58.681990 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 50786.1us
I20260709 12:20:58.597244 29065 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:58.683840 25167 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:58.694645 25123 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:20:58.622361 29127 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:58.616045 28830 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:58.701717 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:58.626320 29187 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.635327 28985 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:58.716377 25853 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:58.716883 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:58.724855 29240 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:58.727815 29265 log.cc:927] Time spent T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.409s	user 0.005s	sys 0.000s
W20260709 12:20:58.728615 29275 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:20:58.606703 28744 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:58.732661 25123 raft_consensus.cc:3055] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:58.733057 25123 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:20:58.734073 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 133539us
W20260709 12:20:58.727396 29269 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:20:58.687879 29185 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:20:58.762410 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 159916us
W20260709 12:20:58.707733 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.748059 25123 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:58.784566 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 498230us
I20260709 12:20:58.775532 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:58.683574 29035 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:58.647459 29147 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.800289 25123 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:58.720546 29127 raft_consensus.cc:697] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:20:58.733860 29238 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:20:58.807662 25242 leader_election.cc:336] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.835s (SENT)
I20260709 12:20:58.694567 29065 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:58.811290 25120 raft_consensus.cc:1240] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:58.773679 28803 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:58.829967 29147 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:58.778061 29226 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:20:58.832526 29127 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.736788 29195 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.776151 29229 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:20:58.815747 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:58.808264 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 107511us
I20260709 12:20:58.825593 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:20:58.719267 29187 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:58.841094 25165 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:58.855783 25123 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:58.682118 29199 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:58.835457 29195 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.785235 29185 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:58.866160 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 58559.9us
I20260709 12:20:58.868377 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:58.865075 25165 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:58.871707 25274 raft_consensus.cc:2410] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:20:58.839670 28827 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:58.854388 29060 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:20:58.873366 25242 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.880s (SENT)
I20260709 12:20:58.873380 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:58.860791 28803 raft_consensus.cc:697] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:58.852949 28997 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:58.864645 29266 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.332s	user 0.002s	sys 0.001s
I20260709 12:20:58.876973 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:20:58.881503 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:58.889159 25165 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:58.713891 29230 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.880208 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:20:58.871798 28983 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:58.887336 25200 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:20:58.895725 25200 pending_rounds.cc:85] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 4
I20260709 12:20:58.896051 25200 pending_rounds.cc:107] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:20:58.896368 25200 raft_consensus.cc:2889] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:58.880048 29060 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:58.900086 25124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.011s	sys 0.005s
W20260709 12:20:58.929379 25124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.012s	sys 0.005s
I20260709 12:20:58.931579 25269 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:58.932346 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:58.888563 28862 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:58.937438 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:58.884796 29267 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:58.860930 29229 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.949316 28827 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:58.892530 28997 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:58.938525 28983 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:58.934048 29060 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:58.951607 28997 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:58.952004 28744 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:58.953145 29195 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:58.955556 25851 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:58.956940 29035 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:58.958246 29187 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:58.958403 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 85056.5us
I20260709 12:20:58.969038 25270 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:20:58.970907 25269 raft_consensus.cc:2410] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:20:58.928304 29162 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:58.986447 29089 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:58.977967 29268 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.370s	user 0.000s	sys 0.001s
W20260709 12:20:58.975301 29272 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 12:20:58.992682 25242 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:58.974999 29267 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:59.006310 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:58.975914 29282 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:59.018473 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:58.996729 29063 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:59.028550 25013 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.411s	user 0.000s	sys 0.014s
I20260709 12:20:58.991566 29288 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:59.004585 28803 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:59.016870 28827 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:59.074548 29185 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:59.075109 28827 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:20:59.075135 25090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.195:44749 timed out after 1.600s (SENT) [suppressed 36 similar messages]
W20260709 12:20:59.077342 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 291973us
I20260709 12:20:59.029874 29063 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.076475 29288 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.026760 29284 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:20:59.100430 25092 leader_election.cc:336] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.584s (SENT)
I20260709 12:20:59.100965 25092 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:59.105434 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 170633us
I20260709 12:20:59.089007 29229 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:59.108400 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 458371us
W20260709 12:20:59.102888 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 201232us
W20260709 12:20:59.111019 25825 leader_election.cc:336] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.055s (SENT)
W20260709 12:20:59.086299 25012 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897be935c42e41b995f177155b042be0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:20:59.102262 29063 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:59.126449 25825 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:20:59.169524 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60544.4us
I20260709 12:20:59.171180 25851 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:59.102059 29288 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:59.180385 25822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.001s	sys 0.009s
I20260709 12:20:59.182775 25242 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:20:59.183255 25822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.001s	sys 0.009s
I20260709 12:20:59.175493 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:59.175112 25241 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:20:59.184252 25853 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 4.
I20260709 12:20:59.185607 25198 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:59.186148 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.186985 29267 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:59.189265 29070 consensus_meta.cc:287] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.842s	user 0.009s	sys 0.002s
I20260709 12:20:59.190188 29238 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:59.191630 28830 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:59.194429 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 105953us
I20260709 12:20:59.195036 29294 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:20:59.205056 29272 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:20:59.207074 25092 leader_election.cc:336] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.735s (SENT)
I20260709 12:20:59.207543 25092 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:59.208268 29162 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:59.209537 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2508) took 1189 ms. Trace:
I20260709 12:20:59.209995 25124 rpcz_store.cc:276] 0709 12:20:58.020058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.020316 (+   258us) service_pool.cc:224] Handling call
0709 12:20:58.020753 (+   437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:58.132123 (+111370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.132155 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:58.169314 (+ 37159us) log.cc:844] Serialized 52 byte log entry
0709 12:20:58.929748 (+760434us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:58.930188 (+   440us) log.cc:844] Serialized 14 byte log entry
0709 12:20:58.930607 (+   419us) log.cc:844] Serialized 14 byte log entry
0709 12:20:58.930798 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.930897 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:59.209318 (+278421us) raft_consensus.cc:1685] finished
0709 12:20:59.209337 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.209475 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2401,"raft.queue_time_us":8406,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":2644,"spinlock_wait_cycles":58419968,"thread_start_us":748095,"threads_started":2,"wal-append.queue_time_us":827675}
W20260709 12:20:59.209581 25092 leader_election.cc:336] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.790s (SENT)
W20260709 12:20:59.212697 25092 leader_election.cc:336] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.808s (SENT)
I20260709 12:20:59.213111 25092 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:59.213745 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2509) took 1193 ms. Trace:
I20260709 12:20:59.214195 25119 rpcz_store.cc:276] 0709 12:20:58.020344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.021495 (+  1151us) service_pool.cc:224] Handling call
0709 12:20:58.021917 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:58.105074 (+ 83157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.105101 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:58.163116 (+ 58015us) log.cc:844] Serialized 52 byte log entry
0709 12:20:58.289015 (+125899us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:58.289341 (+   326us) log.cc:844] Serialized 14 byte log entry
0709 12:20:58.289729 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 12:20:58.289901 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.289968 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:59.213527 (+923559us) raft_consensus.cc:1685] finished
0709 12:20:59.213545 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.213683 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8055,"prepare.queue_time_us":247,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":10853,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":9999,"thread_start_us":112401,"threads_started":2,"wal-append.queue_time_us":183463}
W20260709 12:20:59.218370 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 107435us
I20260709 12:20:59.218874 29195 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:59.220023 29195 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:59.220831 29185 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:59.221259 29185 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:59.221746 29164 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:59.221876 29063 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:59.222139 29185 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:59.223476 29185 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:59.224128 29063 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:59.226233 28862 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:59.227145 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1105) took 1096 ms. Trace:
I20260709 12:20:59.227522 25271 rpcz_store.cc:276] 0709 12:20:58.130280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.130415 (+   135us) service_pool.cc:224] Handling call
0709 12:20:59.226972 (+1096557us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54003147d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:20:59.227089 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260217728}
W20260709 12:20:59.220086 25092 leader_election.cc:336] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.882s (SENT)
I20260709 12:20:59.171455 29286 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:59.231761 25092 leader_election.cc:336] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.977s (SENT)
I20260709 12:20:59.218420 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:59.232998 25092 leader_election.cc:336] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.027s (SENT)
I20260709 12:20:59.233390 25857 raft_consensus.cc:2393] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 7: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:20:59.234457 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:20:59.233961 25092 leader_election.cc:336] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.071s (SENT)
W20260709 12:20:59.235502 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 60510.4us
I20260709 12:20:59.235096 25855 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 4.
W20260709 12:20:59.255118 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 72447.3us
I20260709 12:20:59.264899 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:59.242178 29279 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:59.189709 29070 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:59.278476 25118 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.004s	sys 0.012s
W20260709 12:20:59.278939 25118 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.005s	sys 0.012s
W20260709 12:20:59.274385 29219 consensus_meta.cc:287] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.984s	user 0.008s	sys 0.004s
I20260709 12:20:59.258092 29164 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:59.298961 25859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.003s	sys 0.016s
I20260709 12:20:59.256973 29060 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:20:59.301882 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 67959.6us
W20260709 12:20:59.282637 25267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.000s	sys 0.016s
W20260709 12:20:59.302795 25267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.000s	sys 0.017s
I20260709 12:20:59.269275 29226 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 12:20:59.308506 25092 leader_election.cc:336] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.076s (SENT)
W20260709 12:20:59.299315 25859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.003s	sys 0.016s
I20260709 12:20:59.269275 29267 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 12:20:59.309170 25239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.009s	sys 0.011s
W20260709 12:20:59.333976 25239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.009s	sys 0.011s
I20260709 12:20:59.297418 29279 raft_consensus.cc:697] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:20:59.350256 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:59.351625 29229 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:20:59.352310 29229 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:59.299575 29164 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:59.298041 29219 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:59.377476 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 107974us
W20260709 12:20:59.379755 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 160742us
W20260709 12:20:59.380311 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 77728.7us
I20260709 12:20:59.380605 25241 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:20:59.391682 25092 leader_election.cc:336] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.125s (SENT)
I20260709 12:20:59.392267 25092 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:59.372654 29245 consensus_queue.cc:1059] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:20:59.404389 29070 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:59.407313 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1110) took 1036 ms. Trace:
I20260709 12:20:59.407724 25267 rpcz_store.cc:276] 0709 12:20:58.371296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.371464 (+   168us) service_pool.cc:224] Handling call
0709 12:20:58.421027 (+ 49563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:58.421433 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.421463 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:58.444891 (+ 23428us) log.cc:844] Serialized 26 byte log entry
0709 12:20:59.304045 (+859154us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:59.304084 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.304151 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:59.407098 (+102947us) raft_consensus.cc:1685] finished
0709 12:20:59.407121 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.407252 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3569,"raft.queue_time_us":165,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":50145,"thread_start_us":676679,"threads_started":1,"wal-append.queue_time_us":779559}
I20260709 12:20:59.375830 28845 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:20:59.414234 25092 leader_election.cc:336] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.141s (SENT)
I20260709 12:20:59.401813 29286 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:59.414690 29300 log.cc:927] Time spent T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:20:59.415874 29060 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:59.417071 29070 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:59.417456 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:20:59.417632 29070 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:59.419330 29307 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:59.419983 29241 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:59.420063 29070 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:59.420439 29241 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.419453 25825 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:59.420873 29241 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:59.422305 29164 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:59.424691 29219 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:59.424762 29238 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:59.426075 25825 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:20:59.426651 29299 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:20:59.426786 29267 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:59.414702 25092 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:59.433198 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.436657 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:20:59.436570 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 161645us
I20260709 12:20:59.439352 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.439988 25196 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
I20260709 12:20:59.430774 29267 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.436333 29226 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:59.452941 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:20:59.443670 29284 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:59.444064 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.433403 29280 raft_consensus.cc:3055] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:59.455561 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.457196 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.445748 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.446286 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2079) took 1312 ms. Trace:
I20260709 12:20:59.448017 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:59.458652 25196 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
I20260709 12:20:59.454327 25195 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:20:59.459087 25202 raft_consensus.cc:2393] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:20:59.461750 25825 leader_election.cc:336] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.617s (SENT)
I20260709 12:20:59.462387 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:59.407121 29187 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.458566 25118 rpcz_store.cc:276] 0709 12:20:58.134059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.580369 (+446310us) service_pool.cc:224] Handling call
0709 12:20:58.580692 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.580906 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:59.281871 (+700965us) log.cc:844] Serialized 14 byte log entry
0709 12:20:59.445948 (+164077us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:59.445997 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:59.446063 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.446124 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.446234 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16800,"prepare.queue_time_us":101371,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":5079,"raft.queue_time_us":831,"thread_start_us":844190,"threads_started":2}
I20260709 12:20:59.482460 25196 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:20:59.534649 25197 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:59.535739 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:59.536541 25199 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:59.538628 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.546838 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:20:59.547607 25121 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:59.548458 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.449831 29267 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:59.552234 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 90534.2us
I20260709 12:20:59.552066 29317 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:20:59.552909 25825 leader_election.cc:336] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.150s (SENT)
I20260709 12:20:59.553287 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:59.553646 29317 consensus_queue.cc:1059] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:59.554358 29317 consensus_queue.cc:1243] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:20:59.545315 29307 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:59.562698 29307 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:59.564695 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 150519us
I20260709 12:20:59.392048 25013 maintenance_manager.cc:643] P 2d05ccaaf1604ba0be2f6d54385e7ce3: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.665s	user 0.167s	sys 0.095s Metrics: {"bytes_written":30138,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":317371,"dirs.run_cpu_time_us":576,"dirs.run_wall_time_us":31723,"drs_written":1,"lbm_read_time_us":391,"lbm_reads_lt_1ms":4,"lbm_write_time_us":158871,"lbm_writes_10-100_ms":5,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":439289,"threads_started":3,"update_count":10,"wal-append.queue_time_us":360287}
W20260709 12:20:59.565354 25092 leader_election.cc:336] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.159s (SENT)
I20260709 12:20:59.565768 25092 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:20:59.413254 29288 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:59.567180 25825 connection.cc:256] RPC call timeout handler was delayed by -1.6973153410001487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2584s for a response
W20260709 12:20:59.567574 25825 connection.cc:256] RPC call timeout handler was delayed by -1.4489397540000937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3259s for a response
I20260709 12:20:59.571368 25118 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:20:59.576287 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.577103 25202 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 5.
W20260709 12:20:59.589345 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.593173 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.594190 25201 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:20:59.611253 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:59.455238 29280 raft_consensus.cc:740] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:20:59.613798 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.616873 25202 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:20:59.561889 29185 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:59.624020 25194 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:59.626499 29307 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:59.627413 29316 raft_consensus.cc:3055] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:59.627821 29316 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:20:59.629240 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.630205 29060 consensus_queue.cc:1059] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:59.631841 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.632632 25201 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:20:59.628747 29316 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:59.407325 29279 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:59.636869 25199 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:20:59.643138 25202 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:59.615254 29219 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:59.659806 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 94485.1us
W20260709 12:20:59.668830 25092 leader_election.cc:336] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.170s (SENT)
I20260709 12:20:59.669579 25014 maintenance_manager.cc:419] P 2d05ccaaf1604ba0be2f6d54385e7ce3: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10507 bytes on disk
I20260709 12:20:59.609912 29247 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:20:59.545637 29187 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:59.578902 29315 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 12:20:59.622802 29070 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:20:59.756620 25201 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:20:59.757506 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 96840.5us
W20260709 12:20:59.764007 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 152826us
I20260709 12:20:59.638003 29185 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:59.668605 29316 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:59.767467 25092 leader_election.cc:336] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.219s (SENT)
I20260709 12:20:59.815913 25092 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:59.797516 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:59.819015 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:59.819223 29322 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:20:59.823810 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:59.727627 29320 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:59.824713 25199 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:20:59.826700 29307 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:59.826776 29305 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:20:59.827868 29307 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:59.827747 29305 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:59.828596 29307 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:59.830497 29305 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:59.831673 29307 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:59.782648 29313 log.cc:927] Time spent T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:20:59.836325 25013 maintenance_manager.cc:643] P 2d05ccaaf1604ba0be2f6d54385e7ce3: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.074s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":482,"lbm_reads_lt_1ms":4}
I20260709 12:20:59.839601 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1078) took 1341 ms. Trace:
I20260709 12:20:59.637216 29241 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:20:59.779588 29186 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.514s	user 0.010s	sys 0.019s
I20260709 12:20:59.767473 29284 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:20:59.856885 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 59489.5us
W20260709 12:20:59.840204 29269 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:20:59.858011 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:59.842312 25859 rpcz_store.cc:276] 0709 12:20:58.484567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.484699 (+   132us) service_pool.cc:224] Handling call
0709 12:20:58.559804 (+ 75105us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:59.310132 (+750328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:59.310179 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:59.348422 (+ 38243us) log.cc:844] Serialized 26 byte log entry
0709 12:20:59.605265 (+256843us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:59.605304 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.605374 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:59.820570 (+215196us) raft_consensus.cc:1685] finished
0709 12:20:59.820591 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.825652 (+  5061us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45544,"raft.queue_time_us":131759,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":14992,"thread_start_us":936832,"threads_started":2,"wal-append.queue_time_us":296896}
W20260709 12:20:59.852630 29186 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.589s	user 0.010s	sys 0.020s
W20260709 12:20:59.877071 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:59.877357 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 497467us
I20260709 12:20:59.846709 29261 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:59.900894 25825 leader_election.cc:400] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11.
I20260709 12:20:59.864574 29319 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:20:59.865922 29307 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:59.915634 29318 log.cc:927] Time spent T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:20:59.860114 29284 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:59.917866 29284 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:20:59.913575 29327 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:20:59.919099 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.920969 29185 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:59.922123 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.911878 29319 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:59.929322 29319 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:20:59.930302 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.931845 29267 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:59.934823 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:20:59.935377 25201 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:59.935973 25825 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:59.918360 29241 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:59.942278 25121 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:20:59.945104 25201 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
W20260709 12:20:59.943665 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 183646us
I20260709 12:20:59.783797 29280 consensus_queue.cc:260] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:20:59.949414 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:20:59.945653 29288 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:59.949200 29070 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:59.952571 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:20:59.953284 25857 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:20:59.943605 29267 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:20:59.946172 25092 leader_election.cc:336] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.232s (SENT)
I20260709 12:20:59.952147 29280 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:59.958772 29187 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:20:59.961050 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:20:59.969341 25859 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:59.962594 29070 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:59.975147 25092 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.296s (SENT)
I20260709 12:20:59.975629 25092 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:20:59.976362 29329 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:59.977100 29065 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:20:59.961131 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:20:59.978628 25201 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:59.967738 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:20:59.964509 29195 consensus_meta.cc:287] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.744s	user 0.006s	sys 0.006s
I20260709 12:20:59.981829 25825 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:20:59.984722 25857 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 6.
I20260709 12:20:59.986266 29070 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:59.991163 29319 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.991777 29319 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:20:59.998826 25857 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:21:00.001628 25092 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.652s (SENT)
I20260709 12:21:00.002288 25092 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:00.002789 29262 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:00.003127 29261 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.003469 29329 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:00.003399 29262 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:00.003728 29261 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:00.004663 29319 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:00.005681 29262 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:00.006636 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.007341 25855 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:00.008958 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.009801 25273 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:00.008109 29261 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:00.011763 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.012553 25271 raft_consensus.cc:2393] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 6: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:00.008126 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.013360 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.013962 29195 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:00.014017 25271 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:00.015678 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:00.016348 25271 raft_consensus.cc:2393] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:00.017132 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:00.017695 25271 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:00.014325 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.019083 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.014613 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.022867 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:00.054236 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.060483 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:00.061192 25201 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
W20260709 12:21:00.062156 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 60614.1us
I20260709 12:21:00.062275 25271 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:21:00.064383 25271 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:00.014475 29267 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:00.068403 25092 leader_election.cc:336] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 2.924s (SENT)
I20260709 12:21:00.069042 25092 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:00.071434 25270 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:00.077078 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.077989 25855 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:00.085551 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2460) took 1385 ms. Trace:
I20260709 12:21:00.099484 25272 rpcz_store.cc:276] 0709 12:20:58.700053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.874209 (+174156us) service_pool.cc:224] Handling call
0709 12:20:58.878387 (+  4178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.899776 (+ 21389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.899805 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:58.899854 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:58.899906 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.085203 (+1185297us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b54002a8d54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:00.085274 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.085455 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48667904}
I20260709 12:21:00.091128 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2405) took 1483 ms. Trace:
I20260709 12:21:00.103874 29229 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:00.104033 25198 rpcz_store.cc:276] 0709 12:20:58.607999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.608975 (+   976us) service_pool.cc:224] Handling call
0709 12:20:58.638270 (+ 29295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:59.186089 (+547819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.090770 (+904681us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b540016c6d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:00.091041 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249261312}
I20260709 12:21:00.097241 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:00.106377 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.106882 25165 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:21:00.099017 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.108129 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.109547 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.110456 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.070884 29261 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:00.111579 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.112594 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.113541 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.114400 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.115485 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.072820 29267 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:00.116158 25860 raft_consensus.cc:2368] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10.
I20260709 12:21:00.116856 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.117580 25860 raft_consensus.cc:2410] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:00.089370 29262 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:00.118955 29323 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:21:00.118713 29262 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:00.120517 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 1975) took 1502 ms. Trace:
I20260709 12:21:00.120895 25274 rpcz_store.cc:276] 0709 12:20:58.618132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.618392 (+   260us) service_pool.cc:224] Handling call
0709 12:21:00.120347 (+1501955us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400418f54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:00.120461 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520409344}
I20260709 12:21:00.121426 29262 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:00.121965 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:00.123073 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.123205 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:00.123821 25274 raft_consensus.cc:2410] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 11 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:21:00.101596 25090 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:00.138567 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:00.142417 25270 raft_consensus.cc:2410] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:21:00.107069 28983 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:00.108247 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.140343 25165 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:00.138196 25852 raft_consensus.cc:2368] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
I20260709 12:21:00.107101 25857 raft_consensus.cc:2368] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
I20260709 12:21:00.126801 25199 raft_consensus.cc:2410] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:00.127094 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.129172 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.145087 25268 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:21:00.100790 28830 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:00.100478 29320 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:00.137396 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:00.098796 25092 leader_election.cc:336] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 3.110s (SENT)
I20260709 12:21:00.138559 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.124101 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.147373 28983 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:00.151446 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.158704 25090 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:00.188829 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.187395 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:00.190862 25853 raft_consensus.cc:2368] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 4. Current term is 6.
I20260709 12:21:00.185248 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.179263 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.191676 25273 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:00.191885 25851 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12.
I20260709 12:21:00.192607 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.193228 25851 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:00.182984 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.185662 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.194020 25852 raft_consensus.cc:2410] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:21:00.195030 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.195325 25272 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:21:00.138732 29283 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 1.063s	user 0.000s	sys 0.013s
I20260709 12:21:00.197999 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.198732 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.198858 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.199395 25857 raft_consensus.cc:2368] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10.
I20260709 12:21:00.200254 25851 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:21:00.201843 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 61593.6us
W20260709 12:21:00.203205 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 80066.9us
I20260709 12:21:00.205325 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.205646 25856 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:00.117684 29267 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:00.147836 29188 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:00.183195 29162 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:00.211875 25268 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:21:00.206373 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.189615 28983 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:00.215777 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.216804 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.220772 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.221508 25858 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:00.220711 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.222715 25852 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12.
I20260709 12:21:00.223773 25860 raft_consensus.cc:2410] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:21:00.227962 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.228557 25852 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:21:00.229513 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.230698 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.231954 25852 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:00.230597 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.233821 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.233825 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:00.236438 29331 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 12:21:00.184666 29261 consensus_queue.cc:1059] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:21:00.201622 29329 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:00.209226 29262 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:00.202731 29070 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:00.242452 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 143688us
I20260709 12:21:00.264887 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.265914 25853 raft_consensus.cc:2410] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:21:00.212116 29191 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:00.245132 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:00.260591 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:00.265050 25092 leader_election.cc:336] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 3.135s (SENT)
I20260709 12:21:00.268318 25092 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:00.208976 29060 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:00.277669 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.278378 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.198410 29320 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:00.287776 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.288470 25860 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:00.289832 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:00.292451 25009 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1f471cfad2348a09c4b699f01f9dfa9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2e30bdd4cd1b45299f50b9bcfc9c1667 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:21:00.300046 29285 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 1.224s	user 0.008s	sys 0.018s
I20260709 12:21:00.284528 29070 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:00.304391 29070 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:00.245157 29162 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:21:00.282781 29261 raft_consensus.cc:3055] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:00.306586 29261 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:00.307714 29261 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:00.308375 25125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2507) took 2288 ms (client timeout 2163 ms). Trace:
I20260709 12:21:00.133968 29097 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:00.309072 29261 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:00.309268 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:00.309505 29097 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:00.309859 25271 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:00.310227 29191 raft_consensus.cc:697] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:00.311250 29191 consensus_queue.cc:237] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:00.315789 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:00.316252 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:00.316563 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2075) took 2210 ms. Trace:
I20260709 12:21:00.316972 25267 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 6: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:00.318084 25198 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:00.318631 29286 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:00.319060 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:00.320277 29230 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:00.320472 25241 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:00.323248 29267 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:00.323705 29317 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:00.323738 29267 raft_consensus.cc:697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:00.325429 29060 raft_consensus.cc:697] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:00.316383 25196 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:00.325856 29267 consensus_queue.cc:237] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:00.326378 29060 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:00.317852 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.331962 29200 consensus_queue.cc:1059] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:00.329847 29219 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:00.333237 29219 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:00.338181 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:00.339634 29081 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:00.340950 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:00.332834 29200 raft_consensus.cc:3055] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:00.316994 25126 rpcz_store.cc:276] 0709 12:20:58.105969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.106214 (+   245us) service_pool.cc:224] Handling call
0709 12:21:00.315253 (+2209039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.315438 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.315475 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:00.315523 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:00.315557 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.315618 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.316359 (+   741us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54000c49d0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:00.316480 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5077968128}
I20260709 12:21:00.341686 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.346659 25196 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:00.340435 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:00.308841 25125 rpcz_store.cc:269] 0709 12:20:58.019724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.026571 (+  6847us) service_pool.cc:224] Handling call
0709 12:21:00.308174 (+2281603us) spinlock_profiling.cc:243] Waited 87.4 ms on lock 0x7b54000c49d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:00.308283 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201081728}
I20260709 12:21:00.347731 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.351025 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:00.343609 25241 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:00.360385 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.361177 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:00.361513 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:00.363232 25271 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:00.358413 28997 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.373356 25269 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:00.377570 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 180730us
I20260709 12:21:00.355418 28744 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:00.350128 29200 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:21:00.358142 29296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.036s	user 0.015s	sys 0.026s
W20260709 12:21:00.379148 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.358156 29187 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:21:00.383759 29220 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:00.358767 29195 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:00.405354 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:00.386559 28744 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:00.410123 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:00.395188 25198 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:00.379035 29279 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:00.391906 29296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.016s	sys 0.026s
I20260709 12:21:00.395646 29180 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:00.378911 29308 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:21:00.408272 29315 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:00.408489 29195 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:00.412781 28744 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:00.379654 28997 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:00.412871 29279 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:00.501807 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 69486.9us
I20260709 12:21:00.430215 28951 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.422719 29316 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.508095 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:00.507705 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 242709us
I20260709 12:21:00.569074 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:00.569644 25118 raft_consensus.cc:2376] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9. Re-sending same reply.
W20260709 12:21:00.514202 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 79992.6us
I20260709 12:21:00.570531 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.571324 25124 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
W20260709 12:21:00.500839 29306 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:21:00.517290 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:00.518381 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:00.578249 25276 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:00.519438 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.435683 29315 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.507083 25167 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:00.533733 25271 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:21:00.539479 29346 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:21:00.541137 29185 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.558251 29195 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:00.596172 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.378708 29255 consensus_queue.cc:1059] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 12:21:00.572332 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 64335us
I20260709 12:21:00.572535 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.573953 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.574651 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.599434 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.600641 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.576042 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.579457 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:00.580251 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:00.583199 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:00.588717 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.597810 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:00.602617 25127 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:00.602835 25090 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:00.584270 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 77303.8us
I20260709 12:21:00.551033 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.604761 25273 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:00.605017 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:00.503942 29180 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:00.596832 25120 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:00.606635 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.607761 25123 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 9: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:00.601688 25125 raft_consensus.cc:2376] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9. Re-sending same reply.
I20260709 12:21:00.610167 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.566305 29279 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:00.612470 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.612697 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.606484 25122 raft_consensus.cc:2376] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9. Re-sending same reply.
I20260709 12:21:00.614575 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.615943 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.617678 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.585160 29226 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:00.624992 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.589037 29315 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:00.629448 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.637822 25165 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:00.501924 29200 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:00.588696 28951 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:00.592890 29245 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:00.642362 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.646409 25122 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:00.647055 28951 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:00.647305 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.604175 29185 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:00.649626 29185 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:00.654848 28983 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:00.663661 29328 raft_consensus.cc:3055] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:00.665093 29276 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:00.667115 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:00.692725 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:00.693542 25127 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:00.669178 29349 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:21:00.583041 29316 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:00.670792 29345 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 12:21:00.671797 29350 log.cc:927] Time spent T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:21:00.702888 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.703229 25825 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:00.704037 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.704547 25825 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:00.675998 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 45685.2us
I20260709 12:21:00.676779 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.677119 25855 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:00.679122 25268 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:00.683699 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:00.684331 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 46578.6us
I20260709 12:21:00.642594 29188 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:00.710184 25118 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:00.620853 29351 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:00.619971 29286 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:00.638563 29226 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:00.727520 29226 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:00.700268 29316 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:00.675518 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:00.711627 25194 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:00.735519 25123 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:00.735746 25275 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:00.712682 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:00.736374 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:00.713902 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:00.719405 29307 raft_consensus.cc:2764] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:21:00.689857 29185 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.683418 29252 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:00.720687 25860 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:00.731642 25167 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:00.717957 29160 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:00.691466 29328 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:00.716836 25825 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:00.764642 25118 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:21:00.769757 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 57099.6us
I20260709 12:21:00.719079 29097 raft_consensus.cc:2764] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:21:00.717845 29351 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:00.824359 29351 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:00.721668 29070 consensus_queue.cc:1059] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:21:00.797806 29348 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:21:00.823680 29245 raft_consensus.cc:2764] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:21:00.798609 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 67092.1us
I20260709 12:21:00.849681 25167 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:00.827306 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 252016us
I20260709 12:21:00.835697 25127 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
W20260709 12:21:00.800544 29352 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.248s	user 0.003s	sys 0.000s
I20260709 12:21:00.855316 25242 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:00.857013 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:00.861061 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:00.862634 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:00.866212 25167 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:00.834017 29230 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
W20260709 12:21:00.882539 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 127806us
I20260709 12:21:00.785087 29219 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:00.854694 29316 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.854580 29307 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:21:00.900606 25092 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 3.555s (SENT)
I20260709 12:21:00.801929 29252 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:00.868949 29191 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:00.795737 29185 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:01.159010 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 442215us
W20260709 12:21:01.121673 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 211212us
I20260709 12:21:00.897651 29273 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:01.171738 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:01.182346 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 281742us
W20260709 12:21:01.183212 25092 leader_election.cc:336] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 3.633s (SENT)
I20260709 12:21:01.183651 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:01.187446 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 324927us
I20260709 12:21:01.188529 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:01.191341 25825 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:01.191691 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:00.902478 29357 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:01.219730 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1072) took 3192 ms. Trace:
W20260709 12:21:01.218503 25090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.008s	sys 0.004s
I20260709 12:21:01.220050 25275 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:21:01.225029 25090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.009s	sys 0.004s
W20260709 12:21:01.226773 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 617290us
W20260709 12:21:01.229375 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:01.241842 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 59624.5us
I20260709 12:21:01.224903 25854 rpcz_store.cc:276] 0709 12:20:58.008253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.009739 (+  1486us) service_pool.cc:224] Handling call
0709 12:20:58.056023 (+ 46284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:58.071064 (+ 15041us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:58.095202 (+ 24138us) log.cc:844] Serialized 14 byte log entry
0709 12:20:58.207765 (+112563us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:00.015194 (+1807429us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b1800460060. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e21522 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:00.320181 (+304987us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b2c00047098. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:21:00.320583 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 12:21:00.383477 (+ 62894us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:00.383512 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.383587 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:00.665906 (+282319us) spinlock_profiling.cc:243] Waited 9.82 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:01.200036 (+534130us) raft_consensus.cc:1685] finished
0709 12:21:01.200057 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.200192 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22093,"prepare.queue_time_us":13423,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":4478,"raft.queue_time_us":54118,"raft.run_cpu_time_us":7205,"raft.run_wall_time_us":62449,"spinlock_wait_cycles":97338240,"thread_start_us":103044,"threads_started":2,"wal-append.queue_time_us":276685,"wal-append.run_cpu_time_us":7168,"wal-append.run_wall_time_us":1667070}
I20260709 12:21:01.258316 28997 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:01.259583 29185 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:01.200301 29070 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:21:01.260881 29247 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:21:01.261148 25276 consensus_meta.cc:287] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.679s	user 0.006s	sys 0.000s
I20260709 12:21:01.261354 29070 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:01.261772 25276 raft_consensus.cc:2410] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
W20260709 12:21:01.258378 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 75197.4us
I20260709 12:21:01.261451 29247 raft_consensus.cc:697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:01.192451 29362 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:01.212507 29353 log.cc:927] Time spent T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 12:21:00.912556 29316 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:01.235466 28744 consensus_meta.cc:287] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.653s	user 0.012s	sys 0.000s
I20260709 12:21:01.277410 25092 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:01.211001 29180 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:01.273280 29081 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:01.211931 29363 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:01.233249 28983 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:01.233985 29357 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:01.192914 29307 consensus_queue.cc:1059] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:21:01.275915 29070 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.266227 29374 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:01.390911 29354 log.cc:927] Time spent T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
W20260709 12:21:01.392398 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.355093 29319 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:01.307540 29097 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.910681 29328 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:01.414431 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:01.415112 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 137771us
I20260709 12:21:01.451043 25200 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:01.452895 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:01.355645 28744 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:01.395083 29357 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:01.469786 29360 log.cc:927] Time spent T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 12:21:01.470973 29364 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.471527 29364 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:01.472927 29160 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.473392 29160 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:01.475265 29279 consensus_meta.cc:287] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.832s	user 0.012s	sys 0.000s
I20260709 12:21:01.475699 29279 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:01.476001 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1405) took 1137 ms. Trace:
I20260709 12:21:01.466629 29366 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:01.476527 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1100) took 1133 ms. Trace:
W20260709 12:21:01.488616 29361 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.591s	user 0.000s	sys 0.001s
I20260709 12:21:01.488121 25858 rpcz_store.cc:276] 0709 12:21:00.338659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.338824 (+   165us) service_pool.cc:224] Handling call
0709 12:21:00.339167 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:00.339491 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.339520 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:00.339957 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:21:00.746599 (+406642us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:00.746643 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.746709 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:01.475792 (+729083us) raft_consensus.cc:1685] finished
0709 12:21:01.475814 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.475944 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1010,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":10296,"thread_start_us":406289,"threads_started":1,"wal-append.queue_time_us":521521}
I20260709 12:21:01.488929 25852 rpcz_store.cc:276] 0709 12:21:00.343137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.344323 (+  1186us) service_pool.cc:224] Handling call
0709 12:21:00.359792 (+ 15469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:00.360086 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.360110 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:00.381915 (+ 21805us) log.cc:844] Serialized 26 byte log entry
0709 12:21:00.509470 (+127555us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:00.509508 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.509579 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:01.476315 (+966736us) raft_consensus.cc:1685] finished
0709 12:21:01.476340 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.476474 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1821,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":9849,"thread_start_us":86485,"threads_started":1,"wal-append.queue_time_us":1060149}
W20260709 12:21:01.481216 29368 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:21:01.493054 25269 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:01.417076 29307 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:01.417866 29374 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:01.452605 29097 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:01.473769 29364 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:01.412143 29362 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:01.492189 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:01.425916 29319 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:01.410728 29070 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:01.505607 29286 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:01.505113 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:01.510728 25092 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:01.505038 29219 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:01.512488 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 321280us
I20260709 12:21:01.504103 29319 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:01.511490 29366 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:01.502584 29307 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:01.510488 29252 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:01.532629 29315 consensus_meta.cc:287] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.882s	user 0.012s	sys 0.000s
I20260709 12:21:01.529726 29356 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:01.571096 29261 consensus_meta.cc:287] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.262s	user 0.015s	sys 0.000s
I20260709 12:21:01.487669 29247 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:01.598902 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:01.599750 25200 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:01.541481 29195 consensus_meta.cc:287] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.907s	user 0.010s	sys 0.001s
I20260709 12:21:01.571435 29070 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:01.606875 25122 raft_consensus.cc:2410] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:21:01.612339 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:01.598798 29187 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.574534 29383 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:01.575258 29316 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:01.618583 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 426920us
I20260709 12:21:01.619323 29187 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:01.621665 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2554) took 1040 ms. Trace:
I20260709 12:21:01.622574 29187 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:01.622051 25118 rpcz_store.cc:276] 0709 12:21:00.581212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.826515 (+245303us) service_pool.cc:224] Handling call
0709 12:21:00.826867 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:00.862240 (+ 35373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.862273 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:00.871547 (+  9274us) log.cc:844] Serialized 26 byte log entry
0709 12:21:01.401010 (+529463us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:01.401166 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.401300 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:01.621455 (+220155us) raft_consensus.cc:1685] finished
0709 12:21:01.621474 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.621609 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24743,"raft.queue_time_us":34367,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":22231,"thread_start_us":222583,"threads_started":1,"wal-append.queue_time_us":432379}
W20260709 12:21:01.617018 29226 consensus_meta.cc:287] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.889s	user 0.009s	sys 0.002s
I20260709 12:21:01.611132 29380 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.625563 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:01.645534 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:01.647011 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:01.648154 25196 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:01.649010 25242 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:01.649528 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:01.660106 25200 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:01.609426 29195 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:01.668143 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:01.599489 29315 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:01.665618 25198 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:21:01.659339 29187 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:01.627408 29273 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.671684 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:01.652976 29252 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:01.669073 25195 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:01.651456 28744 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:01.683283 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:01.685488 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2559) took 1099 ms. Trace:
I20260709 12:21:01.673157 29060 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.623692 29383 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:01.687300 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1992) took 1167 ms. Trace:
W20260709 12:21:01.680205 28830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.032s	sys 0.049s
I20260709 12:21:01.688391 25127 rpcz_store.cc:276] 0709 12:21:00.586542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.863377 (+276835us) service_pool.cc:224] Handling call
0709 12:21:00.863700 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.863903 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:01.218899 (+354996us) log.cc:844] Serialized 14 byte log entry
0709 12:21:01.684517 (+465618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.684569 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:01.684620 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.685320 (+   700us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.685435 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4623,"prepare.queue_time_us":548583,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":4867,"raft.queue_time_us":4933,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":2549,"thread_start_us":784895,"threads_started":3,"wal-append.queue_time_us":389249}
I20260709 12:21:01.675429 29187 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:01.692354 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 47998us
I20260709 12:21:01.649942 29226 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:01.696298 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:01.698721 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:01.693073 25267 rpcz_store.cc:276] 0709 12:21:00.520091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.520210 (+   119us) service_pool.cc:224] Handling call
0709 12:21:00.523488 (+  3278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.523701 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:01.595021 (+1071320us) log.cc:844] Serialized 14 byte log entry
0709 12:21:01.686697 (+ 91676us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.686750 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:01.686797 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.686857 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.686962 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1048656,"prepare.queue_time_us":1071411,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":120,"thread_start_us":91240,"threads_started":1}
W20260709 12:21:01.695510 28830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.033s	sys 0.049s
I20260709 12:21:01.687968 29364 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:01.690987 29374 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:01.694190 29060 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:01.714614 29385 log.cc:927] Time spent T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:21:01.715040 29374 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:01.710978 29127 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:01.698115 29187 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:01.683013 29386 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:21:01.699043 29252 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:01.722322 29383 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:01.652155 29380 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:01.871320 29384 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:21:01.714689 29364 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.683743 29273 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:01.916015 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 217473us
I20260709 12:21:01.920410 25825 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:01.848614 29307 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:01.926961 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:01.873750 29127 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:01.915496 29364 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:01.941468 29307 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:01.942607 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:01.943804 25852 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:01.944685 25240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.048s	user 0.034s	sys 0.041s
W20260709 12:21:01.945032 25240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.034s	sys 0.041s
I20260709 12:21:01.934906 29127 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:01.954668 29393 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:21:01.956148 29127 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:01.930444 29252 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:01.850265 29374 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:01.930680 29282 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:01.975744 29267 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.976336 29267 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:01.978731 29267 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:01.979135 29240 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:01.980162 25194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 777) took 1665 ms. Trace:
I20260709 12:21:01.980544 25194 rpcz_store.cc:276] 0709 12:21:00.314344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.350340 (+ 35996us) service_pool.cc:224] Handling call
0709 12:21:00.364061 (+ 13721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.738226 (+374165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.979915 (+1241689us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54004132d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:01.980103 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798886784}
I20260709 12:21:01.983702 29320 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:01.992455 29395 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:21:01.971654 29252 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:02.011531 29220 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:02.012302 29220 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:02.016533 25199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2420) took 2086 ms (client timeout 1918 ms). Trace:
W20260709 12:21:02.017092 25199 rpcz_store.cc:269] 0709 12:20:59.929904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.930055 (+   151us) service_pool.cc:224] Handling call
0709 12:21:02.016315 (+2086260us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400440554. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:02.016458 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449435008}
I20260709 12:21:02.019768 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2476) took 1497 ms. Trace:
I20260709 12:21:02.020318 25269 rpcz_store.cc:276] 0709 12:21:00.522104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.605421 (+ 83317us) service_pool.cc:224] Handling call
0709 12:21:00.605658 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.493487 (+887829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.019426 (+525939us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54003156d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:02.019667 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2040283520}
I20260709 12:21:02.025492 29200 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:02.038677 29279 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:02.052021 29081 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:02.074323 29081 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:02.076481 29081 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.014945 29195 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:02.083187 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.083853 25124 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:02.084332 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 745) took 1496 ms. Trace:
W20260709 12:21:02.084780 29160 consensus_meta.cc:287] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.611s	user 0.007s	sys 0.004s
W20260709 12:21:02.091279 29397 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:21:02.093628 29357 consensus_meta.cc:287] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.000s
I20260709 12:21:02.060883 29127 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:02.062990 29307 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:02.063349 29097 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.066428 25858 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:02.065261 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.159090 25852 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:01.990135 29282 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:02.069386 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.070261 29226 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.070488 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.168857 25859 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:02.014719 29252 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:02.071705 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:02.072105 29398 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:02.073527 29273 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.096653 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 1996) took 1575 ms. Trace:
I20260709 12:21:02.097029 29376 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:02.084625 25124 rpcz_store.cc:276] 0709 12:21:00.587934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.622531 (+ 34597us) service_pool.cc:224] Handling call
0709 12:21:02.083047 (+1460516us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b5800002798. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9b71 00007f2100de9a22 00007f2109d028d9 00007f2108e5cee0 00007f2108f260ab 00007f2108f26131 00007f2108ed40a0 00007f2108ed3984 00007f210244e6d4 00007f210244e662
0709 12:21:02.084279 (+  1232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5177088}
W20260709 12:21:02.122367 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:02.126856 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 616171us
I20260709 12:21:02.085572 29160 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.175793 25092 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:02.127977 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2539) took 1558 ms. Trace:
I20260709 12:21:02.130007 29366 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:02.175935 25271 rpcz_store.cc:276] 0709 12:21:00.521022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.603700 (+ 82678us) service_pool.cc:224] Handling call
0709 12:21:00.632468 (+ 28768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.632747 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:01.597475 (+964728us) log.cc:844] Serialized 14 byte log entry
0709 12:21:01.687114 (+ 89639us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.093560 (+406446us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b18002aa5a0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f21079063c7 00007f2103f189a7 00007f2103f215e5 00007f2103f21568
0709 12:21:02.093771 (+   211us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.094016 (+   245us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.096231 (+  2215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:02.096274 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:02.096321 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.096470 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.096593 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1364673,"prepare.queue_time_us":1375859,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":109,"raft.queue_time_us":1209,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":4766080,"thread_start_us":88561,"threads_started":1,"wal-append.queue_time_us":103278}
I20260709 12:21:02.125669 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2538) took 1556 ms. Trace:
I20260709 12:21:02.176573 25119 rpcz_store.cc:276] 0709 12:21:00.569280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.570299 (+  1019us) service_pool.cc:224] Handling call
0709 12:21:00.595823 (+ 25524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:00.768663 (+172840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.768711 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:00.769363 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 12:21:01.170143 (+400780us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:01.594732 (+424589us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.127644 (+532912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.127726 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.127766 (+    40us) raft_consensus.cc:1685] finished
0709 12:21:02.127777 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.127909 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":539302,"prepare.queue_time_us":290339,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":7765,"raft.queue_time_us":609059,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":10470,"thread_start_us":889525,"threads_started":3,"wal-append.queue_time_us":734080}
I20260709 12:21:02.056775 25273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35504 (request call id 3) took 1526 ms. Trace:
W20260709 12:21:02.148815 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 285962us
I20260709 12:21:02.069195 29315 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:02.187245 25093 connection.cc:256] RPC call timeout handler was delayed by -1.0685460610000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260709 12:21:01.990846 29374 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.127904 29261 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:02.178210 25121 rpcz_store.cc:276] 0709 12:21:00.569003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.582716 (+ 13713us) service_pool.cc:224] Handling call
0709 12:21:00.603854 (+ 21138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:00.614418 (+ 10564us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:00.868829 (+254411us) log.cc:844] Serialized 14 byte log entry
0709 12:21:01.514682 (+645853us) log.cc:844] Serialized 14 byte log entry
0709 12:21:01.520062 (+  5380us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:01.522867 (+  2805us) log.cc:844] Serialized 26 byte log entry
0709 12:21:01.523020 (+   153us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:01.523290 (+   270us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.089927 (+566637us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b1800499360. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:02.123474 (+ 33547us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b1800499360. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:02.124982 (+  1508us) spinlock_profiling.cc:243] Waited 891 us on lock 0x7b1800499360. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287 00007f2103f29208
0709 12:21:02.125210 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.125314 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.125372 (+    58us) raft_consensus.cc:1685] finished
0709 12:21:02.125393 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.125583 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11611,"prepare.queue_time_us":745608,"prepare.run_cpu_time_us":165,"prepare.run_wall_time_us":1921,"raft.queue_time_us":622689,"raft.run_cpu_time_us":524,"raft.run_wall_time_us":63978,"spinlock_wait_cycles":24799616,"thread_start_us":503138,"threads_started":2,"wal-append.queue_time_us":475826}
I20260709 12:21:02.184619 25273 rpcz_store.cc:276] 0709 12:21:00.530746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.615516 (+ 84770us) service_pool.cc:224] Handling call
0709 12:21:02.056354 (+1440838us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540002c954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f14735 00007f2103f0c9fa 00007f2108ed44c9 00007f2102450c54 00007f2102450be2 00007f2102450b11 00007f2102450a8c 00007f210244fd42 00007f210224948c 00007f21022488c6
0709 12:21:02.056667 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2464460544}
I20260709 12:21:02.190284 25167 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:02.193140 29320 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:02.203507 29320 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.208550 29320 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.209378 29262 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.209873 29162 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:02.197383 29363 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:02.210492 29162 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.210669 29363 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.212698 29162 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.213069 29363 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.202834 29261 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.216120 29261 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.216949 29328 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:02.203812 28985 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.218676 28985 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:02.209892 29262 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:02.220949 28985 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.221041 29262 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.221837 29301 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:21:02.223044 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 47338us
I20260709 12:21:02.223270 29392 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:02.224846 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:02.225195 29348 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.226377 25092 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:02.153676 29357 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.159588 29307 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.158243 29127 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.236537 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:02.246162 25856 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:21:02.259104 25856 pending_rounds.cc:85] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 7
I20260709 12:21:02.259361 25856 pending_rounds.cc:107] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:21:02.259611 25856 raft_consensus.cc:2889] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:02.256368 25126 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:02.187165 29097 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:02.276587 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.274744 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.275202 29366 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:02.275466 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.203719 29286 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:02.276481 25851 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:02.274608 25822 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:02.277871 25852 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:02.282984 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:02.275599 25009 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1f471cfad2348a09c4b699f01f9dfa9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2e30bdd4cd1b45299f50b9bcfc9c1667 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:21:02.319031 25009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 43485.6us
I20260709 12:21:02.319708 29343 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:02.319773 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:02.320482 25859 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:02.320361 29343 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.322329 29379 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:02.322970 29282 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.322901 29379 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:02.323766 28744 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:02.324313 28744 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:02.324837 29127 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.325178 29379 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:02.326190 29185 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:02.326776 29307 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:02.327607 29307 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:02.234150 29380 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.330135 29386 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:02.331704 25853 raft_consensus.cc:2410] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:21:02.292321 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.333050 25199 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
W20260709 12:21:02.334364 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 52504.5us
I20260709 12:21:02.293272 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.335361 25200 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:02.297374 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.299175 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.300058 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:02.337133 25196 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:02.289786 25860 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:02.308422 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.289108 29315 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.345130 29366 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:02.289230 29261 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:02.345698 29366 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.346395 29261 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.348408 29261 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.348469 29366 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.310148 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:02.325439 29127 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:02.313407 29065 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:02.349730 29127 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:02.225685 29348 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.351032 29127 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.351814 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.257542 29262 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:21:02.352869 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.314184 29195 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:02.246973 29320 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:02.315109 25195 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:02.315822 25852 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
W20260709 12:21:02.318596 29391 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.627s	user 0.000s	sys 0.004s
I20260709 12:21:02.341336 25851 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:02.269187 29376 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:02.342605 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:02.362083 25199 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:02.304795 29363 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:02.343253 29351 consensus_meta.cc:287] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.518s	user 0.014s	sys 0.000s
I20260709 12:21:02.343533 29286 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.304616 29280 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:02.344049 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.349188 25198 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:02.351938 29348 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.353417 25126 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:02.369787 25196 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:02.373210 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.257121 29164 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:02.312975 25241 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:21:02.378407 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 65488.9us
I20260709 12:21:02.382305 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:02.383632 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.355530 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.385707 25200 raft_consensus.cc:2410] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:02.363924 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.364806 29376 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.359184 28985 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:02.365299 28827 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.400746 25167 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:02.365988 29316 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:02.368618 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 431435us
I20260709 12:21:02.377063 25270 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 4. (term mismatch)
I20260709 12:21:02.403820 25270 pending_rounds.cc:85] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 3
I20260709 12:21:02.404140 25270 pending_rounds.cc:107] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 12:21:02.404479 25270 raft_consensus.cc:2889] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:02.404284 25825 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:02.374010 25126 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:02.406677 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.407605 25126 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:02.399798 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.408458 25273 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:02.276078 29279 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 12:21:02.414305 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:02.415555 25825 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:02.409582 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.417569 25273 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:02.403343 25167 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:02.413188 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.421279 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.423563 25272 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:02.416564 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:02.353901 29195 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.420567 29282 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:02.428205 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:02.429675 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.458353 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.440066 25199 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:02.187327 29398 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.447212 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.451619 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.377523 29262 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:02.452647 25241 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:02.476246 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.403256 29366 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:02.455613 25275 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:02.392186 29363 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:02.399035 29296 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:02.497756 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.498556 25271 raft_consensus.cc:2393] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 9: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:02.481838 29160 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:02.483727 29240 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.001s
I20260709 12:21:02.486325 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.358896 29380 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:21:02.488008 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:02.387104 29185 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 12:21:02.309266 29097 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.377851 29320 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:02.494127 25272 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:02.433806 25822 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:02.345115 29187 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.426570 28983 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:21:02.361884 29315 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.431691 29070 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:02.505329 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2551) took 1924 ms. Trace:
I20260709 12:21:02.506510 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.539750 29195 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.540388 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:02.488469 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 754) took 1874 ms. Trace:
I20260709 12:21:02.507102 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2391) took 2109 ms. Trace:
I20260709 12:21:02.500561 29401 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:02.570528 25859 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:21:02.454262 29282 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:02.479228 29247 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:02.475814 29279 raft_consensus.cc:3055] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:02.505733 29386 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:21:02.514132 29292 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.478835 28744 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:02.495582 29219 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:02.515873 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.372089 29351 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:02.421166 29081 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:02.500895 29296 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.422309 28827 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.508103 29392 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:02.535794 25276 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:02.536986 29315 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.507154 29307 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:02.431330 29369 consensus_queue.cc:1059] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:21:02.392468 29280 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.576850 29279 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:02.541563 25123 rpcz_store.cc:276] 0709 12:21:00.614167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.483919 (+869752us) service_pool.cc:224] Handling call
0709 12:21:01.484265 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:01.484647 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:01.484949 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.128263 (+643314us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:02.128948 (+   685us) log.cc:844] Serialized 52 byte log entry
0709 12:21:02.129109 (+   161us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:02.129339 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.129652 (+   313us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.129795 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.129863 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.218613 (+ 88750us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b1800449da0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:02.223038 (+  4425us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b1800449da0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e21522 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:02.317958 (+ 94920us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:02.488236 (+170278us) raft_consensus.cc:1685] finished
0709 12:21:02.488259 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.488391 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":555178,"prepare.queue_time_us":32239,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":105,"raft.queue_time_us":565321,"raft.run_cpu_time_us":525,"raft.run_wall_time_us":24109,"spinlock_wait_cycles":31364352,"thread_start_us":125526,"threads_started":1,"wal-append.queue_time_us":165948}
I20260709 12:21:02.569340 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.575191 25272 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:21:02.575892 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.539357 25125 rpcz_store.cc:276] 0709 12:21:00.580541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.713939 (+133398us) service_pool.cc:224] Handling call
0709 12:21:00.719409 (+  5470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:00.740551 (+ 21142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.740602 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:00.746823 (+  6221us) log.cc:844] Serialized 26 byte log entry
0709 12:21:01.187423 (+440600us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:01.641720 (+454297us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.504957 (+863237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.505048 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.505105 (+    57us) raft_consensus.cc:1685] finished
0709 12:21:02.505123 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.505264 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":557000,"prepare.queue_time_us":279609,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":553431,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":42778,"thread_start_us":1076643,"threads_started":3,"wal-append.queue_time_us":468518}
I20260709 12:21:02.479507 29316 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.521059 29065 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.618805 29065 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.620674 29316 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.503921 29366 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:02.599406 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 205999us
I20260709 12:21:02.570515 29401 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.604696 29392 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.577723 29282 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:02.596702 29081 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:02.525928 29320 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:02.605657 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.604272 29296 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:02.630446 25199 raft_consensus.cc:2410] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:02.606323 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.544340 29343 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.607831 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 750) took 2015 ms. Trace:
I20260709 12:21:02.577579 29247 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.613540 29070 raft_consensus.cc:697] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:02.541777 25201 rpcz_store.cc:276] 0709 12:21:00.391634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.391768 (+   134us) service_pool.cc:224] Handling call
0709 12:21:00.402856 (+ 11088us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:00.598083 (+195227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.598113 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:00.598526 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 12:21:00.760745 (+162219us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:00.760807 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.493211 (+1732404us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540035ff54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:02.493259 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.493303 (+    44us) raft_consensus.cc:1685] finished
0709 12:21:02.493316 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.500781 (+  7465us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32133,"raft.queue_time_us":5110,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":105,"spinlock_wait_cycles":448109952,"thread_start_us":142189,"threads_started":1,"wal-append.queue_time_us":586801}
I20260709 12:21:02.499183 29262 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.624215 25120 raft_consensus.cc:2393] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:02.598846 29219 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.631300 25119 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:02.622706 29401 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:02.631943 25122 rpcz_store.cc:276] 0709 12:21:00.592284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.647050 (+ 54766us) service_pool.cc:224] Handling call
0709 12:21:02.607586 (+1960536us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54002ace54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:02.607760 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2193303424}
I20260709 12:21:02.648556 29414 raft_consensus.cc:3055] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:02.652330 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.674134 25825 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:02.674923 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.676452 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.678268 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:02.667964 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 146016us
I20260709 12:21:02.681874 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.657090 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.636271 29081 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:02.685043 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.686018 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.634827 29247 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:02.692202 25123 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 9: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:02.615203 29374 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.665010 29219 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:02.616966 29307 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.730746 25276 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:02.734300 25276 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:21:02.735530 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 85709.2us
I20260709 12:21:02.686769 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:02.690689 25168 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:02.697216 29357 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.709594 29366 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.086938 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:02.715785 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.747627 29369 raft_consensus.cc:3055] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:02.738001 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 63973.4us
I20260709 12:21:02.782202 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.783254 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:02.739895 25276 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:02.785470 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:02.740947 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.737738 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.670468 29414 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:02.665287 29420 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:02.757061 25202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2387) took 2382 ms. Trace:
I20260709 12:21:02.767460 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.837445 29351 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.838462 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:02.737056 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:02.839672 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 102692us
I20260709 12:21:02.840576 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:02.842083 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:02.727289 29286 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:02.770529 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 79875.6us
I20260709 12:21:02.742062 29406 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.770833 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.771027 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:02.771283 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.849435 25196 raft_consensus.cc:2393] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:02.588814 29292 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:02.772791 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:02.772631 25853 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:21:02.750114 29374 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:02.692656 29276 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:21:02.737766 29376 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.806957 28827 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:02.808578 29220 consensus_meta.cc:287] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.796s	user 0.005s	sys 0.006s
I20260709 12:21:02.811149 29307 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:02.818881 29320 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.823899 29280 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.824980 29262 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:02.888108 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 112301us
I20260709 12:21:02.777307 29363 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.889724 25859 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:02.772439 29097 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.772578 29187 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:02.774657 29070 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.826999 25198 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:21:02.775820 29229 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:02.896433 29229 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.896966 29229 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:02.897949 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:02.828477 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 755) took 2202 ms. Trace:
I20260709 12:21:02.898738 25118 rpcz_store.cc:276] 0709 12:21:00.626560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.626362 (+999802us) service_pool.cc:224] Handling call
0709 12:21:01.635209 (+  8847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:02.505986 (+870777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:02.506041 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:02.516001 (+  9960us) log.cc:844] Serialized 26 byte log entry
0709 12:21:02.725881 (+209880us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:02.747259 (+ 21378us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.747953 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.748211 (+   258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.828269 (+ 80058us) raft_consensus.cc:1685] finished
0709 12:21:02.828289 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.828419 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":524682,"prepare.queue_time_us":17170,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":534580,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":24368,"spinlock_wait_cycles":7749888,"thread_start_us":576244,"threads_started":2,"wal-append.queue_time_us":251445}
I20260709 12:21:02.900884 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.831022 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:02.902263 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 44029.9us
I20260709 12:21:02.902952 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.904197 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.904788 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:02.833622 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.852999 29351 consensus_queue.cc:1059] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 12:21:02.813776 29319 consensus_meta.cc:287] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.215s	user 0.010s	sys 0.000s
I20260709 12:21:02.852061 25201 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:02.905305 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.768432 28830 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:02.854274 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 420498us
I20260709 12:21:02.910135 28830 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:02.750531 29315 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:21:02.836462 29420 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.821355 29081 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.861528 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.921868 25852 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:21:02.836552 25202 rpcz_store.cc:276] 0709 12:21:00.374283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.374399 (+   116us) service_pool.cc:224] Handling call
0709 12:21:00.374678 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:00.397182 (+ 22504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.397209 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:02.074038 (+1676829us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b180035ba20. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100def2a6 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a
0709 12:21:02.074428 (+   390us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b2c0000e5c8. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:21:02.074887 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:21:02.428305 (+353418us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:02.756547 (+328242us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.756769 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.756843 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.756879 (+    36us) raft_consensus.cc:1685] finished
0709 12:21:02.756890 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.757007 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22587,"raft.queue_time_us":40529,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":12034,"spinlock_wait_cycles":25042944,"thread_start_us":590964,"threads_started":2,"wal-append.queue_time_us":503889}
I20260709 12:21:02.865302 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:02.872078 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.873766 25193 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:02.775367 29369 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:02.877835 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.718272 29279 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.858999 29357 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:02.859817 29343 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:21:02.875352 29403 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:21:02.851835 29200 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:02.876410 29328 consensus_meta.cc:287] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.000s
I20260709 12:21:02.874534 29410 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:02.901918 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:02.907192 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.914283 25092 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:02.881222 29220 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:02.981606 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 67386.7us
I20260709 12:21:02.858469 29406 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:02.874274 29286 consensus_queue.cc:1059] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:21:02.923187 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.891606 29401 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:02.990967 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.948769 25123 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:02.959267 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.959771 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:02.977727 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.988181 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:02.995154 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:02.961676 29364 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.002s	user 0.012s	sys 0.000s
I20260709 12:21:02.923988 29420 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:02.909999 25197 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:02.983469 25201 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:03.008808 25851 raft_consensus.cc:1240] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:02.906793 29398 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:02.985935 25092 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:02.919916 29262 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:02.988533 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.989295 25275 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:02.982698 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:02.923213 29363 raft_consensus.cc:3055] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:02.951088 29417 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:02.999274 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.961122 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.978169 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:02.922912 29280 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:21:02.990805 29320 consensus_queue.cc:1059] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:21:02.987422 29380 consensus_queue.cc:1059] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:21:03.003921 29410 raft_consensus.cc:697] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:03.014276 25201 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:21:03.014655 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:02.929301 29433 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:21:02.987522 29351 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:02.922263 29414 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.015949 25197 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:21:03.020134 25269 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:21:02.997464 29343 raft_consensus.cc:697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:02.920318 29319 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.014009 25118 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:03.003805 29279 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:03.035183 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.084136 25123 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:03.047312 25859 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:21:03.024022 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:03.103591 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.106439 25118 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:21:03.107311 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:03.051342 29252 consensus_meta.cc:287] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.851s	user 0.010s	sys 0.000s
W20260709 12:21:03.114750 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 210044us
I20260709 12:21:03.020246 29284 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.025774 29081 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.009732 29364 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.063580 29406 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:03.116907 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 134270us
I20260709 12:21:03.118122 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.118743 29252 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.121454 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:03.116530 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.133064 25126 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:03.034627 29220 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:03.119695 25270 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:03.134240 25202 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:03.127620 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.134797 25123 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:03.130439 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.125334 29229 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:03.083843 29363 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:03.108495 29357 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:03.116290 29351 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:03.139701 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:03.140141 25267 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 13: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:03.062790 29282 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.126402 29320 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:03.142633 29081 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:03.143448 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.164364 25857 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:03.164789 25242 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.165329 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.142246 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:03.144392 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.027365 29369 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.172130 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
W20260709 12:21:03.110129 29230 consensus_queue.cc:1175] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
I20260709 12:21:03.176199 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.163980 25126 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:03.137166 29406 raft_consensus.cc:3055] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:03.182482 25195 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:03.161360 29386 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.123697 29284 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:03.185312 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 199449us
I20260709 12:21:03.184927 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:03.168774 29432 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:03.163268 29429 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:03.169085 29081 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:03.192315 25242 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:03.179387 29185 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:03.196262 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.197831 25276 raft_consensus.cc:2410] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:21:03.198550 25120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2561) took 2611 ms (client timeout 2113 ms). Trace:
I20260709 12:21:03.199683 25127 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:03.126179 29410 consensus_queue.cc:237] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:03.180917 29255 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:03.178848 29320 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:03.202809 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:03.179605 29416 consensus_queue.cc:1175] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" responder_term: 9 status { last_received { term: 9 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 9 index: 10 } }
I20260709 12:21:03.182730 29406 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:03.257706 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:03.258530 25123 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:03.195516 29081 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:03.193763 29432 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:03.249274 25126 raft_consensus.cc:2376] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12. Re-sending same reply.
I20260709 12:21:03.250958 25093 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.251314 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.194758 29386 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.184883 29343 consensus_queue.cc:237] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:03.254142 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:03.198968 25120 rpcz_store.cc:269] 0709 12:21:00.587099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.629125 (+ 42026us) service_pool.cc:224] Handling call
0709 12:21:03.198342 (+2569217us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b540021edd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:03.198488 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4575578880}
I20260709 12:21:03.196202 29357 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:03.287453 25093 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.252247 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.296074 25276 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:03.262246 29255 raft_consensus.cc:697] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:03.298096 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.298096 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.299013 25126 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:03.300200 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.279876 29321 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:03.305457 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:03.306115 25241 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.306298 25855 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:03.300981 25126 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:03.278805 29229 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:03.310391 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.190050 29363 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:03.201006 29429 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.255872 29320 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.313481 29097 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:03.317800 25126 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:03.324082 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.324625 25126 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:03.325381 25123 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:03.325677 25126 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 12:21:03.318356 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:03.288113 29380 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:03.288408 29432 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:03.315521 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:03.328714 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2125) took 1008 ms. Trace:
I20260709 12:21:03.294819 29357 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:03.328151 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2124) took 1008 ms. Trace:
I20260709 12:21:03.333797 25126 rpcz_store.cc:276] 0709 12:21:02.319727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.325136 (+1005409us) service_pool.cc:224] Handling call
0709 12:21:03.325396 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:03.327901 (+  2505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.328103 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:03.313905 29220 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:03.328195 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.329229 25123 rpcz_store.cc:276] 0709 12:21:02.319974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.326015 (+1006041us) service_pool.cc:224] Handling call
0709 12:21:03.327304 (+  1289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:03.327622 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.327680 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:03.327776 (+    96us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:03.327889 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.328442 (+   553us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.328622 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:03.313704 29351 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:03.335979 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:03.337908 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 145725us
I20260709 12:21:03.345418 25273 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:03.327250 29364 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.347105 25825 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:03.347465 29438 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:21:03.348708 29362 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:03.333026 29357 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:03.351874 25092 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.354167 25274 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:03.354316 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.354581 25123 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:03.356196 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:03.358137 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:03.358778 25859 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:21:03.360219 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.361145 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:03.329702 29097 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:03.359360 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 53335.8us
I20260709 12:21:03.355614 29070 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:03.315029 29406 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:03.365448 25092 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:03.375224 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:03.362329 29307 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:03.378691 29286 raft_consensus.cc:3055] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:03.379163 29286 raft_consensus.cc:740] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:03.380030 29070 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:21:03.381760 29444 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:21:03.381623 29070 consensus_queue.cc:1059] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:03.382653 29070 raft_consensus.cc:3055] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:03.383181 29070 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:03.384315 29070 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.385694 29070 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:03.388463 29320 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.389256 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1113) took 1086 ms. Trace:
I20260709 12:21:03.343906 29220 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:03.390859 29219 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.641s	user 0.002s	sys 0.009s
I20260709 12:21:03.390769 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:03.391373 29060 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:03.391574 29247 consensus_meta.cc:287] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.000s
W20260709 12:21:03.393029 29296 consensus_meta.cc:287] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.000s
I20260709 12:21:03.394850 29097 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:03.395016 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.368899 29445 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:03.395561 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:03.426571 25125 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:03.382767 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2107) took 1131 ms. Trace:
I20260709 12:21:03.402931 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:03.403194 25857 rpcz_store.cc:276] 0709 12:21:02.302983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.323261 (+ 20278us) service_pool.cc:224] Handling call
0709 12:21:02.323545 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:03.164799 (+841254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.389033 (+224234us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b5400373054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:03.389202 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1929493376}
I20260709 12:21:03.385849 29420 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.425062 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.356343 29443 consensus_queue.cc:1059] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:21:03.427538 25121 rpcz_store.cc:276] 0709 12:21:02.251256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.253443 (+  2187us) service_pool.cc:224] Handling call
0709 12:21:02.295204 (+ 41761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:02.427068 (+131864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:02.427097 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:02.427140 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:02.427177 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.382548 (+955371us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54001c98d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:03.382592 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.382716 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302762752}
I20260709 12:21:03.416267 25241 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:03.362483 29255 consensus_queue.cc:237] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.415750 29406 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:03.432066 29097 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:03.445910 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.433302 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:03.416056 29380 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:03.442041 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1134) took 1015 ms. Trace:
I20260709 12:21:03.459028 25825 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:03.447551 25090 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.424896 29321 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:03.461475 25090 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:03.462673 25121 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:03.426589 29416 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:03.457535 25270 rpcz_store.cc:276] 0709 12:21:02.426438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.521959 (+ 95521us) service_pool.cc:224] Handling call
0709 12:21:02.573658 (+ 51699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:03.134294 (+560636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.441700 (+307406us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b5400026f54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:03.441940 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1255177984}
I20260709 12:21:03.464195 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.464365 25092 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:03.419696 29219 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.477643 25855 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 13: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:03.478394 29451 consensus_queue.cc:1059] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:03.479401 29451 consensus_queue.cc:1059] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:03.481176 29451 raft_consensus.cc:3055] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:03.481549 29451 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:03.482241 29356 raft_consensus.cc:3055] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:03.482678 29356 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:03.483542 29356 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.470064 25092 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.488250 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:03.488912 25854 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:21:03.454748 29097 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:03.423555 29247 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.495776 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:03.426087 29296 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.464264 29380 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.500819 25241 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:03.485011 29356 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:03.502997 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.466156 29307 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:03.467769 29445 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:03.486198 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.485900 29398 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:03.470650 29362 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:03.508674 25121 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:03.486308 29386 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.502259 29097 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:03.504464 29380 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:03.466751 29450 consensus_queue.cc:1059] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:21:03.517637 25856 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:03.517170 25268 raft_consensus.cc:2368] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13.
I20260709 12:21:03.508324 29307 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:03.494665 29081 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:03.511263 29398 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:03.540089 29343 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:03.515276 29453 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:03.551079 29060 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.510604 29416 consensus_queue.cc:1059] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:21:03.551836 29445 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:03.557956 29307 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:03.581146 29060 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.588282 29296 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.589466 29220 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:03.591655 29060 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.565842 29398 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:03.593096 29185 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:03.564833 29443 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:03.566249 29343 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.613984 29380 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.616628 29380 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.617390 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2016) took 1170 ms. Trace:
I20260709 12:21:03.617818 25271 rpcz_store.cc:276] 0709 12:21:02.447368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.534188 (+ 86820us) service_pool.cc:224] Handling call
0709 12:21:02.534536 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:02.621392 (+ 86856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:02.621423 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:02.621464 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:02.621495 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.617135 (+995640us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b54002be3d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:03.617186 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.617329 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199304064}
I20260709 12:21:03.619041 29319 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.622262 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2014) took 1186 ms. Trace:
I20260709 12:21:03.622848 25275 rpcz_store.cc:276] 0709 12:21:02.436277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.497677 (+ 61400us) service_pool.cc:224] Handling call
0709 12:21:03.621972 (+1124295us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b540034e9d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:03.622157 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916564224}
I20260709 12:21:03.575717 29453 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:03.638685 29420 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:03.639822 29247 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:03.622855 29455 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:21:03.650894 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1126) took 1270 ms. Trace:
I20260709 12:21:03.651495 25267 rpcz_store.cc:276] 0709 12:21:02.379953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.383340 (+  3387us) service_pool.cc:224] Handling call
0709 12:21:03.650588 (+1267248us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b540034e4d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:03.650794 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1651012480}
I20260709 12:21:03.631210 29453 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:03.552071 29321 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.624023 29343 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:03.629536 29398 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.513352 29362 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.729671 29081 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:03.737309 25125 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:03.541074 29451 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.735810 29362 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:03.668290 29432 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:03.663900 29097 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.683389 29357 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:03.756117 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.759275 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.763254 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.766263 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:03.768362 29469 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:21:03.772543 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.764395 29377 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:03.778432 29377 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:03.778811 29377 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:03.779001 29262 raft_consensus.cc:3055] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:03.779376 29262 raft_consensus.cc:740] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:03.780180 29262 consensus_queue.cc:260] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:03.765730 29315 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:03.788749 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 1126) took 1018 ms. Trace:
I20260709 12:21:03.789031 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.790102 25121 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:03.791356 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:03.693029 25857 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:03.707796 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:03.797232 25854 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:21:03.708438 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.789213 25856 rpcz_store.cc:276] 0709 12:21:02.769993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.960862 (+190869us) service_pool.cc:224] Handling call
0709 12:21:03.788538 (+827676us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400726854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:03.788689 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987909376}
I20260709 12:21:03.709472 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1119) took 1278 ms. Trace:
W20260709 12:21:03.817438 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 51263.9us
I20260709 12:21:03.818801 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.814458 25860 rpcz_store.cc:276] 0709 12:21:02.431288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.431424 (+   136us) service_pool.cc:224] Handling call
0709 12:21:02.487016 (+ 55592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:02.487236 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:03.632428 (+1145192us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b1800460540. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2103ab64bc 00007f2100e0448b 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e1e455 00007f21079063c7 00007f2103f189a7 00007f2103f280bf
0709 12:21:03.632662 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 12:21:03.709134 (+ 76472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:03.709184 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:03.709234 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.709297 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.709414 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44837,"prepare.queue_time_us":129845,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":5793,"raft.queue_time_us":864,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":1664,"spinlock_wait_cycles":12569472,"thread_start_us":207019,"threads_started":2,"wal-append.queue_time_us":119703}
I20260709 12:21:03.824558 25242 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:03.830413 25274 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:03.832690 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:03.838279 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 368321us
I20260709 12:21:03.839056 25092 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:03.839516 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.692374 29398 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:03.823516 29187 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:03.853730 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.856487 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.833235 25854 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:03.857900 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:03.870110 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.875056 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:03.882344 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:03.882897 25125 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:03.885465 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.885578 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:03.885658 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:03.886219 25271 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:03.833528 29185 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:03.886684 25267 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:03.838716 29469 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:03.887019 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:03.887632 25125 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:03.889899 25270 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:03.889773 29185 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:03.918721 29410 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.922801 29185 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:03.922920 29410 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:03.924549 29401 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.925354 29410 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:03.929066 25268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1130) took 1548 ms (client timeout 1630 ms). Trace:
W20260709 12:21:03.929528 25268 rpcz_store.cc:269] 0709 12:21:02.381094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.383253 (+  2159us) service_pool.cc:224] Handling call
0709 12:21:03.928826 (+1545573us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400418a54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:03.928999 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428621696}
I20260709 12:21:03.935289 29279 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.936410 29279 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.944491 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:03.945227 25118 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:03.947487 29065 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.880733 29255 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:03.692027 29453 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.950313 29369 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:03.959647 29414 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:03.952863 29429 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:03.953387 29315 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:03.955502 29097 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:03.961997 29255 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:03.962512 29255 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:03.962631 25193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2430) took 2317 ms (client timeout 2009 ms). Trace:
I20260709 12:21:03.950263 29279 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.957324 25121 raft_consensus.cc:2393] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:03.849982 29187 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.977782 29219 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:03.958287 29453 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.871351 29307 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:03.980997 29307 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:03.884115 29364 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:03.955880 29070 consensus_meta.cc:287] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.000s
I20260709 12:21:03.921129 25269 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
W20260709 12:21:03.963086 25193 rpcz_store.cc:269] 0709 12:21:01.645485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.646761 (+  1276us) service_pool.cc:224] Handling call
0709 12:21:03.962420 (+2315659us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000a6254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:03.962535 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2819525632}
I20260709 12:21:04.023264 29432 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:03.954981 29343 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.026964 29343 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:03.880661 29366 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.029170 29366 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.031314 29366 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:04.033728 25125 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:04.034922 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:04.035511 25125 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
W20260709 12:21:04.038651 25090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.022s	sys 0.041s
W20260709 12:21:04.039022 25090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.022s	sys 0.041s
W20260709 12:21:04.039556 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 578142us
I20260709 12:21:04.040758 25090 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:04.041810 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:03.872200 29081 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:03.855408 29405 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:03.872469 29461 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:04.047611 29453 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:04.047709 29070 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.048835 25090 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:04.050175 25118 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
W20260709 12:21:04.051343 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.081940 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:04.055261 29255 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:04.057381 29357 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:04.061499 25167 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:04.071059 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:03.996780 29187 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:04.080924 25851 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:21:04.095315 25853 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
W20260709 12:21:04.095970 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 47213.2us
I20260709 12:21:04.080808 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:04.102651 25090 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:04.052664 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:04.102737 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:04.054502 29343 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.104316 25090 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:04.104096 29343 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:04.105470 29463 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:04.106170 29463 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:04.108417 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:04.110236 25851 raft_consensus.cc:2368] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11.
I20260709 12:21:04.109114 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:04.111366 25118 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:04.112740 25090 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:04.069823 29429 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.117533 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:04.123016 29429 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.100399 29453 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:04.094350 29470 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.126178 29470 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.071323 29127 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.066401 29062 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:21:04.109091 29081 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.068884 29307 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.129529 29463 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:04.141793 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1133) took 1730 ms. Trace:
I20260709 12:21:04.166316 25272 rpcz_store.cc:276] 0709 12:21:02.411192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.528883 (+117691us) service_pool.cc:224] Handling call
0709 12:21:02.529319 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:02.617991 (+ 88672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.141462 (+1523471us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b54002bf2d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:04.141713 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104722688}
I20260709 12:21:04.100728 29246 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:04.094491 29200 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.151541 29307 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.178596 29219 consensus_queue.cc:1059] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:04.179478 29219 raft_consensus.cc:3055] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:04.152352 29398 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:21:04.177816 29200 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.180658 29343 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:04.179859 29219 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:04.166288 29463 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.148249 29432 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.117352 29366 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.223197 29366 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.219079 29463 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:04.071966 29070 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.152268 29127 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.217532 29398 consensus_queue.cc:1243] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:04.237543 29255 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:04.224015 29432 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:04.254060 29219 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:04.348623 29477 log.cc:927] Time spent T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:21:04.348337 29416 raft_consensus.cc:3055] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:04.357028 29416 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:04.358222 29416 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.359814 29416 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:04.302595 29286 consensus_queue.cc:260] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.381757 29451 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:04.381804 29262 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:04.385565 29282 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:04.451026 25090 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:04.451922 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.467094 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.469158 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.472352 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2132) took 1450 ms. Trace:
I20260709 12:21:04.478899 29081 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:04.485695 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:04.487515 25125 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:04.488874 25167 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:04.489334 25125 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:04.492563 25195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2447) took 1848 ms (client timeout 2378 ms). Trace:
I20260709 12:21:04.496160 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2112) took 2243 ms. Trace:
I20260709 12:21:04.496671 25127 rpcz_store.cc:276] 0709 12:21:02.252627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.270594 (+ 17967us) service_pool.cc:224] Handling call
0709 12:21:03.199494 (+928900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:03.200093 (+   599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.495668 (+1295575us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b540021edd0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:04.495927 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2135528192}
W20260709 12:21:04.493252 25195 rpcz_store.cc:269] 0709 12:21:02.643486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.976617 (+333131us) service_pool.cc:224] Handling call
0709 12:21:04.491927 (+1515310us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54000a7154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:04.492246 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431290752}
I20260709 12:21:04.506752 29405 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:04.472994 25122 rpcz_store.cc:276] 0709 12:21:03.021852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.417630 (+395778us) service_pool.cc:224] Handling call
0709 12:21:03.417892 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:03.440131 (+ 22239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.440162 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:03.440204 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:03.440242 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.471773 (+1031531us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b5400105c54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:04.471849 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.472147 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50671872}
I20260709 12:21:04.507417 25118 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:04.517333 29284 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:04.520148 29292 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:04.521674 29377 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.742s	user 0.023s	sys 0.027s
I20260709 12:21:04.501719 29081 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.523643 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:04.507450 29405 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.529500 29398 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:04.530102 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:04.530891 25119 raft_consensus.cc:1240] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:04.530804 29070 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:04.530682 29398 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.531901 29405 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:04.536316 29127 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:04.537750 29081 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:04.550387 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 485504us
I20260709 12:21:04.553184 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:04.557449 28830 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:04.560439 28997 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:04.562211 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1116) took 2251 ms. Trace:
I20260709 12:21:04.563428 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:04.566983 25202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2448) took 1920 ms (client timeout 2238 ms). Trace:
W20260709 12:21:04.567584 25202 rpcz_store.cc:269] 0709 12:21:02.643791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.959483 (+315692us) service_pool.cc:224] Handling call
0709 12:21:04.563644 (+1604161us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54004132d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:04.563854 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304107264}
I20260709 12:21:04.575426 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:04.564808 29398 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:04.580670 25855 raft_consensus.cc:1240] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:04.566280 28997 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:04.570521 29127 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:04.592060 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:04.572873 29070 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.540619 29377 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:04.586647 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2576) took 1865 ms. Trace:
I20260709 12:21:04.597360 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:04.596140 25126 rpcz_store.cc:276] 0709 12:21:02.644705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.352475 (+707770us) service_pool.cc:224] Handling call
0709 12:21:03.352805 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:03.353012 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:03.420962 (+ 67950us) log.cc:844] Serialized 14 byte log entry
0709 12:21:04.477625 (+1056663us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b1800429880. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2103ab64bc 00007f2100e0448b 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae23a
0709 12:21:04.500626 (+ 23001us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:04.500755 (+   129us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:04.500934 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.501074 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.510363 (+  9289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5268,"prepare.queue_time_us":101349,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":16156,"raft.queue_time_us":39436,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":315,"spinlock_wait_cycles":5348096,"thread_start_us":147672,"threads_started":2,"wal-append.queue_time_us":145184}
I20260709 12:21:04.597904 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:04.598332 25853 raft_consensus.cc:2393] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:04.599113 29279 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.600165 29279 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.601343 29377 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:04.603453 29279 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:04.614480 29369 consensus_meta.cc:287] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.656s	user 0.016s	sys 0.036s
I20260709 12:21:04.615599 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:04.616704 25125 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:04.621053 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:04.621865 25125 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
W20260709 12:21:04.625444 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.627707 29432 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:04.628283 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:04.584786 28997 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:04.631313 29405 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:04.632944 29220 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:04.633523 29220 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:04.634802 25274 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:04.635017 29220 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.636160 29470 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:04.636852 29414 consensus_meta.cc:287] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.677s	user 0.000s	sys 0.018s
I20260709 12:21:04.637442 29070 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.594563 25273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35504 (request call id 5) took 1192 ms. Trace:
I20260709 12:21:04.638628 25855 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:21:04.642383 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 70472us
W20260709 12:21:04.641110 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 63086us
I20260709 12:21:04.643400 25273 rpcz_store.cc:276] 0709 12:21:03.372272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.372408 (+   136us) service_pool.cc:224] Handling call
0709 12:21:04.549580 (+1177172us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540002c954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f14735 00007f2103f0c9fa 00007f2108ed44c9 00007f2102450c54 00007f2102450be2 00007f2102450b11 00007f2102450a8c 00007f210244fd42 00007f210224948c 00007f21022488c6
0709 12:21:04.564633 (+ 15053us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386446592}
I20260709 12:21:04.633808 29405 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:04.642305 29363 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:04.658376 25851 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:04.666224 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.565090 25858 rpcz_store.cc:276] 0709 12:21:02.310224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.327697 (+ 17473us) service_pool.cc:224] Handling call
0709 12:21:02.720511 (+392814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:02.720782 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:21:02.752935 (+ 32153us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.923741 (+170806us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:02.923790 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:02.923836 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.923895 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.560959 (+1637064us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b1800460720. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100def2a6 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4
0709 12:21:04.561811 (+   852us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b540054e7d0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:04.561996 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34736,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":245,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":26888,"spinlock_wait_cycles":954933888,"thread_start_us":170226,"threads_started":1,"wal-append.queue_time_us":253020,"wal-append.run_cpu_time_us":1191,"wal-append.run_wall_time_us":1029553}
I20260709 12:21:04.663726 29366 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:04.673940 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:04.665766 25825 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.568s (SENT) [suppressed 24 similar messages]
W20260709 12:21:04.679363 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.682384 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.684404 25852 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:04.684558 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:04.681221 29220 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:04.666364 29127 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.683409 25241 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:04.713158 29219 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:04.743721 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:04.761678 25851 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:21:04.722597 25126 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:21:04.764719 25852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 1127) took 1983 ms (client timeout 2238 ms). Trace:
W20260709 12:21:04.715276 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 55650.9us
W20260709 12:21:04.789824 25852 rpcz_store.cc:269] 0709 12:21:02.779605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.922874 (+143269us) service_pool.cc:224] Handling call
0709 12:21:04.758549 (+1835675us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54005a3a54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:04.762767 (+  4218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3822262656}
I20260709 12:21:04.777184 29070 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:04.801064 25853 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:21:04.714078 29081 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:04.722951 29286 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:04.707737 29405 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.723413 29328 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:04.742015 29200 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:04.774816 29240 consensus_queue.cc:1059] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:21:04.810839 29127 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:04.810714 29279 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:04.813035 25125 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:04.746316 29392 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:04.813127 25009 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1f471cfad2348a09c4b699f01f9dfa9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:21:04.814479 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:04.761842 29429 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:04.725606 28997 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.835878 29252 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:04.837193 29315 consensus_queue.cc:1059] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
W20260709 12:21:04.839644 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.844002 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.850370 25167 leader_election.cc:400] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11.
I20260709 12:21:04.854215 25167 leader_election.cc:403] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:21:04.833456 29328 raft_consensus.cc:697] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:21:04.855721 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 191930us
I20260709 12:21:04.850466 29296 raft_consensus.cc:3055] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:04.838979 29405 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.866390 29188 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.864849 29392 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:04.897255 29328 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.935204 29188 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.885039 29284 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:21:04.937642 29188 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:04.935436 29392 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.923353 25198 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:04.886394 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:04.908227 25127 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:21:04.930974 29187 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.815s	user 0.007s	sys 0.010s
W20260709 12:21:04.876652 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 141215us
I20260709 12:21:04.953291 29187 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:04.894361 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 59925.1us
I20260709 12:21:04.955749 29187 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:04.868398 29229 raft_consensus.cc:3055] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:04.956840 29229 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:04.904677 29081 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:04.928035 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:04.885944 25090 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:04.907593 29362 consensus_meta.cc:287] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.146s	user 0.021s	sys 0.029s
I20260709 12:21:04.914633 25123 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:04.866779 29307 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:04.885356 29366 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:21:04.943285 29220 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:04.913399 29416 consensus_meta.cc:287] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.514s	user 0.016s	sys 0.004s
I20260709 12:21:04.928750 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:04.939936 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:04.940871 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:04.864822 29296 raft_consensus.cc:740] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:04.911191 28997 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:04.886492 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:04.904258 29185 consensus_meta.cc:287] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.980s	user 0.010s	sys 0.017s
I20260709 12:21:04.869810 29262 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:04.957998 29229 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.986629 25854 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:21:04.987336 29229 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:04.958926 25195 raft_consensus.cc:2393] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:21:04.959658 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 73823.6us
I20260709 12:21:04.959932 29467 raft_consensus.cc:2764] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:04.960414 29362 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:04.993120 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:04.993752 25854 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:04.962246 29453 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:04.994480 29453 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:04.995559 29453 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:04.996990 29453 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:04.998379 25272 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:04.962935 25269 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:05.002101 29240 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:05.004359 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.005532 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:05.006229 29467 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:05.006415 25120 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:05.007004 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:05.005851 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.006901 29467 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.007894 25854 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:05.009505 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:05.010823 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.010386 25854 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.011641 25198 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:05.012156 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.012921 25194 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:21:04.963963 25852 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:21:05.014801 25852 pending_rounds.cc:85] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 8
I20260709 12:21:05.015067 25852 pending_rounds.cc:107] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:21:05.015373 25852 raft_consensus.cc:2889] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.016345 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:04.965438 29296 consensus_queue.cc:260] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.016184 25198 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:04.972703 29392 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:05.018203 29440 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.973258 29185 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.018980 29440 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:04.977522 29262 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.021689 29262 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:04.982872 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:05.022352 29443 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:04.985122 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:05.023285 29443 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.013218 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.025470 25200 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:05.026499 29443 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:05.021812 29440 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.014328 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:05.030632 25859 raft_consensus.cc:2393] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:05.015067 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.036432 28983 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:04.964457 29405 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:05.021978 29185 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:04.962584 29220 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.039520 29276 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:05.040091 29276 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:05.040277 29377 raft_consensus.cc:3055] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:05.040684 29377 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:05.041322 29276 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.041651 29377 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.042896 29276 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:05.043148 29377 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:05.047591 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.048586 25194 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:05.048928 25197 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:05.051481 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2587) took 1011 ms. Trace:
I20260709 12:21:05.051906 25123 rpcz_store.cc:276] 0709 12:21:04.040620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.469755 (+429135us) service_pool.cc:224] Handling call
0709 12:21:04.914162 (+444407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:04.960791 (+ 46629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:05.051286 (+ 90495us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400454050. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:05.051425 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020776832}
I20260709 12:21:05.052914 29220 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.055218 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:04.908259 25241 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:21:05.058461 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 150376us
I20260709 12:21:05.059542 29284 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:05.037067 25200 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:04.902069 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:04.963797 25271 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 13: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:05.065039 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.065999 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.013170 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:04.981855 25855 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:05.073168 29362 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:05.074214 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.074213 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.076352 29220 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:05.076789 29220 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:05.077167 29220 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:05.080120 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:05.083626 29463 consensus_meta.cc:287] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.854s	user 0.015s	sys 0.005s
I20260709 12:21:05.084182 29463 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.009408 29467 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:05.084489 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 71508.3us
I20260709 12:21:05.087996 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.092233 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:05.095510 29362 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:05.096115 29362 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:05.096640 25825 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:05.102313 29416 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:05.102769 29416 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:05.103121 29416 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:05.103677 25196 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:05.104440 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.106298 25201 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:05.106413 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.106964 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.107613 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.053756 29081 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11.
I20260709 12:21:05.108366 25201 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:05.102314 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.107779 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.109849 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.114840 25200 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:05.115156 29276 consensus_queue.cc:1059] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:05.116760 29292 raft_consensus.cc:3055] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:05.117231 29292 raft_consensus.cc:740] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:05.118512 29292 consensus_queue.cc:260] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.120429 29292 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:05.126124 25193 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
W20260709 12:21:05.126888 29451 consensus_meta.cc:287] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.744s	user 0.013s	sys 0.005s
I20260709 12:21:05.127476 29315 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.098368 29219 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:05.128230 29219 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:05.127992 29315 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.128755 29219 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.129015 25168 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:05.129277 25270 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:05.131145 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.131587 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.132253 25197 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:21:05.132966 29220 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.133698 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.135221 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.128014 25825 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:05.136425 29467 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:05.136601 29307 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:05.137117 29467 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.137429 25854 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:05.125674 29416 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.140136 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.140825 25860 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:05.140414 29416 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.153097 25269 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:05.159562 25118 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:21:05.162504 25090 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.163372 29405 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:05.163851 29405 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:05.164157 25167 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:05.164446 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.164966 29432 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:05.164819 29405 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.165369 29432 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.166193 29432 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.166287 28997 consensus_queue.cc:1059] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:21:05.166862 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.167423 28997 consensus_queue.cc:1059] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:05.168478 29081 raft_consensus.cc:3055] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:05.168970 29081 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:05.169494 28997 raft_consensus.cc:3055] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:05.160101 25118 pending_rounds.cc:85] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 4
I20260709 12:21:05.172331 25118 pending_rounds.cc:107] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:21:05.172672 25118 raft_consensus.cc:2889] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.170622 28983 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:05.173808 25168 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:05.182889 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.169919 28997 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:05.187563 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:05.194234 25168 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:05.194891 29307 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.194964 29433 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:05.097187 29362 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:05.202607 29363 consensus_meta.cc:287] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.004s
I20260709 12:21:05.203922 29463 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:05.206700 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 47529.8us
I20260709 12:21:05.207834 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.208863 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.177699 28983 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.171742 29220 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:05.213479 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.217696 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.215982 29307 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.214061 29433 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.222337 29433 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:05.222563 29127 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:05.223084 29127 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:05.223459 29127 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:05.224572 29229 raft_consensus.cc:2764] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:05.216940 28983 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:05.229389 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 86222.8us
I20260709 12:21:05.230445 25195 raft_consensus.cc:2410] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:21:05.231580 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:05.232465 25120 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12. Ops: [11.4-11.4]
I20260709 12:21:05.232527 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:05.233291 25127 raft_consensus.cc:2376] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10. Re-sending same reply.
I20260709 12:21:05.233637 29467 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:05.222529 25825 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:05.234371 29286 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:05.234839 29286 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.235044 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.235239 29286 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.235579 29406 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.237753 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:05.238451 29252 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:05.238632 25120 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:05.239002 29252 raft_consensus.cc:697] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:05.239292 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:05.239841 29296 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:05.239982 29252 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.236153 29406 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.240978 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:05.242203 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:05.240499 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:05.243186 25122 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:21:05.242751 25124 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 5.
W20260709 12:21:05.245792 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 185781us
I20260709 12:21:05.213918 29451 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:05.251499 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.251997 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.253616 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.254870 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:05.255445 25127 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:05.212069 29416 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:21:05.256989 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:05.258961 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.260026 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.249905 29429 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:05.259483 25119 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:05.251257 29451 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.250787 29284 raft_consensus.cc:697] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:05.266652 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.170136 29081 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.268796 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:05.263718 25126 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:05.271788 25198 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 13: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:05.264696 29429 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:05.275178 25120 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:05.275405 29429 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.278667 29081 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:05.282507 29127 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.286968 25090 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.253609 29219 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.270670 29451 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:05.258185 29432 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.295398 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:05.268118 29307 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.321820 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:05.301314 25023 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41752 (request call id 364) took 23098 ms (client timeout 15000 ms). Trace:
I20260709 12:21:05.302237 25022 catalog_manager.cc:5697] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 5 to 9, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 9 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.303783 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.312733 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:05.330317 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.272608 29328 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:21:05.294479 29366 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:05.335937 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.338354 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.332468 25127 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:05.347195 25125 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:05.326139 29315 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:05.352458 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.363610 25119 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:21:05.346630 29467 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:05.360656 25121 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:05.355798 29127 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.361531 29307 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:05.362323 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 71186.7us
W20260709 12:21:05.362576 29492 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:21:05.362985 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.368474 29435 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.307691 28997 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.370296 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.371143 29494 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.371354 29432 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:05.374652 29220 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.375859 29416 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.425683 29363 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:05.426641 29416 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.426976 29363 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.427465 29286 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.428296 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:05.377231 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.428964 25851 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:05.429313 29363 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:05.377990 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.378958 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.431126 25123 raft_consensus.cc:2393] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:05.431576 25859 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:05.426653 29220 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.433212 29219 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:05.434278 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:05.434646 29220 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.435075 29286 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.436372 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.437505 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.438392 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.438524 25241 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:05.439869 29296 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:05.440016 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.440258 29296 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.380553 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.377293 29406 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.440969 25201 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:05.381860 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.449699 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.382695 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.383018 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.384087 29328 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.346952 29366 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:05.388732 25198 raft_consensus.cc:2410] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:21:05.398664 25270 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:05.399257 25273 raft_consensus.cc:2393] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:05.400925 25093 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:05.401463 29463 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:05.401224 25022 catalog_manager.cc:5697] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 7 to 8, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 8 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.402109 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.402231 29307 raft_consensus.cc:697] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:05.403473 25268 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:05.406322 29467 consensus_queue.cc:1059] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:05.407007 29255 consensus_queue.cc:1059] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:21:05.464155 28997 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:05.465376 29433 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.408511 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:05.468147 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 59743.7us
I20260709 12:21:05.408064 29429 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.330313 29284 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.432740 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:05.440944 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.379433 29451 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.379056 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.440658 29296 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:05.456827 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 55987us
I20260709 12:21:05.455924 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:05.462706 25194 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:05.462387 29435 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.481933 25199 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:05.482631 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.483292 25199 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:05.483850 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.483947 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.484738 25195 raft_consensus.cc:2368] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10.
I20260709 12:21:05.485064 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.485131 29377 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:05.485476 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.486320 29493 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:05.470923 29494 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.463160 28983 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:05.490317 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.492408 25859 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:05.493009 29416 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.493321 25197 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:05.493743 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:05.493650 25022 catalog_manager.cc:5697] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 4 to 7, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 7 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:05.495386 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:05.495234 25022 catalog_manager.cc:5697] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 9 to 12, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 12 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:05.496852 25022 catalog_manager.cc:5697] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 7 to 8, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 8 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:05.463076 29307 consensus_queue.cc:237] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.498231 25856 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:05.498399 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:05.464090 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.466432 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.466802 29328 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.455930 29366 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.458377 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:05.470386 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 87779.1us
I20260709 12:21:05.501590 25271 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 6.
I20260709 12:21:05.486603 29467 raft_consensus.cc:3055] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:05.508358 25275 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 13: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:05.489048 29494 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:05.494405 25859 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.406973 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:05.466193 25200 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:05.466112 29255 raft_consensus.cc:3055] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:05.525883 29255 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:05.526038 29328 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:05.526988 29255 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.528316 29255 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:05.529151 29451 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:05.530104 25269 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:21:05.323282 25023 rpcz_store.cc:269] 0709 12:20:42.202472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.202710 (+   238us) service_pool.cc:224] Handling call
0709 12:21:05.301046 (+23098336us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:58.607318 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:58.875797 (+268479us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:58.884956 (+  9159us) write_op.cc:435] Acquired schema lock
0709 12:20:58.888246 (+  3290us) tablet.cc:662] Decoding operations
0709 12:20:59.196663 (+308417us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:59.196747 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:59.196775 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:20:59.197640 (+   865us) tablet.cc:701] Row locks acquired
0709 12:20:59.197690 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:20:59.197885 (+   195us) write_op.cc:270] Start()
0709 12:20:59.198016 (+   131us) write_op.cc:276] Timestamp: P: 1783599659197809 usec, L: 0
0709 12:20:59.198057 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:20:59.198690 (+   633us) log.cc:844] Serialized 4005 byte log entry
0709 12:20:59.862468 (+663778us) op_driver.cc:464] REPLICATION: finished
0709 12:21:00.042630 (+180162us) write_op.cc:301] APPLY: starting
0709 12:21:00.042715 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:00.083993 (+ 41278us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:00.084109 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:00.303785 (+219676us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:00.304125 (+   340us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:21:00.304196 (+    71us) write_op.cc:312] APPLY: finished
0709 12:21:00.304669 (+   473us) log.cc:844] Serialized 97 byte log entry
0709 12:21:00.304901 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:00.305092 (+   191us) write_op.cc:454] Released schema lock
0709 12:21:00.305157 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:00.305670 (+   513us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:00.305715 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2613138,"reported_tablets":39,"spinlock_wait_cycles":2944,"child_traces":[["op",{"apply.queue_time_us":174093,"apply.run_cpu_time_us":19438,"apply.run_wall_time_us":262978,"cfile_cache_hit":38,"cfile_cache_hit_bytes":39786,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6221,"cfile_init":2,"lbm_read_time_us":1138,"lbm_reads_lt_1ms":12,"num_ops":10,"prepare.queue_time_us":106256,"prepare.run_cpu_time_us":6748,"prepare.run_wall_time_us":644205,"replication_time_us":636632,"thread_start_us":173322,"threads_started":2}]]}
I20260709 12:21:05.531651 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:05.502123 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.532802 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.534379 25168 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:05.502699 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.536262 25193 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:05.503925 25270 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:05.505373 25196 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 14: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:05.485908 25273 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:05.510772 29187 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:05.540179 29187 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.540570 29187 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.470302 29406 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:05.541121 29406 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.541499 29406 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.483322 29435 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:05.510890 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.512138 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.540504 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.512993 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.448081 29315 consensus_queue.cc:1059] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:21:05.515242 29363 raft_consensus.cc:3055] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:05.515538 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.516883 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.517359 29432 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:05.545172 25022 catalog_manager.cc:5697] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.518183 25194 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:05.518368 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.508136 29467 raft_consensus.cc:740] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:05.532711 28983 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.537966 29081 consensus_queue.cc:1059] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:05.539261 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:05.539424 29433 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.512531 29429 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.544631 25274 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:05.551666 25275 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.553237 25267 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:21:05.553231 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 47278.9us
I20260709 12:21:05.517557 25090 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:05.554787 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 49840.6us
I20260709 12:21:05.569367 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.556617 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.570463 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:05.558588 25271 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:05.571341 25118 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 14: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:05.561555 25269 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:05.561609 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.562389 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.534984 29252 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:05.572386 25196 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.569098 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:05.551189 29363 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:05.570195 25272 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:05.575731 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:05.574472 25200 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 5.
W20260709 12:21:05.575138 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 57675us
I20260709 12:21:05.583176 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.584215 25274 raft_consensus.cc:2368] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11.
I20260709 12:21:05.558369 29416 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:05.591480 25242 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:05.588553 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.575337 25022 catalog_manager.cc:5697] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 9, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 9 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.596632 25267 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12. Ops: [11.4-11.4]
I20260709 12:21:05.591151 25090 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:05.602603 25022 catalog_manager.cc:5697] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 5 to 7, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 7 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:05.583225 29220 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:05.598129 25168 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:05.574244 29252 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:05.582952 29463 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:05.614491 29363 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.591051 29416 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:05.618712 25274 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:21:05.619851 29229 raft_consensus.cc:3055] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:05.622987 25270 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:05.626360 29328 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:05.626421 29467 consensus_queue.cc:260] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.636330 25196 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:05.682487 25022 catalog_manager.cc:5697] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 9, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 9 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.638958 25275 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:05.645673 25859 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:05.647524 25276 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:05.605036 29435 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:05.685299 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:05.657199 29060 raft_consensus.cc:3055] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:05.686143 25167 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:05.661954 25272 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:05.662330 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.663053 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.664870 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.601985 29429 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:05.665866 29377 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:05.691205 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.691599 29377 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:05.691990 25274 raft_consensus.cc:2393] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 6: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:05.589622 29315 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:05.609524 25822 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:21:05.693279 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 148845us
I20260709 12:21:05.694590 25822 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:05.694816 25859 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:05.695425 25822 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:05.667505 25268 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:05.696313 29127 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:05.696643 29501 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:05.697046 29501 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.697361 29501 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:05.672245 29240 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.686693 28997 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:05.698379 28997 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:05.698349 29240 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:05.672763 29496 log.cc:927] Time spent T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:21:05.673110 25854 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:05.691491 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:05.674175 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 83103.2us
I20260709 12:21:05.672003 29296 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:05.678576 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 89569.9us
W20260709 12:21:05.679339 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 90855.2us
I20260709 12:21:05.701268 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.701480 25022 catalog_manager.cc:5697] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 4 to 9, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 9 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.702282 29296 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:05.702980 29296 consensus_queue.cc:1059] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:05.703888 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:05.704437 25854 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:05.704077 25022 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:05.705106 29467 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:05.700706 29406 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.708091 29406 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.708748 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:05.709344 25126 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:21:05.710501 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:05.710670 25126 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:05.705505 25022 catalog_manager.cc:5697] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 7 to 8, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 8 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:05.711573 29363 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:05.711688 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:05.712061 25022 catalog_manager.cc:5697] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 5 to 8, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 8 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:05.713001 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:05.714071 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.714116 29081 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:05.714804 29081 raft_consensus.cc:697] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:05.716316 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:05.715953 29081 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.716842 25127 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.687531 29262 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:05.719528 29262 raft_consensus.cc:697] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:05.720376 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:05.721010 25120 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:05.720602 29262 consensus_queue.cc:237] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.680125 29220 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:05.713424 25022 catalog_manager.cc:5697] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 5 to 8, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 8 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:05.682804 29229 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:05.726111 29220 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:05.726377 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:05.726722 29229 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.682760 29463 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.730129 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.730510 29463 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:05.730957 25267 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 14: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:05.731887 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.731617 29377 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.732857 29377 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:05.733047 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.689401 29429 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:05.734241 29429 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.735895 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.738507 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.738708 29188 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:05.739141 25276 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:05.739349 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.681375 29252 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.739797 29188 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:05.740306 29188 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:05.689631 29435 raft_consensus.cc:697] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:05.686780 29060 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:05.699024 28997 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.674656 29405 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:05.711095 25121 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:05.708220 29187 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.680986 29219 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:05.658255 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.681668 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 94787.5us
I20260709 12:21:05.722844 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:05.701268 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:05.729995 29229 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:05.739866 25200 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.682916 29416 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:05.741457 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:05.741102 25196 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:05.742708 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:05.745847 25022 catalog_manager.cc:5697] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.774394 25092 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:05.756438 29188 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.775596 25022 catalog_manager.cc:5697] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:05.776691 29188 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:05.750670 25127 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:05.778748 29435 consensus_queue.cc:237] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.780869 29060 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.782282 29060 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:05.783501 25165 connection.cc:256] RPC call timeout handler was delayed by -1.2933070839999345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 12:21:05.783977 25165 connection.cc:256] RPC call timeout handler was delayed by -1.0599411270000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 12:21:05.785136 25165 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:05.785856 25268 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:05.786351 29187 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:05.786599 29463 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.772945 29219 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:05.788242 29219 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:05.747251 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:05.790418 25859 raft_consensus.cc:2410] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:21:05.790808 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 89616.6us
I20260709 12:21:05.759305 29512 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:21:05.769120 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 73794.3us
I20260709 12:21:05.777272 25022 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:05.792292 25273 raft_consensus.cc:2393] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:05.743016 29307 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:05.700739 29240 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:05.790611 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:05.768852 25854 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:05.798785 25822 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:05.800954 25241 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:05.810669 29499 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:05.810302 25022 catalog_manager.cc:5697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 7 to 8, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 8 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:05.811528 29499 consensus_queue.cc:1243] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:05.811316 28997 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.812062 29451 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:05.812276 25022 catalog_manager.cc:5697] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.813058 29276 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:05.813588 28997 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.814085 25194 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:05.807626 29490 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:21:05.807922 29286 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:05.800282 29494 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:05.818014 29494 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:05.819011 29494 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.822150 25194 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:21:05.824142 29463 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:05.827558 25093 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:05.813817 25022 catalog_manager.cc:5697] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:05.839339 25022 catalog_manager.cc:5697] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 1 to 8, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 8 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.851889 25200 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:05.831399 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:05.853834 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.853060 25022 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 4 to 7, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 7 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.853745 25273 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:05.855497 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 145621us
I20260709 12:21:05.853238 25093 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:05.827595 29451 raft_consensus.cc:697] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:05.860281 25022 catalog_manager.cc:5697] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 4, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:05.862651 29432 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:05.861970 25022 catalog_manager.cc:5697] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 5 to 6, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 6 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.863113 29432 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:05.863772 25022 catalog_manager.cc:5697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 3 to 4, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:05.864076 29432 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.865491 29432 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:05.865191 25022 catalog_manager.cc:5697] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 7 to 8, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 8 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.839313 29463 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:05.801532 29307 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:05.869005 25854 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:05.871726 25092 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:05.873533 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 45028.3us
I20260709 12:21:05.766101 29366 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:05.876873 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.874481 29219 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.884610 29219 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:05.885761 29219 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:05.886942 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.866488 29463 raft_consensus.cc:697] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:05.898623 25242 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:05.861423 29451 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.870849 29307 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:05.873410 29286 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:05.912868 25859 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:05.878225 29490 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:05.915793 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:05.918957 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.924579 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.878737 29406 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.867081 29501 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:05.936637 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 56300.1us
I20260709 12:21:05.914589 29219 raft_consensus.cc:697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:05.920250 29405 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:21:05.973759 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 58065.2us
I20260709 12:21:05.920715 29286 raft_consensus.cc:697] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:05.967794 29296 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:05.936118 29255 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.990489 25853 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 12:21:05.928764 29429 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:05.999972 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:05.921272 29416 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:06.002619 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 130972us
I20260709 12:21:05.977172 29512 raft_consensus.cc:697] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:05.971019 29362 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:21:05.969985 29284 consensus_queue.cc:1059] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:21:05.967449 29490 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:05.972364 29406 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:06.012964 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 214224us
I20260709 12:21:06.019786 25860 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:06.024444 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.006448 29433 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:06.033351 25822 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:06.014078 29187 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:06.006796 29519 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:06.011165 29493 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:21:06.010871 29255 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:06.067202 25822 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:06.046895 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:06.074098 29501 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:06.078191 29523 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.078768 29523 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.080935 29523 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:06.000896 29463 consensus_queue.cc:237] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:06.082649 29519 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.081559 29512 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.091674 25273 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
W20260709 12:21:06.094159 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.027841 29220 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:06.097565 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 108862us
I20260709 12:21:06.108397 29521 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:06.108940 29521 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.109264 29521 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:06.110267 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:06.110985 25122 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:06.113291 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:06.113708 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:06.114568 25126 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:06.118649 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 71924.3us
I20260709 12:21:06.096824 29366 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:06.122136 25119 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 12:21:06.124939 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:06.127751 25165 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:06.129417 25120 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:06.130461 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:06.131201 25122 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:06.106279 29513 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.047633 29219 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.104038 29501 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:06.139504 25120 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:06.140069 29416 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:06.142813 25165 leader_election.cc:400] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11.
I20260709 12:21:06.123180 29262 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:06.138005 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:06.084961 29286 consensus_queue.cc:237] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:06.104648 29127 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 12:21:06.139230 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 139811us
I20260709 12:21:06.149557 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:06.150882 25268 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:06.150209 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.157910 25852 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:21:06.161008 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.138300 28983 raft_consensus.cc:2764] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:21:06.167114 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:06.153029 29262 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.167806 25274 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:06.143273 29501 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:06.180976 25273 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:06.144053 29405 raft_consensus.cc:697] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:06.146634 29525 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:06.199918 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 453635us
I20260709 12:21:06.146597 29284 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:21:06.179684 29501 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:06.184953 29429 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:06.162103 29362 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:21:06.192096 29187 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.209776 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:06.211504 29362 consensus_queue.cc:1243] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:21:06.218503 29405 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.190626 29523 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:21:06.192425 29519 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:06.185822 29328 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:21:06.201823 29518 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:06.144300 29513 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.242383 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:06.236209 25825 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:06.276845 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 67153.8us
I20260709 12:21:06.278090 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:06.279876 25124 raft_consensus.cc:2393] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:06.243774 29229 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:06.244380 25274 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:06.216048 29187 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.292369 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:06.293892 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:06.241503 29416 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:21:06.296758 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.299631 25275 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:06.279980 29406 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:06.282812 29127 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:06.203925 29525 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.303215 25859 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:06.308310 29517 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.315s	user 0.000s	sys 0.004s
I20260709 12:21:06.312894 29307 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.314100 25852 raft_consensus.cc:1240] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:06.291553 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.301379 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 65339.4us
I20260709 12:21:06.284047 28983 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:06.290889 29220 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:06.337745 29520 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:06.338932 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:06.344439 25119 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:06.351504 25822 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:06.298859 29490 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:06.458762 29536 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 12:21:06.467306 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.473682 25118 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:06.397269 25126 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
W20260709 12:21:06.395705 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 64045.1us
I20260709 12:21:06.291524 29435 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:21:06.315642 29127 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:06.411072 29539 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:06.416780 29252 consensus_meta.cc:287] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.001s
W20260709 12:21:06.420286 29432 consensus_meta.cc:287] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.554s	user 0.000s	sys 0.011s
I20260709 12:21:06.420647 29296 raft_consensus.cc:3055] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:06.277279 29518 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.408327 29520 consensus_queue.cc:1059] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 12:21:06.427143 29467 consensus_meta.cc:287] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.003s
I20260709 12:21:06.400296 29416 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:06.433101 29521 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:06.400081 29060 consensus_meta.cc:287] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.004s
W20260709 12:21:06.443325 29533 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:21:06.444036 29516 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:21:06.445914 29513 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:06.448314 29307 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:06.449263 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:06.451282 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 158993us
W20260709 12:21:06.503803 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 54627.7us
I20260709 12:21:06.504017 25165 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:06.504626 29521 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:06.504813 29467 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:06.505209 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:06.452271 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:06.506706 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 54541.2us
I20260709 12:21:06.506927 25200 raft_consensus.cc:606] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:06.506978 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.507568 25200 raft_consensus.cc:614] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:06.507727 29435 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:06.508669 29513 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:06.479867 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:06.507038 29060 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:06.480684 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.482870 25852 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:06.494282 29362 consensus_queue.cc:1059] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:21:06.487083 29229 consensus_queue.cc:1059] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:06.511081 29490 raft_consensus.cc:3055] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:06.511492 29490 raft_consensus.cc:740] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:06.511811 29229 raft_consensus.cc:3055] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:06.512209 29229 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:06.512411 29490 consensus_queue.cc:260] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.513144 29229 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.513711 29490 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:06.515417 29500 consensus_queue.cc:1059] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:06.516528 29500 raft_consensus.cc:3055] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:06.516857 29500 raft_consensus.cc:740] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:06.518594 25165 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:06.522167 29060 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:06.522972 29060 consensus_queue.cc:1059] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:06.523876 29435 raft_consensus.cc:3055] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:06.524287 29435 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:06.524828 29229 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:06.496449 29524 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:06.526697 29524 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:06.527822 29524 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:06.529328 29524 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:06.507429 29416 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:06.531078 29416 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.493611 29252 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.538941 25854 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:06.543524 29252 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:06.545035 28997 consensus_queue.cc:1059] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:06.546311 28997 raft_consensus.cc:3055] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:06.546693 28997 raft_consensus.cc:740] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:06.547674 28997 consensus_queue.cc:260] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.549082 28997 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:06.551343 29522 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:06.552014 29522 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:06.561653 29255 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:06.567191 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.571005 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:06.571116 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:06.571624 25200 raft_consensus.cc:606] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:06.573704 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:06.575567 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:21:06.576323 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.282498 29515 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:21:06.484818 29127 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:06.498548 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:06.491793 29296 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:06.492503 29539 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:06.500167 29240 raft_consensus.cc:3055] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:06.500979 29518 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:06.505321 29467 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.517684 29500 consensus_queue.cc:260] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.525164 29435 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:06.507472 25825 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:06.471480 29262 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:06.495371 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.581024 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:06.583243 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.611159 25273 raft_consensus.cc:2410] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:21:06.584971 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:06.592106 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:06.612080 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:06.598851 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.614107 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.602407 25272 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:06.604105 25855 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:06.616951 25267 raft_consensus.cc:2368] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7.
I20260709 12:21:06.605238 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.605937 29292 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.607458 29518 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.613205 25193 raft_consensus.cc:2410] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 12 because replica has last-logged OpId of term: 11 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:21:06.618737 25194 raft_consensus.cc:2393] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 7: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:06.600988 29276 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.594528 29240 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:06.625772 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:06.626482 25197 raft_consensus.cc:2393] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:06.627374 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:06.627836 25198 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:06.628849 25200 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:06.629602 25242 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:06.630335 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.608464 29467 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:06.630988 25202 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:21:06.634783 25202 pending_rounds.cc:85] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 7
I20260709 12:21:06.635105 25202 pending_rounds.cc:107] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:21:06.635327 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:06.632819 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.635875 25273 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:06.604390 29219 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:06.632652 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.636770 25195 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:06.633227 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:06.637660 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 130255us
I20260709 12:21:06.621465 28983 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.635228 29531 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:06.638948 29518 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.639132 29219 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.641487 29518 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:06.643101 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.638610 28983 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:06.644033 25193 raft_consensus.cc:2410] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 12 because replica has last-logged OpId of term: 11 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:21:06.643890 29296 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.644994 29296 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:06.642315 29522 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:06.647703 29544 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:21:06.635358 25202 raft_consensus.cc:2889] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:06.649521 25201 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:06.653214 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.656425 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:06.657258 25126 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:06.661055 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.661194 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.662047 25200 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:06.666950 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:06.667335 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 47396.8us
I20260709 12:21:06.670238 25200 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:06.670940 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:06.672138 25120 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:06.672397 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:06.672998 25194 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:06.624814 29292 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.677809 25123 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:06.642222 29540 consensus_queue.cc:1059] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:21:06.684350 25196 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:06.689400 25860 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:06.695013 25193 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:21:06.642284 29493 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:06.645861 28983 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:06.699796 25273 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:06.703648 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.704481 25822 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:06.669042 29416 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:06.696005 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.708423 25825 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:06.712973 25270 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 8: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:21:06.712548 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 290322us
I20260709 12:21:06.714531 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:06.634588 29276 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.716720 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:06.717082 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:06.717607 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.718293 25202 raft_consensus.cc:2393] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 7: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:06.718164 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:06.719204 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.719820 25195 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:06.725183 25193 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:06.727650 25197 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:06.727653 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:06.728273 25123 pending_rounds.cc:85] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 10
I20260709 12:21:06.728610 25123 pending_rounds.cc:107] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:21:06.728910 25123 raft_consensus.cc:2889] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:06.729646 25120 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:21:06.730365 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:06.730932 25126 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:06.732218 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:06.714076 29513 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:06.735503 29539 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:06.740540 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.689246 29219 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:06.796952 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:06.797360 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.682134 29501 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:06.781183 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 65378.2us
I20260709 12:21:06.749024 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.742157 29516 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:06.708487 29252 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:06.781262 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 95598.6us
I20260709 12:21:06.802981 25274 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 14: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:21:06.812551 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 98110us
I20260709 12:21:06.806134 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.806445 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.809847 25197 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:21:06.813319 25276 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:06.804903 25269 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:06.802568 29286 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:21:06.814740 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.818320 25276 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:06.818503 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.819186 25270 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:06.795727 29518 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.820451 25090 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:06.746001 29416 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:06.802315 29493 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:06.828531 25242 leader_election.cc:400] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10.
I20260709 12:21:06.829155 25242 leader_election.cc:403] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:06.830555 25856 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:06.801510 29284 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:06.802476 29513 raft_consensus.cc:697] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:06.782121 29363 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:21:06.844921 29550 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.002s
I20260709 12:21:06.736946 29262 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:21:06.742815 29240 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:06.838151 29548 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:21:06.833043 29451 consensus_queue.cc:1059] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:21:06.819152 29523 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:06.812427 29516 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:06.838454 29187 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:06.873375 29516 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:06.853178 25198 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
W20260709 12:21:06.874249 29546 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.074s	user 0.003s	sys 0.000s
W20260709 12:21:06.854012 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.878742 25270 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:06.828166 29060 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:06.884649 25825 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:06.885008 29523 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.887084 29220 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:06.887318 29523 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:06.822474 29525 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:06.849407 29539 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:06.866554 29494 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:21:06.867422 29513 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.832464 29493 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:06.850919 29490 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:21:06.832382 29518 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:06.871249 25242 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:06.850658 29284 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:06.872896 29240 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:06.908473 25825 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:06.922222 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 51057.8us
W20260709 12:21:06.924767 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.874239 29262 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.851265 29519 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:21:06.926882 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:06.851745 29362 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:21:06.930699 28997 raft_consensus.cc:993] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:21:06.932698 25199 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:06.935235 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:06.899020 29539 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:06.916428 29292 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:06.938582 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 206438us
I20260709 12:21:06.919224 29493 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:06.943512 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:06.947507 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:06.949185 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:06.950582 25165 leader_election.cc:400] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7.
I20260709 12:21:06.950924 25165 leader_election.cc:403] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:21:06.915505 29127 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:06.962378 25199 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:21:06.969017 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.944111 29539 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:06.940454 29252 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:06.943684 29451 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:06.927523 29060 consensus_queue.cc:1059] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:21:06.954982 28997 raft_consensus.cc:1081] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:21:06.954115 29081 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:06.983744 25267 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:06.988025 25270 raft_consensus.cc:3055] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:06.984632 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:06.988610 25270 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:06.937640 29262 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:06.990828 25856 raft_consensus.cc:1240] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:06.988976 25271 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
W20260709 12:21:06.995805 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 70479.7us
I20260709 12:21:06.999058 25857 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:07.002555 25093 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:07.003893 25093 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:06.998741 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 100043us
W20260709 12:21:07.005435 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 169467us
I20260709 12:21:07.006057 25168 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:07.006440 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:07.006816 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:06.980330 29328 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:07.007257 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:06.995224 25270 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:07.015678 25270 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:06.983206 29451 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:06.989794 29557 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:07.027696 25860 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:07.011744 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:06.977475 29406 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:21:07.045858 25852 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:07.013000 29363 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:07.018692 29220 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:07.053973 25165 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:06.946518 29416 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:07.063952 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 57197us
I20260709 12:21:07.042279 29451 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:07.041913 29286 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:07.062934 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 138351us
I20260709 12:21:06.998684 29523 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:21:07.050800 29229 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7.
I20260709 12:21:07.046490 29307 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:21:07.070856 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 74334.8us
I20260709 12:21:07.053715 29276 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:07.069934 25270 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:21:07.081199 25270 pending_rounds.cc:85] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 5
I20260709 12:21:07.081501 25270 pending_rounds.cc:107] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:21:07.081784 25270 raft_consensus.cc:2889] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:07.028174 29520 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:21:07.079734 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:07.047184 29501 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:07.083567 29561 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:07.064807 29540 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:07.049240 29519 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:21:07.072939 29286 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:07.121690 29525 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.122442 29525 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.125877 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:07.126678 25267 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:07.127498 29525 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:07.127921 25090 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:07.130370 29560 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:07.130883 29560 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.131134 29220 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:07.131724 29560 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:07.132671 29220 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.130491 29525 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:07.145704 25120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:21:07.146168 29570 raft_consensus.cc:2764] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:21:07.146450 25120 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:07.146811 25120 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:07.101905 29307 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:21:07.195855 29567 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:21:07.198225 29518 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:07.199035 29578 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:07.199368 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.199769 29578 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.138403 29493 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.138365 29286 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:07.210047 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:07.210604 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 203386us
I20260709 12:21:07.210793 25275 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:07.114616 29252 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:07.208040 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.102622 29315 consensus_queue.cc:1059] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:21:07.110941 29540 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.213268 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.172921 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:07.103293 29467 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:07.212566 25090 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:07.225741 25854 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:07.230310 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 118927us
I20260709 12:21:07.231494 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.232708 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.234727 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.203477 29284 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:07.238853 25853 raft_consensus.cc:2393] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:07.241981 25857 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:07.243201 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:07.140938 29525 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.207804 29578 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:07.150377 29574 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:21:07.172020 29363 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:21:07.255421 25125 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:07.239300 29540 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.252404 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:07.266116 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.266984 25860 raft_consensus.cc:2368] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:21:07.223343 29523 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:07.256685 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 176746us
I20260709 12:21:07.238461 29127 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:07.269620 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.266645 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.240700 29406 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:07.298240 29406 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.298686 29406 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.292685 29578 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.300912 29525 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:07.301076 29578 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:07.302220 29451 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.303495 29578 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:07.304605 29451 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:07.306777 29493 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:07.307080 29307 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.314158 29523 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:07.319828 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:07.302724 29572 log.cc:927] Time spent T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:07.247915 29284 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:07.323155 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.343168 25273 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:07.294076 25120 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.321841 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:07.339520 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:07.345085 25127 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:07.351279 25120 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:07.347172 25009 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1f471cfad2348a09c4b699f01f9dfa9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:21:07.381968 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:07.379221 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 126829us
I20260709 12:21:07.347839 29559 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:07.342864 28997 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:07.382840 25857 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:07.317215 29523 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:07.384143 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:07.389583 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.394659 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.395228 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:07.395871 25860 raft_consensus.cc:2368] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:21:07.395918 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.396238 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.396708 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.397001 25858 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:07.397135 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.397744 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.397961 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.398720 25859 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:07.363397 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:07.400796 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.401885 25854 raft_consensus.cc:2393] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:07.402148 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.403625 29586 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:07.404302 29560 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.405296 29432 raft_consensus.cc:3055] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:07.405795 29432 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:07.407480 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.401917 29581 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:07.387235 29262 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:07.389117 29559 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.428221 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:07.413825 25858 raft_consensus.cc:2368] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:21:07.347101 29571 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:21:07.415084 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.429881 25851 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:07.426586 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.349758 29284 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:07.371507 29286 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.438361 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:07.439891 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.451624 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.452495 25858 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:07.449857 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 66030us
I20260709 12:21:07.454622 25860 raft_consensus.cc:2393] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 13: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:07.455173 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:07.455787 25271 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:07.457182 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.460023 25852 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 6: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:07.439602 29559 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.466337 25121 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:07.420866 29467 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:07.421576 29586 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:07.392468 28997 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:07.474359 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.474400 25270 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:07.482287 25274 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:07.475729 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.461170 29500 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:07.473553 29406 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:07.489735 29435 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.491528 29406 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:07.492590 29432 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:07.478873 29524 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.949s	user 0.009s	sys 0.007s
I20260709 12:21:07.504372 29432 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:07.505842 29578 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.506388 29578 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:07.507148 29591 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.507678 29591 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.508477 29578 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:07.509325 29429 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:07.510183 29220 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:07.510999 29220 raft_consensus.cc:3055] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:07.511346 29220 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:07.512212 29220 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.513661 29220 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:07.509858 29591 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:07.523451 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.523680 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.524767 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.525206 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:07.526003 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:07.526629 25851 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:07.526952 29060 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:07.527402 29060 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:07.528226 29060 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.529603 29060 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:07.530635 29516 consensus_meta.cc:287] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.005s
I20260709 12:21:07.531070 29516 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.533582 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.532066 29284 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:07.534894 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:07.536023 25851 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:21:07.538355 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:07.540122 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:07.543888 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:07.549136 25270 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:07.552871 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:07.553454 25119 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:07.550289 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 494027us
I20260709 12:21:07.558460 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.559207 25858 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:07.559463 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.561596 25856 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:07.564386 25851 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:07.565752 25860 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:07.566288 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:07.566931 25196 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:07.566975 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:07.567263 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:07.534068 29516 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:07.566290 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:07.568126 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:07.570295 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:07.571983 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:07.573487 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:07.574321 25198 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:07.574290 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:07.575174 25199 raft_consensus.cc:2393] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:07.575261 29286 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:07.576606 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.582701 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:07.583338 25193 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:07.583501 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:07.584167 25199 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:07.584688 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:07.586280 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:07.577234 25854 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:07.588624 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:07.589398 25271 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:07.583451 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:07.592151 25202 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.596218 25127 raft_consensus.cc:1240] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:07.589823 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:07.596845 25856 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:07.597078 25125 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.599488 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:07.601336 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 137480us
I20260709 12:21:07.607673 25193 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:07.607894 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:07.608551 25196 raft_consensus.cc:3055] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:21:07.608579 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.608913 25196 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:07.609798 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:07.610406 25271 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.610915 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:07.613281 25092 leader_election.cc:400] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:21:07.614193 25092 leader_election.cc:403] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:21:07.537751 29560 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:07.550969 29262 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.556936 29574 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.616591 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:07.576190 29433 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.554876 29586 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.620213 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:07.587559 29255 raft_consensus.cc:3055] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:07.623214 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:07.573443 29540 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:07.635357 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.637264 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:07.633147 25271 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:07.624493 25199 raft_consensus.cc:2376] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10. Re-sending same reply.
I20260709 12:21:07.643215 25090 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:07.645920 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:07.619618 29524 consensus_queue.cc:1059] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:21:07.630613 29597 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.628451 29255 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:07.628931 29286 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:21:07.657537 25090 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:07.629514 29586 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:07.656400 29363 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:07.694485 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:07.701349 29597 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.634828 29433 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:07.629084 29262 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:07.657449 29494 consensus_meta.cc:287] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.002s
I20260709 12:21:07.664719 29512 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:07.664654 29514 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.692051 29467 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:07.666189 29406 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:07.812088 25202 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:07.636874 29560 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:07.818364 25275 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:07.818539 25092 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:07.819425 25193 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:07.637251 29519 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:07.821801 25201 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:07.828222 25825 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:07.827688 25119 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:07.830541 29416 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.831770 29540 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:07.630952 29574 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.840740 25199 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:07.841977 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:07.844611 25167 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:07.828770 29565 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:07.833211 29539 consensus_meta.cc:287] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.845s	user 0.000s	sys 0.015s
I20260709 12:21:07.844123 25196 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.833560 29286 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:07.837216 29524 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:07.878870 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 60444.8us
W20260709 12:21:07.946369 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 70911.1us
I20260709 12:21:07.947248 25092 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:07.948725 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:07.879041 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 275925us
W20260709 12:21:07.880357 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 52234us
I20260709 12:21:07.888017 25121 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:07.952780 25197 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:07.957337 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:07.961602 25092 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:07.961906 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:07.963666 29578 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:07.964972 25276 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:07.965062 25271 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:07.965950 29597 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:07.966012 29600 consensus_queue.cc:1059] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:21:07.966965 29542 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:07.958760 29524 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.967470 25271 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:07.860074 29363 raft_consensus.cc:697] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:07.863919 29494 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10.
I20260709 12:21:07.886251 29599 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.932888 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:07.972406 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:07.955454 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:07.886543 29557 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:07.955873 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 111343us
I20260709 12:21:07.936335 29220 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:07.964764 29604 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:21:07.967562 29576 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.945674 25196 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:07.933640 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:07.976214 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.963416 29467 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:07.960444 29286 raft_consensus.cc:697] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:07.851307 29559 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.943444 28997 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:07.979157 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:07.880687 29560 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:07.982963 25274 raft_consensus.cc:1240] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:07.993444 25092 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:07.986379 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 328891us
I20260709 12:21:07.879254 29406 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.960292 29540 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:07.873658 29512 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:07.967469 29588 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:21:07.944855 29539 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.973253 29598 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.020123 25196 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
W20260709 12:21:07.986791 29595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.000s	sys 0.026s
I20260709 12:21:07.872646 29255 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.884740 29416 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.978235 29220 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:07.876428 29514 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.992929 25272 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:07.997900 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:08.000823 25092 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:08.001436 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:08.037335 25201 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:08.001632 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.007815 25200 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:07.981875 29578 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:07.981284 29599 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:08.021867 29612 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:07.999763 29540 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.002115 29328 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:08.046666 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:08.047034 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:08.047669 25276 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:07.954312 29565 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.026973 25193 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:07.996294 29519 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:07.980319 29060 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:21:08.039376 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:08.039964 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:08.036103 28997 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:08.042996 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 45167.4us
I20260709 12:21:08.031929 29574 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:08.042395 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.969105 29363 consensus_queue.cc:237] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:08.026197 29595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.001s	sys 0.026s
W20260709 12:21:08.051285 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 50522.7us
I20260709 12:21:08.076399 25092 leader_election.cc:400] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:21:08.077195 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:08.045379 29220 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:08.065560 25274 raft_consensus.cc:2393] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:08.025493 29429 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:21:08.052121 29540 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:08.095148 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:08.088227 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:07.981097 29557 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:08.022998 29609 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:21:07.996052 25090 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:07.982308 29576 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:07.980015 29571 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:21:08.067139 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:08.082463 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:08.091008 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:08.050598 29362 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:08.097054 25201 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:21:08.095950 25854 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:08.103963 25125 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:08.121352 25241 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:08.117854 25193 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 6.
I20260709 12:21:08.031334 29598 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:08.122545 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 126575us
I20260709 12:21:08.123507 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:08.094264 29255 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:08.146158 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.151754 25201 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:08.152890 25275 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:08.103030 29578 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:08.155658 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 205234us
W20260709 12:21:08.155746 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 67637.1us
W20260709 12:21:08.157173 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 163123us
I20260709 12:21:08.160176 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2056) took 1006 ms. Trace:
I20260709 12:21:08.102761 29617 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:08.082674 29405 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:08.158960 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:08.119098 29362 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:08.095198 29516 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:21:08.080862 29608 consensus_queue.cc:1059] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:21:08.160660 25268 rpcz_store.cc:276] 0709 12:21:07.149287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.149409 (+   122us) service_pool.cc:224] Handling call
0709 12:21:07.149999 (+   590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.456184 (+306185us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:07.456230 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.464288 (+  8058us) log.cc:844] Serialized 26 byte log entry
0709 12:21:07.788151 (+323863us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:07.788216 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:07.788335 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:08.154384 (+366049us) raft_consensus.cc:1685] finished
0709 12:21:08.154412 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.155459 (+  1047us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34080,"raft.queue_time_us":167866,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":8181,"spinlock_wait_cycles":513792,"thread_start_us":464329,"threads_started":2,"wal-append.queue_time_us":375267}
I20260709 12:21:08.129954 29604 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:08.096983 28997 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.063946 29286 consensus_queue.cc:237] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:08.185222 29618 log.cc:927] Time spent T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:21:08.167434 25825 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:08.182093 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:08.126394 29518 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.189298 25274 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:21:08.198518 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 75082.3us
I20260709 12:21:08.163192 29262 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:08.128707 29315 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:08.201790 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:08.184003 29362 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:08.183027 29060 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:08.186160 29377 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:08.232921 25852 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:08.188052 29578 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:08.220713 29433 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:08.217948 25857 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:08.200798 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:08.225978 29525 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:21:08.234133 29610 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 12:21:08.270772 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 69859.9us
I20260709 12:21:08.231079 29315 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.288461 25199 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:08.289338 29377 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:08.289662 29525 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:08.291564 29616 log.cc:927] Time spent T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 12:21:08.292428 29620 log.cc:927] Time spent T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:21:08.293213 29615 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:21:08.246644 29060 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.232551 29624 consensus_queue.cc:1059] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:21:08.280372 29406 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:08.244702 29560 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:08.296037 29627 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:21:08.296149 29514 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:08.298089 29566 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:08.237661 29604 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:08.306064 29328 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:21:08.311434 29613 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:21:08.238641 29262 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:08.324575 25193 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:21:08.255475 29435 consensus_meta.cc:287] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.765s	user 0.007s	sys 0.003s
W20260709 12:21:08.328517 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 99882.7us
I20260709 12:21:08.247100 29578 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.247128 29512 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:08.337402 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 246485us
I20260709 12:21:08.362903 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:08.275141 29433 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.230805 29518 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.368326 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:08.345952 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 178540us
I20260709 12:21:08.369554 25167 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:08.369764 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:08.295215 29623 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:21:08.317487 29315 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:08.313369 29539 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:08.350731 25852 raft_consensus.cc:1240] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:08.324622 29377 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:08.337792 29416 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:08.381235 25194 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:08.351339 29276 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.366624 25092 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:08.364310 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:08.371073 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:08.373034 29433 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.385663 25274 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:08.373492 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:08.379451 25825 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:08.360185 29565 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:08.356950 29566 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.361966 29516 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:08.380492 25167 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:08.364110 29578 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:08.354179 29625 consensus_queue.cc:1059] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:21:08.379765 29619 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:08.403518 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:08.384567 29624 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:08.384218 29435 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:08.383697 29377 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:08.408387 25125 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:08.411794 29435 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:08.395836 29187 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.414520 29435 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.414963 29187 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.416738 29435 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:08.417325 29187 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:08.394399 29566 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:08.415335 29629 raft_consensus.cc:3055] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:08.417121 29628 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:21:08.395823 29600 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:08.434329 29600 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.436461 29600 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:08.391104 29525 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.439002 29518 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:08.417896 29451 raft_consensus.cc:3055] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:08.439879 29451 raft_consensus.cc:740] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:08.440824 29451 consensus_queue.cc:260] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.442342 29637 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:08.412757 29514 raft_consensus.cc:3055] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:08.406821 29635 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:08.443585 29514 raft_consensus.cc:740] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:08.444078 29635 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.444572 29514 consensus_queue.cc:260] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.399488 29574 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:08.446240 29574 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:08.446660 29574 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:08.418835 29576 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:08.453058 29578 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.454483 28997 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:08.454586 29220 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.456331 25858 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:08.457330 29220 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:08.401633 29581 consensus_queue.cc:1059] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 12:21:08.458070 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.392195 29276 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.463459 25193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:08.464115 25193 raft_consensus.cc:606] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:08.445971 29514 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:08.395972 29539 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:08.427119 29598 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:08.422147 29604 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.428700 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:08.474416 25120 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:08.429307 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:08.431505 29540 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.409300 29560 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:08.478744 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:08.479362 25851 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:08.420497 29629 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:08.421084 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:21:08.428339 29586 consensus_meta.cc:287] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.571s	user 0.002s	sys 0.007s
W20260709 12:21:08.481804 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60791.5us
I20260709 12:21:08.482762 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:08.483287 25825 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:08.467445 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:08.469488 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:08.408051 29307 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:08.477118 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:08.477118 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:08.510134 25860 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:08.441861 29451 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:08.478104 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:08.464442 25193 raft_consensus.cc:614] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:08.486159 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:08.531909 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:08.498839 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:08.503986 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:08.532907 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:08.505662 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.437827 29599 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:08.505215 25241 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:08.530627 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:08.531167 25242 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.660s (SENT)
I20260709 12:21:08.486584 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:08.539618 25853 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:08.531770 25854 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:21:08.539793 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:08.509159 25858 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
W20260709 12:21:08.536401 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 69046.4us
I20260709 12:21:08.453825 29574 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:08.545502 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 62292.6us
I20260709 12:21:08.546617 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:08.554239 25167 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:08.556963 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:08.557437 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 52351us
I20260709 12:21:08.557740 25127 raft_consensus.cc:2368] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13.
I20260709 12:21:08.494935 29628 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:08.560693 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:08.564368 25825 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:08.530090 29307 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:08.571103 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.572921 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:08.575088 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:08.575703 25122 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:08.575636 25825 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:08.576795 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:08.577311 25825 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:08.577782 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:08.579430 25122 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:21:08.554399 29416 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:08.581178 25122 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:08.552942 29565 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:08.486857 29560 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.559332 29220 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:08.562417 29292 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:08.556593 29429 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:08.487974 29586 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.594369 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:08.578325 29637 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:08.590965 25242 leader_election.cc:400] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13.
I20260709 12:21:08.565392 29255 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:08.585983 25092 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:08.570920 29638 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:08.584793 25120 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:08.583559 29490 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:08.583679 29513 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:08.611884 29513 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:08.612797 29513 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.547452 29187 consensus_queue.cc:1059] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:21:08.574776 29307 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:08.599620 25242 leader_election.cc:403] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:08.615896 29286 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:08.616577 25122 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:08.536041 29362 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.605314 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:08.581441 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:08.619733 29362 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:08.619951 29512 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:08.620368 29362 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:21:08.621030 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:08.622210 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:08.621966 29639 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:08.622524 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:08.622946 25852 raft_consensus.cc:2393] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 13: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:08.623214 25859 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:08.623656 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:08.624938 29523 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:08.625396 25092 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:08.627779 29286 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:08.628175 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:08.627466 29523 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:08.629359 29539 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:08.629621 29523 raft_consensus.cc:697] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:08.630767 29523 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.632899 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:08.593036 29292 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.583865 29416 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.623746 29640 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:08.588351 29516 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:08.604568 29255 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.642593 25852 raft_consensus.cc:2393] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:08.644125 25193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:08.672658 25193 raft_consensus.cc:606] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:08.673108 25193 raft_consensus.cc:614] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:08.622157 25269 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:08.673763 25825 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:08.670472 25119 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:08.603549 29635 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:08.677670 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:08.594064 29565 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.595705 29576 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:21:08.634552 29637 raft_consensus.cc:697] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:08.681043 25119 raft_consensus.cc:2393] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:08.637868 29292 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:08.638003 29639 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:08.641126 29416 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:08.675966 29255 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:08.715234 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:08.670650 29187 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:08.682808 29638 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:08.697654 29640 raft_consensus.cc:697] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:08.719229 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:08.712251 25269 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:08.679467 29516 raft_consensus.cc:697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:08.732168 29565 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:08.735513 25860 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:08.736445 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:21:08.717396 29617 consensus_meta.cc:287] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 12:21:08.742200 29531 raft_consensus.cc:3055] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:08.742435 29658 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:21:08.716434 29578 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:08.769949 29647 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:21:08.771523 29628 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:08.758430 29531 raft_consensus.cc:740] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:08.749796 29512 raft_consensus.cc:697] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:08.775285 29531 consensus_queue.cc:260] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.775660 29512 consensus_queue.cc:237] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.776638 29531 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:08.779449 29467 consensus_meta.cc:287] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.797s	user 0.010s	sys 0.000s
I20260709 12:21:08.779860 29467 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:08.703372 29220 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:21:08.781044 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 803) took 1148 ms. Trace:
I20260709 12:21:08.781916 25125 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:08.781476 25121 rpcz_store.cc:276] 0709 12:21:07.632201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.632371 (+   170us) service_pool.cc:224] Handling call
0709 12:21:07.641985 (+  9614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:07.950700 (+308715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.780799 (+830099us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400454054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:08.780984 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554568960}
I20260709 12:21:08.728209 29187 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.760433 29617 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:08.749877 29377 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.810153 29362 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13.
I20260709 12:21:08.797281 29640 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.869927 29187 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:08.811744 29566 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.881218 29566 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:08.797551 29637 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:08.888931 29315 consensus_meta.cc:287] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.000s
I20260709 12:21:08.889394 29315 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.894188 29617 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.866976 29262 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:08.895912 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:08.822438 29560 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:08.896530 29566 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:08.799322 29516 consensus_queue.cc:237] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:08.816078 29658 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 12:21:08.937676 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.873430 29255 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:08.914791 29519 consensus_meta.cc:287] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.003s
I20260709 12:21:08.944783 25123 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:08.921041 29617 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:08.939539 29566 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:09.011648 29643 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.171s	user 0.001s	sys 0.001s
W20260709 12:21:09.027038 29655 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 12:21:09.051504 29657 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:21:09.053833 29617 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:08.989256 29519 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:09.080361 29619 consensus_meta.cc:287] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.000s
I20260709 12:21:09.083408 29619 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:09.086282 29416 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.088986 29416 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:09.091305 29307 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.077212 29315 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:09.025717 29292 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.099702 29292 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:09.104245 29566 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:09.093873 29307 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:09.123747 29255 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:09.174412 29255 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:09.308486 29540 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:09.295076 29566 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.311332 29566 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:09.295282 29292 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.314559 29292 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:09.316610 29292 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:09.317551 29521 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:09.318128 29521 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.286602 29255 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:09.320446 29521 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:09.320596 29255 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:09.322140 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1200) took 1502 ms. Trace:
W20260709 12:21:09.325140 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 224253us
I20260709 12:21:09.322525 25856 rpcz_store.cc:276] 0709 12:21:07.820006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.820776 (+   770us) service_pool.cc:224] Handling call
0709 12:21:07.821058 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.035518 (+214460us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:21:08.050466 (+ 14948us) log.cc:844] Serialized 14 byte log entry
0709 12:21:08.382816 (+332350us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:08.382863 (+    47us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:08.382903 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.321843 (+938940us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540066a654. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:09.321906 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.322058 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58412,"prepare.queue_time_us":14750,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":7347,"raft.queue_time_us":86530,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8307,"spinlock_wait_cycles":510471808,"thread_start_us":287249,"threads_started":2,"wal-append.queue_time_us":323220}
I20260709 12:21:09.331698 29566 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:09.367267 29433 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:09.390130 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2060) took 1350 ms. Trace:
I20260709 12:21:09.391042 25269 rpcz_store.cc:276] 0709 12:21:08.039244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.039876 (+   632us) service_pool.cc:224] Handling call
0709 12:21:09.389853 (+1349977us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b5400123254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:09.390000 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322067712}
I20260709 12:21:09.393383 25273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2063) took 1353 ms. Trace:
I20260709 12:21:09.418370 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:09.419173 25201 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:09.418593 25273 rpcz_store.cc:276] 0709 12:21:08.040172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.040308 (+   136us) service_pool.cc:224] Handling call
0709 12:21:08.063647 (+ 23339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.074837 (+ 11190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:08.074868 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:08.074913 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:08.074958 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.393050 (+1318092us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b540002b054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:09.393113 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.393277 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25211264}
I20260709 12:21:09.396785 29296 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.398257 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:09.402894 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1179) took 1455 ms. Trace:
W20260709 12:21:09.418406 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 178325us
I20260709 12:21:09.420794 25275 rpcz_store.cc:276] 0709 12:21:07.947445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.950111 (+  2666us) service_pool.cc:224] Handling call
0709 12:21:07.960186 (+ 10075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.154712 (+194526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.402635 (+1247923us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400299854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:09.402833 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388043648}
W20260709 12:21:09.408669 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.410198 29433 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:09.413146 29540 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:09.413815 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:09.414471 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:09.414917 25857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 1198) took 1881 ms (client timeout 1921 ms). Trace:
I20260709 12:21:09.415598 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:09.431481 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:09.431931 25193 raft_consensus.cc:2368] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10.
I20260709 12:21:09.432096 25196 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:09.417322 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:09.417970 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:09.432960 25200 raft_consensus.cc:2410] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 13 because replica has last-logged OpId of term: 11 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:21:09.426599 25201 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:21:09.426622 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:09.433859 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:09.434341 25267 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:09.434464 25126 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:21:09.427225 25269 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:09.427721 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:09.430989 25857 rpcz_store.cc:269] 0709 12:21:07.533608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.534641 (+  1033us) service_pool.cc:224] Handling call
0709 12:21:09.414717 (+1880076us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400373cd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:09.414850 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756795648}
I20260709 12:21:09.423888 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.437285 25270 raft_consensus.cc:2368] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:21:09.438699 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.439445 25269 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:09.441378 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:09.442145 25195 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:09.442381 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.443127 25276 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:09.443872 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:09.445403 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:09.445499 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.445873 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:09.446221 25273 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:09.446478 25193 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:09.454478 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:09.457834 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.459935 25196 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:09.462220 25193 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:21:09.463281 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 330075us
I20260709 12:21:09.463654 25276 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:09.464969 25274 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:09.465044 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:09.465929 25124 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:09.433028 29433 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:09.479451 25270 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:09.480312 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.481122 25274 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:09.429504 29296 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.492365 25126 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:09.494050 25274 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:09.494221 25202 raft_consensus.cc:2410] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:21:09.496791 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.479205 29594 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:09.479012 29519 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:09.434805 29540 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.498631 25268 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:21:09.504035 29654 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.504654 29433 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:09.489063 29515 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.461220 29219 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:21:09.513131 25267 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:09.517048 25090 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:09.511446 25242 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:09.466572 29516 consensus_queue.cc:1059] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:21:09.524032 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:09.483789 29315 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.522089 25825 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:09.533957 25090 leader_election.cc:400] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:21:09.534364 25090 leader_election.cc:403] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:09.536053 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:09.546710 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.548269 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.549028 25274 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:21:09.549114 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.549892 25267 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:09.550880 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.551524 25267 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:09.513190 29594 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:09.560109 29060 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:09.560536 29296 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:09.540287 29658 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:09.534049 29515 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.561764 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2055) took 2396 ms. Trace:
I20260709 12:21:09.541335 29307 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:09.562214 25272 rpcz_store.cc:276] 0709 12:21:07.148987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.149434 (+   447us) service_pool.cc:224] Handling call
0709 12:21:07.149738 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.036648 (+886910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.544620 (+1507972us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b5400123754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:09.544850 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1935710080}
I20260709 12:21:09.562909 29515 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:09.563459 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.564182 25272 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:09.565207 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:09.560961 29594 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:09.564914 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.569574 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.565315 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:09.566711 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:09.570457 25276 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:09.570828 25267 raft_consensus.cc:2368] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12.
I20260709 12:21:09.571794 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.566653 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.574453 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:09.575317 25272 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:09.537009 29362 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:09.580085 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:09.580792 25272 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:09.519779 29519 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:09.580669 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:09.584344 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 96500us
I20260709 12:21:09.593753 25093 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:09.582880 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 171269us
I20260709 12:21:09.540438 29315 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:09.578562 29658 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:09.577886 29598 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:09.622370 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.577832 29307 raft_consensus.cc:697] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:21:09.644606 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 108653us
I20260709 12:21:09.648319 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:09.663093 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:09.586366 29362 raft_consensus.cc:697] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:09.523360 29654 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.668219 25276 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:09.669169 25267 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
W20260709 12:21:09.674322 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 80656us
I20260709 12:21:09.634753 29658 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:09.682965 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 159067us
I20260709 12:21:09.675282 25093 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:09.683897 25090 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:09.668401 29516 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:09.698922 29686 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:09.680365 29658 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:09.662611 29598 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.670451 29362 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.749186 29540 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:09.749600 29416 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:09.751685 29524 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:09.755764 29625 raft_consensus.cc:3055] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:09.759249 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:09.766391 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.746628 29617 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:09.746675 29685 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:09.757942 29624 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.762444 29625 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:09.761053 29688 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11.
I20260709 12:21:09.769666 29617 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.776759 29540 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.771819 29524 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.677846 29629 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.744427 29307 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.803912 29516 raft_consensus.cc:697] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:09.805089 29686 raft_consensus.cc:697] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:09.859012 25272 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:09.837448 29617 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:09.857100 29519 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:09.819519 29624 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.859869 29315 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:09.910081 29673 log.cc:927] Time spent T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 12:21:09.806980 29685 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.849807 29524 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:09.924600 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.908728 29654 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:09.841084 29540 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.889093 29625 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.910429 29694 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:09.922873 29516 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.911029 29554 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.919652 29686 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:09.888156 29688 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:10.034649 29699 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.133s	user 0.000s	sys 0.009s
W20260709 12:21:10.038066 29689 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.313s	user 0.000s	sys 0.004s
I20260709 12:21:09.906002 29060 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:10.022147 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 338202us
I20260709 12:21:10.016271 29608 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.043368 25090 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:10.021593 29629 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:10.028201 29696 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.263s	user 0.000s	sys 0.003s
W20260709 12:21:10.027009 29677 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.339s	user 0.002s	sys 0.007s
W20260709 12:21:10.028041 29695 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.200s	user 0.000s	sys 0.003s
W20260709 12:21:10.026139 29697 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.178s	user 0.000s	sys 0.003s
I20260709 12:21:10.051952 25090 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:10.048655 25242 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.575s (SENT) [suppressed 28 similar messages]
W20260709 12:21:10.028795 29684 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.261s	user 0.003s	sys 0.000s
W20260709 12:21:10.063215 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 387969us
W20260709 12:21:10.139312 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.105207 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:10.153561 25858 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:10.093465 25857 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:10.134759 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.154704 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:10.076159 25242 leader_election.cc:336] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.732s (SENT)
W20260709 12:21:10.116101 25194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2492) took 3399 ms (client timeout 1660 ms). Trace:
I20260709 12:21:10.108310 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:10.155283 25854 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:10.156545 25852 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:10.155989 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 79878.3us
I20260709 12:21:10.157559 25093 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:10.071658 25090 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:10.159019 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 87437.4us
W20260709 12:21:10.156020 25194 rpcz_store.cc:269] 0709 12:21:06.716324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.716451 (+   127us) service_pool.cc:224] Handling call
0709 12:21:10.115848 (+3399397us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400178c54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:10.115989 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3803396864}
I20260709 12:21:10.070830 25165 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:10.167384 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:10.055154 29598 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:10.160087 29640 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:10.049294 29513 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:10.160243 29623 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:10.129164 29692 log.cc:927] Time spent T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:21:10.080127 29625 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:10.043852 29554 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.181504 25093 leader_election.cc:400] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10.
I20260709 12:21:10.060016 29713 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:10.063392 29654 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:10.186064 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:10.104043 29637 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.089319 29694 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:10.099268 29691 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:10.161435 29700 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:10.060055 29284 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:10.055347 29060 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:10.190701 25093 leader_election.cc:403] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:21:10.188618 29693 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:10.188894 29716 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:10.205133 29708 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:21:10.205303 29685 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:10.205971 29524 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:10.208168 29574 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:10.059734 29608 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:10.198714 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.182096 29711 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:10.217404 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:10.186493 29690 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:10.201155 25854 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:10.190550 29688 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:10.186503 29707 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:10.191681 29713 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:10.188227 29513 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:10.294737 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.183764 29640 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.298398 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:10.298457 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 121434us
W20260709 12:21:10.304852 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:10.332916 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.333025 25093 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:10.322386 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 245375us
I20260709 12:21:10.293023 25167 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:10.325083 29685 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:21:10.325835 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 147920us
W20260709 12:21:10.335695 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 264936us
I20260709 12:21:10.210987 29654 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.348196 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:10.350135 29654 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:10.189702 29623 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.353314 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:10.218667 29693 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:10.347069 25093 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:10.210882 29637 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.220788 29658 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.326570 29713 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:10.367761 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:10.373474 25854 raft_consensus.cc:2393] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:10.362442 29718 log.cc:927] Time spent T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:21:10.381026 25857 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 14: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:10.344931 29540 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:10.356755 29574 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:10.220626 29691 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.221068 29284 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:10.388357 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:10.362824 29693 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:10.361501 29624 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:10.392675 25856 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:10.332571 29700 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:21:10.325572 29707 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.356083 29688 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:21:10.297739 29690 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:10.409600 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 60536.8us
I20260709 12:21:10.379238 29229 raft_consensus.cc:3055] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:10.388725 29524 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.379842 29685 raft_consensus.cc:697] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:10.290184 29716 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.424003 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:10.418171 29694 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:10.427851 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 80836.4us
I20260709 12:21:10.440641 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:10.441490 25272 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:10.428614 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2632) took 1891 ms. Trace:
I20260709 12:21:10.402415 29574 raft_consensus.cc:697] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:10.419915 29540 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:10.430733 25854 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:10.396469 29724 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.425120 29712 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:10.426532 29229 raft_consensus.cc:740] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:10.453755 25858 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:10.428100 29519 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:10.493196 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:10.494451 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 60031.2us
I20260709 12:21:10.431139 29711 raft_consensus.cc:697] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:10.496316 29640 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:10.496490 29732 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:10.474007 29515 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.496966 29732 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.497567 29608 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:10.497279 29515 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.498446 29060 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:10.482969 29724 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:10.499681 29515 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:10.500314 29658 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:10.431561 29524 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.501446 29724 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:10.501811 29642 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 1.949s	user 0.003s	sys 0.011s
I20260709 12:21:10.501729 29700 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:10.503795 29700 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:10.504148 29700 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:10.504905 29700 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:10.506649 29722 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:21:10.507009 29720 log.cc:927] Time spent T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:21:10.507854 25851 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:10.510138 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.511397 29554 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:10.512001 29731 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:10.512681 29646 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 1.911s	user 0.014s	sys 0.003s
I20260709 12:21:10.484972 25852 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:10.496130 29711 consensus_queue.cc:237] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:10.521834 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:10.522058 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:10.522336 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:10.517354 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:10.523696 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:10.524329 25858 raft_consensus.cc:2393] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 12: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:10.497339 29732 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:10.526588 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:10.523252 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:10.528439 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:10.529503 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:10.530934 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:10.525758 29292 consensus_queue.cc:1059] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:21:10.532104 25124 raft_consensus.cc:2410] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:21:10.533072 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:10.476084 29723 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:10.492327 29617 consensus_meta.cc:287] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.003s
I20260709 12:21:10.536190 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:10.554611 25121 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:10.530293 25854 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:10.538909 25126 raft_consensus.cc:2410] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:21:10.543582 29574 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.544607 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:10.556573 25167 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:10.562079 25090 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:10.570591 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:10.563969 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 215867us
I20260709 12:21:10.571756 25126 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:10.572507 25165 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:10.549420 29712 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10.
I20260709 12:21:10.550560 29700 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:10.573483 25165 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:10.549947 29513 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:10.557732 29654 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.507032 29733 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:21:10.544591 29707 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:10.585877 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:10.609920 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:10.585939 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:10.587086 29727 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:10.587718 29654 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.588426 29540 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:10.600262 29716 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:10.602435 29292 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:10.603387 29691 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:10.558806 29723 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.632128 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:10.660494 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 74692.1us
I20260709 12:21:10.570382 29619 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:10.581604 29554 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:10.645530 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.519927 29694 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.673058 25165 leader_election.cc:400] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12.
I20260709 12:21:10.705857 25165 leader_election.cc:403] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:21:10.560206 29617 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:10.709235 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.711104 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:10.711984 25126 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:10.716812 29712 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:10.726285 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:10.739248 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 77384us
I20260709 12:21:10.741155 25165 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:10.737921 29525 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.743541 29525 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:10.744179 29629 consensus_meta.cc:287] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.001s
W20260709 12:21:10.745832 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.748288 29586 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:10.561587 29685 consensus_queue.cc:237] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:10.754277 25120 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 13: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:21:10.754441 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 427189us
W20260709 12:21:10.757609 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.762430 25122 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:10.773990 25165 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:10.705013 29554 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.705112 29524 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:10.780886 25119 raft_consensus.cc:2410] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:21:10.660516 29292 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:10.786657 25165 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:10.812449 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:10.813478 25126 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:10.776420 29608 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:10.754493 29727 raft_consensus.cc:697] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:10.933380 25121 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
W20260709 12:21:10.933521 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 87218.9us
I20260709 12:21:10.783285 29554 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:10.775085 29737 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:10.778644 29703 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:10.718232 29619 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:10.814218 29292 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:10.823578 29524 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:10.776546 29712 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.052838 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:11.057404 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 270774us
I20260709 12:21:10.934068 29531 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:11.027442 29731 consensus_meta.cc:287] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.003s
I20260709 12:21:10.822250 29690 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:10.988174 29586 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:11.078385 29586 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.080536 29586 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.082985 29727 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:11.051033 29625 consensus_meta.cc:287] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.849s	user 0.011s	sys 0.000s
I20260709 12:21:11.026324 29688 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.087606 29688 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.089695 29688 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.063625 29730 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:11.090222 29730 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:11.090622 29730 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:11.070277 29706 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:21:11.070380 29738 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 12:21:11.070631 29276 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.072273 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:11.024345 29255 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:11.054286 29521 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:11.073865 29723 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.074271 29731 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:11.149703 25851 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:10.448130 25118 rpcz_store.cc:276] 0709 12:21:08.537241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.537371 (+   130us) service_pool.cc:224] Handling call
0709 12:21:08.537650 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.537883 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:10.125261 (+1587378us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b1800387be0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2103ab64bc 00007f2100e0448b 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e1e455 00007f21079063c7 00007f2103f189a7 00007f2103f280bf
0709 12:21:10.125409 (+   148us) log.cc:844] Serialized 14 byte log entry
0709 12:21:10.426822 (+301413us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:10.426892 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:10.426960 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:10.428411 (+  1451us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:10.428542 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19981,"prepare.queue_time_us":97321,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":204736,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":7222,"spinlock_wait_cycles":2304768,"thread_start_us":408249,"threads_started":3,"wal-append.queue_time_us":236188}
I20260709 12:21:11.078564 29557 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:10.989516 29734 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:11.096544 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.156797 25241 connection.cc:256] RPC call timeout handler was delayed by -1.2108592329998373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 12:21:11.133097 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.134150 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:11.091279 29292 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:11.050370 29707 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.099292 29685 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.062212 29524 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:11.140612 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:10.990952 29693 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:11.149724 29521 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.141817 25852 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:11.141845 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:11.169860 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.159785 25194 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:11.150369 29706 raft_consensus.cc:697] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:11.172886 25127 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:11.139874 29586 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:11.166493 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.166877 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:11.091806 29531 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:11.162191 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 403689us
I20260709 12:21:11.147228 29255 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.177102 25193 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:11.172643 29524 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:11.185531 25168 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:11.172608 29377 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.175108 29617 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:11.190626 25168 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:11.193002 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.197834 25194 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:11.183385 29521 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:11.202927 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.170297 29707 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.164664 29734 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.172700 29685 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.192718 29574 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:11.184305 29586 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:11.217902 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:11.223271 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.225448 25194 raft_consensus.cc:2376] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11. Re-sending same reply.
I20260709 12:21:11.214936 29752 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:11.228410 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.223574 25201 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:11.235293 29292 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:11.237253 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.237794 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.239789 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.240666 25194 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:11.241772 25825 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:11.242988 29690 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:11.243363 29690 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:11.243445 29685 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.243777 29690 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:11.245170 29586 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:11.246434 29531 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.247807 29255 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.248674 29619 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.249696 29734 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.224255 29706 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.253212 29690 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.231353 29752 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.254992 29752 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:11.254375 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.263149 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.266744 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:11.267553 25197 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:11.283325 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.292582 29690 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:11.266101 29608 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12.
I20260709 12:21:11.294515 25197 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:11.291015 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.315840 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.296267 29712 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:11.318123 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.298339 29748 log.cc:927] Time spent T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:21:11.300374 29524 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:11.301762 25241 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:11.316517 25198 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:11.322921 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:11.323230 25825 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:11.323547 25198 raft_consensus.cc:2376] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8. Re-sending same reply.
I20260709 12:21:11.323230 25241 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:11.324450 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.324939 25825 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:11.296686 29732 consensus_meta.cc:287] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.000s
I20260709 12:21:11.320304 25194 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:11.327425 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:11.328039 25197 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:11.325544 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.302660 29255 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:11.336894 29255 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.340444 29255 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:11.343148 29641 log.cc:927] Time spent T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 2.787s	user 0.006s	sys 0.016s
I20260709 12:21:11.344338 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1192) took 2981 ms. Trace:
I20260709 12:21:11.345214 29693 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:11.344715 25271 rpcz_store.cc:276] 0709 12:21:08.363418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.363912 (+   494us) service_pool.cc:224] Handling call
0709 12:21:08.364417 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:08.371076 (+  6659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:08.371110 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:08.374147 (+  3037us) log.cc:844] Serialized 26 byte log entry
0709 12:21:08.489016 (+114869us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:08.489075 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.489170 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:11.342561 (+2853391us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:11.344027 (+  1466us) raft_consensus.cc:1685] finished
0709 12:21:11.344054 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:11.344276 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10443,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":85,"spinlock_wait_cycles":8058496,"thread_start_us":114451,"threads_started":1,"wal-append.queue_time_us":181392}
I20260709 12:21:11.346918 29524 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:11.347512 29758 consensus_queue.cc:1059] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:11.347618 29554 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:11.349685 29554 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:11.349799 29284 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:11.350862 29255 raft_consensus.cc:3055] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:11.354231 25201 raft_consensus.cc:2368] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11.
I20260709 12:21:11.357575 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.359200 25198 raft_consensus.cc:2368] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13.
I20260709 12:21:11.640756 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:11.425199 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 54920.6us
I20260709 12:21:11.641924 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.642555 25168 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:11.642999 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.643678 25198 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:11.336369 29377 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:11.425601 29566 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:11.438657 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 113811us
I20260709 12:21:11.332975 29586 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:11.486876 25197 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:11.357682 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 1108) took 2679 ms. Trace:
I20260709 12:21:11.357127 29624 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:11.639600 29730 consensus_meta.cc:287] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.548s	user 0.005s	sys 0.006s
I20260709 12:21:11.646215 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:11.639405 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.646314 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:11.459475 25202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2453) took 2045 ms (client timeout 2340 ms). Trace:
I20260709 12:21:11.457865 29707 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:11.495076 29712 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:11.535655 29632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.002s	user 0.010s	sys 0.014s
I20260709 12:21:11.322371 29690 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.334944 29732 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:11.366329 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.431816 29754 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:21:11.435531 29757 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:21:11.460246 29713 consensus_meta.cc:287] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.069s	user 0.012s	sys 0.000s
W20260709 12:21:11.472522 29744 log.cc:927] Time spent T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.445s	user 0.000s	sys 0.001s
I20260709 12:21:11.678090 25859 rpcz_store.cc:276] 0709 12:21:08.678335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.678478 (+   143us) service_pool.cc:224] Handling call
0709 12:21:08.709842 (+ 31364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:08.728130 (+ 18288us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:08.740241 (+ 12111us) log.cc:844] Serialized 14 byte log entry
0709 12:21:10.037241 (+1297000us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b18004aff80. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:11.078846 (+1041605us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18004aff80. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae23a 00007f2103f18a2a
0709 12:21:11.185465 (+106619us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:11.190748 (+  5283us) log.cc:844] Serialized 52 byte log entry
0709 12:21:11.190893 (+   145us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:11.269486 (+ 78593us) log.cc:844] Serialized 14 byte log entry
0709 12:21:11.316643 (+ 47157us) log.cc:844] Serialized 14 byte log entry
0709 12:21:11.356992 (+ 40349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.357447 (+   455us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:11.357490 (+    43us) raft_consensus.cc:1685] finished
0709 12:21:11.357500 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:11.357631 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32906,"prepare.queue_time_us":270342,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":3150,"raft.queue_time_us":309981,"raft.run_cpu_time_us":676,"raft.run_wall_time_us":65218,"spinlock_wait_cycles":42641024,"thread_start_us":268150,"threads_started":4,"wal-append.queue_time_us":2536636}
I20260709 12:21:11.646149 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2466) took 1015 ms. Trace:
I20260709 12:21:11.445943 29229 consensus_queue.cc:260] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.495118 29617 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.570603 29723 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.358470 29255 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:11.806947 25124 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 15: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:11.458272 29764 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:11.538921 29763 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:11.810108 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:11.680877 29566 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:11.761487 25267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2070) took 2187 ms (client timeout 2132 ms). Trace:
W20260709 12:21:11.762378 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 119912us
I20260709 12:21:11.752055 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:11.535534 29731 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:11.676038 29377 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:11.852553 25267 rpcz_store.cc:269] 0709 12:21:09.547370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.571518 (+ 24148us) service_pool.cc:224] Handling call
0709 12:21:11.692992 (+2121474us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x7b540005ffd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:11.734734 (+ 41742us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222414080}
I20260709 12:21:11.765450 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:11.680414 29559 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.857231 29732 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:11.760298 29654 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:11.764861 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:11.857810 29732 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.858340 25271 raft_consensus.cc:2393] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 14: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:11.858284 29732 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:11.763361 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 435224us
I20260709 12:21:11.859382 29731 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.769542 29690 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.861675 29731 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.447969 29519 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:11.803977 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:11.771101 25196 rpcz_store.cc:276] 0709 12:21:10.630421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.632973 (+  2552us) service_pool.cc:224] Handling call
0709 12:21:10.707582 (+ 74609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.740569 (+ 32987us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:11.164718 (+424149us) log.cc:844] Serialized 14 byte log entry
0709 12:21:11.289623 (+124905us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:11.290218 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 12:21:11.290361 (+   143us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:11.290392 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.290459 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:11.645902 (+355443us) raft_consensus.cc:1685] finished
0709 12:21:11.645931 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:11.646097 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99064,"prepare.queue_time_us":323221,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":61650,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":7245,"thread_start_us":436481,"threads_started":2,"wal-append.queue_time_us":144396}
I20260709 12:21:11.849069 25273 raft_consensus.cc:2410] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:21:11.763240 29730 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:11.782852 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:11.899322 25269 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:11.900701 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:11.763340 29632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.259s	user 0.018s	sys 0.022s
I20260709 12:21:11.776731 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:11.751230 29768 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:11.903237 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 126560us
I20260709 12:21:11.808265 29764 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:11.761051 25202 rpcz_store.cc:269] 0709 12:21:09.413665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.414223 (+   558us) service_pool.cc:224] Handling call
0709 12:21:11.459216 (+2044993us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b54000a6254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:11.459396 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144664960}
I20260709 12:21:11.429925 29752 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.852746 25197 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:11.852911 25168 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:11.682232 29624 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.855901 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:11.856000 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.907725 25267 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:11.866672 29377 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:11.763991 29766 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.768684 29586 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.772336 29727 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:11.768044 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.916734 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.917140 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.769428 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:11.863154 25241 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:11.864993 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:11.865197 29690 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:11.803751 29680 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.920639 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.922531 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.923344 25199 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:21:11.867393 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:11.867796 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:11.925904 25271 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:11.926483 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.927115 25196 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:11.809161 29723 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:11.908846 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 56037.5us
I20260709 12:21:11.849618 29693 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:11.934379 29767 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.934872 29693 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.935357 25168 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:11.935994 29632 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.936185 29557 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:11.912087 29706 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:11.937668 29693 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.860415 29732 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.902594 29519 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:11.942483 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:11.946192 29519 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:11.918088 25276 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
W20260709 12:21:11.955370 25124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 2202) took 1431 ms (client timeout 1885 ms). Trace:
I20260709 12:21:11.955833 29752 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.919279 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.962432 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.963049 25201 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:11.963560 29566 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:11.963943 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.925957 25198 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:11.765259 29712 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:11.930327 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.955828 25124 rpcz_store.cc:269] 0709 12:21:10.524075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.544391 (+ 20316us) service_pool.cc:224] Handling call
0709 12:21:11.955151 (+1410760us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540026c854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:11.955284 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2870590208}
I20260709 12:21:11.930599 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:11.906836 29764 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:11.907929 29654 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:11.905400 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:11.806576 29617 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.932472 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2564) took 1488 ms. Trace:
I20260709 12:21:11.978160 25272 rpcz_store.cc:276] 0709 12:21:10.444017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.444214 (+   197us) service_pool.cc:224] Handling call
0709 12:21:10.444623 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.444911 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.444948 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:10.445563 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:21:10.566771 (+121208us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:10.566826 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:10.566939 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:11.471920 (+904981us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:11.919178 (+447258us) raft_consensus.cc:1685] finished
0709 12:21:11.919200 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:11.932408 (+ 13208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8548096,"thread_start_us":31402,"threads_started":1,"wal-append.queue_time_us":275403}
I20260709 12:21:11.804080 29713 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.937999 29706 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.947253 29758 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:11.965158 25201 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:11.966398 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:11.869128 29763 raft_consensus.cc:697] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:11.921769 29727 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.982717 25271 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:12.009593 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:12.009979 25276 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:11.993666 25197 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:11.999773 25196 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: [9.7-12.8]
I20260709 12:21:11.993325 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:12.015849 25825 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:11.989771 29706 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:12.017848 29724 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.922087 29586 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:12.038844 25201 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:11.993846 29637 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:11.977248 29654 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:12.008709 29690 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:12.041679 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:12.035347 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:11.913000 29255 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.027222 29752 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.025903 29707 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:12.017522 29727 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:12.050261 25125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2628) took 3546 ms (client timeout 2223 ms). Trace:
I20260709 12:21:12.060377 25267 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:12.034497 29686 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:12.036715 29658 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:21:12.071560 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 323236us
I20260709 12:21:12.082446 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:12.040930 29731 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:12.083907 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:12.067322 25125 rpcz_store.cc:269] 0709 12:21:08.499797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.499951 (+   154us) service_pool.cc:224] Handling call
0709 12:21:12.046406 (+3546455us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54003d5254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:12.046526 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570668800}
W20260709 12:21:12.087066 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 223974us
I20260709 12:21:12.087541 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:12.091207 25272 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:12.092366 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:12.068354 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:12.098867 25271 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:12.100046 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:11.936517 29632 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:11.909293 29768 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.118876 25269 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:12.120996 25197 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:12.040632 29724 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:11.935250 29680 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:11.916368 29766 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.043228 29701 consensus_queue.cc:1059] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:21:12.142895 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:12.144961 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:12.121966 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 839) took 1055 ms. Trace:
I20260709 12:21:12.146060 25090 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:12.146778 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.093721 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:11.934962 29767 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.113982 29255 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:12.130285 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:12.132009 25198 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:12.049237 29654 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:12.137899 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:12.139752 25267 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:12.067400 29752 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.161708 25165 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:12.146292 25197 rpcz_store.cc:276] 0709 12:21:11.066840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.088818 (+1021978us) service_pool.cc:224] Handling call
0709 12:21:12.089596 (+   778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.121605 (+ 32009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.121875 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:12.165198 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 120389us
I20260709 12:21:12.163450 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:12.146675 29769 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 12:21:12.142436 29723 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:12.061785 29707 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:12.169284 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 78145.7us
I20260709 12:21:12.173852 25271 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:12.100756 29731 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.188759 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.189428 25122 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 6.
I20260709 12:21:12.084864 29658 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:12.175237 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 91426.6us
I20260709 12:21:12.190866 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.154973 29690 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:12.179354 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.192117 25242 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:12.180125 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:12.171247 25198 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:12.192838 25125 raft_consensus.cc:2376] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12. Re-sending same reply.
I20260709 12:21:12.193181 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 843) took 1125 ms. Trace:
I20260709 12:21:12.134606 29763 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.164315 29559 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:12.181105 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.181565 29779 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:12.183099 29680 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:12.184496 29724 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:12.185396 29617 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:12.186363 29296 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:12.205278 25271 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:12.173063 29693 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:12.187132 29519 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:12.168131 29566 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:12.190333 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:12.219691 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.220834 25122 raft_consensus.cc:2410] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:21:12.192224 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:12.180886 25197 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:12.189071 29771 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:12.226804 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.195001 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:12.195416 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.195844 25118 raft_consensus.cc:2410] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:21:12.227799 25121 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:12.101375 29686 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.193687 25198 rpcz_store.cc:276] 0709 12:21:11.068048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.170644 (+1102596us) service_pool.cc:224] Handling call
0709 12:21:12.170935 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.192866 (+ 21931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.193113 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:12.201658 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:12.228694 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.230161 25126 raft_consensus.cc:2376] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10. Re-sending same reply.
I20260709 12:21:12.231086 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.231918 29686 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:12.180771 29707 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:12.194712 29690 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:12.209116 29766 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:12.191542 29557 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:12.210525 29770 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:21:12.195569 29559 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.211861 29624 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:12.216150 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 830) took 1151 ms. Trace:
I20260709 12:21:12.253226 25196 rpcz_store.cc:276] 0709 12:21:11.064344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.969342 (+904998us) service_pool.cc:224] Handling call
0709 12:21:11.999507 (+ 30165us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:12.012019 (+ 12512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.215886 (+203867us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54003610d0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:12.216064 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36100352}
I20260709 12:21:12.218186 25194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 833) took 1153 ms. Trace:
I20260709 12:21:12.254245 25194 rpcz_store.cc:276] 0709 12:21:11.065053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.254116 (+189063us) service_pool.cc:224] Handling call
0709 12:21:12.217956 (+963840us) spinlock_profiling.cc:243] Waited 64.2 ms on lock 0x7b54000a8054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:12.218114 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147625856}
I20260709 12:21:12.222898 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 842) took 1155 ms. Trace:
I20260709 12:21:12.255151 25197 rpcz_store.cc:276] 0709 12:21:11.067727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.170585 (+1102858us) service_pool.cc:224] Handling call
0709 12:21:12.180424 (+  9839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.222569 (+ 42145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.222829 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:12.224223 25123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2627) took 3726 ms (client timeout 1792 ms). Trace:
W20260709 12:21:12.255951 25123 rpcz_store.cc:269] 0709 12:21:08.498341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.498494 (+   153us) service_pool.cc:224] Handling call
0709 12:21:12.224062 (+3725568us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54002ac954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:12.224162 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947465600}
I20260709 12:21:12.256979 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.224643 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:12.141192 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.259505 25274 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:12.191841 29658 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:12.228240 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.261301 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.232368 25121 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:12.232913 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:12.264078 25125 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:12.233691 25126 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:12.204241 25165 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:12.265158 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 60975.7us
I20260709 12:21:12.238719 25198 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:12.266650 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 848) took 1195 ms. Trace:
I20260709 12:21:12.266952 25198 rpcz_store.cc:276] 0709 12:21:11.070750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.238298 (+1167548us) service_pool.cc:224] Handling call
0709 12:21:12.238555 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.266433 (+ 27878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.266600 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:12.211786 29632 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:12.199301 29730 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:12.239871 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.199470 29712 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:12.219545 29713 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:12.226706 29219 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.245752 29731 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:12.245774 29752 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:12.246230 29586 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:12.246887 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:12.248610 29768 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:12.199741 29779 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:12.250368 29767 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:12.205516 29296 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.225493 29566 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:12.220233 29693 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:12.275277 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.276171 25198 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 8. Ops: []
I20260709 12:21:12.241796 29557 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:12.284230 25125 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:12.287525 29219 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.289093 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:12.320742 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.240736 29519 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:12.293084 29764 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.294546 25197 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:12.294979 25268 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:12.286233 29712 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.332198 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2495) took 1258 ms. Trace:
I20260709 12:21:12.335974 25197 rpcz_store.cc:276] 0709 12:21:11.073383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.273105 (+1199722us) service_pool.cc:224] Handling call
0709 12:21:12.294404 (+ 21299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.331928 (+ 37524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.332137 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:12.270047 29758 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:12.251298 29690 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.274430 29060 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:12.271632 29524 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.347167 29060 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:12.348027 29377 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.348124 29060 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:12.252404 29559 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:12.350016 25272 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:12.302706 25124 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:21:12.330354 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 98179.9us
I20260709 12:21:12.333738 25168 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:12.296231 25121 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:12.340961 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:12.242772 29771 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.281517 29724 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:21:12.300565 29296 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:12.301717 29557 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:12.302441 29566 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:12.346897 29524 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:12.279580 29786 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:12.348366 29768 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:12.353729 25273 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:12.387195 25197 raft_consensus.cc:1240] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:12.302624 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.375886 25825 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:12.387837 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2500) took 1313 ms. Trace:
I20260709 12:21:12.388271 25197 rpcz_store.cc:276] 0709 12:21:11.074787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.357670 (+1282883us) service_pool.cc:224] Handling call
0709 12:21:12.387046 (+ 29376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.387615 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.387785 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:12.301908 29693 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:12.381143 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:12.384398 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.390517 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.385330 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:12.391601 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.391866 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.392414 25854 raft_consensus.cc:2410] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:21:12.392482 25858 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:12.393550 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.394282 25856 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:12.394411 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.393559 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.395063 25125 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:12.396483 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.397032 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:12.397066 25856 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:12.398010 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.400597 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:12.400992 25853 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:12.401028 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.300144 29787 consensus_queue.cc:1059] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:21:12.335628 29654 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.401852 25125 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:12.337230 29519 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.341876 29712 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.422109 25856 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:21:12.411194 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:12.401053 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.422801 25856 pending_rounds.cc:85] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 9
I20260709 12:21:12.423117 25856 pending_rounds.cc:107] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:21:12.395550 25241 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:12.407691 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.423332 25856 raft_consensus.cc:2889] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:12.423578 25092 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:12.425083 25825 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:12.425243 25851 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:12.387768 29127 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.387034 29690 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:12.388068 29752 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:12.395299 29766 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:12.432554 25167 connection.cc:256] RPC call timeout handler was delayed by -1.2878262180001911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
I20260709 12:21:12.426441 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.436493 25856 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:12.381230 29512 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:21:12.444545 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.445051 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.445358 25092 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:12.445739 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:12.445784 25851 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:12.447029 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.428864 29732 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:12.455785 25859 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:12.394227 29768 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.449739 25092 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:12.454907 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:12.395572 29516 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:21:12.430598 29752 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.400580 29624 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:21:12.451608 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.458627 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.400431 29686 consensus_queue.cc:1059] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:21:12.438658 29713 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:12.462299 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.469007 25853 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:12.443949 29766 raft_consensus.cc:697] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:12.469514 25121 raft_consensus.cc:2393] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 15: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:21:12.471009 29783 log.cc:927] Time spent T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:21:12.437664 29127 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.440824 29730 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:21:12.474778 25126 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:12.484966 25856 raft_consensus.cc:2376] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12. Re-sending same reply.
W20260709 12:21:12.478751 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.457726 29731 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:12.460594 29701 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:12.458273 29377 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:12.436456 29758 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:12.495764 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:12.720171 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 324639us
I20260709 12:21:13.343677 25276 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 7.
I20260709 12:21:13.344374 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2096) took 1074 ms. Trace:
I20260709 12:21:13.149380 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:13.346007 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 829) took 1055 ms. Trace:
W20260709 12:21:12.588222 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 254527us
I20260709 12:21:13.346469 25118 rpcz_store.cc:276] 0709 12:21:12.290567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.149018 (+858451us) service_pool.cc:224] Handling call
0709 12:21:13.345948 (+196930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:12.892570 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:13.348317 25124 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:09.983918 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:13.348877 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 837) took 1056 ms. Trace:
I20260709 12:21:12.589872 25126 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
W20260709 12:21:13.102560 25857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1522) took 2916 ms (client timeout 1546 ms). Trace:
I20260709 12:21:13.349462 25124 rpcz_store.cc:276] 0709 12:21:12.292753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.892192 (+599439us) service_pool.cc:224] Handling call
0709 12:21:13.348824 (+456632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:12.918622 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1216) took 2762 ms. Trace:
W20260709 12:21:13.349798 25857 rpcz_store.cc:269] 0709 12:21:10.186527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.202861 (+ 16334us) service_pool.cc:224] Handling call
0709 12:21:13.102242 (+2899381us) spinlock_profiling.cc:243] Waited 90.8 ms on lock 0x7b5400373cd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:13.102437 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208762752}
I20260709 12:21:12.941099 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2080) took 1176 ms. Trace:
I20260709 12:21:13.351357 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:13.351750 25268 rpcz_store.cc:276] 0709 12:21:11.764804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.765099 (+   295us) service_pool.cc:224] Handling call
0709 12:21:12.940930 (+1175831us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54003147d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:12.941032 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":918949632}
I20260709 12:21:12.591002 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.923893 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2091) took 1012 ms. Trace:
I20260709 12:21:13.354643 25267 rpcz_store.cc:276] 0709 12:21:11.911602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.911712 (+   110us) service_pool.cc:224] Handling call
0709 12:21:12.923708 (+1011996us) spinlock_profiling.cc:243] Waited 88.3 ms on lock 0x7b5400418f54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:12.923827 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202983296}
I20260709 12:21:12.922693 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2465) took 2292 ms. Trace:
I20260709 12:21:12.468345 29694 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:12.592526 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:12.935078 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:13.475157 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 1111) took 1082 ms. Trace:
I20260709 12:21:12.896749 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2497) took 1822 ms. Trace:
I20260709 12:21:13.344455 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:12.465994 29752 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:13.353760 25121 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:13.356460 25193 rpcz_store.cc:276] 0709 12:21:10.630055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.632869 (+  2814us) service_pool.cc:224] Handling call
0709 12:21:10.638975 (+  6106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:11.183122 (+544147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.922378 (+1739256us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b540016d5d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:12.922595 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237030656}
I20260709 12:21:13.477164 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 2233) took 1169 ms. Trace:
W20260709 12:21:13.359964 29060 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.004s	sys 0.004s
I20260709 12:21:12.472954 29713 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.467533 29763 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:13.096027 29654 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:13.471019 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:13.508487 25118 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:13.066473 29467 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.344812 25276 rpcz_store.cc:276] 0709 12:21:12.269683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.495403 (+225720us) service_pool.cc:224] Handling call
0709 12:21:13.344321 (+848918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.471698 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:12.918642 29712 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:13.515079 25126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 825) took 1225 ms (client timeout 1578 ms). Trace:
W20260709 12:21:13.515522 25126 rpcz_store.cc:269] 0709 12:21:12.289465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.351128 (+ 61663us) service_pool.cc:224] Handling call
0709 12:21:13.514900 (+1163772us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b540005b9d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:13.515008 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193835264}
I20260709 12:21:13.421855 29725 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:13.360699 25274 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:13.518496 25168 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:13.518628 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:13.361761 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 719105us
I20260709 12:21:13.519701 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1537) took 1071 ms. Trace:
W20260709 12:21:13.505625 29060 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.011s	sys 0.011s
I20260709 12:21:12.651239 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:12.941099 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1518) took 2780 ms. Trace:
W20260709 12:21:13.518989 29732 consensus_meta.cc:287] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.058s	user 0.008s	sys 0.003s
W20260709 12:21:12.647351 25127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 2195) took 2126 ms (client timeout 2132 ms). Trace:
W20260709 12:21:12.507139 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:13.622759 25127 rpcz_store.cc:269] 0709 12:21:10.520996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.521718 (+   722us) service_pool.cc:224] Handling call
0709 12:21:12.647173 (+2125455us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b5400452c54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:12.647287 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494910336}
W20260709 12:21:13.189193 29727 consensus_meta.cc:287] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 1.099s	user 0.012s	sys 0.000s
W20260709 12:21:13.243094 29686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.009s	sys 0.011s
W20260709 12:21:13.138705 29706 consensus_meta.cc:287] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 1.104s	user 0.012s	sys 0.000s
W20260709 12:21:12.647060 29717 log.cc:927] Time spent T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 2.495s	user 0.009s	sys 0.000s
I20260709 12:21:13.476599 25198 rpcz_store.cc:276] 0709 12:21:11.073918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.275783 (+1201865us) service_pool.cc:224] Handling call
0709 12:21:12.276056 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.300934 (+ 24878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.896369 (+595435us) spinlock_profiling.cc:243] Waited 87.4 ms on lock 0x7b540045f9a0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e85dc0 00007f2103f11a02 00007f2103f0ddd6 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:21:12.896669 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201091840}
I20260709 12:21:13.648473 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:13.649197 25198 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:13.594664 29229 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:12.884330 29721 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 2.459s	user 0.000s	sys 0.013s
I20260709 12:21:13.475592 25854 rpcz_store.cc:276] 0709 12:21:12.392363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.393205 (+   842us) service_pool.cc:224] Handling call
0709 12:21:12.934950 (+541745us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b5800093398. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9f8c 00007f2100de9ef6 000000000036eb39 00007f2108e5d1e0 00007f2108f260c4 00007f2108f26131 00007f2108ed40a0 00007f2108ed3984 00007f210244e6d4 00007f210244e662
0709 12:21:13.475082 (+540132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15769088}
W20260709 12:21:12.750571 29794 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 12:21:13.086133 29707 consensus_meta.cc:287] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.816s	user 0.008s	sys 0.003s
W20260709 12:21:12.988523 29566 consensus_meta.cc:287] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.001s
I20260709 12:21:13.479341 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:13.662923 25193 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:12.687330 25120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 2193) took 2169 ms (client timeout 2242 ms). Trace:
W20260709 12:21:12.749853 29790 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 12:21:13.663920 25120 rpcz_store.cc:269] 0709 12:21:10.517453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.517557 (+   104us) service_pool.cc:224] Handling call
0709 12:21:12.687012 (+2169455us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400453b54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:12.687243 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496973184}
I20260709 12:21:13.636039 29524 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:13.346340 29625 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.005s	sys 0.009s
I20260709 12:21:13.350841 25855 rpcz_store.cc:276] 0709 12:21:10.156571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.156987 (+   416us) service_pool.cc:224] Handling call
0709 12:21:10.180003 (+ 23016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:10.451491 (+271488us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:10.451766 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 12:21:10.539011 (+ 87245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:10.539060 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:10.539111 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.918313 (+2379202us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54005802d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:12.918376 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.918547 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":122,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":476,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":623810816,"thread_start_us":86870,"threads_started":1,"wal-append.queue_time_us":129040,"wal-append.run_cpu_time_us":1195,"wal-append.run_wall_time_us":1017710}
W20260709 12:21:13.350965 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:13.507421 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:13.681772 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.853243 29779 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:12.643253 29623 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:13.509017 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 827) took 1219 ms. Trace:
I20260709 12:21:13.686964 25118 rpcz_store.cc:276] 0709 12:21:12.290084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.422687 (+1132603us) service_pool.cc:224] Handling call
0709 12:21:13.508956 (+ 86269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.688261 25118 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:13.688853 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 820) took 1412 ms. Trace:
I20260709 12:21:13.689213 25118 rpcz_store.cc:276] 0709 12:21:12.276287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.687653 (+1411366us) service_pool.cc:224] Handling call
0709 12:21:13.687950 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.688606 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.688803 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:12.686872 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 390921us
I20260709 12:21:13.506361 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1539) took 1043 ms. Trace:
I20260709 12:21:12.784837 29781 raft_consensus.cc:3055] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:13.691933 25853 rpcz_store.cc:276] 0709 12:21:12.463227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.560038 (+ 96811us) service_pool.cc:224] Handling call
0709 12:21:13.506293 (+946255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.693032 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:13.693687 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 1122) took 1285 ms. Trace:
I20260709 12:21:13.693974 25853 rpcz_store.cc:276] 0709 12:21:12.408757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.692771 (+1284014us) service_pool.cc:224] Handling call
0709 12:21:13.693638 (+   867us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.694883 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:13.695192 29701 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.784585 29284 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:13.695446 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:13.695823 29701 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:13.512636 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.696256 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1538) took 1237 ms. Trace:
W20260709 12:21:13.696707 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.696671 25855 rpcz_store.cc:276] 0709 12:21:12.458649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.695213 (+1236564us) service_pool.cc:224] Handling call
0709 12:21:13.696200 (+   987us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:13.697220 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.697474 29598 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:13.698223 29598 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:13.698915 25165 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:13.699777 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:13.700277 29598 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:13.512272 25195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.021s	sys 0.061s
I20260709 12:21:12.911286 29219 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:12.748420 29787 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:13.700857 25195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.254s	user 0.021s	sys 0.062s
I20260709 12:21:13.701252 29787 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.701797 29565 raft_consensus.cc:2764] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:21:12.912290 29127 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:12.865365 29764 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:13.337019 29793 log.cc:927] Time spent T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.592s	user 0.000s	sys 0.001s
I20260709 12:21:12.578193 29774 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:13.706283 29774 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.707093 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:12.878265 29789 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.476s	user 0.000s	sys 0.001s
I20260709 12:21:13.708717 29774 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:13.515900 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 836) took 1223 ms. Trace:
I20260709 12:21:13.110100 29771 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:13.357596 29519 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:13.520099 25857 rpcz_store.cc:276] 0709 12:21:12.448288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.499672 (+1051384us) service_pool.cc:224] Handling call
0709 12:21:13.519647 (+ 19975us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.709271 25124 rpcz_store.cc:276] 0709 12:21:12.292481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.422631 (+1130150us) service_pool.cc:224] Handling call
0709 12:21:13.515816 (+ 93185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.035202 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:13.710142 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:13.710429 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 822) took 1421 ms. Trace:
W20260709 12:21:13.103030 25119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 2201) took 2579 ms (client timeout 1593 ms). Trace:
I20260709 12:21:13.466336 29525 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:13.710734 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 836) took 2644 ms. Trace:
I20260709 12:21:13.515540 29786 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:13.711197 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 844) took 2642 ms. Trace:
I20260709 12:21:13.711423 29786 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.711678 25195 rpcz_store.cc:276] 0709 12:21:11.068345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.217543 (+1149198us) service_pool.cc:224] Handling call
0709 12:21:12.217956 (+   413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:12.218378 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:12.397327 (+178949us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.701428 (+1304101us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:13.701972 (+   544us) log.cc:844] Serialized 52 byte log entry
0709 12:21:13.702154 (+   182us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:13.702368 (+   214us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.702540 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.702615 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:13.710966 (+  8351us) raft_consensus.cc:1685] finished
0709 12:21:13.710985 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.711140 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":247328,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":9115,"raft.queue_time_us":9382,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":13062,"thread_start_us":1432851,"threads_started":2,"wal-append.queue_time_us":1235102}
I20260709 12:21:13.713574 29786 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:13.711202 25201 rpcz_store.cc:276] 0709 12:21:11.065962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.039860 (+973898us) service_pool.cc:224] Handling call
0709 12:21:12.040222 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:12.120713 (+ 80491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:12.120738 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:12.142546 (+ 21808us) log.cc:844] Serialized 26 byte log entry
0709 12:21:12.234313 (+ 91767us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:12.446126 (+211813us) log.cc:844] Serialized 14 byte log entry
0709 12:21:12.449114 (+  2988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.449165 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:13.710523 (+1261358us) raft_consensus.cc:1685] finished
0709 12:21:13.710541 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.710658 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2666,"prepare.queue_time_us":325255,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":84381,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":16760,"thread_start_us":218437,"threads_started":2,"wal-append.queue_time_us":179795}
W20260709 12:21:13.516896 29658 consensus_meta.cc:287] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 1.235s	user 0.008s	sys 0.005s
I20260709 12:21:12.793049 29559 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.474344 29694 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:13.600600 25197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.140s	user 0.018s	sys 0.023s
I20260709 12:21:12.655155 29557 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:13.509152 29713 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:13.672145 29707 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.701263 29608 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:12.648645 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:13.710676 25857 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:13.619804 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:12.666430 29777 consensus_queue.cc:1175] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "897be935c42e41b995f177155b042be0" responder_term: 7 status { last_received { term: 7 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 7 index: 5 } }
I20260709 12:21:13.471022 29735 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.618672 25860 rpcz_store.cc:276] 0709 12:21:10.160832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.160961 (+   129us) service_pool.cc:224] Handling call
0709 12:21:10.161260 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:10.348424 (+187164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.348455 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:10.348497 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:10.348526 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.940874 (+2592348us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400470ed4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:12.940923 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.941049 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429973376}
I20260709 12:21:13.509336 29763 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.466836 28997 consensus_queue.cc:1059] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
W20260709 12:21:13.591768 29617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.017s	sys 0.022s
I20260709 12:21:13.635506 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:13.521977 29710 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.647009 25200 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:13.649677 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2481) took 1062 ms. Trace:
W20260709 12:21:13.715312 29806 log.cc:927] Time spent T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:21:13.478423 25121 rpcz_store.cc:276] 0709 12:21:12.307959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.567401 (+259442us) service_pool.cc:224] Handling call
0709 12:21:13.477106 (+909705us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.718868 29658 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.733369 25121 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:13.733628 25857 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:13.518232 29467 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:13.720027 29694 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:13.713970 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:13.735497 25195 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:13.735616 29467 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:13.617378 29522 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:21:13.720844 29690 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 1.286s	user 0.012s	sys 0.000s
I20260709 12:21:13.710469 25124 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:13.736855 25852 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:13.737108 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 821) took 1453 ms. Trace:
I20260709 12:21:13.735908 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2480) took 1157 ms. Trace:
I20260709 12:21:12.785761 29766 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.737771 25195 rpcz_store.cc:276] 0709 12:21:12.578874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.713713 (+1134839us) service_pool.cc:224] Handling call
0709 12:21:13.735854 (+ 22141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.721983 29800 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:13.741266 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:13.740881 29800 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.738143 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 830) took 1447 ms. Trace:
I20260709 12:21:13.734608 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:13.742305 25270 consensus_queue.cc:237] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.741977 25195 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:13.743322 29800 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:13.743508 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2478) took 1214 ms. Trace:
I20260709 12:21:13.729116 28997 raft_consensus.cc:3055] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:13.744177 28997 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:13.744889 25857 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:13.745000 28997 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.661279 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:13.716023 29787 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:13.371755 29729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.966s	user 0.008s	sys 0.018s
I20260709 12:21:13.746335 25854 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
W20260709 12:21:13.746620 29729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.347s	user 0.009s	sys 0.021s
W20260709 12:21:13.729277 29617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.018s	sys 0.022s
I20260709 12:21:13.746884 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 1117) took 1339 ms. Trace:
W20260709 12:21:13.664115 29693 consensus_meta.cc:287] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 1.267s	user 0.011s	sys 0.001s
I20260709 12:21:13.747452 25854 rpcz_store.cc:276] 0709 12:21:12.407144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.660967 (+1253823us) service_pool.cc:224] Handling call
0709 12:21:13.746831 (+ 85864us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.748080 29693 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.692058 29781 raft_consensus.cc:740] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:12.468056 29702 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.998s
I20260709 12:21:13.748714 25854 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:13.728335 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:13.749526 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1535) took 1307 ms. Trace:
I20260709 12:21:13.627018 29732 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:13.749752 25860 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:21:13.751753 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1540) took 1281 ms. Trace:
I20260709 12:21:13.370728 29731 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.723398 25858 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:13.752808 29731 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:13.695899 29284 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:13.717864 25856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1536) took 1273 ms (client timeout 1618 ms). Trace:
I20260709 12:21:13.753396 29284 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:13.753494 25856 rpcz_store.cc:269] 0709 12:21:12.444668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.445504 (+   836us) service_pool.cc:224] Handling call
0709 12:21:13.717716 (+1272212us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b5400668ad4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:13.717813 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88543488}
I20260709 12:21:13.754980 25856 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:13.520323 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:13.755442 29693 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:13.597398 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:13.707125 29632 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:13.756301 29632 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:13.756417 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 832) took 1465 ms. Trace:
I20260709 12:21:13.756692 29632 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:13.757021 25122 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:13.757337 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 1114) took 1355 ms. Trace:
I20260709 12:21:13.720628 29559 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:13.758301 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 818) took 1494 ms. Trace:
I20260709 12:21:13.758345 29559 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:13.695554 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1541) took 1224 ms. Trace:
I20260709 12:21:13.759276 25853 rpcz_store.cc:276] 0709 12:21:12.471107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.694619 (+1223512us) service_pool.cc:224] Handling call
0709 12:21:13.695506 (+   887us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.727787 29735 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.732138 25198 rpcz_store.cc:276] 0709 12:21:12.587515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.648215 (+1060700us) service_pool.cc:224] Handling call
0709 12:21:13.649627 (+  1412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.760492 29768 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:13.720204 25196 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:13.650643 29706 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.634748 29624 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.721122 25118 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:13.724939 29608 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.761739 29608 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:13.730475 29710 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.619014 29725 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:13.519145 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2094) took 1250 ms. Trace:
W20260709 12:21:13.720369 25197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.260s	user 0.020s	sys 0.024s
I20260709 12:21:13.760680 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:13.761596 29624 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.761749 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 828) took 1471 ms. Trace:
W20260709 12:21:13.805836 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 68364.7us
I20260709 12:21:13.806097 25118 rpcz_store.cc:276] 0709 12:21:12.290342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.720527 (+1430185us) service_pool.cc:224] Handling call
0709 12:21:13.720809 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.761525 (+ 40716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.761697 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.807804 25118 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:13.808539 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 831) took 1517 ms. Trace:
I20260709 12:21:13.808962 25118 rpcz_store.cc:276] 0709 12:21:12.291211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.806999 (+1515788us) service_pool.cc:224] Handling call
0709 12:21:13.807387 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.808246 (+   859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.808474 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.735942 25123 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:13.728515 29763 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:13.737533 25124 rpcz_store.cc:276] 0709 12:21:12.283453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.710044 (+1426591us) service_pool.cc:224] Handling call
0709 12:21:13.710308 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.736860 (+ 26552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.737045 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.743839 25195 rpcz_store.cc:276] 0709 12:21:12.529015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.740957 (+1211942us) service_pool.cc:224] Handling call
0709 12:21:13.743453 (+  2496us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.811111 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:13.805809 25090 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:13.639570 29727 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.811789 25195 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:13.812352 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2475) took 1330 ms. Trace:
I20260709 12:21:13.812574 25124 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:13.812697 25195 rpcz_store.cc:276] 0709 12:21:12.485601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.810900 (+1325299us) service_pool.cc:224] Handling call
0709 12:21:13.812290 (+  1390us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.745512 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1534) took 1307 ms. Trace:
I20260709 12:21:13.813380 25859 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:13.737864 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46484 (request call id 1229) took 1354 ms. Trace:
I20260709 12:21:13.756852 25126 rpcz_store.cc:276] 0709 12:21:12.291470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.536493 (+1245023us) service_pool.cc:224] Handling call
0709 12:21:13.756362 (+219869us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.813560 25857 rpcz_store.cc:276] 0709 12:21:12.438588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.744222 (+1305634us) service_pool.cc:224] Handling call
0709 12:21:13.744522 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.745285 (+   763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.745462 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.813896 25852 rpcz_store.cc:276] 0709 12:21:12.383065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.384972 (+  1907us) service_pool.cc:224] Handling call
0709 12:21:13.737718 (+1352746us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400750154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:13.737813 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3077661056}
W20260709 12:21:13.730868 25200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2474) took 1259 ms (client timeout 1570 ms). Trace:
I20260709 12:21:13.730526 25127 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:21:13.815353 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 834) took 1523 ms. Trace:
I20260709 12:21:13.815866 25127 rpcz_store.cc:276] 0709 12:21:12.291995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.635181 (+1343186us) service_pool.cc:224] Handling call
0709 12:21:13.815299 (+180118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.719038 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:13.816706 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2232) took 1520 ms. Trace:
I20260709 12:21:13.742446 25121 rpcz_store.cc:276] 0709 12:21:12.290959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.732829 (+1441870us) service_pool.cc:224] Handling call
0709 12:21:13.733186 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.733810 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.734015 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.766644 25125 rpcz_store.cc:276] 0709 12:21:12.288549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.034791 (+746242us) service_pool.cc:224] Handling call
0709 12:21:13.710358 (+675567us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:13.767051 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 246767us
I20260709 12:21:13.767627 25193 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:13.758879 25122 rpcz_store.cc:276] 0709 12:21:12.263585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.278976 (+ 15391us) service_pool.cc:224] Handling call
0709 12:21:12.279321 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.757484 (+1478163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.758086 (+   602us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400351954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:13.758245 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3397944704}
I20260709 12:21:13.697625 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:13.700793 25165 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:13.818675 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 117944us
I20260709 12:21:13.817344 25118 rpcz_store.cc:276] 0709 12:21:12.295851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.809854 (+1514003us) service_pool.cc:224] Handling call
0709 12:21:13.816053 (+  6199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.816287 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.816325 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:13.816382 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:13.816435 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.816518 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.816640 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:13.819172 25193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2476) took 1325 ms (client timeout 1594 ms). Trace:
W20260709 12:21:13.819608 25193 rpcz_store.cc:269] 0709 12:21:12.493843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.478063 (+984220us) service_pool.cc:224] Handling call
0709 12:21:13.819120 (+341057us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.820649 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:13.821292 25193 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
W20260709 12:21:13.634572 29686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.009s	sys 0.016s
I20260709 12:21:13.749891 25854 rpcz_store.cc:276] 0709 12:21:12.441665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.748127 (+1306462us) service_pool.cc:224] Handling call
0709 12:21:13.748404 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.749311 (+   907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.749475 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.752159 25860 rpcz_store.cc:276] 0709 12:21:12.470801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.750746 (+1279945us) service_pool.cc:224] Handling call
0709 12:21:13.751132 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.751344 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.751381 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:13.751440 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:13.751484 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.751554 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.751690 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:13.740773 25119 rpcz_store.cc:269] 0709 12:21:10.523796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.526353 (+  2557us) service_pool.cc:224] Handling call
0709 12:21:13.102773 (+2576420us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54000c49d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:13.102942 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581560192}
I20260709 12:21:13.778074 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:13.779289 25271 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:13.780027 29768 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:13.780023 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:13.788393 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:13.680749 29625 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.008s	sys 0.012s
W20260709 12:21:13.688421 29296 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.297s	user 0.013s	sys 0.000s
I20260709 12:21:13.804040 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2479) took 1244 ms. Trace:
I20260709 12:21:13.804131 25274 rpcz_store.cc:276] 0709 12:21:12.269126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.657086 (+387960us) service_pool.cc:224] Handling call
0709 12:21:13.360373 (+703287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.518916 (+158543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.519093 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.804386 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:13.757776 25858 rpcz_store.cc:276] 0709 12:21:12.402429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.402585 (+   156us) service_pool.cc:224] Handling call
0709 12:21:12.402905 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.752956 (+1350051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.757118 (+  4162us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54005d1954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:13.757281 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3036380928}
I20260709 12:21:13.777034 29803 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:13.816798 25201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2482) took 1175 ms (client timeout 1562 ms). Trace:
I20260709 12:21:13.673254 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:13.678607 29566 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:13.924191 29725 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:13.824844 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:13.815148 25200 rpcz_store.cc:269] 0709 12:21:12.471873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.650901 (+179028us) service_pool.cc:224] Handling call
0709 12:21:13.730810 (+1079909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.925613 25195 raft_consensus.cc:2410] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:21:13.828800 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2235) took 1496 ms. Trace:
I20260709 12:21:13.926153 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2483) took 1283 ms. Trace:
I20260709 12:21:13.926062 25124 rpcz_store.cc:276] 0709 12:21:12.332796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.810858 (+1478062us) service_pool.cc:224] Handling call
0709 12:21:13.811118 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.812990 (+  1872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.828721 (+ 15731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.926707 25195 rpcz_store.cc:276] 0709 12:21:12.642321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.813405 (+1171084us) service_pool.cc:224] Handling call
0709 12:21:13.926087 (+112682us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.927567 29735 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:13.929209 29632 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.834295 29786 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.930569 29786 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.931828 29632 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:13.932628 29786 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:13.871500 25123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 2234) took 1542 ms (client timeout 1936 ms). Trace:
W20260709 12:21:13.933451 25123 rpcz_store.cc:269] 0709 12:21:12.328712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.648339 (+319627us) service_pool.cc:224] Handling call
0709 12:21:13.871311 (+1222972us) spinlock_profiling.cc:243] Waited 9.6 ms on lock 0x7b540022b5d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:13.871431 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22075648}
I20260709 12:21:13.843550 29732 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 12:21:13.721814 29557 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:13.872273 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 851) took 2800 ms. Trace:
I20260709 12:21:13.684752 29654 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:13.831840 29712 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:13.936914 29654 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:13.834249 29467 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 12:21:13.938604 29624 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:13.939459 29654 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:13.903965 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 71092.9us
I20260709 12:21:13.723224 29707 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:13.924304 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:13.818544 25855 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:13.935401 29693 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:21:13.959637 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 615234us
I20260709 12:21:13.961946 29803 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:13.874504 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.734634 29658 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:13.787945 29604 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:13.936064 25196 rpcz_store.cc:276] 0709 12:21:11.071673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.273152 (+1201479us) service_pool.cc:224] Handling call
0709 12:21:12.287721 (+ 14569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.761207 (+1473486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.872033 (+110826us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000a5d54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:13.872215 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3293914368}
W20260709 12:21:13.941285 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 82779.1us
I20260709 12:21:13.965677 29296 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:13.942262 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:13.847527 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:13.836534 29559 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:14.016042 25273 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:14.016402 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.015645 25200 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 7.
I20260709 12:21:14.016649 29559 raft_consensus.cc:697] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:14.017082 25271 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:14.017752 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:13.875133 25199 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:14.018847 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.019053 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.018139 29559 consensus_queue.cc:237] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:14.019855 25271 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:14.019806 25200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2470) took 1561 ms. Trace:
I20260709 12:21:14.020330 25200 rpcz_store.cc:276] 0709 12:21:12.458752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.018790 (+1560038us) service_pool.cc:224] Handling call
0709 12:21:14.019745 (+   955us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.850404 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:13.943248 25198 rpcz_store.cc:276] 0709 12:21:12.559676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.760442 (+1200766us) service_pool.cc:224] Handling call
0709 12:21:13.803977 (+ 43535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.852432 25202 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
W20260709 12:21:13.873819 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 352649us
I20260709 12:21:13.944296 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 824) took 1655 ms. Trace:
I20260709 12:21:13.944387 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2081) took 2179 ms. Trace:
I20260709 12:21:13.945036 25269 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:13.945555 25201 rpcz_store.cc:269] 0709 12:21:12.641835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.718795 (+1076960us) service_pool.cc:224] Handling call
0709 12:21:13.816744 (+ 97949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.947340 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:13.821776 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2471) took 1356 ms. Trace:
I20260709 12:21:14.011372 25194 raft_consensus.cc:1217] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 12:21:14.003960 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.021281 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.050196 25271 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:13.920548 25165 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:14.051111 25267 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
W20260709 12:21:14.051347 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 130922us
I20260709 12:21:14.052330 25194 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 11. Ops: [9.6-9.6]
I20260709 12:21:13.999191 25855 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:14.049633 25120 rpcz_store.cc:276] 0709 12:21:12.289188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.672986 (+1383798us) service_pool.cc:224] Handling call
0709 12:21:13.944230 (+271244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:14.055076 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:13.941305 25090 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:14.056618 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:14.058046 25193 rpcz_store.cc:276] 0709 12:21:12.465176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.820391 (+1355215us) service_pool.cc:224] Handling call
0709 12:21:13.821725 (+  1334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:14.059587 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.061220 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:14.061889 25198 raft_consensus.cc:2376] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14. Re-sending same reply.
I20260709 12:21:14.021281 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:14.063983 25200 raft_consensus.cc:2376] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13. Re-sending same reply.
W20260709 12:21:14.005302 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 408055us
I20260709 12:21:14.075335 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:14.076480 25195 raft_consensus.cc:2368] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10.
I20260709 12:21:14.063374 25274 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:13.732415 29713 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.080987 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.081173 25242 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:14.081533 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 140292us
I20260709 12:21:14.081815 25120 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 13: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:14.082425 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:14.084111 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.085206 25090 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:14.085431 25200 raft_consensus.cc:2368] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 13.
I20260709 12:21:14.086627 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:14.050089 25275 rpcz_store.cc:276] 0709 12:21:11.765376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.765512 (+   136us) service_pool.cc:224] Handling call
0709 12:21:11.771785 (+  6273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:11.771937 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:12.084778 (+312841us) log.cc:844] Serialized 14 byte log entry
0709 12:21:12.653808 (+569030us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b1800493060. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2107de258f 00007f2100e21571 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd
0709 12:21:13.114941 (+461133us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b1800493060. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2103ab64bc 00007f2100e0448b 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287
0709 12:21:13.466500 (+351559us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.943967 (+477467us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:13.944025 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:13.944085 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.944181 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.944318 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44798,"prepare.queue_time_us":946959,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":95,"raft.queue_time_us":58150,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":19642,"spinlock_wait_cycles":40452608,"thread_start_us":1175299,"threads_started":5,"wal-append.queue_time_us":200240,"wal-append.run_cpu_time_us":1086,"wal-append.run_wall_time_us":1010041}
I20260709 12:21:14.090207 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.090915 25193 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:21:14.088866 25198 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:14.009928 29599 raft_consensus.cc:3055] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:14.004673 29625 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.095718 25120 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:14.097939 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.100133 25276 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:13.959724 29693 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:14.111884 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:14.104843 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.105894 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.113340 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2473) took 1645 ms. Trace:
I20260709 12:21:14.113431 25123 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:14.113790 25201 rpcz_store.cc:276] 0709 12:21:12.468127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.083581 (+1615454us) service_pool.cc:224] Handling call
0709 12:21:14.113279 (+ 29698us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:14.113446 25196 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:14.107609 25271 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:14.110494 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:13.958050 29710 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:14.111871 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.116773 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.117561 25276 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:14.071993 29775 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.118539 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.119771 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.120941 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.122687 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2468) took 1671 ms. Trace:
I20260709 12:21:14.123121 25196 rpcz_store.cc:276] 0709 12:21:12.451441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.079017 (+1627576us) service_pool.cc:224] Handling call
0709 12:21:14.122604 (+ 43587us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:14.089884 29792 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:14.128728 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:13.844106 29768 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.095785 29812 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:14.151260 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2501) took 3076 ms. Trace:
I20260709 12:21:14.154062 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 1120) took 1745 ms. Trace:
I20260709 12:21:14.154387 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.155404 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:14.156212 25119 raft_consensus.cc:2410] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:21:14.156343 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 338042us
I20260709 12:21:14.156929 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.157027 25168 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:14.157822 29710 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:14.158008 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.158738 25125 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:14.079286 29554 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:14.094404 29802 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:14.167544 25198 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:14.168283 25242 leader_election.cc:400] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10.
I20260709 12:21:14.168622 25242 leader_election.cc:403] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:14.168746 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:14.010510 29752 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.129419 25195 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:14.089087 29758 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:14.101632 29788 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:21:14.104560 29467 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:14.130300 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:14.130789 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.100871 29811 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.096123 29799 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:21:14.131639 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.181723 25267 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:14.132263 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.132000 29775 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.134100 29701 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.103130 29599 raft_consensus.cc:740] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:14.196074 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:14.102326 29779 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:14.136787 29598 consensus_queue.cc:1059] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:14.136790 25241 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:14.102489 29284 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.119473 29625 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.159595 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.159775 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.127705 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.160902 25168 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:14.209167 25127 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 13: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:14.154498 25859 rpcz_store.cc:276] 0709 12:21:12.408197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.706824 (+1298627us) service_pool.cc:224] Handling call
0709 12:21:14.153853 (+447029us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54008bcc54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:14.153985 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242610944}
I20260709 12:21:14.159205 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:14.209400 25123 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:14.162338 25269 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:14.210573 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.210618 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:14.211191 25269 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:14.101260 29787 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:14.165140 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.151665 25197 rpcz_store.cc:276] 0709 12:21:11.075100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.394876 (+1319776us) service_pool.cc:224] Handling call
0709 12:21:12.423085 (+ 28209us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:12.423476 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:12.423503 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:12.429056 (+  5553us) log.cc:844] Serialized 52 byte log entry
0709 12:21:13.803903 (+1374847us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:13.831971 (+ 28068us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.934903 (+102932us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18003e1880. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:14.150480 (+215577us) spinlock_profiling.cc:243] Waited 9.11 ms on lock 0x7b18003e1880. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f21079063c7 00007f2103f189a7 00007f2103f280bf 00007f2103f28038
0709 12:21:14.150688 (+   208us) log.cc:844] Serialized 14 byte log entry
0709 12:21:14.150905 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.150994 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.151031 (+    37us) raft_consensus.cc:1685] finished
0709 12:21:14.151046 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.151186 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1988,"prepare.queue_time_us":30112,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":365,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":10215,"spinlock_wait_cycles":49774208,"thread_start_us":1343695,"threads_started":1,"wal-append.queue_time_us":1243301}
W20260709 12:21:14.172194 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 401366us
I20260709 12:21:14.212445 25201 raft_consensus.cc:2368] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13.
I20260709 12:21:14.174139 25242 leader_election.cc:400] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 13.
I20260709 12:21:14.213120 25242 leader_election.cc:403] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:14.173954 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:14.175318 25825 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:14.145485 29608 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:14.178556 25121 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:14.179232 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.078634 29604 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.184286 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 831) took 3119 ms. Trace:
W20260709 12:21:14.184859 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:14.185724 25273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2093) took 1917 ms (client timeout 2132 ms). Trace:
I20260709 12:21:14.131685 29566 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:14.128540 29792 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:14.188844 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:14.229436 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.230747 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.229094 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.163129 29554 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.198499 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.233714 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.157658 29694 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.181911 29777 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:14.235834 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.214396 25267 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:14.190333 29731 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.215878 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.216346 29598 raft_consensus.cc:3055] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:14.244904 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:14.216773 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 80055.6us
I20260709 12:21:14.216920 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.246251 25201 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 14: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:14.217116 29521 raft_consensus.cc:3055] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:14.258198 29521 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:14.259133 29521 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.260151 29521 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:14.263509 29566 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:14.264403 29566 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:14.267347 29566 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:14.219126 25858 raft_consensus.cc:2393] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:14.224632 25273 rpcz_store.cc:269] 0709 12:21:12.268819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.396790 (+127971us) service_pool.cc:224] Handling call
0709 12:21:14.185562 (+1788772us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540005ffd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:14.185675 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3712798464}
I20260709 12:21:14.269196 29467 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:14.269510 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.270565 25273 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
W20260709 12:21:14.227190 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 66375.5us
I20260709 12:21:14.223491 25199 rpcz_store.cc:276] 0709 12:21:11.064578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.943534 (+878956us) service_pool.cc:224] Handling call
0709 12:21:11.943821 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.018665 (+2074844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.184044 (+165379us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b5400220954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:14.184222 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4440934144}
I20260709 12:21:14.272624 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:14.273257 25199 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:14.274113 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.275359 29713 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:14.230795 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.267369 29608 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:14.277153 29229 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:14.277765 29608 consensus_queue.cc:1059] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:14.279165 29229 raft_consensus.cc:3055] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:14.279716 29229 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:14.281327 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:14.188388 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.283005 29752 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:14.231741 25196 raft_consensus.cc:2393] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:14.284519 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:14.217273 29802 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:14.286178 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.237630 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.287922 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.288695 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.288815 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.289523 25272 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:14.290107 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.290468 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.290977 25273 raft_consensus.cc:2393] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 14: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:14.291811 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.292888 25122 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:14.293295 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:14.236773 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 61551.8us
W20260709 12:21:14.243620 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.243109 25269 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:14.288169 25241 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:14.295783 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.296145 25241 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:14.296463 25269 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:14.298571 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.298946 25093 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:14.241170 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:14.247427 25202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2508) took 3165 ms (client timeout 2373 ms). Trace:
W20260709 12:21:14.299718 25202 rpcz_store.cc:269] 0709 12:21:11.082396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.910474 (+828078us) service_pool.cc:224] Handling call
0709 12:21:14.247258 (+2336784us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54003615d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:14.247359 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4440777984}
I20260709 12:21:14.300026 25093 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:14.232604 29710 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.249181 29712 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.235978 29554 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:14.226671 29787 raft_consensus.cc:697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:14.245193 29598 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:14.255337 29701 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:14.267529 25127 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:14.323269 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:14.323513 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:14.324167 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:14.160032 29557 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:14.236598 25121 raft_consensus.cc:2393] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:14.324829 25127 raft_consensus.cc:2376] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9. Re-sending same reply.
I20260709 12:21:14.334878 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:14.335235 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.335742 25855 raft_consensus.cc:2368] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15.
I20260709 12:21:14.335929 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.286356 29802 raft_consensus.cc:697] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:14.300853 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:14.301069 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:14.232707 29792 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:14.343771 25127 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:14.302276 29786 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 13.
I20260709 12:21:14.302652 25093 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:14.306123 25124 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:14.189997 29811 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.299793 25276 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:14.306785 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.352414 25825 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:14.308475 25199 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:14.310532 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:14.239018 28997 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:14.314338 25120 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:14.315841 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.358525 25269 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:14.316337 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.197048 29693 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:14.312011 29814 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.244122 29766 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:14.301625 29710 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.304653 29632 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:14.244442 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.280985 29229 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:14.305424 29713 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:14.302361 29296 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:14.353843 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 51281.4us
I20260709 12:21:14.304090 25126 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:14.359395 25201 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:14.360432 25276 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:14.361100 25274 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:14.358731 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:14.335975 25202 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:14.305632 29654 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:21:14.294932 29599 consensus_queue.cc:260] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.357936 29701 consensus_queue.cc:1059] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:21:14.304638 29624 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:21:14.397590 29710 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:14.398569 29731 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:14.365770 29799 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:21:14.401193 25269 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:21:14.435881 29598 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.401731 29729 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:14.404475 29811 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:14.364481 29766 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:14.310384 29707 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:21:14.305024 29658 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:21:14.302258 29752 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:21:14.307315 29559 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:21:14.345779 29557 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.454912 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.478434 25200 raft_consensus.cc:2410] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:21:14.367038 29763 consensus_meta.cc:287] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.003s
W20260709 12:21:14.437793 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.441015 25267 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:14.362519 29815 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:14.360754 29712 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:14.336179 29735 consensus_queue.cc:1059] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 12:21:14.453204 29819 log.cc:927] Time spent T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:21:14.363881 29814 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.431612 29604 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:14.455718 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.499558 25193 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:21:14.457834 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.500981 25126 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:14.457902 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.503414 25201 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:21:14.460561 25274 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:14.461414 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.462129 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.462770 25194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2494) took 3389 ms. Trace:
I20260709 12:21:14.507146 25194 rpcz_store.cc:276] 0709 12:21:11.073113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.272988 (+1199875us) service_pool.cc:224] Handling call
0709 12:21:12.273313 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:14.052730 (+1779417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.462527 (+409797us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54000b18d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:14.462707 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3996702080}
I20260709 12:21:14.508982 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.471715 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.459405 25275 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:14.480823 25197 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
W20260709 12:21:14.453951 29821 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:21:14.494421 25198 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:14.496198 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.492465 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.510550 25269 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:14.510017 25194 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 13: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:14.472820 29521 raft_consensus.cc:3055] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:14.505651 25121 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:14.514333 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.521488 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.522295 25267 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:14.472438 29766 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:14.532236 25195 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:14.523627 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.455559 29296 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:14.464548 29625 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:14.463060 29701 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:14.478196 29811 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.522401 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:14.537451 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:14.540053 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.533654 25194 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
W20260709 12:21:14.565073 25851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46474 (request call id 1533) took 2131 ms (client timeout 1746 ms). Trace:
I20260709 12:21:14.566071 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.534804 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.524286 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.567548 25274 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:14.568547 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.568784 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.569178 25274 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:14.570433 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:14.573422 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 269400us
I20260709 12:21:14.540655 25202 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:14.539824 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.469794 29777 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10.
I20260709 12:21:14.471585 29598 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:14.542850 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.550154 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:14.552671 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 275925us
I20260709 12:21:14.584880 25270 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:14.585435 25168 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:14.554610 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.586971 25267 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:14.453951 29802 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.520398 29521 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:14.531605 29604 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:14.588011 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:14.562554 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.520706 29815 raft_consensus.cc:697] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:14.465436 29727 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:14.597508 25269 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:14.497305 29814 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:14.589342 25121 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:14.590602 25167 leader_election.cc:400] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15.
I20260709 12:21:14.618932 25167 leader_election.cc:403] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:14.592141 25168 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:14.592417 25200 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:14.542071 29701 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:14.594561 25199 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:14.623186 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2511) took 3540 ms. Trace:
I20260709 12:21:14.593930 29779 raft_consensus.cc:697] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:14.596952 25194 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 12:21:14.565528 25851 rpcz_store.cc:269] 0709 12:21:12.433814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.451329 (+ 17515us) service_pool.cc:224] Handling call
0709 12:21:14.564758 (+2113429us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400745254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:14.564968 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3948065664}
I20260709 12:21:14.599530 25825 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:14.600174 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.601136 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.553480 29296 raft_consensus.cc:697] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:21:14.604717 25165 leader_election.cc:336] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Timed out: RequestConsensusVote RPC to 127.23.81.195:44749 timed out after 2.132s (SENT)
I20260709 12:21:14.606473 25275 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:21:14.495935 29763 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:14.643657 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 51595.3us
I20260709 12:21:14.635037 25195 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:14.643230 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.645020 25168 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:14.645424 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2505) took 3569 ms. Trace:
W20260709 12:21:14.615463 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 319356us
I20260709 12:21:14.615872 25202 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:14.595647 29625 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:14.595353 29707 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:21:14.647022 25202 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:14.648095 25202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2472) took 2182 ms. Trace:
I20260709 12:21:14.647810 25165 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:14.648519 25202 rpcz_store.cc:276] 0709 12:21:12.466199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.646453 (+2180254us) service_pool.cc:224] Handling call
0709 12:21:14.646739 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.647888 (+  1149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.648051 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:14.647423 25194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2504) took 3571 ms. Trace:
W20260709 12:21:14.616616 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 442605us
I20260709 12:21:14.553098 29811 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:14.620121 25274 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:14.620898 25201 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:14.652837 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 863) took 2694 ms. Trace:
I20260709 12:21:14.610169 25198 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:14.653178 25201 rpcz_store.cc:276] 0709 12:21:11.957945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.604639 (+2646694us) service_pool.cc:224] Handling call
0709 12:21:14.620668 (+ 16029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.652611 (+ 31943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.652785 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:14.590483 29604 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:14.621310 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.623509 25199 rpcz_store.cc:276] 0709 12:21:11.083217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.593954 (+3510737us) service_pool.cc:224] Handling call
0709 12:21:14.594365 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.622945 (+ 28580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.623134 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:14.659328 25269 raft_consensus.cc:2376] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12. Re-sending same reply.
I20260709 12:21:14.595028 25196 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:14.660176 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.660485 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2502) took 3585 ms. Trace:
I20260709 12:21:14.660851 25196 rpcz_store.cc:276] 0709 12:21:11.075368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.594448 (+3519080us) service_pool.cc:224] Handling call
0709 12:21:14.594789 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:14.660246 (+ 65457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.660436 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:14.661311 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.463222 29787 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:14.643225 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 53021us
I20260709 12:21:14.650580 25242 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:14.643443 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.650112 25194 rpcz_store.cc:276] 0709 12:21:11.075951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.596354 (+3520403us) service_pool.cc:224] Handling call
0709 12:21:14.596695 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:14.647146 (+ 50451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.647365 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:14.664093 25242 leader_election.cc:400] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13.
I20260709 12:21:14.664337 25194 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:14.662544 29604 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:14.665656 25194 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:14.665993 29727 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:14.666826 25194 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:14.666905 29727 raft_consensus.cc:697] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:14.668145 25194 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:14.669206 25194 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:14.669703 25201 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:14.671532 29559 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:14.672459 29559 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:14.673532 25194 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:14.674443 29624 raft_consensus.cc:3055] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:21:14.674386 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 74966.3us
I20260709 12:21:14.675019 29624 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:14.675966 29624 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.677450 29624 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:14.678244 29623 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:14.678900 29623 raft_consensus.cc:697] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:14.679940 29623 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.682983 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.683669 25120 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:14.684688 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.687608 25858 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:14.690559 25120 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:14.688807 25167 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:14.651154 25125 raft_consensus.cc:2393] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:14.615609 29566 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.647871 25090 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:14.591686 29284 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:14.655507 25202 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:14.694257 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 46465.6us
I20260709 12:21:14.694514 25202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2477) took 2189 ms. Trace:
I20260709 12:21:14.655479 29701 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:14.691725 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.695073 25851 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:14.645815 25195 rpcz_store.cc:276] 0709 12:21:11.076238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.599118 (+3522880us) service_pool.cc:224] Handling call
0709 12:21:14.634650 (+ 35532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:14.645167 (+ 10517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.645369 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:14.696602 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.640661 25267 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:14.694854 25202 rpcz_store.cc:276] 0709 12:21:12.505022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.649328 (+2144306us) service_pool.cc:224] Handling call
0709 12:21:14.655343 (+  6015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.694288 (+ 38945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.694463 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:14.695106 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:14.668437 29727 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.694180 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:14.700423 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:14.700431 25118 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:14.701237 25851 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:14.693069 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:14.704941 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:14.713054 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:14.715173 25857 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:14.700884 25242 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:14.716351 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:14.666182 29832 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.722489 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:14.651823 29625 raft_consensus.cc:697] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:14.724043 25121 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:14.705451 25093 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:14.728426 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:14.733291 25200 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:21:14.733700 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.737383 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:14.739574 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:14.732326 25093 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:14.740869 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:14.742290 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.743041 25267 raft_consensus.cc:2376] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11. Re-sending same reply.
I20260709 12:21:14.687711 29752 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15.
I20260709 12:21:14.740206 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.745332 25858 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:14.745766 25276 raft_consensus.cc:2376] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10. Re-sending same reply.
I20260709 12:21:14.746704 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:14.750861 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:14.751462 25269 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:14.751627 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:14.752218 25202 raft_consensus.cc:2376] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10. Re-sending same reply.
I20260709 12:21:14.753211 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.762571 25195 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:14.764990 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:14.714581 29713 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:14.729455 29788 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:14.714483 29812 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:14.740648 29701 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:14.788347 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:14.766224 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:14.795068 25201 raft_consensus.cc:2393] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:14.737643 29832 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.737948 29735 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:14.645834 29521 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.800725 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:14.801113 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:14.776841 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 172152us
I20260709 12:21:14.807279 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:14.783069 29713 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.803784 25269 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:14.796661 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:14.815361 25857 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:14.815903 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:14.773924 29707 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.786233 29284 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.772686 29829 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:14.787937 29812 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.820194 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:14.835361 25269 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:21:14.836613 25269 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:14.808095 29632 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:14.793951 29554 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.784914 29777 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:14.736145 29815 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.821270 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:14.799582 29512 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:21:14.806586 29832 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:14.811707 29516 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:14.817176 29713 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:14.817076 29515 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:14.867508 29516 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:14.823674 29559 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:14.874548 29559 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:14.874976 29559 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:14.874895 29516 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.788539 29710 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.878113 29710 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:14.827046 29521 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:14.841241 29632 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:14.889741 29632 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:14.843080 29625 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.903493 29763 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:14.865319 29735 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:14.909368 29735 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.909871 29735 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:14.920442 29792 consensus_meta.cc:287] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.001s
I20260709 12:21:14.921089 29792 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:14.796141 29781 consensus_queue.cc:260] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.930792 29781 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:14.800444 29779 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.939628 29811 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:14.873349 29777 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:21:14.942903 29559 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:14.827216 29829 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:14.837065 29812 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:14.838553 29842 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:14.943902 29843 raft_consensus.cc:3055] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:15.042004 29843 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:15.043224 29843 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.030067 29829 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:15.032388 29842 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.049540 29842 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:15.075798 29792 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:15.088325 29766 consensus_meta.cc:287] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 12:21:15.125054 29832 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.179435 29832 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:14.773463 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 74818.2us
W20260709 12:21:15.224426 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.224824 25090 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:14.812517 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:15.227656 25194 raft_consensus.cc:1240] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:21:15.229043 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 416430us
W20260709 12:21:14.809340 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 164407us
I20260709 12:21:15.235060 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:15.237686 25090 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:15.231839 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2506) took 4155 ms. Trace:
I20260709 12:21:15.239395 25090 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:15.239347 25193 rpcz_store.cc:276] 0709 12:21:11.081669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.597988 (+3516319us) service_pool.cc:224] Handling call
0709 12:21:14.598394 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:14.598652 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:14.598680 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:14.605023 (+  6343us) log.cc:844] Serialized 26 byte log entry
0709 12:21:14.813103 (+208080us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:14.813141 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.813213 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:15.231075 (+417862us) raft_consensus.cc:1685] finished
0709 12:21:15.231135 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.231567 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":166451,"threads_started":1,"wal-append.queue_time_us":264685}
I20260709 12:21:15.247313 25196 raft_consensus.cc:1240] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:21:15.252487 25165 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:14.810810 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:15.257933 25201 raft_consensus.cc:2376] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15. Re-sending same reply.
W20260709 12:21:15.268915 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 492665us
W20260709 12:21:15.269205 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.270066 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.271018 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.851429 25825 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:15.292353 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.293087 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 441566us
I20260709 12:21:14.850039 25857 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:14.780417 29296 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.298293 25270 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:15.288995 25242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.000s	sys 0.018s
W20260709 12:21:15.299687 25242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.000s	sys 0.019s
I20260709 12:21:14.822633 29284 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.302719 29284 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.304036 29554 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:15.290637 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.308379 29467 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:15.308579 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.308871 29467 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:15.309154 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.309324 29467 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:15.291090 25267 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:15.311560 25241 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:15.299003 29512 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:15.293797 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.140036 29713 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:15.172683 29735 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.089138 29766 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.142977 29812 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:15.484764 29812 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:15.093086 29814 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.488133 29814 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:15.488418 29713 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:15.490631 25127 raft_consensus.cc:1240] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:21:15.425953 25273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.009s	sys 0.016s
I20260709 12:21:15.169759 29829 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.165972 29842 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:15.433878 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.434482 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 195385us
I20260709 12:21:15.515801 25090 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:15.516564 29842 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:15.317984 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 578402us
I20260709 12:21:15.521184 29842 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:15.421094 29512 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.522457 29512 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.522797 29625 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.523789 29625 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:15.524814 29604 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.859s	user 0.005s	sys 0.010s
W20260709 12:21:15.445958 25122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.004s	sys 0.019s
I20260709 12:21:15.526211 29803 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:15.528054 29829 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:15.529223 25197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2488) took 1329 ms (client timeout 1544 ms). Trace:
I20260709 12:21:15.455940 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:15.530526 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 74757.1us
I20260709 12:21:15.530730 29766 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:15.531845 29766 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:15.532305 29766 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:15.532825 29766 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:15.458546 29559 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:15.494212 29856 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:15.534380 29787 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:15.460511 29811 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:15.460012 29654 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:15.461911 29752 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:15.466008 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.464859 29788 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:15.471082 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 159772us
I20260709 12:21:15.470883 29828 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:15.474716 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:15.535915 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:15.480803 29832 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:15.489703 29735 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:15.256063 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:15.529673 25197 rpcz_store.cc:269] 0709 12:21:14.199502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.227857 (+ 28355us) service_pool.cc:224] Handling call
0709 12:21:15.528833 (+1300976us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54000a8a54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:15.529013 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540956416}
I20260709 12:21:15.505447 25276 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: []
W20260709 12:21:15.498844 25273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.010s	sys 0.016s
I20260709 12:21:15.521811 29842 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:15.517699 25090 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:15.534458 29856 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:15.461103 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 208964us
I20260709 12:21:15.459642 29710 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:21:15.526273 25122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.004s	sys 0.020s
I20260709 12:21:15.525364 29604 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:15.512320 25126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.005s	sys 0.041s
W20260709 12:21:15.477973 29623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.000s	sys 0.009s
I20260709 12:21:15.265165 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:15.535427 29811 raft_consensus.cc:697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:15.546865 29788 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:15.566723 25119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.008s	sys 0.020s
I20260709 12:21:15.566962 29799 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:15.567606 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:15.570155 29623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.001s	sys 0.009s
I20260709 12:21:15.569901 29512 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.535434 29787 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.571710 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:15.566882 25202 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 11: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:21:15.575493 25126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.006s	sys 0.041s
I20260709 12:21:15.578267 29799 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:15.582338 25119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.009s	sys 0.021s
I20260709 12:21:15.584614 25860 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:15.586210 29799 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:15.600430 25273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2589) took 1808 ms. Trace:
I20260709 12:21:15.601238 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:15.602340 25851 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 14: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:15.600893 25273 rpcz_store.cc:276] 0709 12:21:13.791661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.304987 (+513326us) service_pool.cc:224] Handling call
0709 12:21:14.305314 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.305556 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:14.711982 (+406426us) log.cc:844] Serialized 14 byte log entry
0709 12:21:15.599799 (+887817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:15.599906 (+   107us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:15.600071 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.600181 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.600348 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8751,"prepare.queue_time_us":493819,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":17843,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":1227112,"threads_started":2,"wal-append.queue_time_us":714028}
W20260709 12:21:15.603578 29632 consensus_meta.cc:287] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.713s	user 0.017s	sys 0.002s
W20260709 12:21:15.603657 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 144645us
I20260709 12:21:15.604241 29512 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:15.605566 29712 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:15.605670 29710 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:15.606375 29712 raft_consensus.cc:697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:15.606498 29787 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:15.606747 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:15.607307 25854 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:15.607910 29712 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.608914 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:15.609309 29566 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:15.609965 29566 raft_consensus.cc:697] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:15.610900 29811 consensus_queue.cc:237] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:15.611348 29604 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:15.611296 29566 consensus_queue.cc:237] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:15.613196 29839 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:15.614573 29839 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.614996 29839 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:15.615579 25268 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:15.615204 29799 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.617651 29799 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:15.575810 29788 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:15.615140 25201 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:15.622485 25193 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:15.546838 29781 consensus_queue.cc:1059] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 12:21:15.641595 25860 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:15.586508 29829 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.604281 29632 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:15.647754 29624 consensus_meta.cc:287] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.941s	user 0.016s	sys 0.003s
W20260709 12:21:15.650264 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 44737.7us
I20260709 12:21:15.655267 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 871) took 1588 ms. Trace:
I20260709 12:21:15.652292 29559 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:21:15.652706 29842 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:15.656337 29856 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.657332 29817 raft_consensus.cc:3055] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:21:15.658663 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.655762 29284 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.661182 29557 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:15.640466 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:15.648819 29467 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:15.654410 25165 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:15.644208 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2600) took 1092 ms. Trace:
I20260709 12:21:15.664413 25200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2469) took 3208 ms. Trace:
I20260709 12:21:15.668694 29599 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:15.670463 25198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 869) took 1750 ms (client timeout 2028 ms). Trace:
I20260709 12:21:15.673417 29693 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:15.674474 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 157023us
W20260709 12:21:15.675287 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 112056us
I20260709 12:21:15.676970 25196 rpcz_store.cc:276] 0709 12:21:14.066653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.661563 (+594910us) service_pool.cc:224] Handling call
0709 12:21:14.661850 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.248086 (+586236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.654947 (+406861us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54000a5854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:15.655193 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344661760}
I20260709 12:21:15.690297 25857 raft_consensus.cc:2410] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:21:15.684126 25200 rpcz_store.cc:276] 0709 12:21:12.456289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.634142 (+2177853us) service_pool.cc:224] Handling call
0709 12:21:14.634518 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:14.733924 (+ 99406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.663833 (+929909us) spinlock_profiling.cc:243] Waited 98.5 ms on lock 0x7b54002da854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:15.664232 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226553728}
W20260709 12:21:15.687121 25198 rpcz_store.cc:269] 0709 12:21:13.919940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.168399 (+248459us) service_pool.cc:224] Handling call
0709 12:21:15.669963 (+1501564us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54000a7b54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:15.670256 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747119360}
I20260709 12:21:15.678390 29817 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:15.707216 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1240) took 1021 ms. Trace:
I20260709 12:21:15.707728 25854 rpcz_store.cc:276] 0709 12:21:14.685660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.688567 (+  2907us) service_pool.cc:224] Handling call
0709 12:21:14.688882 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.607831 (+918949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.706908 (+ 99077us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54006c0cd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:15.707144 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948644096}
I20260709 12:21:15.710279 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1226) took 1638 ms. Trace:
I20260709 12:21:15.710731 25268 rpcz_store.cc:276] 0709 12:21:14.071945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.569732 (+497787us) service_pool.cc:224] Handling call
0709 12:21:14.588935 (+ 19203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.616082 (+1027147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.709897 (+ 93815us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b540034e4d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:15.710208 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2283131136}
I20260709 12:21:15.711539 29817 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.712863 29694 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:15.713375 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2659) took 1561 ms. Trace:
I20260709 12:21:15.713593 29799 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:15.713857 25124 rpcz_store.cc:276] 0709 12:21:14.151926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.154126 (+  2200us) service_pool.cc:224] Handling call
0709 12:21:15.712906 (+1558780us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003d5254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:15.713126 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346781056}
I20260709 12:21:15.715322 29799 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:15.715517 29632 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:15.715819 25194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 878) took 1590 ms. Trace:
I20260709 12:21:15.715871 29799 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:15.716380 25194 rpcz_store.cc:276] 0709 12:21:14.125551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.674743 (+549192us) service_pool.cc:224] Handling call
0709 12:21:14.675180 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.228714 (+553534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.715491 (+486777us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b5400361354. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:15.715761 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268348160}
I20260709 12:21:15.717777 29768 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:15.718042 29727 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:15.718585 29727 raft_consensus.cc:697] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:21:15.718699 29701 consensus_meta.cc:287] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.923s	user 0.013s	sys 0.004s
I20260709 12:21:15.719831 29727 consensus_queue.cc:237] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:15.722630 29799 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:15.723450 25271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1228) took 1613 ms (client timeout 1637 ms). Trace:
W20260709 12:21:15.723980 25271 rpcz_store.cc:269] 0709 12:21:14.110064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.115269 (+  5205us) service_pool.cc:224] Handling call
0709 12:21:15.723054 (+1607785us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001234d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:15.723244 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2486245120}
I20260709 12:21:15.724484 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2593) took 1262 ms. Trace:
I20260709 12:21:15.724747 29284 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:15.724952 25274 rpcz_store.cc:276] 0709 12:21:14.461530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.584153 (+122623us) service_pool.cc:224] Handling call
0709 12:21:14.619856 (+ 35703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.652290 (+ 32434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.724079 (+1071789us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b54002a8d50. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:15.724303 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81290496}
W20260709 12:21:15.728400 25822 connection.cc:256] RPC call timeout handler was delayed by -1.1896308670000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 12:21:15.728843 25822 connection.cc:256] RPC call timeout handler was delayed by -1.1716308670002036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
W20260709 12:21:15.729146 25822 connection.cc:256] RPC call timeout handler was delayed by -1.1662308670001948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 12:21:15.729420 25822 connection.cc:256] RPC call timeout handler was delayed by -1.1500308670001687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
I20260709 12:21:15.734323 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:15.735811 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 846) took 1385 ms. Trace:
I20260709 12:21:15.736264 25127 rpcz_store.cc:276] 0709 12:21:14.350901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.351074 (+   173us) service_pool.cc:224] Handling call
0709 12:21:14.351550 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.491162 (+1139612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.735431 (+244269us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001c98d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:15.735705 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2618447232}
I20260709 12:21:15.684487 25269 rpcz_store.cc:276] 0709 12:21:14.493406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.837412 (+344006us) service_pool.cc:224] Handling call
0709 12:21:14.837692 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:14.838019 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:14.838133 (+   114us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:14.842989 (+  4856us) log.cc:844] Serialized 26 byte log entry
0709 12:21:15.545971 (+702982us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:15.558586 (+ 12615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.559915 (+  1329us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:15.573707 (+ 13792us) raft_consensus.cc:1685] finished
0709 12:21:15.573735 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.585765 (+ 12030us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80531,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":150,"thread_start_us":163821,"threads_started":1,"wal-append.queue_time_us":268992}
I20260709 12:21:15.737360 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:15.701792 25242 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:21:15.742355 29598 consensus_meta.cc:287] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.103s	user 0.004s	sys 0.012s
W20260709 12:21:15.710752 29859 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:21:15.760627 29799 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:15.762705 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.692986 29781 consensus_queue.cc:1243] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:21:15.702627 29625 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:15.712857 29817 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:15.740567 25822 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.195:44749 timed out after 1.980s (SENT) [suppressed 56 similar messages]
I20260709 12:21:15.772006 25200 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:21:15.775467 29229 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:15.780201 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2110) took 1125 ms. Trace:
I20260709 12:21:15.780989 25196 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:21:15.786374 29706 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:15.791208 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 1.05438e+06us
I20260709 12:21:15.791327 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:15.792269 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:15.792497 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.792577 25857 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:21:15.793140 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:15.793869 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1233) took 1657 ms. Trace:
I20260709 12:21:15.794270 25275 rpcz_store.cc:276] 0709 12:21:14.136191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.594380 (+458189us) service_pool.cc:224] Handling call
0709 12:21:14.603524 (+  9144us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:14.647562 (+ 44038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.766874 (+1119312us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5400298e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:15.793687 (+ 26813us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6148480}
I20260709 12:21:15.796190 25194 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
W20260709 12:21:15.798588 25093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.012s	sys 0.005s
W20260709 12:21:15.799010 25093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.012s	sys 0.005s
I20260709 12:21:15.798256 25021 catalog_manager.cc:5697] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 4 to 7, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 7 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:15.803030 25195 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:15.794005 25860 raft_consensus.cc:2393] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:15.810573 29839 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:15.812379 29843 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:15.813418 25241 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:15.816077 25276 raft_consensus.cc:3055] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:15.816498 25276 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:15.793164 25857 pending_rounds.cc:85] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 9
W20260709 12:21:15.820726 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 90783.6us
I20260709 12:21:15.693547 29829 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.819207 25857 pending_rounds.cc:107] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 10.10
W20260709 12:21:15.835420 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.830839 25857 raft_consensus.cc:2889] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:15.780647 25267 rpcz_store.cc:276] 0709 12:21:14.654575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.476351 (+821776us) service_pool.cc:224] Handling call
0709 12:21:15.477242 (+   891us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:15.492809 (+ 15567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.492851 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:15.497816 (+  4965us) log.cc:844] Serialized 52 byte log entry
0709 12:21:15.682248 (+184432us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:15.682288 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.682357 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:15.779938 (+ 97581us) raft_consensus.cc:1685] finished
0709 12:21:15.779956 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.780116 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2881,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":140,"thread_start_us":123568,"threads_started":1,"wal-append.queue_time_us":213945}
I20260709 12:21:15.817276 29839 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:15.838056 29701 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.846570 25272 raft_consensus.cc:2410] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:15.846630 29701 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.847040 25194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
W20260709 12:21:15.854569 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 173607us
I20260709 12:21:15.854696 25194 raft_consensus.cc:606] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:15.855271 25194 raft_consensus.cc:614] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:15.856808 25242 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:15.857672 29701 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:15.857910 29786 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:21:15.858665 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 1.1263e+06us
I20260709 12:21:15.859131 29786 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:15.859370 29781 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:15.860373 29598 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:15.860857 29598 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:15.861867 29598 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:15.862138 25276 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.862331 29775 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:15.863476 29467 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:15.863278 29598 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:15.864061 25276 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.866962 29781 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:15.868263 29781 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.870074 29768 consensus_queue.cc:1059] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:15.870386 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:15.871265 25195 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:15.871202 29768 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:15.872262 29768 consensus_queue.cc:1059] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:15.873348 29729 raft_consensus.cc:3055] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:15.873766 29729 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:15.875051 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 870) took 1954 ms. Trace:
I20260709 12:21:15.874801 29729 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.876405 29729 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:15.875468 25199 rpcz_store.cc:276] 0709 12:21:13.920207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.659421 (+739214us) service_pool.cc:224] Handling call
0709 12:21:14.659728 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:14.808404 (+148676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:14.808435 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:14.808917 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:21:15.517477 (+708560us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:15.682665 (+165188us) log.cc:844] Serialized 14 byte log entry
0709 12:21:15.689169 (+  6504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.695482 (+  6313us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:15.874678 (+179196us) raft_consensus.cc:1685] finished
0709 12:21:15.874697 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.874853 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1016,"prepare.queue_time_us":132807,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":16493,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":3842,"thread_start_us":496955,"threads_started":3,"wal-append.queue_time_us":279509}
I20260709 12:21:15.878247 29632 raft_consensus.cc:3055] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:15.878716 29632 raft_consensus.cc:740] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:15.878938 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:15.879814 29632 consensus_queue.cc:260] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:15.880342 25854 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:21:15.880401 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:15.881253 29632 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:15.883324 29829 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:15.883973 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 48711.1us
I20260709 12:21:15.882102 29284 consensus_queue.cc:1059] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:15.886356 29598 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:15.886876 29598 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:21:15.895556 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.920053 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:15.925675 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:15.928966 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.929919 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.930369 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.929625 25021 catalog_manager.cc:5697] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:15.931169 25858 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:15.932873 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1230) took 1797 ms. Trace:
I20260709 12:21:15.935263 29654 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:15.935844 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.936412 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.936859 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.937525 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.938304 29701 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.938880 29701 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.939260 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2671) took 1758 ms. Trace:
I20260709 12:21:15.933207 25021 catalog_manager.cc:5697] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:15.933491 25272 rpcz_store.cc:276] 0709 12:21:14.135287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.293004 (+157717us) service_pool.cc:224] Handling call
0709 12:21:15.932558 (+1639554us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540002c954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:15.932789 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3548655488}
I20260709 12:21:15.939781 25123 rpcz_store.cc:276] 0709 12:21:14.180312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.235726 (+ 55414us) service_pool.cc:224] Handling call
0709 12:21:14.235971 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.457144 (+221173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:14.457184 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:14.457229 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:14.457270 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.938732 (+1481462us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b540009e054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:15.938814 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.939053 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507953536}
W20260709 12:21:15.950500 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 90818.9us
W20260709 12:21:15.958303 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 166217us
I20260709 12:21:15.958175 29856 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:15.959025 29467 consensus_queue.cc:1059] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:15.960042 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:15.960402 29467 consensus_queue.cc:1059] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:15.962059 29693 raft_consensus.cc:3055] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:15.962589 29693 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:15.963842 29693 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:15.965332 29693 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:15.966224 29712 raft_consensus.cc:3055] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:15.966686 29712 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:15.967787 29712 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:15.969645 29712 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:15.973140 29802 raft_consensus.cc:2764] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:21:15.975040 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:15.975852 25200 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:15.978175 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:15.980086 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:15.980890 25822 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:15.982398 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.982468 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:15.983000 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.983300 25855 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.985853 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:15.987277 25198 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:15.988554 29829 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.989114 29829 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.989471 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:15.942792 29713 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:15.991111 29713 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:15.991537 29713 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:15.992545 29766 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.993047 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:15.995230 29848 log.cc:927] Time spent T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:21:15.935846 29654 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:15.961899 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:15.985934 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:15.959254 25092 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:16.005625 25276 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:15.957746 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:16.007808 25194 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:16.007483 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1238) took 1314 ms. Trace:
I20260709 12:21:16.008459 25276 rpcz_store.cc:276] 0709 12:21:14.693353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.572304 (+878951us) service_pool.cc:224] Handling call
0709 12:21:15.572889 (+   585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.815980 (+243091us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54004c07a0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e85dc0 00007f2103f101c0 00007f2103f11231 00007f2103f0dd8f 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c
0709 12:21:16.007198 (+191218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.007405 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451358592}
W20260709 12:21:16.010403 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 193677us
I20260709 12:21:16.012844 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:16.021952 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 69870us
I20260709 12:21:16.014118 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:15.966998 29777 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:16.012588 29788 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:16.029435 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.031971 29788 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:16.035233 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:16.036027 25276 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:16.045230 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:16.045619 29779 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:16.046078 25269 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:16.046168 29779 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:16.046682 29779 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:16.046960 29758 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:21:16.048363 25272 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:16.021525 29625 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:16.054503 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 73674.1us
I20260709 12:21:16.050560 25021 catalog_manager.cc:5697] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:21:16.085539 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.070228 29377 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.094826 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:16.097012 25276 raft_consensus.cc:2410] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:16.091277 25822 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:16.052524 29811 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:16.059280 29768 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:16.102770 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:16.108558 25274 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 13: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:16.103397 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:16.103972 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:16.104406 29727 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:16.105131 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:16.108959 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:16.115355 25022 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41770 (request call id 328) took 24468 ms (client timeout 15000 ms). Trace:
I20260709 12:21:16.119024 29654 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:16.119464 25852 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:16.048434 29598 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.112655 29694 raft_consensus.cc:3055] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:16.134613 29694 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:16.135885 29694 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:16.140012 29877 log.cc:927] Time spent T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:21:16.141687 29811 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:16.142884 29811 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:16.148190 29598 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:16.150533 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 188725us
W20260709 12:21:16.160055 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 63504.6us
I20260709 12:21:16.161772 25194 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:16.108220 29768 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:16.071522 29625 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.137853 29694 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:16.165515 25021 catalog_manager.cc:5697] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:16.169183 25857 raft_consensus.cc:1240] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:16.168705 25195 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:16.163930 29768 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:16.171811 25267 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:16.170967 25856 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
W20260709 12:21:16.172183 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 214564us
I20260709 12:21:16.175217 25855 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:16.170636 29624 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:16.174104 29766 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:16.159695 29377 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:16.190481 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 231361us
I20260709 12:21:16.189517 29701 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:16.204283 29377 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:16.177412 29623 raft_consensus.cc:2764] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:16.188560 25021 catalog_manager.cc:5697] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:16.210861 25021 catalog_manager.cc:5697] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 6 to 9, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 9 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:16.171383 29758 consensus_queue.cc:1059] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:21:16.214542 29758 raft_consensus.cc:3055] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:16.214932 29758 raft_consensus.cc:740] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:16.215303 29779 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:16.215942 29758 consensus_queue.cc:260] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.217321 29758 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:16.217494 29779 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:16.115778 25022 rpcz_store.cc:269] 0709 12:20:51.566392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.566566 (+   174us) service_pool.cc:224] Handling call
0709 12:21:16.025620 (+24459054us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:06.108669 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:06.109781 (+  1112us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:06.109832 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:21:06.109852 (+    20us) tablet.cc:662] Decoding operations
0709 12:21:06.111802 (+  1950us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:06.111884 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:06.111910 (+    26us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:21:06.399175 (+287265us) tablet.cc:701] Row locks acquired
0709 12:21:06.453239 (+ 54064us) write_op.cc:260] PREPARE: finished
0709 12:21:06.458574 (+  5335us) write_op.cc:270] Start()
0709 12:21:06.458775 (+   201us) write_op.cc:276] Timestamp: P: 1783599666458496 usec, L: 0
0709 12:21:06.458802 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:21:06.508322 (+ 49520us) log.cc:844] Serialized 10220 byte log entry
0709 12:21:07.090511 (+582189us) op_driver.cc:464] REPLICATION: finished
0709 12:21:07.374558 (+284047us) write_op.cc:301] APPLY: starting
0709 12:21:07.374664 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:07.695579 (+320915us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:07.832295 (+136716us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:08.899318 (+1067023us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:08.899911 (+   593us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 12:21:08.899978 (+    67us) write_op.cc:312] APPLY: finished
0709 12:21:08.900596 (+   618us) log.cc:844] Serialized 228 byte log entry
0709 12:21:09.031753 (+131157us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:09.032064 (+   311us) write_op.cc:454] Released schema lock
0709 12:21:09.032165 (+   101us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:09.295495 (+263330us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:09.296664 (+  1169us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":197264,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":257116,"apply.run_cpu_time_us":74373,"apply.run_wall_time_us":1789097,"cfile_cache_hit":106,"cfile_cache_hit_bytes":113015,"num_ops":26,"prepare.queue_time_us":78438,"prepare.run_cpu_time_us":21424,"prepare.run_wall_time_us":522867,"raft.queue_time_us":235665,"raft.run_cpu_time_us":20519,"raft.run_wall_time_us":148992,"replication_time_us":631544,"thread_start_us":531721,"threads_started":5,"wal-append.queue_time_us":359996,"wal-append.run_cpu_time_us":22924,"wal-append.run_wall_time_us":2360340}]]}
I20260709 12:21:16.223610 25271 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:21:16.225334 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:16.229197 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 44371.8us
I20260709 12:21:16.187986 29830 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:16.228291 25274 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:16.232956 29829 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:16.242560 29693 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:16.244067 29693 consensus_queue.cc:1059] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:16.224443 25021 catalog_manager.cc:5697] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:16.249943 29624 consensus_queue.cc:1059] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:21:16.246230 29803 raft_consensus.cc:3055] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:16.259801 29624 raft_consensus.cc:3055] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:16.260275 29624 raft_consensus.cc:740] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:16.262185 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:16.263923 25092 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:16.264160 29632 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:16.268180 29625 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:16.269068 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:16.249300 29830 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.269989 29623 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:16.270929 25272 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 12:21:16.259017 25093 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:16.304973 25275 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:16.272154 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:16.272707 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:16.273023 29608 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.276006 25021 catalog_manager.cc:5697] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:16.278158 25268 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:16.278352 29876 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:21:16.278700 28997 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:16.326308 28997 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:16.328305 28997 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:16.331845 29693 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:16.258858 29803 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:16.332743 29377 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:16.332877 25241 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:16.333478 29803 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.334188 29802 consensus_queue.cc:1059] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:16.334339 29781 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:16.334880 29803 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:16.335214 29284 raft_consensus.cc:3055] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:16.335351 29377 consensus_queue.cc:1059] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:21:16.335698 29284 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:16.336534 29779 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:16.336999 29779 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:16.337957 29779 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.339197 29779 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:16.344276 29817 consensus_meta.cc:287] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.001s
W20260709 12:21:16.345223 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.283352 25267 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:16.271329 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:16.305837 25851 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:16.310338 25273 raft_consensus.cc:2393] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:16.306109 29608 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.315126 29624 consensus_queue.cc:260] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:16.316558 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 63427us
I20260709 12:21:16.319133 29694 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:16.321031 29830 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:16.321797 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 57960.6us
W20260709 12:21:16.322503 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 53535.4us
I20260709 12:21:16.368000 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:16.369305 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:16.353854 25271 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:16.354691 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:16.289319 29632 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:16.361049 25855 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:16.361243 25093 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:16.370651 25269 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:16.335076 29781 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:16.376704 25857 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:16.378016 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:16.374928 29817 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:21:16.380751 25093 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:16.382329 29694 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:16.382828 29608 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:16.387192 29467 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:16.387455 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:16.392972 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.394510 25272 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:21:16.396616 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:16.397488 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.398612 25856 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
W20260709 12:21:16.397855 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.404948 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:16.375795 29632 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:16.307232 29768 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.407953 25092 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:16.403571 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:16.412518 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:16.422886 25269 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 9: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:21:16.423003 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.423249 25194 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:16.407225 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:16.394199 29729 consensus_meta.cc:287] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.004s
I20260709 12:21:16.307763 29713 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.427418 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:16.424787 28997 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.407814 29811 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:16.403203 29712 raft_consensus.cc:2764] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:16.413546 29843 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:16.436980 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:16.435971 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:16.439949 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 52614.8us
I20260709 12:21:16.442324 25195 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:16.438323 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:16.407992 29467 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:21:16.445174 28997 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:16.449342 25200 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:16.449919 25198 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:16.450477 29693 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:16.450811 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:16.414497 29598 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 12:21:16.451933 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.421880 29599 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:21:16.413877 29829 consensus_queue.cc:1059] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:21:16.457754 25196 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 13: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:21:16.466756 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 375522us
I20260709 12:21:16.467872 25822 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:16.443210 29729 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:16.469069 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:16.469576 29623 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:16.469823 25269 raft_consensus.cc:2368] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
I20260709 12:21:16.471792 25090 leader_election.cc:400] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
W20260709 12:21:16.471938 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.472086 25090 leader_election.cc:403] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:21:16.452670 29811 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:16.473627 29712 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:16.473737 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:16.435460 29654 consensus_queue.cc:1059] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:21:16.474697 25269 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:16.474839 29654 raft_consensus.cc:3055] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:16.475272 29654 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:16.476120 29654 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.477483 29654 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:16.473735 29811 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:16.482775 29712 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
I20260709 12:21:16.483603 25822 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:16.484805 29623 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:16.484650 29284 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.485278 29623 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:16.485765 29623 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:16.413399 29625 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:21:16.445223 29624 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.445622 25021 catalog_manager.cc:5697] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 6 to 7, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 7 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:16.512888 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.505710 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:16.518220 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:16.489404 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.504738 25165 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:16.490085 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:16.507100 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:16.497692 28997 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:16.506614 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:16.521942 25198 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:21:16.519896 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:16.487812 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:16.451079 29608 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.489883 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:16.488617 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:16.595377 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:16.595880 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:16.600788 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:16.594455 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.594961 25196 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:16.602239 25271 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:16.488253 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:16.490564 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:16.491187 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:16.502328 29861 log.cc:927] Time spent T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:21:16.511605 29777 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:16.605728 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 134602us
W20260709 12:21:16.611030 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 106410us
W20260709 12:21:16.613620 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.511417 29829 raft_consensus.cc:3055] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:16.510624 29599 consensus_queue.cc:1243] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:21:16.485947 29284 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:16.432475 29694 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:16.635061 25120 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 12:21:16.635291 29713 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:16.636101 25122 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:16.504956 29799 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.513453 29766 consensus_queue.cc:1059] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 12:21:16.623514 25124 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 13: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:21:16.655938 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 267569us
I20260709 12:21:16.656153 25198 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:16.617782 29788 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:16.658443 29788 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:16.659447 29788 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:16.661852 29830 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:16.568468 29768 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:16.628995 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:16.609282 29843 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:16.457227 29817 consensus_queue.cc:1059] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.161s
I20260709 12:21:16.451048 29693 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:16.513984 29701 consensus_queue.cc:1059] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 12:21:16.647315 25196 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:21:16.647786 29632 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.620524 29608 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.649408 25856 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:16.650545 25194 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:16.651785 29777 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.654172 25822 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:16.630132 29377 raft_consensus.cc:3055] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:16.668789 25195 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:16.647783 25127 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:16.691967 25122 raft_consensus.cc:2410] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:21:16.692528 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 178982us
I20260709 12:21:16.673460 29799 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:16.623067 25200 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:16.657733 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:16.705483 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 185660us
I20260709 12:21:16.673892 25126 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:16.666806 25125 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.706936 25121 raft_consensus.cc:2410] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:21:16.606868 29758 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.514285 29889 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 12:21:16.677495 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:16.682663 25271 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:16.621729 29829 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:16.498189 29781 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.716354 25199 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:16.720530 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:16.687391 29377 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:16.726148 25124 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 9: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:16.729269 25122 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:21:16.736495 25825 leader_election.cc:336] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.086s (SENT)
I20260709 12:21:16.741951 29907 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:16.745441 29895 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:16.745577 25194 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:16.747188 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:16.748943 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:16.739780 25021 catalog_manager.cc:5697] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:16.761765 25853 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:16.762759 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:16.763643 25124 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:16.735879 29758 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:16.778494 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 44907.5us
W20260709 12:21:16.795083 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:16.802114 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 144492us
I20260709 12:21:16.757908 29727 consensus_queue.cc:1059] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:21:16.816761 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:16.773595 29829 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:16.822330 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.843081 25126 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:16.808013 29779 consensus_queue.cc:1059] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:21:16.805699 29830 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
W20260709 12:21:16.882097 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:16.884268 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 142361us
I20260709 12:21:16.885070 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:16.888808 29903 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:21:16.889358 25092 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:16.890779 29768 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:16.891309 29768 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:16.846479 29901 raft_consensus.cc:3055] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:16.891606 25092 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:16.857448 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:16.850674 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.893235 28997 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.835875 29811 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:16.913034 25125 raft_consensus.cc:2410] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:21:16.907097 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1337940720000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
I20260709 12:21:16.893327 25165 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:16.829289 29625 raft_consensus.cc:3055] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:16.938808 29625 raft_consensus.cc:740] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:16.940968 29625 consensus_queue.cc:260] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.847178 29729 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:16.901623 29803 consensus_meta.cc:287] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.000s
I20260709 12:21:16.952841 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:16.891806 29768 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:16.909106 29766 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:16.953416 25121 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:16.951063 28997 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:16.957676 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 61414.6us
I20260709 12:21:16.892738 29912 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.956693 29777 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:16.893682 29901 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:16.901091 29377 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:16.948320 29799 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:16.960361 29713 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:16.964510 25122 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:16.975325 25126 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:17.013945 29901 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:16.978983 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 242507us
I20260709 12:21:17.015419 29901 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:16.981953 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:17.016696 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.017231 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:17.010001 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 50820.6us
I20260709 12:21:17.018783 25851 raft_consensus.cc:2410] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:21:17.022601 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 131073us
I20260709 12:21:17.012552 25119 raft_consensus.cc:2410] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:21:17.013475 29799 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.948135 29889 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:16.955734 29625 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:16.955675 29907 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:21:17.043780 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 389639us
I20260709 12:21:16.957006 29781 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:17.045714 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.020232 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:16.897965 29623 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.048010 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:17.052657 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:17.054153 25126 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:17.019805 29598 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.058710 29598 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:17.059795 29229 raft_consensus.cc:2764] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:21:17.060864 29598 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:17.061491 29608 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:17.062707 25092 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:17.019678 29713 raft_consensus.cc:697] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:17.069464 28997 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:16.977866 29842 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:21:17.074887 25199 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
W20260709 12:21:17.075415 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 56579.7us
I20260709 12:21:17.047081 29889 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:17.017495 29843 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:17.141431 29843 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:17.143703 29843 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:17.144219 29829 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:17.078608 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:17.145721 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.147214 25825 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:17.080227 25857 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:17.085158 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:17.052264 29915 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:17.092468 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:17.066038 29777 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:17.095592 25822 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:17.018286 29912 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.078116 29758 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:17.056283 29799 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:17.094599 29654 consensus_meta.cc:287] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.617s	user 0.002s	sys 0.009s
I20260709 12:21:17.089236 29803 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:17.054695 29781 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:17.103958 29906 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:21:17.105820 29927 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:21:17.169260 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 275990us
W20260709 12:21:17.110638 29913 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:21:17.112602 25168 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:17.114073 29598 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:17.114835 29713 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:17.117900 29897 log.cc:927] Time spent T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.427s	user 0.005s	sys 0.000s
W20260709 12:21:17.119374 29910 log.cc:927] Time spent T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:21:17.114874 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:17.121789 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.138273 29889 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:17.138892 29842 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:17.155587 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:17.140836 29624 consensus_meta.cc:287] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.003s
I20260709 12:21:17.163004 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:17.164951 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:17.167824 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:17.236131 25200 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
W20260709 12:21:17.172079 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 79712.9us
I20260709 12:21:17.237658 25093 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:17.107053 29917 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:21:17.175601 25165 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:17.258812 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 83275.5us
I20260709 12:21:17.168268 29777 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.177599 29623 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:17.162652 29694 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:17.162667 29766 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:17.183346 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 98953.9us
W20260709 12:21:17.282662 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.188869 25853 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:17.239050 29758 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:17.240204 29912 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:17.243148 29788 raft_consensus.cc:3055] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:17.243541 29781 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:17.244827 29911 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 12:21:17.246160 29693 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:17.247218 29817 raft_consensus.cc:3055] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:17.320252 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:17.250980 29909 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:17.252595 25825 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:17.278719 29918 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:17.280391 25093 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:17.293870 29766 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:17.294314 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:17.295326 29921 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:17.187433 29842 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:17.298321 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 183590us
W20260709 12:21:17.332346 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 79847.5us
I20260709 12:21:17.309973 29788 raft_consensus.cc:740] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:17.313650 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:17.320185 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.321766 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:17.253641 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 141128us
I20260709 12:21:17.338461 25168 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:21:17.338614 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.323016 25198 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:17.320976 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:17.339380 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.302309 29799 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:17.172842 29915 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.345765 29915 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:17.327222 25197 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:21:17.327780 25195 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:17.333671 25202 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:21:17.309108 25194 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:21:17.316334 29623 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
W20260709 12:21:17.326318 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 46034us
I20260709 12:21:17.322752 29817 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:17.331012 29693 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:17.341877 25193 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:17.342641 29768 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.371115 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:17.302495 29803 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:17.355195 25093 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:17.358716 25196 raft_consensus.cc:2376] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11. Re-sending same reply.
I20260709 12:21:17.316558 29625 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:21:17.329370 29766 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:17.373525 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:17.373441 29799 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:17.368816 29694 consensus_queue.cc:1059] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:21:17.371913 29729 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:21:17.382635 25194 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:17.339274 29921 raft_consensus.cc:697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:17.383513 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:17.388612 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:17.371786 29284 consensus_meta.cc:287] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.004s
I20260709 12:21:17.368661 29624 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:17.390270 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:17.391844 29624 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.384806 29693 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:17.392166 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:17.392293 29624 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:17.392910 29909 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.393210 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:17.393445 29909 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:17.392937 25202 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 14: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:17.393812 25276 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:17.392331 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:17.400883 25168 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:17.388716 29830 raft_consensus.cc:2764] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 12:21:17.401787 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 48015.6us
I20260709 12:21:17.403193 29632 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:17.401403 25118 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:17.401371 29799 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:17.403870 29909 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:17.404561 29768 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:17.404425 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:17.404886 29817 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.405525 25168 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:17.405972 29921 consensus_queue.cc:237] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.431098 25168 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:17.406554 29608 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:17.406677 25275 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:17.432435 25168 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:17.393446 29788 consensus_queue.cc:260] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:17.433380 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:17.433842 29788 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:17.398006 29842 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:17.401532 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 50675.5us
I20260709 12:21:17.396117 29693 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:17.416388 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:17.409852 29895 consensus_meta.cc:287] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.002s
I20260709 12:21:17.414842 25196 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:17.451936 25193 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:17.452212 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:17.453104 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:17.453912 25275 raft_consensus.cc:2393] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 8: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:17.435087 29842 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:17.453019 25274 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:17.461066 29934 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:17.461951 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.461841 29934 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.459081 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:17.470803 25276 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:17.444931 29895 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:17.444780 29632 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.475510 29632 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:17.478432 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 46091.8us
I20260709 12:21:17.479599 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:17.480175 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:17.477752 29632 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:17.453186 29909 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:17.457389 29799 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:17.479451 25168 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:17.483665 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:17.428949 29889 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.442562 29927 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:21:17.495752 25273 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:17.482985 25196 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:17.481007 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:17.490901 25271 raft_consensus.cc:2393] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 9: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:17.490936 25195 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:17.491936 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:17.492822 25168 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:17.493551 28997 raft_consensus.cc:2764] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:21:17.498637 25202 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:17.497557 25276 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:17.498869 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:17.506510 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:17.507112 25202 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
W20260709 12:21:17.509008 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 61411.4us
I20260709 12:21:17.490249 29632 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.503034 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:17.510039 25270 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:17.510370 25825 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:17.513441 25168 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:17.513716 25273 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:21:17.515089 25267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:17.515718 25267 raft_consensus.cc:606] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:17.516081 25267 raft_consensus.cc:614] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:17.498553 29608 raft_consensus.cc:2764] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:17.518081 25825 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:17.504380 29229 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:17.528627 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:17.499971 29727 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:21:17.529757 25126 raft_consensus.cc:2410] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:17.535620 25127 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:21:17.517676 29625 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:17.547456 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:17.549587 25165 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:17.550760 25125 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:17.523619 29909 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:17.527348 29229 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.529693 29701 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:17.542747 29901 consensus_meta.cc:287] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.004s
I20260709 12:21:17.536201 29895 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.518181 29623 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:21:17.552660 29625 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.570477 25165 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:17.591889 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:17.571904 29945 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:17.504623 29693 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.569411 29229 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:17.575872 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:17.524402 29632 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:17.570067 29944 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:17.552258 29566 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:21:17.577195 25125 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 12:21:17.578079 29936 log.cc:927] Time spent T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:21:17.582713 29937 log.cc:927] Time spent T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:21:17.585011 29889 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:17.594503 29625 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:17.536056 29654 consensus_queue.cc:1059] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:21:17.559535 29909 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.596925 25268 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:17.556660 29923 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:17.568857 29701 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.600761 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 2242) took 1112 ms. Trace:
W20260709 12:21:17.577031 29933 log.cc:927] Time spent T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:21:17.602584 25195 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:17.575229 29599 raft_consensus.cc:3055] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:17.604408 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2541) took 1100 ms. Trace:
I20260709 12:21:17.605737 25126 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 14: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:17.607738 25201 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:21:17.610641 29934 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:17.610571 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:17.619524 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:17.589059 29766 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.621464 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:17.620962 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 94642.1us
I20260709 12:21:17.622366 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:17.621461 29799 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.626873 25165 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:17.618949 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:17.629603 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:17.644778 25267 raft_consensus.cc:2410] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:21:17.632905 25199 rpcz_store.cc:276] 0709 12:21:16.504368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.506814 (+  2446us) service_pool.cc:224] Handling call
0709 12:21:17.604244 (+1097430us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400177d54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:17.604350 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276000000}
I20260709 12:21:17.606537 29927 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:17.637370 25270 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:21:17.628268 25119 rpcz_store.cc:276] 0709 12:21:16.487891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.488000 (+   109us) service_pool.cc:224] Handling call
0709 12:21:17.597741 (+1109741us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b540021e8d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:17.600696 (+  2955us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931772288}
I20260709 12:21:17.649473 25120 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:17.597117 29901 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:21:17.655102 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:17.655829 25120 raft_consensus.cc:2376] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11. Re-sending same reply.
I20260709 12:21:17.657284 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:17.639451 29923 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.660640 29923 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:17.662161 29830 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:17.603579 29895 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.663343 29927 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.613243 29632 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:17.613605 29944 raft_consensus.cc:697] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:17.663996 29927 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:17.665174 29895 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:17.664836 29944 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.633658 29701 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:17.625317 25269 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:21:17.666312 25125 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:17.637992 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 61630.9us
I20260709 12:21:17.639076 29599 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:17.652117 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:17.663290 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:17.637581 29654 raft_consensus.cc:3055] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:17.629158 29909 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:17.656744 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:17.649199 25126 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:21:17.640786 25121 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:17.666975 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:17.679126 25272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b13f2e891f348229e95286682b88911"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:17.668541 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:17.725859 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 57385.8us
W20260709 12:21:17.717025 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 70875.4us
I20260709 12:21:17.672824 25851 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:17.668329 25168 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:17.713970 25167 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:17.719034 25199 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:17.727311 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:17.719658 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.728012 25272 raft_consensus.cc:606] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:17.723315 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 96428.3us
W20260709 12:21:17.723817 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.724619 25120 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 14: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:17.734347 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:17.736891 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 88156.8us
I20260709 12:21:17.737618 25242 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:17.724982 25126 pending_rounds.cc:85] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 7
I20260709 12:21:17.738787 25126 pending_rounds.cc:107] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:21:17.739144 25126 raft_consensus.cc:2889] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:17.741070 25196 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
I20260709 12:21:17.715786 29777 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:17.745645 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:17.716068 29654 raft_consensus.cc:740] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:17.750576 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:17.750854 25242 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:17.753957 25125 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:17.748642 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:17.738901 29729 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:17.738306 29895 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.739632 29912 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:21:17.762267 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:17.767422 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 99183us
I20260709 12:21:17.681295 29799 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.768755 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:17.724514 29901 consensus_queue.cc:1059] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 12:21:17.773875 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 60025.4us
I20260709 12:21:17.747262 29779 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:17.743713 29830 raft_consensus.cc:697] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:17.772550 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:17.777947 25853 raft_consensus.cc:2410] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:21:17.775113 25242 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:17.776141 25093 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:17.778548 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:17.778932 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:17.779251 25202 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:17.756059 29624 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.781304 25196 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:17.780014 29632 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:17.783255 29632 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.783631 29632 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:17.784780 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:17.755336 29889 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:17.786158 29758 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:17.786494 29901 raft_consensus.cc:3055] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:17.786947 29901 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:17.787356 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:17.786199 29889 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.787835 29901 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.786186 29624 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:17.789219 29901 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:17.779325 29830 consensus_queue.cc:237] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:17.788470 29889 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:17.793387 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:17.755944 29918 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.794582 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:17.762682 29729 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:17.760177 29781 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:17.761399 29912 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.769804 29623 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:17.813634 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:17.816604 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:17.821130 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1575) took 1205 ms. Trace:
I20260709 12:21:17.825220 25857 rpcz_store.cc:276] 0709 12:21:16.608570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.609030 (+   460us) service_pool.cc:224] Handling call
0709 12:21:16.622232 (+ 13202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.151426 (+529194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.813730 (+662304us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54005a3a54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:17.813930 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043292032}
I20260709 12:21:17.831543 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:17.800491 25121 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:17.855016 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:17.859163 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:17.860636 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:17.813673 29758 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:17.769905 29895 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.824790 29912 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:17.866484 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:17.794080 29953 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:17.871104 25857 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:21:17.856700 29948 log.cc:927] Time spent T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:21:17.876237 25854 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:17.819988 29729 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:17.876683 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 98284.9us
I20260709 12:21:17.804888 29777 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
W20260709 12:21:17.886494 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 128330us
I20260709 12:21:17.837626 29802 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.830173 29929 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:17.892707 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 86900.1us
I20260709 12:21:17.891893 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:17.883564 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:17.899077 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 76343.6us
I20260709 12:21:17.861963 29623 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:17.815028 29918 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.891816 25120 raft_consensus.cc:2410] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:21:17.892352 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:17.908151 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.994127 25121 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:17.889745 25853 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:17.993347 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 104804us
W20260709 12:21:17.926152 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.926527 25202 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:17.994067 25857 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:17.992569 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:17.995496 25855 raft_consensus.cc:2368] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
I20260709 12:21:17.997045 25242 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:18.000110 25126 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
W20260709 12:21:17.927726 29954 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:21:17.994087 29811 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.029402 29811 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.030311 29927 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:18.031428 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.032153 29811 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:17.928071 29922 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:18.035333 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:18.035900 29842 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 12:21:18.036624 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:18.037066 25119 raft_consensus.cc:2410] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:21:18.037231 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:18.037916 25126 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:18.038753 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:18.040828 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:18.006268 29955 log.cc:927] Time spent T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:21:18.045706 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:18.046386 25122 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:18.047468 25122 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:18.048382 25852 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:21:18.048586 25122 raft_consensus.cc:1240] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:18.048763 25852 pending_rounds.cc:85] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 8
I20260709 12:21:18.049012 25852 pending_rounds.cc:107] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:21:18.049237 25852 raft_consensus.cc:2889] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:17.991343 29624 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.990947 29712 raft_consensus.cc:3055] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:21:18.004590 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 272475us
I20260709 12:21:18.001804 29777 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:17.893718 29916 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 12:21:18.005530 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:17.916498 29802 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.068711 29802 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.017479 29377 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:18.018209 29929 raft_consensus.cc:697] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:17.830608 29654 consensus_queue.cc:260] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:17.916247 29758 consensus_queue.cc:1059] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:21:17.890242 29779 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:21:18.008939 29788 consensus_meta.cc:287] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.575s	user 0.012s	sys 0.000s
I20260709 12:21:18.023666 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:18.024286 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:18.083425 25854 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 14: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:18.024905 29799 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:17.890539 29694 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
W20260709 12:21:18.027762 25242 connection.cc:256] RPC call timeout handler was delayed by -1.0961173880000388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 12:21:18.061407 29927 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.041663 25201 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:21:18.050894 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:18.037333 25125 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:18.003266 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:18.057014 25126 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:18.056051 25168 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:17.928514 29926 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.096618 29926 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:18.097237 25242 leader_election.cc:336] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.223s (SENT)
I20260709 12:21:18.070349 29842 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:21:18.099249 29926 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.060660 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:18.062773 25202 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:21:18.062865 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:18.101256 29940 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.101439 25855 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:17.950263 29766 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:18.025727 29625 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.101886 29940 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.059674 29712 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:18.104049 29940 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.062109 29803 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.104781 29654 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:18.105088 29803 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.107304 29758 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.107869 29758 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.007567 29918 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:18.070125 29929 consensus_queue.cc:237] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.111408 25242 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:18.111645 25093 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:18.112589 29962 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.113266 25126 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:18.113117 29962 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.114326 29961 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.066403 29909 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.114893 29961 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.115396 29934 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:18.115895 29934 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.116261 29934 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.116432 29284 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:18.116566 29909 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.117198 29961 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.076242 25127 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:18.109848 25125 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:18.119135 25121 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:18.055840 29830 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:18.084794 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.153052 29701 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.063340 29624 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.155857 29624 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:18.107259 29803 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.089232 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:18.162050 25851 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 7.
W20260709 12:21:18.028048 29932 log.cc:927] Time spent T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:21:18.164731 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:18.089870 25123 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:18.091568 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 96303.7us
I20260709 12:21:18.166363 25853 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:18.166430 25822 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:18.077068 29817 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:18.167826 25855 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:21:18.064179 29777 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:18.054247 29632 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:18.148552 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 92611.8us
W20260709 12:21:18.149639 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 89093.5us
I20260709 12:21:18.085353 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:18.084862 29802 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:18.157768 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 46429us
I20260709 12:21:18.179147 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:18.179900 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:18.101481 29912 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:18.163895 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:18.183964 25855 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:18.103870 29928 raft_consensus.cc:993] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:18.168681 25273 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:21:18.164462 29926 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.104053 29625 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:18.172834 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.185503 25273 pending_rounds.cc:85] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 8
I20260709 12:21:18.173595 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:18.193060 25273 pending_rounds.cc:107] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 14.9
W20260709 12:21:18.193218 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.193542 25853 raft_consensus.cc:2410] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:21:18.182358 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:18.109905 29758 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.169580 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.173702 29777 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:18.185225 25851 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 9: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:18.168172 29961 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.171617 29909 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:18.095340 29229 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:18.191366 25124 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:18.193471 25273 raft_consensus.cc:2889] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:18.175777 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.184041 25854 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:18.197014 25275 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:18.207564 25272 raft_consensus.cc:2410] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:18.150640 29830 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.200461 25196 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:18.201654 25267 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:18.184389 29624 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:18.104802 29712 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:18.205348 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:18.228015 25858 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:18.208524 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.205628 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:18.229425 25125 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:18.209627 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:18.147651 29623 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:18.209929 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 131063us
I20260709 12:21:18.231719 25090 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:18.211953 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:18.216102 25855 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:18.221405 29929 raft_consensus.cc:1081] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:18.234768 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:18.234920 29929 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:18.221568 29973 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:18.235809 29929 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.236634 29973 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:18.239114 29929 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.240358 29929 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:18.240984 29929 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.241541 29929 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:18.185860 29922 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:21:18.186161 29727 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 12:21:18.251410 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 85732.9us
I20260709 12:21:18.218441 29830 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:18.262975 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:18.268760 25860 raft_consensus.cc:2410] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:21:18.269232 29924 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.206357 29907 consensus_queue.cc:1059] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:21:18.189626 29802 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.198601 29926 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.270548 29965 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:18.343118 25125 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:18.251389 29803 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:18.248071 29624 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:18.344434 25273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:18.356211 25273 raft_consensus.cc:606] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:18.356612 25273 raft_consensus.cc:614] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:18.345021 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:18.255769 29916 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.209338 29961 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.347455 25168 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:18.202199 29779 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:18.359830 25853 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:18.252950 29768 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:21:18.365861 25090 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:18.380652 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:18.280431 29284 consensus_queue.cc:1059] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:21:18.430905 25853 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:18.362759 29701 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:18.363009 29956 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.361s	user 0.002s	sys 0.000s
I20260709 12:21:18.367936 29973 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.376041 29907 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:18.363658 29958 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:21:18.425725 29954 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:21:18.431402 29901 consensus_meta.cc:287] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.000s
I20260709 12:21:18.426331 29803 raft_consensus.cc:697] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:18.283859 29924 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:18.525370 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 243388us
W20260709 12:21:18.524995 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 159224us
I20260709 12:21:18.375625 29856 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.152s
I20260709 12:21:18.375191 29693 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.146s
I20260709 12:21:18.528041 25090 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:18.510602 29842 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.513991 29727 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.513458 29962 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.523936 29958 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.527205 29940 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:18.375094 29624 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.554589 25193 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:18.365386 29916 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.529274 29907 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:18.532953 29632 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.546260 29912 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:18.550683 29958 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:18.528743 29973 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:18.551607 29974 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:18.535647 29964 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.196s
I20260709 12:21:18.529942 29976 consensus_queue.cc:1059] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.203s
W20260709 12:21:18.563387 29889 consensus_meta.cc:287] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.000s
W20260709 12:21:18.573736 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 45774.3us
I20260709 12:21:18.562640 29229 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:18.562294 29768 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:18.570501 29967 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 12:21:18.547610 29842 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.539440 29727 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:18.612488 29978 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:21:18.611142 29974 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:18.575915 29929 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:18.661150 29971 log.cc:927] Time spent T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 12:21:18.687849 29961 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.688488 29599 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.702284 29962 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:18.702744 29962 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:21:18.715801 29729 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.000s
I20260709 12:21:18.703751 29962 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:18.720091 29968 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 12:21:18.655750 29803 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:18.675213 29377 consensus_meta.cc:287] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.001s
I20260709 12:21:18.653985 29889 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.726449 29926 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.737900 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.737785 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.754247 25269 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:18.754580 25273 raft_consensus.cc:2410] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:21:18.748917 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2517) took 1086 ms. Trace:
I20260709 12:21:18.730888 25274 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:21:18.690012 29599 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:18.750072 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.756130 25271 raft_consensus.cc:2376] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12. Re-sending same reply.
I20260709 12:21:18.762293 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.763018 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.763453 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.764019 25275 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:18.764806 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.765740 25275 raft_consensus.cc:2410] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:21:18.755604 25274 pending_rounds.cc:85] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 9
I20260709 12:21:18.767187 25274 pending_rounds.cc:107] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:21:18.768113 25274 raft_consensus.cc:2889] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:18.755541 25198 rpcz_store.cc:276] 0709 12:21:17.662509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.664447 (+  1938us) service_pool.cc:224] Handling call
0709 12:21:17.664801 (+   354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:17.665262 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:17.665292 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:17.665929 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 12:21:17.755657 (+ 89728us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:17.773061 (+ 17404us) log.cc:844] Serialized 14 byte log entry
0709 12:21:17.777962 (+  4901us) log.cc:844] Serialized 14 byte log entry
0709 12:21:17.778138 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.778206 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:18.014629 (+236423us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b180037d4a0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2107de258f 00007f2100e21571 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd
0709 12:21:18.748706 (+734077us) raft_consensus.cc:1685] finished
0709 12:21:18.748730 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:18.748860 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36693,"prepare.queue_time_us":17315,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":8821,"raft.queue_time_us":139903,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":29182,"spinlock_wait_cycles":20687232,"thread_start_us":89151,"threads_started":1,"wal-append.queue_time_us":170013}
I20260709 12:21:18.786882 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:18.789290 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.790343 25167 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:18.792413 25269 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 14: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:18.792651 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.765112 29962 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:18.819272 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 90062.4us
I20260709 12:21:18.740221 29729 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:18.821519 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:18.822728 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:18.824061 25275 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:18.825186 25275 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:21:18.825721 29830 consensus_meta.cc:287] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.000s
I20260709 12:21:18.827996 29977 consensus_queue.cc:1059] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:18.829128 29958 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.830322 29957 raft_consensus.cc:3055] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:18.830734 29957 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:18.831514 29957 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.773378 29924 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.796730 29566 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:18.838085 25269 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:18.836202 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:18.842406 25273 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:18.832692 29957 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:18.846330 29944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.008s	sys 0.022s
I20260709 12:21:18.849900 25126 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:18.829018 29977 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
W20260709 12:21:18.835577 29934 consensus_meta.cc:287] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.719s	user 0.004s	sys 0.010s
I20260709 12:21:18.840562 25275 raft_consensus.cc:1240] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 12:21:18.861959 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:18.862865 25275 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:18.728855 29907 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:18.854496 29944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.008s	sys 0.023s
W20260709 12:21:18.871124 29925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.019s	sys 0.034s
I20260709 12:21:18.880662 25825 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:18.890142 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:18.837231 29830 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:18.897735 29925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.024s	sys 0.036s
I20260709 12:21:18.820680 29965 consensus_queue.cc:1059] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
W20260709 12:21:18.926497 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 45930.6us
I20260709 12:21:18.931715 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:18.933326 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:18.935621 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:18.890843 29842 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:18.943344 25119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2673) took 1295 ms (client timeout 1538 ms). Trace:
W20260709 12:21:18.943871 25119 rpcz_store.cc:269] 0709 12:21:17.647502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.649887 (+  2385us) service_pool.cc:224] Handling call
0709 12:21:18.943122 (+1293235us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400452c54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:18.943269 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871084928}
I20260709 12:21:18.945946 25271 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:18.925969 29624 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:21:18.931154 29817 consensus_meta.cc:287] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.001s
I20260709 12:21:18.927520 29929 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:18.894109 29973 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:18.948674 29983 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:21:18.949018 29729 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:18.938359 29901 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:18.972700 28997 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.947151 25275 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:18.973930 28997 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:18.957538 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 130401us
I20260709 12:21:18.905676 29974 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:18.881100 29934 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.972059 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:18.939101 29701 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:21:18.993115 29377 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.993671 29377 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:18.994346 29934 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.995244 29958 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.995677 29377 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:19.002912 28997 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:18.971668 29817 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:18.972081 29895 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:19.008719 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 75488.4us
I20260709 12:21:19.009861 25268 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:21:19.010565 25268 pending_rounds.cc:85] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 11
I20260709 12:21:19.010807 25268 pending_rounds.cc:107] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:21:19.011047 25268 raft_consensus.cc:2889] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:18.974670 29916 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:19.018121 29889 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:19.016041 29990 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:21:19.017280 29985 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:21:19.031186 29969 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.609s	user 0.000s	sys 0.001s
I20260709 12:21:19.032915 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:19.012544 29817 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:19.034794 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2270) took 1381 ms. Trace:
I20260709 12:21:19.035218 25122 rpcz_store.cc:276] 0709 12:21:17.653006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.049284 (+396278us) service_pool.cc:224] Handling call
0709 12:21:18.049589 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:18.057718 (+  8129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:18.057745 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:18.058416 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.206159 (+147743us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:18.206216 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.206293 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:19.030517 (+824224us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:19.034483 (+  3966us) raft_consensus.cc:1685] finished
0709 12:21:19.034506 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.034736 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7296,"raft.queue_time_us":10714,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":15589,"spinlock_wait_cycles":9142016,"thread_start_us":120376,"threads_started":1,"wal-append.queue_time_us":219426}
I20260709 12:21:19.036322 29817 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.020323 25825 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:19.018939 29777 consensus_meta.cc:287] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.001s
I20260709 12:21:19.044921 29777 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.046223 29950 raft_consensus.cc:3055] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:19.046625 29950 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:19.047356 29950 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.048274 29950 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:19.049592 25273 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
W20260709 12:21:19.050716 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:19.051165 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:19.051460 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.051929 29928 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:19.052404 29928 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:19.054282 29928 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:19.051509 29777 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:19.054740 29928 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.055202 29928 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.057106 29928 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:19.060022 25822 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:19.068044 25268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:19.069021 25268 raft_consensus.cc:606] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:19.069480 25268 raft_consensus.cc:614] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:19.063792 29623 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:21:19.043228 29701 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.074508 25822 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:19.064383 29901 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:19.082516 25822 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:19.092032 30001 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:19.080163 29623 consensus_queue.cc:1059] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:21:19.102936 29623 raft_consensus.cc:3055] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:19.103400 29623 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:19.104261 29623 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.105684 29623 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:19.107404 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.070520 29916 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:21:19.118060 25822 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:19.080163 29999 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:19.080430 29624 raft_consensus.cc:697] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:19.081018 29701 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.142208 25268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:19.146786 25268 raft_consensus.cc:606] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:19.147236 25268 raft_consensus.cc:614] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:19.138164 29599 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:19.158381 29999 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:19.162323 29999 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:21:19.163353 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.171228 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:21:19.159869 29599 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.175125 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 863) took 1599 ms. Trace:
I20260709 12:21:19.175520 25124 rpcz_store.cc:276] 0709 12:21:17.575488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.575749 (+   261us) service_pool.cc:224] Handling call
0709 12:21:17.576035 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.210512 (+634477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.174856 (+964344us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b540009db54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:19.175057 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414594944}
I20260709 12:21:19.176456 29599 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:19.182982 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:19.184353 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.186668 29599 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:19.187258 29599 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:19.189322 29599 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:19.198362 29701 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:19.211874 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:19.212509 25854 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:19.213260 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.214016 25851 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
W20260709 12:21:19.218714 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 100751us
I20260709 12:21:19.219682 25822 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:19.223660 25855 pending_rounds.cc:85] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 9
I20260709 12:21:19.223985 25855 pending_rounds.cc:107] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:21:19.224273 25855 raft_consensus.cc:2889] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:19.224550 30007 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:19.226429 25167 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:19.227146 29951 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 1.228s	user 0.007s	sys 0.004s
I20260709 12:21:19.228098 29953 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:19.228353 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2264) took 1707 ms. Trace:
I20260709 12:21:19.228510 29953 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.228961 29953 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:19.228772 25118 rpcz_store.cc:276] 0709 12:21:17.520887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.524534 (+  3647us) service_pool.cc:224] Handling call
0709 12:21:17.541845 (+ 17311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:17.542179 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:17.542220 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:17.548474 (+  6254us) log.cc:844] Serialized 26 byte log entry
0709 12:21:17.643922 (+ 95448us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:17.643956 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.644025 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:19.225830 (+1581805us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:19.228083 (+  2253us) raft_consensus.cc:1685] finished
0709 12:21:19.228104 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.228297 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7972608,"thread_start_us":81786,"threads_started":1,"wal-append.queue_time_us":262748}
I20260709 12:21:19.234460 25822 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:19.241055 29701 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:19.261571 29701 raft_consensus.cc:697] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:19.262589 29701 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.263412 29712 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:19.270695 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2688) took 1266 ms. Trace:
I20260709 12:21:19.239224 30007 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:21:19.271121 25126 rpcz_store.cc:276] 0709 12:21:18.003962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.114075 (+110113us) service_pool.cc:224] Handling call
0709 12:21:18.114365 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.854826 (+740461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.270443 (+415617us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54000c44d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:19.270635 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1691051392}
I20260709 12:21:19.230645 29624 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.298695 29817 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.299247 29817 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.301370 29817 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:19.304499 29817 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:19.304976 29817 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.307554 29817 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:19.309116 29599 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.309641 29599 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:19.311534 29599 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:19.322520 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2628) took 1162 ms. Trace:
I20260709 12:21:19.323053 25270 rpcz_store.cc:276] 0709 12:21:18.160460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.160630 (+   170us) service_pool.cc:224] Handling call
0709 12:21:18.171523 (+ 10893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.360734 (+189211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:18.360771 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:18.360812 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:18.360856 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.322244 (+961388us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400121e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:19.322302 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.322449 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434641664}
I20260709 12:21:19.329257 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2682) took 1588 ms. Trace:
I20260709 12:21:19.329816 25121 rpcz_store.cc:276] 0709 12:21:17.740717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.089182 (+348465us) service_pool.cc:224] Handling call
0709 12:21:18.089581 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.119740 (+ 30159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.328856 (+1209116us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b5400003054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:19.329174 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67446528}
I20260709 12:21:19.333272 29608 raft_consensus.cc:3055] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:19.333835 29608 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:19.334888 29608 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.336795 29608 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:19.340602 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.341682 29895 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.342365 29842 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.343063 29940 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.343117 29842 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:19.343752 29940 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:19.342293 29895 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:19.346249 29729 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:21:19.351576 29729 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.352137 29729 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.352442 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:19.352504 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:19.353242 25198 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:19.353735 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:19.354280 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:19.354532 25267 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:21:19.348196 29895 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:19.354842 29984 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:19.355386 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:19.353255 25197 raft_consensus.cc:2393] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:19.355981 25851 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:19.356025 29984 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:19.356659 29984 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:19.348654 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:19.357630 29984 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:19.359339 29984 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:19.360240 29802 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:19.349299 25090 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:19.345978 29842 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:19.361980 29803 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:19.362360 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:19.363097 25194 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:19.364382 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:19.364948 25195 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:19.365628 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.366243 25854 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:19.366564 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:19.358170 29999 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.361081 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:19.371086 25202 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:19.361903 25201 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:19.366247 25856 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:19.362493 29803 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.367532 25167 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:19.370143 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.381949 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.383654 25853 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:19.345919 29940 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:19.381989 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.398386 25202 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:21:19.402181 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.383510 29922 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:19.379331 29901 raft_consensus.cc:697] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:21:19.420873 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.383916 29803 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:19.441481 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.386678 25856 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b13f2e891f348229e95286682b88911"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:21:19.470775 25856 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:19.471246 25856 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:19.472687 25854 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:19.475757 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2523) took 1591 ms. Trace:
I20260709 12:21:19.476171 25196 rpcz_store.cc:276] 0709 12:21:17.884427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.884559 (+   132us) service_pool.cc:224] Handling call
0709 12:21:17.884852 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.214910 (+330058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.475469 (+1260559us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400440a54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:19.475651 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725388160}
I20260709 12:21:19.384228 30007 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:21:19.366163 29895 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 12:21:19.428150 25193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2549) took 1969 ms (client timeout 2176 ms). Trace:
I20260709 12:21:19.435288 25195 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
W20260709 12:21:19.443297 29962 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.004s
I20260709 12:21:19.421504 29811 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.409219 29729 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:19.383718 29999 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.419656 29901 consensus_queue.cc:237] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:19.485147 25193 rpcz_store.cc:269] 0709 12:21:17.458967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.460477 (+  1510us) service_pool.cc:224] Handling call
0709 12:21:19.427982 (+1967505us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400440554. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:19.428093 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392480512}
I20260709 12:21:19.525792 25092 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:19.529066 25200 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:21:19.533389 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:19.534221 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:19.534988 25199 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 14: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:19.536526 25092 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:19.537824 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:19.538107 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:19.538987 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:19.539347 25275 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:21:19.539594 25198 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:19.540974 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:19.500373 25276 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:19.425877 25194 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:19.503508 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 1143) took 1712 ms. Trace:
I20260709 12:21:19.505734 25269 raft_consensus.cc:2410] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:21:19.469013 29922 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:19.508970 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:19.550136 25200 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:19.549012 25860 rpcz_store.cc:276] 0709 12:21:17.775536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.775661 (+   125us) service_pool.cc:224] Handling call
0709 12:21:19.487305 (+1711644us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b5400376754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:19.487441 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110996224}
I20260709 12:21:19.558952 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:19.523619 30007 consensus_queue.cc:1243] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:21:19.568964 25273 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:19.559823 25193 raft_consensus.cc:2410] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:21:19.560418 25268 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 12 index: 14. (index mismatch)
I20260709 12:21:19.560591 25196 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: [9.7-13.9]
I20260709 12:21:19.562165 25856 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.564028 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:19.574954 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.584018 25859 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:19.585183 25270 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:19.590381 29758 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.591104 25241 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:19.590961 29758 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.591958 25241 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:19.593722 29758 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:19.567837 29909 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.519707 29811 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.574016 29957 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.602952 30007 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:21:19.603022 29802 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:19.604012 30017 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:19.632375 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.600930 29984 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:19.609874 29999 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:19.604139 29964 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:19.601688 30018 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.611925 30006 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:19.555760 29916 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:21:19.609800 29727 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:19.634483 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.635284 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.606915 29895 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:21:19.638888 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 110965us
I20260709 12:21:19.619742 29940 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.619932 29712 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:19.704994 25851 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 8.
I20260709 12:21:19.601151 29701 consensus_queue.cc:1059] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:21:19.629093 29802 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:19.731766 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:19.750662 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.605722 29624 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:21:19.666586 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:19.649420 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:19.622948 30008 consensus_queue.cc:1059] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:21:19.762850 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:19.707247 25093 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:19.765987 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 58806.5us
I20260709 12:21:19.620102 29909 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.767478 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:19.767911 25852 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:19.760952 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:19.767189 25093 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:19.641616 29964 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.647617 29923 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.705973 29997 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:19.641925 30006 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:19.788261 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:19.806993 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:19.770750 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:19.770694 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 234224us
I20260709 12:21:19.640955 29984 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.807380 25274 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:19.813946 25267 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:21:19.761247 29802 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:19.825816 25856 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:19.771416 29964 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:19.758733 29962 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.827346 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:19.829655 25272 raft_consensus.cc:3055] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:19.827845 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.829959 25272 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:19.630054 29957 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:19.811728 30013 log.cc:927] Time spent T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 12:21:19.834203 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 469726us
I20260709 12:21:19.835099 25269 raft_consensus.cc:1275] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:19.641738 29922 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.646432 30018 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:19.819770 29953 consensus_meta.cc:287] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.000s
I20260709 12:21:19.805413 29727 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.805594 29830 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:19.832078 25272 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.851656 25272 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:19.825644 30012 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:21:19.758662 29940 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:19.845542 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 224440us
I20260709 12:21:19.811080 29788 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:19.818939 29912 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:19.703238 30017 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.857391 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.806730 29923 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.846416 30008 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:19.895361 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.896236 25856 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:19.813778 29997 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:19.847954 29934 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:19.893328 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 122660us
I20260709 12:21:19.864684 25852 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:19.834417 29962 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:19.903741 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:19.904572 25126 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:19.893879 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 85596.3us
W20260709 12:21:19.897871 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.833981 29895 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:21:19.859380 29284 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.907473 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:19.854306 29727 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:19.850247 29953 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.917376 25124 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:19.923300 25271 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:19.901938 29996 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.932403 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:19.933578 25121 raft_consensus.cc:2410] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:21:19.938643 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:19.862881 29788 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.946076 25241 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:19.907099 29912 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:19.952690 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.963477 29811 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:19.942353 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:19.967047 25856 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:19.970589 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:19.971357 25195 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:19.977187 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:19.925948 29830 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.901234 30008 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:19.980873 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:19.994249 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 327775us
I20260709 12:21:19.961653 30022 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:19.921932 29284 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.990238 25124 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:21:19.974182 29811 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:19.860354 30006 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.978017 25121 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:19.966446 30016 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 12:21:19.992993 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 142793us
I20260709 12:21:19.924903 29712 consensus_queue.cc:1059] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:21:19.992086 29758 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:21:19.983255 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 96343.1us
I20260709 12:21:20.000456 25126 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
W20260709 12:21:19.992045 30015 log.cc:927] Time spent T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 12:21:20.007340 25271 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:19.997519 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:20.010187 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 98799.2us
I20260709 12:21:19.975222 29912 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:20.025556 25195 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
W20260709 12:21:20.031109 30025 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:19.964318 29996 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:19.994699 29830 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.015837 29909 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.011754 29758 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:19.995862 30031 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:21:20.035547 30006 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:20.033216 30019 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:20.063573 25092 leader_election.cc:400] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9.
I20260709 12:21:20.076103 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:20.039019 29934 raft_consensus.cc:697] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:20.064790 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.033429 30022 raft_consensus.cc:697] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:20.085741 25121 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
W20260709 12:21:20.090072 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 170201us
W20260709 12:21:20.090303 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 107720us
W20260709 12:21:20.089818 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 128224us
I20260709 12:21:20.098662 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:20.098954 29788 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.099236 29909 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:20.067390 29758 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:20.044128 30021 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:21:20.111155 25272 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:20.072729 29729 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:20.117357 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:20.126670 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:20.127323 25858 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 8.
I20260709 12:21:20.128094 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:20.096082 29984 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.101065 29940 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:20.118670 29803 consensus_meta.cc:287] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.003s
I20260709 12:21:20.160902 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:20.167744 29803 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.121685 29997 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:20.135731 30020 raft_consensus.cc:3055] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:20.088733 30019 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.122932 30017 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.155751 29962 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:20.194509 25825 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.770s (SENT)
I20260709 12:21:20.155507 29957 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.208388 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:21:20.209784 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:20.214802 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 138815us
I20260709 12:21:20.177395 29934 consensus_queue.cc:237] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:20.219318 25825 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.770s (SENT)
I20260709 12:21:20.170722 29953 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.125240 30034 consensus_queue.cc:1059] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:21:20.134488 29729 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:20.228451 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 233268us
I20260709 12:21:20.169739 29623 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:20.220785 25092 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:20.231674 25165 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:20.198720 30020 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:20.237052 25165 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:21:20.261060 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.219183 30031 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:20.217981 29727 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:20.236797 25090 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:20.268560 30008 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:20.226599 29624 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:20.160267 30036 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 12:21:20.231194 29811 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:20.264400 29984 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:20.264206 30053 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:20.277259 29284 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.272624 29962 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:20.237638 29623 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.324316 29912 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:20.401243 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 164525us
I20260709 12:21:20.402137 25090 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:20.339373 29953 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.413244 29632 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:20.213971 30022 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.414058 29803 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:20.420578 30040 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:21:20.360210 29962 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:20.422403 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:20.423130 25274 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:20.424677 29962 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:20.425516 29811 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:20.427781 29623 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:20.369412 29608 consensus_meta.cc:287] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 1.032s	user 0.015s	sys 0.002s
I20260709 12:21:20.317529 30031 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.346563 29984 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:20.360539 30020 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:20.551453 29999 raft_consensus.cc:3055] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:21:20.579864 30033 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.473s	user 0.000s	sys 0.002s
W20260709 12:21:20.455466 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 53427.2us
I20260709 12:21:20.593374 25090 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:20.491137 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 270390us
I20260709 12:21:20.411619 30058 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:20.411700 30043 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:20.410965 29996 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:20.640861 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 45432us
W20260709 12:21:20.640028 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.641918 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:20.570183 29964 consensus_meta.cc:287] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.001s
W20260709 12:21:20.550437 30014 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.821s	user 0.006s	sys 0.000s
W20260709 12:21:20.559064 29802 consensus_meta.cc:287] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.001s
I20260709 12:21:20.646436 25092 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:20.640578 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 47321.1us
I20260709 12:21:20.435611 29830 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.643534 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:20.657622 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:20.657981 25858 raft_consensus.cc:2410] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:21:20.646245 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:20.658833 25852 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:20.656715 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:20.660743 25274 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:20.498368 29729 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:20.491118 30041 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:20.490545 30037 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:20.572091 29758 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.557735 29889 raft_consensus.cc:3055] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:20.591677 29999 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:20.674160 29889 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:20.674914 29999 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.675408 29889 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.676184 30047 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:20.676967 29889 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:20.486784 30019 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.667850 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:20.651140 29964 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.678380 25852 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:20.680377 29964 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.681128 30020 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:20.665017 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:20.565199 30018 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:20.645097 30053 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:20.673640 25268 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:21:20.696487 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:20.684172 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.450121 29912 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.216s
I20260709 12:21:20.429466 29953 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.682591 25269 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:21:20.650203 30067 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.649308 30058 raft_consensus.cc:697] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:21:20.702463 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.702788 25092 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:20.476522 29788 consensus_queue.cc:1048] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.194s
I20260709 12:21:20.676209 30057 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.710000 25092 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:20.714397 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:20.717283 30059 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:20.717856 30059 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.718283 30059 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:20.720175 25092 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:20.721266 25858 raft_consensus.cc:2410] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:21:20.699635 30053 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.743294 30053 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:20.743332 29758 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.710387 30067 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:20.710153 29999 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:20.702253 30037 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:20.735006 29953 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.739212 29984 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:20.742740 30031 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:20.751019 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.666103 29802 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.820055 25272 raft_consensus.cc:2393] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 14: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:20.820963 29802 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:20.821040 30059 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.730971 30018 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 12:21:20.822057 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:20.731688 25852 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:20.756335 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:20.823547 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.824636 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.757066 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:20.758150 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:20.825205 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.825949 25123 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:20.826336 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:20.826902 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.827378 25124 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:20.827685 25123 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:20.828575 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.731027 30057 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.831337 30059 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:20.768117 25825 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.689s (SENT) [suppressed 26 similar messages]
I20260709 12:21:20.832680 25167 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:20.832963 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 64900.9us
I20260709 12:21:20.833719 29953 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:20.834328 29953 raft_consensus.cc:697] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:20.814739 30058 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.835274 29953 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.748307 30041 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:20.838315 30041 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.838712 30006 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.839309 30006 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:20.841665 30006 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:20.847931 30067 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:20.758601 30042 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:20.850430 25126 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:20.852072 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.815382 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:20.838757 30041 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:20.831367 30057 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:20.857021 25270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.014s	sys 0.014s
I20260709 12:21:20.857359 25125 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 12:21:20.857697 25270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.015s	sys 0.014s
I20260709 12:21:20.854183 25120 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:20.814395 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.852959 25122 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:20.828527 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:20.856091 25123 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
W20260709 12:21:20.862816 25168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.001s	sys 0.028s
W20260709 12:21:20.863168 25168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.001s	sys 0.028s
I20260709 12:21:20.859202 25119 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
W20260709 12:21:20.863495 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 751338us
I20260709 12:21:20.862560 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.864251 25168 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:21:20.866081 25093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.015s	sys 0.018s
W20260709 12:21:20.866467 25093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.015s	sys 0.018s
W20260709 12:21:20.880303 25165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.013s	sys 0.018s
I20260709 12:21:20.881273 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:20.882368 25165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.014s	sys 0.018s
W20260709 12:21:20.885704 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 622248us
I20260709 12:21:20.887710 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.883055 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:20.884632 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.889415 25197 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:20.884402 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:20.887769 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.889889 25124 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:20.893935 25119 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:20.883023 25122 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:20.895694 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:20.896281 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.898043 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:20.898672 25275 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:20.901116 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:20.901284 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.880791 29984 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:20.905079 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.906170 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:20.881395 30038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.013s	sys 0.017s
I20260709 12:21:20.884702 30067 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:20.918530 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.920554 25118 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 12 index: 14. (index mismatch)
I20260709 12:21:20.902580 29909 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.922039 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:20.924150 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.924988 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.902319 29912 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.928997 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:20.930708 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:20.931041 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:20.931656 25200 raft_consensus.cc:2376] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14. Re-sending same reply.
I20260709 12:21:20.924376 25197 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:20.925643 25124 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:20.942085 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:20.913889 30038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.013s	sys 0.018s
I20260709 12:21:20.952272 25168 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:20.913587 30030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.018s	sys 0.039s
W20260709 12:21:20.955490 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.958467 25195 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:21:20.959008 25201 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:20.957798 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:20.962635 25125 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
W20260709 12:21:20.926203 29934 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.016s	sys 0.011s
I20260709 12:21:20.913594 30019 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:20.902490 30057 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:21:20.914609 29984 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.021360 25120 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:20.977123 25197 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:20.996450 25194 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:20.978104 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:21.044876 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:20.965052 25275 raft_consensus.cc:2410] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:21:21.012116 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.024422 25852 raft_consensus.cc:3055] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:20.976015 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.019616 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.009812 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:21.047178 25200 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:21.047130 25195 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:20.965610 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:20.993963 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:20.987155 25118 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:21.046468 25125 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:21.048826 25193 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:21.046478 25852 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:21.050326 25199 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 8: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:21:21.007728 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 65771us
I20260709 12:21:20.932193 29977 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.920688 30037 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:20.958640 30030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.019s	sys 0.040s
I20260709 12:21:21.066987 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:20.999365 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:21.044178 29934 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.018s	sys 0.013s
I20260709 12:21:21.078691 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.079342 25125 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:21.080153 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.080824 25125 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:20.951498 30059 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.085397 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.086220 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.086606 25125 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:21.102188 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:21.102847 25118 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:21.102949 25195 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:21.051864 25093 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:21.103905 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 52168.8us
I20260709 12:21:21.016628 30031 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:21.087960 25197 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:20.985841 30062 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:21.053081 30067 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:21.085569 25852 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.107373 25120 raft_consensus.cc:2410] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:21:21.069082 29901 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.107471 25124 raft_consensus.cc:2410] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:21:20.951462 29909 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:21.114903 30076 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:21:21.115929 29909 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:21.076241 30037 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.122290 29901 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.124274 30037 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:21.124545 25825 leader_election.cc:336] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.042s (SENT)
I20260709 12:21:21.126485 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.127156 25124 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:21.127970 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.128222 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2652) took 1018 ms. Trace:
I20260709 12:21:21.129035 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.129639 25124 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:21.108669 25200 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:20.977589 29925 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.141s
I20260709 12:21:21.140341 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:21.109071 29803 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:20.958331 29912 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.136606 25852 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:21.068531 30019 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:21.128655 25269 rpcz_store.cc:276] 0709 12:21:20.110334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.264746 (+154412us) service_pool.cc:224] Handling call
0709 12:21:20.318802 (+ 54056us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:20.700293 (+381491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.127959 (+427666us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b5400027954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:21.128163 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835923712}
I20260709 12:21:21.138156 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.150552 25201 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:21.137174 25198 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:21.139557 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:21.116083 30070 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:21:21.144263 25118 raft_consensus.cc:2410] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:21:21.147048 25859 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 15: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:21.112335 30031 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.151682 25200 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:21.153986 25852 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:21:21.155300 25860 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:21.157810 25093 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:21.158682 25852 pending_rounds.cc:85] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 7
I20260709 12:21:21.159546 25852 pending_rounds.cc:107] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:21:21.075851 29977 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.159936 25852 raft_consensus.cc:2889] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:21.138705 29950 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.179493 25194 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:21.132951 30062 raft_consensus.cc:697] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:21.146750 29803 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.209281 25201 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:21.195405 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:21.186585 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.108137 30059 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:21.203524 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.125908 30053 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:21.322557 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 127258us
W20260709 12:21:21.259639 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.324546 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:21.251243 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:21.325627 25201 raft_consensus.cc:2376] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11. Re-sending same reply.
I20260709 12:21:21.238669 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.326975 25200 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 8: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:21.254451 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:21.214797 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:21.275395 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.271462 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:21.311462 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.214059 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:21.261130 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.270394 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.212415 25852 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:21.213454 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:21.214416 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:21.332574 25860 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:21.174954 25093 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:21.334106 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 159241us
I20260709 12:21:21.336266 25825 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:21.337610 25194 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:21.339699 30047 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:21.269071 29802 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.340164 30047 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.340610 30047 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:21.341333 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.342180 30006 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:21.345389 25122 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:21.345592 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.159111 30031 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:21.344308 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.349988 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.350649 25120 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:21.342736 30053 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:21.203917 29729 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:21.342777 29999 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:21.368870 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:21.360526 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.354812 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:21.370721 29912 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:21.276074 29889 consensus_meta.cc:287] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.004s
I20260709 12:21:21.374783 29977 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:21.375126 29889 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:21.252207 30077 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:21:21.210384 29803 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:21.349172 30006 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.367774 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:21.376565 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:21.370787 30084 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:21:21.367616 30037 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:21:21.326977 29984 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:21.388622 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.207449 29608 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.378707 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:21.379943 25852 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:21:21.380564 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.391635 25201 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:21.381474 25120 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:21.393225 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.393982 25120 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:21.395272 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.376976 25197 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:21.383910 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:21.344780 30001 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:21.204182 29909 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.165s
I20260709 12:21:21.382513 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.425390 25267 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:21.207863 29950 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.215282 29842 consensus_queue.cc:1059] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.172s
W20260709 12:21:21.384853 30020 consensus_meta.cc:287] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.703s	user 0.011s	sys 0.000s
I20260709 12:21:21.430730 30059 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:21.432250 30045 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.160s	user 0.008s	sys 0.016s
I20260709 12:21:21.425040 30001 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.207356 29997 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.178s
I20260709 12:21:21.340670 29802 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.433785 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:21.374830 30019 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:21.376462 30006 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:21.424156 30041 consensus_meta.cc:287] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 12:21:21.352141 30062 consensus_queue.cc:237] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:21.442744 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 106530us
I20260709 12:21:21.427712 29608 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:21.455114 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.508469 25201 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:21.464429 30001 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:21.462740 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:21.467666 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:21.427840 29984 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:21.512321 25274 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:21.428308 29999 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:21.469219 25267 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:21.377357 29889 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.443991 30096 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.438737 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:21.446163 25120 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:21.506913 25822 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:21.510263 25122 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:21.510499 25275 raft_consensus.cc:1813] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Handling vote request from an unknown peer b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:21.513854 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:21.519640 25275 raft_consensus.cc:2410] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:21:21.489547 30097 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:21.505595 30090 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:21:21.514566 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:21.464839 30045 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.009s	sys 0.018s
I20260709 12:21:21.523494 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:21.524328 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:21.525141 25193 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:21.525554 25198 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:21.518823 25197 raft_consensus.cc:2376] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13. Re-sending same reply.
I20260709 12:21:21.541962 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.542887 25201 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:21.561553 25267 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:21.569597 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:21.570534 25274 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:21.574630 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:21.574780 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:21.575830 25267 raft_consensus.cc:2410] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:21:21.561821 25193 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:21.523299 29999 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.584308 29608 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:21.584723 29999 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:21.585356 29999 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:21:21.587566 30075 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.477s	user 0.002s	sys 0.000s
I20260709 12:21:21.590376 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:21.591406 25274 raft_consensus.cc:2410] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:21:21.592677 30008 consensus_queue.cc:1059] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:21.593626 30008 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.592329 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:21.596933 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2147) took 1829 ms. Trace:
I20260709 12:21:21.597359 25271 rpcz_store.cc:276] 0709 12:21:19.767132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.767266 (+   134us) service_pool.cc:224] Handling call
0709 12:21:21.596772 (+1829506us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540034e9d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:21.596872 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356856704}
I20260709 12:21:21.598460 30104 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:21.598708 30101 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:21.599287 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:21.600389 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:21.600989 25271 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:21.601601 25199 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:21.604105 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2650) took 1523 ms. Trace:
I20260709 12:21:21.604387 30047 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:21.604595 25270 rpcz_store.cc:276] 0709 12:21:20.080738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.169386 (+ 88648us) service_pool.cc:224] Handling call
0709 12:21:20.169793 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:20.212772 (+ 42979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:20.212819 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:20.225866 (+ 13047us) log.cc:844] Serialized 26 byte log entry
0709 12:21:20.858274 (+632408us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:20.858368 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.858503 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:21.586919 (+728416us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:21.603746 (+ 16827us) raft_consensus.cc:1685] finished
0709 12:21:21.603774 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.604036 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47233,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"spinlock_wait_cycles":4287232,"thread_start_us":627952,"threads_started":2,"wal-append.queue_time_us":783137}
I20260709 12:21:21.518776 29984 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:21.607059 30082 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.301s	user 0.000s	sys 0.000s
I20260709 12:21:21.529415 30096 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.608507 29984 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:21.609019 30081 log.cc:927] Time spent T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.303s	user 0.000s	sys 0.000s
I20260709 12:21:21.613705 25118 raft_consensus.cc:2393] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 12: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:21.629380 25271 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:21.632156 30103 raft_consensus.cc:3055] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:21.609709 30096 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:21.633375 25122 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:21.635819 25268 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:21.611750 29802 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:21.637581 29923 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:21.599225 30101 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:21.595059 29999 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 12:21:21.642254 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 245704us
W20260709 12:21:21.637830 30087 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:21:21.644400 25168 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:21.668839 25168 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:21.664964 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:21.544989 30097 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.645730 30103 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:21.659569 25119 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:21.506809 30041 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.665141 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:21.678375 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 171554us
I20260709 12:21:21.678797 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.679570 25122 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:21.679795 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:21.680411 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.681079 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.681491 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.683049 25124 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:21:21.683465 25124 pending_rounds.cc:85] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 11
I20260709 12:21:21.683696 25124 pending_rounds.cc:107] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:21:21.683943 25124 raft_consensus.cc:2889] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:21.687052 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.655768 25090 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:21.674058 25168 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:21.674932 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.637883 29950 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:21.594120 30008 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.695549 25242 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:21.703212 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:21.705927 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:21.708235 25121 raft_consensus.cc:2368] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 14. Current term is 15.
I20260709 12:21:21.708508 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:21.710095 25122 raft_consensus.cc:2376] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12. Re-sending same reply.
I20260709 12:21:21.711179 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:21.662226 30001 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.712145 30091 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:21.712462 30093 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:21:21.712797 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:21.728847 30088 log.cc:927] Time spent T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 12:21:21.729766 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:21.730906 30100 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:21.731360 30100 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:21.731763 30100 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:21.699307 29984 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:21.739774 29984 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:21.740361 29984 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:21.740921 29984 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:21.693560 29923 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:21.741987 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.742337 29923 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.742864 29923 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:21.743220 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.744330 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.745033 25125 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:21.599166 30104 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:21.686961 30063 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:21.745987 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.762127 25125 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:21.751379 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.752681 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:21.760263 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.763120 25268 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:21.702899 29977 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:21.764132 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 242486us
W20260709 12:21:21.715504 30092 log.cc:927] Time spent T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:21:21.712553 30072 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:21.774055 25125 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:21.719969 30041 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:21.780773 25122 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:21.754096 30059 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.716687 30001 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:21.715184 29802 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:21.714875 30099 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:21.779307 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:21.767660 29977 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.784117 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:21.699529 29632 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:21:21.790758 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:21.803685 25851 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:21.803969 25268 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:21:21.784030 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:21.761451 30063 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.773386 30047 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:21.807924 25127 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:21.833470 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.833633 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:21.868881 25202 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:21.843001 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:21.846570 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.797079 29802 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.789628 30072 raft_consensus.cc:697] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:21.849896 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:21.850075 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.797134 30099 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:21.803158 29977 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:21.832242 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:21.854070 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.888911 25195 raft_consensus.cc:2393] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 14: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:21.814448 30063 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:21.902877 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.903833 25202 raft_consensus.cc:2393] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 13: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:21.890928 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.895123 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.828346 29925 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.907980 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.800773 30059 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:21.932636 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 146949us
I20260709 12:21:21.932874 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:21.748464 30101 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:21.930378 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.930615 25168 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:21.930886 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 201170us
I20260709 12:21:21.872948 29802 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:21.932134 25123 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:21.934572 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.934903 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:21.933009 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.935194 25199 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:21.884280 30099 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:21.937829 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:21.940209 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.938064 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.941246 25856 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:21.941733 25195 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:21.920800 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.943647 25202 raft_consensus.cc:2410] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:21:21.938557 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.929752 25194 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:21.946107 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:21.946795 25852 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:21.946795 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.949131 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.958415 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.958861 25199 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:21:21.783804 30103 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.005623 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 910) took 1028 ms. Trace:
I20260709 12:21:21.974295 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:22.068819 25198 rpcz_store.cc:276] 0709 12:21:20.977554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.977791 (+   237us) service_pool.cc:224] Handling call
0709 12:21:22.005404 (+1027613us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b54000a7654. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:22.005546 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200153856}
I20260709 12:21:21.937306 29997 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:22.010310 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:22.069928 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 102502us
I20260709 12:21:22.002482 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:22.077988 25197 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:22.008723 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:22.079991 25193 raft_consensus.cc:2368] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12.
W20260709 12:21:21.950639 30031 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.011s
I20260709 12:21:22.004747 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:22.073982 29997 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:22.000995 25825 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:22.084383 25269 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:21:22.085749 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:22.099311 25271 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
W20260709 12:21:22.102156 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 101233us
I20260709 12:21:22.108947 25825 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:21.984229 30020 raft_consensus.cc:3055] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:21.968770 30001 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.106221 30031 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:21.953873 30073 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:22.110163 30111 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:21:22.110513 29940 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:22.111644 25121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 876) took 1355 ms (client timeout 1770 ms). Trace:
I20260709 12:21:22.113790 30017 raft_consensus.cc:3055] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:22.119942 30059 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:22.148270 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:22.148393 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:22.149200 25857 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:21.997282 30008 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:22.122926 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:22.126899 30097 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:22.127987 29912 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.147907 30017 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:22.158100 29912 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:22.159476 30109 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:21:22.159202 30017 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.160454 30017 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:22.129042 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:22.162487 25855 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:22.129271 25198 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:22.162947 29901 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:22.163640 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:22.163935 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:22.164287 25195 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:22.164625 25198 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:22.130904 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:22.166491 25202 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:22.005534 30006 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.087625 25852 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
W20260709 12:21:22.079713 30105 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.146s	user 0.004s	sys 0.002s
I20260709 12:21:22.103546 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:21.939172 29925 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.138247 25854 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:22.139993 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:22.142019 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:22.258652 25851 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:22.145555 25121 rpcz_store.cc:269] 0709 12:21:20.756229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.756824 (+   595us) service_pool.cc:224] Handling call
0709 12:21:22.111424 (+1354600us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b540009d654. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:22.111573 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2029724544}
I20260709 12:21:22.141987 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:22.121769 25126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 886) took 1336 ms (client timeout 1715 ms). Trace:
I20260709 12:21:22.148411 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:22.259657 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 117765us
W20260709 12:21:22.259557 25126 rpcz_store.cc:269] 0709 12:21:20.785925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.824378 (+ 38453us) service_pool.cc:224] Handling call
0709 12:21:22.121571 (+1297193us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b540009cc54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:22.121696 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57694976}
I20260709 12:21:22.261586 25165 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:22.102829 29997 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:22.152479 25268 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
W20260709 12:21:22.000620 29803 consensus_meta.cc:287] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.000s
I20260709 12:21:22.149911 30001 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.174491 25122 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:22.161512 29923 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:22.203439 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.289124 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:22.226521 30110 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:22.228762 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2692) took 1344 ms. Trace:
I20260709 12:21:22.302229 25124 rpcz_store.cc:276] 0709 12:21:20.884711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.140070 (+255359us) service_pool.cc:224] Handling call
0709 12:21:21.682668 (+542598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.684405 (+  1737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.228428 (+544023us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b540022abd0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:22.228681 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1247043328}
I20260709 12:21:22.229596 30043 raft_consensus.cc:3055] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:22.231885 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:22.246126 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:22.311957 25855 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:22.247036 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:22.133875 30020 raft_consensus.cc:740] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:22.255167 25199 raft_consensus.cc:2393] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 12: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:22.122756 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2654) took 1998 ms. Trace:
I20260709 12:21:22.314342 25272 rpcz_store.cc:276] 0709 12:21:20.124778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.160591 (+ 35813us) service_pool.cc:224] Handling call
0709 12:21:22.122550 (+1961959us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b5400121454. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:22.122677 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507507072}
I20260709 12:21:22.257750 25860 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:22.263304 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
W20260709 12:21:22.315953 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 52732.1us
I20260709 12:21:22.316946 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:22.268530 25267 raft_consensus.cc:1240] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:21:22.319404 25267 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:22.005884 30106 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.160s
I20260709 12:21:22.270988 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:22.137141 30103 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:22.326009 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:22.152529 29940 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:22.327004 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:22.328868 29940 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:22.307175 29984 consensus_meta.cc:287] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.004s
I20260709 12:21:22.329867 29984 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:22.332077 29984 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:22.332831 25200 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:22.269992 30073 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:22.002660 30107 consensus_queue.cc:1059] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.251s
I20260709 12:21:22.225602 29889 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:22.299304 25202 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:22.274459 25195 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:22.301275 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:22.154218 30097 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:22.305889 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.173903 30008 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:22.310253 25196 raft_consensus.cc:2376] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9. Re-sending same reply.
I20260709 12:21:22.264776 29922 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:22.370798 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:22.341940 29957 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:22.343988 25165 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:22.345506 30031 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:22.346508 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2711) took 1199 ms. Trace:
I20260709 12:21:22.414593 25122 rpcz_store.cc:276] 0709 12:21:21.147460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.785142 (+637682us) service_pool.cc:224] Handling call
0709 12:21:21.785380 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.300181 (+514801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.346277 (+ 46096us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400452c54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:22.346447 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894246784}
I20260709 12:21:22.347301 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 889) took 1559 ms. Trace:
I20260709 12:21:22.416116 25119 rpcz_store.cc:276] 0709 12:21:20.787611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.899740 (+112129us) service_pool.cc:224] Handling call
0709 12:21:21.591983 (+692243us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b5800002798. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9b71 00007f2100de9a22 00007f2109d028d9 00007f2108e5cee0 00007f2108f260ab 00007f2108f26131 00007f2108ee7fc0 00007f2108ed2929 00007f2108ed23d2 00007f2102449bd4
0709 12:21:21.648895 (+ 56912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.677549 (+ 28654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.347130 (+669581us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b54002ac950. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:22.347247 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134822016}
I20260709 12:21:22.350327 25273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2655) took 2217 ms. Trace:
I20260709 12:21:22.272868 30104 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:22.362149 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.264974 30059 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.365959 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:22.339620 30046 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:22.429695 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.310828 30043 raft_consensus.cc:740] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:22.334582 29923 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:22.408669 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.336529 29909 raft_consensus.cc:2764] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:21:22.132738 30072 consensus_queue.cc:237] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:22.438844 25860 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:21:22.439348 25860 pending_rounds.cc:85] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 11
I20260709 12:21:22.439579 25860 pending_rounds.cc:107] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:21:22.439831 25860 raft_consensus.cc:2889] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:22.415858 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:22.441035 25122 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:22.417870 25273 rpcz_store.cc:276] 0709 12:21:20.132754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.482548 (+349794us) service_pool.cc:224] Handling call
0709 12:21:20.482835 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:20.651297 (+168462us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:21.053458 (+402161us) log.cc:844] Serialized 14 byte log entry
0709 12:21:21.504971 (+451513us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:21.505035 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:21.511654 (+  6619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.349195 (+837541us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b180014f980. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100def2a6 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419
0709 12:21:22.350053 (+   858us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540002b054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:22.350113 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.350257 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":470348,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":78142,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":34241,"spinlock_wait_cycles":415739008,"thread_start_us":833594,"threads_started":3,"wal-append.queue_time_us":384355}
I20260709 12:21:22.289515 29803 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.429670 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:22.418555 29984 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:22.434052 30108 log.cc:927] Time spent T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.094s	user 0.000s	sys 0.005s
W20260709 12:21:22.417304 30093 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:21:22.416277 30096 raft_consensus.cc:2764] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:21:22.427109 25267 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:22.425820 29901 raft_consensus.cc:3055] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:21:22.385187 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 307692us
I20260709 12:21:22.486778 29901 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:22.487277 25242 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:22.487987 29901 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.416630 29811 consensus_queue.cc:1059] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:21:22.437354 29922 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:22.497114 30006 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:22.502761 29925 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:22.502949 30106 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.503371 29889 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.503918 30001 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:22.504024 29811 raft_consensus.cc:3055] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:22.504515 25119 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 13. Current term is 14. Ops: []
W20260709 12:21:22.507208 29802 consensus_meta.cc:287] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.003s
W20260709 12:21:22.507550 30119 log.cc:927] Time spent T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.354s	user 0.006s	sys 0.000s
I20260709 12:21:22.432423 30059 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:22.483786 29984 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:22.514426 30112 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:22.415800 30097 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:22.479543 30075 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:21:22.576891 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 467956us
I20260709 12:21:22.544219 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2291) took 1195 ms. Trace:
I20260709 12:21:22.565028 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:22.431555 30020 consensus_queue.cc:260] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.571626 25241 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:22.482822 25122 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:22.436203 30046 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:22.321607 30110 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.581372 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:22.580463 25123 rpcz_store.cc:276] 0709 12:21:21.348551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.938748 (+590197us) service_pool.cc:224] Handling call
0709 12:21:21.956989 (+ 18241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.957198 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:22.223943 (+266745us) log.cc:844] Serialized 14 byte log entry
0709 12:21:22.543693 (+319750us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.543774 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:22.543842 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.543951 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.544134 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":473987,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":134,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5393,"thread_start_us":558697,"threads_started":2}
I20260709 12:21:22.551033 29811 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:22.580526 25268 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:21:22.608875 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:22.605353 25242 connection.cc:256] RPC call timeout handler was delayed by -1.3005659809998633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 12:21:22.609828 25268 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:22.611707 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:22.613329 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:22.550449 30106 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:22.619768 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 275869us
I20260709 12:21:22.621447 25853 raft_consensus.cc:2410] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:21:22.610163 25242 connection.cc:256] RPC call timeout handler was delayed by -1.2915659809998488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 12:21:22.606642 25825 leader_election.cc:336] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Timed out: RequestConsensusVote RPC to 127.23.81.194:43905 timed out after 1.510s (SENT)
I20260709 12:21:22.558807 29889 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.621372 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:21:22.623819 25242 connection.cc:256] RPC call timeout handler was delayed by -1.2636659809998037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 12:21:22.638365 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1817659809998986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
I20260709 12:21:22.638283 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:22.639784 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:22.624032 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 52541.7us
I20260709 12:21:22.622364 30118 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:22.607746 30001 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:22.578154 30122 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:21:22.616509 30036 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:22.647097 25268 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:21:22.566747 29802 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.649461 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:22.630334 30124 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:21:22.650533 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:22.581092 29842 consensus_queue.cc:1059] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:21:22.669041 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:22.595099 30127 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:21:22.624228 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:22.671581 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:22.673453 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2713) took 1490 ms. Trace:
I20260709 12:21:22.673933 25118 rpcz_store.cc:276] 0709 12:21:21.182926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.345305 (+162379us) service_pool.cc:224] Handling call
0709 12:21:22.673223 (+1327918us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b540009e554. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:22.673384 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610562432}
I20260709 12:21:22.675024 30001 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:21:22.676944 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.649298 30027 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:22.583760 30046 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:22.676316 30001 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.664824 25241 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:22.683127 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:22.622912 30133 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:21:22.696792 25267 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: [12.14-12.14]
W20260709 12:21:22.682504 30099 consensus_meta.cc:287] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.713s	user 0.002s	sys 0.007s
I20260709 12:21:22.699482 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:22.705962 25268 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:22.707643 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:22.708886 30017 consensus_meta.cc:287] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 12:21:22.712631 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:22.714427 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:22.716631 25193 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:22.718179 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:22.719187 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:22.720059 29984 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:22.720274 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:22.720899 25269 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:22.721800 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:22.724040 29802 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:22.726229 30099 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:22.727042 30091 consensus_meta.cc:287] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.004s	user 0.007s	sys 0.005s
I20260709 12:21:22.727537 30091 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:22.728294 25276 raft_consensus.cc:2393] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 13: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:22.728958 30099 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:22.729610 25270 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:22.730433 25274 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:22.730749 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:22.732672 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:22.734683 30132 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:21:22.659827 30036 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:22.736627 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:22.748018 25198 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:22.737744 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:22.738422 25202 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:21:22.752058 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 145381us
I20260709 12:21:22.684983 29953 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:22.761422 25268 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:22.753594 25825 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:22.762641 30104 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:22.763329 30104 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:22.764245 30104 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:22.698495 30138 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:22.768735 25198 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:22.771507 25825 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:22.686905 29909 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.088s
W20260709 12:21:22.735800 30135 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:22.776580 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:22.775161 29802 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:22.684289 29811 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:22.778782 30126 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:21:22.780614 30110 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:22.792863 25267 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:22.761878 30036 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:22.796792 30100 consensus_meta.cc:287] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.065s	user 0.011s	sys 0.000s
I20260709 12:21:22.747867 29803 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:22.797612 30121 log.cc:927] Time spent T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 12:21:22.798797 30106 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:22.799593 30097 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:22.801353 25859 raft_consensus.cc:2410] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:21:22.803810 25268 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:22.686473 30062 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:22.813431 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:22.737628 29889 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:22.852238 25270 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:22.774330 29953 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:22.772441 29984 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:22.789844 30063 consensus_meta.cc:287] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.859s	user 0.009s	sys 0.000s
I20260709 12:21:22.788275 29901 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:22.894647 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.899375 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2152) took 1545 ms. Trace:
I20260709 12:21:23.030206 25275 rpcz_store.cc:276] 0709 12:21:21.354180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.354541 (+   361us) service_pool.cc:224] Handling call
0709 12:21:22.897750 (+1543209us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b540002c954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:22.899307 (+  1557us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322514816}
I20260709 12:21:22.868649 29727 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:22.900833 25267 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 13. Current term is 14. Ops: []
W20260709 12:21:22.907409 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.907574 25276 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:21:23.037379 25276 pending_rounds.cc:85] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 5
I20260709 12:21:22.909941 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2296) took 1522 ms. Trace:
I20260709 12:21:23.039037 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:22.797613 29912 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:22.781687 30059 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:23.018584 29811 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:23.099284 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 60341.6us
I20260709 12:21:22.854298 30103 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:21:23.017426 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 204078us
I20260709 12:21:23.125169 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:22.874703 29802 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:23.021600 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 883) took 2225 ms. Trace:
I20260709 12:21:23.140162 25127 rpcz_store.cc:276] 0709 12:21:20.784254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.784378 (+   124us) service_pool.cc:224] Handling call
0709 12:21:20.849115 (+ 64737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.808416 (+959301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.008780 (+1200364us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b5400453154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:23.009084 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204253440}
I20260709 12:21:23.025843 29984 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:23.026081 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:23.026381 30106 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:23.028165 30073 consensus_meta.cc:287] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.001s
I20260709 12:21:23.037941 25121 rpcz_store.cc:276] 0709 12:21:21.388054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.269625 (+881571us) service_pool.cc:224] Handling call
0709 12:21:22.269936 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.270181 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:22.615334 (+345153us) log.cc:844] Serialized 14 byte log entry
0709 12:21:22.909566 (+294232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.909620 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:22.909674 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.909744 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.909882 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5954,"prepare.queue_time_us":227874,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":535,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":96739,"thread_start_us":597572,"threads_started":2}
W20260709 12:21:23.046350 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.148981 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.781047 29997 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:23.050735 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.924260 30100 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:23.151744 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:23.158627 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 132672us
I20260709 12:21:23.037667 25276 pending_rounds.cc:107] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.6
W20260709 12:21:23.106806 30047 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.077s	user 0.021s	sys 0.041s
I20260709 12:21:23.152742 25825 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:23.036212 29909 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:23.107125 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 468072us
W20260709 12:21:23.023811 30101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.008s	sys 0.044s
I20260709 12:21:23.020421 30097 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.052259 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:23.023643 29953 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:23.037176 29977 consensus_meta.cc:287] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 1.127s	user 0.008s	sys 0.005s
I20260709 12:21:23.150312 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:23.122514 30118 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:23.162238 25090 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:23.039098 30063 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.148195 30106 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:23.173252 29909 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.268608 30118 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.270241 29909 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:23.165480 30018 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:23.098104 29727 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.241549 30019 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:21:23.273217 30106 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:23.273684 29727 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:23.157846 30073 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:23.256175 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.241732 30022 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:23.278601 30126 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:21:23.169171 30074 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 12:21:23.278960 30022 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.168769 29803 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:23.281096 30022 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:23.156661 30027 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.163640 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2709) took 2025 ms. Trace:
I20260709 12:21:23.015455 30062 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.167972 25276 raft_consensus.cc:2917] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Aborting config change with OpId 7.6: Aborted: Op aborted by new leader
I20260709 12:21:23.241307 30100 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:23.161365 30047 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.021s	sys 0.042s
I20260709 12:21:23.169752 25272 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:23.283061 30062 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:23.234907 30147 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.457s	user 0.001s	sys 0.000s
I20260709 12:21:23.145644 29802 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:23.146921 29984 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:23.147064 29889 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:23.234380 30137 log.cc:927] Time spent T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:21:23.227618 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 62613.6us
I20260709 12:21:23.228901 25271 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:23.150979 30142 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:23.354874 25093 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:23.281826 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 119687us
I20260709 12:21:23.283460 25276 raft_consensus.cc:2889] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:23.170240 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1574481049999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 12:21:23.356775 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1538606389999586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 12:21:23.357669 25242 connection.cc:256] RPC call timeout handler was delayed by -1.0782659809999586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
I20260709 12:21:23.285749 25197 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:23.189455 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2672) took 1418 ms. Trace:
I20260709 12:21:23.358300 25270 rpcz_store.cc:276] 0709 12:21:21.771452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.771748 (+   296us) service_pool.cc:224] Handling call
0709 12:21:23.189219 (+1417471us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b5400298954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:23.189375 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2134556928}
W20260709 12:21:23.358891 25242 connection.cc:256] RPC call timeout handler was delayed by -1.041365980999899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260709 12:21:23.048013 25856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 1181) took 1101 ms. Trace:
W20260709 12:21:23.345144 25241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.027s	sys 0.019s
W20260709 12:21:23.349427 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 196723us
I20260709 12:21:23.169042 30034 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.282557 25125 rpcz_store.cc:276] 0709 12:21:21.138327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.784610 (+646283us) service_pool.cc:224] Handling call
0709 12:21:21.784901 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.800518 (+ 15617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.800558 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:21.816266 (+ 15708us) log.cc:844] Serialized 26 byte log entry
0709 12:21:22.147722 (+331456us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:22.445743 (+298021us) log.cc:844] Serialized 14 byte log entry
0709 12:21:22.447861 (+  2118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.447949 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:23.163385 (+715436us) raft_consensus.cc:1685] finished
0709 12:21:23.163414 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.163569 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6295,"prepare.queue_time_us":350047,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":19946,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":12783,"thread_start_us":502703,"threads_started":2,"wal-append.queue_time_us":503960}
W20260709 12:21:23.255066 30145 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 12:21:23.364523 25241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.027s	sys 0.019s
I20260709 12:21:23.363906 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:23.375101 25242 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:23.362545 25856 rpcz_store.cc:276] 0709 12:21:21.946284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.946912 (+   628us) service_pool.cc:224] Handling call
0709 12:21:21.947222 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.953780 (+  6558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.953817 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:21.956673 (+  2856us) log.cc:844] Serialized 26 byte log entry
0709 12:21:22.441548 (+484875us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:22.659307 (+217759us) log.cc:844] Serialized 14 byte log entry
0709 12:21:22.672570 (+ 13263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.672711 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:23.047717 (+375006us) raft_consensus.cc:1685] finished
0709 12:21:23.047747 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.047932 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18952,"prepare.queue_time_us":577187,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":29147,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":24843,"thread_start_us":502600,"threads_started":2,"wal-append.queue_time_us":526164}
I20260709 12:21:23.381968 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:23.282843 30097 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.292869 30022 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:23.344907 29889 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.260802 29997 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:23.384646 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 719862us
I20260709 12:21:23.345314 30001 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:23.295926 30133 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.030s	sys 0.043s
I20260709 12:21:23.384200 25242 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:23.280158 29803 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:23.389833 25193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.007s	sys 0.043s
I20260709 12:21:23.285085 30027 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.354967 30142 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.153878 29912 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.220s
I20260709 12:21:23.391497 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:23.486016 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 94596us
I20260709 12:21:23.394565 30125 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:23.393581 25241 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:23.371093 30096 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:23.467721 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35504 (request call id 8) took 13975 ms. Trace:
I20260709 12:21:23.458086 29729 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:23.386619 30100 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:23.390118 30104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.015s	sys 0.035s
I20260709 12:21:23.355731 29977 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:23.417238 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.475641 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 91547.6us
W20260709 12:21:23.476542 25193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.008s	sys 0.043s
I20260709 12:21:23.392704 29889 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:23.389672 30022 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:23.456284 30133 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.030s	sys 0.043s
I20260709 12:21:23.386118 30156 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:21:23.511870 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.458756 30103 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:23.484866 25851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1295) took 1241 ms. Trace:
I20260709 12:21:23.384179 30034 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.502285 25201 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:23.500506 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:23.516320 25851 rpcz_store.cc:276] 0709 12:21:22.243287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.327375 (+ 84088us) service_pool.cc:224] Handling call
0709 12:21:22.327687 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:22.328074 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.328102 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:22.328663 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 12:21:22.565422 (+236759us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:22.565464 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.565556 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:23.484574 (+919018us) raft_consensus.cc:1685] finished
0709 12:21:23.484601 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.484787 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1179,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":236369,"threads_started":1,"wal-append.queue_time_us":550630}
I20260709 12:21:23.523697 25242 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:23.497380 30104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.015s	sys 0.035s
I20260709 12:21:23.456717 29999 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.118s
W20260709 12:21:23.502913 30157 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:21:23.489457 30142 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:23.531319 30036 consensus_meta.cc:287] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.002s
I20260709 12:21:23.557440 30036 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:23.558972 30106 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.559818 30036 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:23.560935 30063 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:23.562991 29803 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:23.497005 30027 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:23.529793 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 474172us
I20260709 12:21:23.499477 29977 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:23.494434 30125 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:23.567021 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:23.569240 25269 raft_consensus.cc:2410] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:21:23.505343 30022 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:23.569120 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:23.492779 25276 rpcz_store.cc:276] 0709 12:21:09.481398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.481550 (+   152us) service_pool.cc:224] Handling call
0709 12:21:12.650004 (+3168454us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b58008d95d0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e6a0aa 00007f2103eec447 00007f2103f0970a 00007f2103f0a76a 00007f2103f0991b 00007f2103f1503c 00007f2103f146b3 00007f2103f0c9fa 00007f2108ed44c9 00007f2102450c54
0709 12:21:13.745001 (+1094997us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54004c1ba0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e82a07 00007f2103f09749 00007f2103f0a76a 00007f2103f0991b 00007f2103f1503c 00007f2103f146b3 00007f2103f0c9fa 00007f2108ed44c9 00007f2102450c54 00007f2102450be2
0709 12:21:13.804907 (+ 59906us) log.cc:844] Serialized 501 byte log entry
0709 12:21:14.229044 (+424137us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b540002c954. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f14735 00007f2103f0c9fa 00007f2108ed44c9 00007f2102450c54 00007f2102450be2 00007f2102450b11 00007f2102450a8c 00007f210244fd42 00007f210224948c 00007f21022488c6
0709 12:21:15.929339 (+1700295us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b58008d95d0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e78090 00007f2103e6843c 00007f2103e6ed53 00007f2103e6ecd9 00007f2103e6ec69 00007f2103e6ec31 00007f2103e6ddfd 0000000000388634 0000000000388479 00007f2100e21475 00007f2100e237c1
0709 12:21:23.394829 (+7465490us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1576,"raft.queue_time_us":109621,"raft.run_cpu_time_us":7247,"raft.run_wall_time_us":1668951,"spinlock_wait_cycles":6308332416,"thread_start_us":543782,"threads_started":2,"wal-append.queue_time_us":324339,"wal-append.run_cpu_time_us":1593,"wal-append.run_wall_time_us":1001620}
I20260709 12:21:23.505601 30133 consensus_queue.cc:1243] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:23.510885 30143 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:23.583778 30036 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:23.467104 30001 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.589047 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2300) took 2100 ms. Trace:
I20260709 12:21:23.565587 30158 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:23.527372 30103 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.527176 30155 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:23.624742 25857 raft_consensus.cc:2410] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:21:23.554875 30154 log.cc:927] Time spent T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:23.564355 30100 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:23.529093 30096 raft_consensus.cc:697] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:21:23.626142 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 59222.1us
I20260709 12:21:23.605190 25126 rpcz_store.cc:276] 0709 12:21:21.488374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.322190 (+833816us) service_pool.cc:224] Handling call
0709 12:21:22.328690 (+  6500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:22.329081 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.329115 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:22.500197 (+171082us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b2c00000c88. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:21:22.500768 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 12:21:22.649818 (+149050us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:22.669516 (+ 19698us) log.cc:844] Serialized 14 byte log entry
0709 12:21:22.685731 (+ 16215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.705837 (+ 20106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:23.588748 (+882911us) raft_consensus.cc:1685] finished
0709 12:21:23.588858 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.588987 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34713,"prepare.queue_time_us":31583,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":16163,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":12749,"spinlock_wait_cycles":69081856,"thread_start_us":148579,"threads_started":1,"wal-append.queue_time_us":393572}
I20260709 12:21:23.585188 30125 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:23.587329 29999 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.590399 30156 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:23.663199 25273 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:23.604594 30036 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:23.662896 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 493007us
I20260709 12:21:23.627039 30143 raft_consensus.cc:697] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:23.571657 30062 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.680619 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1282) took 1112 ms. Trace:
W20260709 12:21:23.686465 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 331635us
I20260709 12:21:23.666462 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:23.690128 25276 rpcz_store.cc:276] 0709 12:21:22.568532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.728996 (+160464us) service_pool.cc:224] Handling call
0709 12:21:22.897900 (+168904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.679506 (+781606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.680398 (+   892us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540002c950. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:23.680548 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387603712}
I20260709 12:21:23.691280 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:23.694630 25242 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:23.696146 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:23.697196 25093 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:23.670284 29901 consensus_meta.cc:287] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.000s
I20260709 12:21:23.709609 25242 leader_election.cc:400] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12.
I20260709 12:21:23.711369 25242 leader_election.cc:403] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:21:23.713969 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2170) took 1626 ms. Trace:
I20260709 12:21:23.714372 25271 rpcz_store.cc:276] 0709 12:21:22.087289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.100339 (+ 13050us) service_pool.cc:224] Handling call
0709 12:21:22.100654 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.347818 (+1247164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.713741 (+365923us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400418f54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:23.713913 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2594244352}
I20260709 12:21:23.716344 25270 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:21:23.664664 30110 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:23.723914 25121 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:23.719687 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:23.720382 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:23.709890 25167 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:23.724949 25271 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:23.725171 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:23.686559 30036 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:23.709184 29811 consensus_meta.cc:287] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.002s
I20260709 12:21:23.686715 30104 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:23.731555 25276 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:23.705690 30101 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:23.733258 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:23.708511 30133 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:23.734730 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:23.704891 30118 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:23.729383 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:23.728650 25194 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 12: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:23.730089 25121 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:23.730805 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:23.771009 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:23.771346 25193 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:23.710175 30100 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:23.716424 29729 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:23.754874 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:23.777669 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:23.766058 29901 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:23.774091 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:23.793102 25121 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:23.758708 29727 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.672605 29999 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.777329 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:23.777937 25120 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:23.778457 25126 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:23.708314 30158 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:21:23.780269 25127 raft_consensus.cc:2410] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 12:21:23.783326 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.726357 29803 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:23.794096 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.729951 30156 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:23.728287 29997 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:23.768908 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1634) took 1595 ms. Trace:
W20260709 12:21:23.802350 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 92550.4us
W20260709 12:21:23.819793 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 110389us
I20260709 12:21:23.819996 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:23.807617 25272 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:23.824270 25242 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:23.812634 25859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46498 (request call id 1175) took 2043 ms (client timeout 2122 ms). Trace:
W20260709 12:21:23.818756 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 43898.3us
I20260709 12:21:23.730535 30110 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.795846 29909 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:21:23.767292 30104 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.779354 30101 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.824513 25121 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:23.819705 25852 rpcz_store.cc:276] 0709 12:21:22.173836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.176284 (+  2448us) service_pool.cc:224] Handling call
0709 12:21:22.176704 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:22.617045 (+440341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.617075 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:22.622837 (+  5762us) log.cc:844] Serialized 26 byte log entry
0709 12:21:23.038295 (+415458us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:23.038331 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.715499 (+677168us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54005d0cd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:23.715544 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:23.753913 (+ 38369us) raft_consensus.cc:1685] finished
0709 12:21:23.753932 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.768826 (+ 14894us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1630,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":16539,"spinlock_wait_cycles":1011840384,"thread_start_us":382096,"threads_started":1,"wal-append.queue_time_us":744098}
I20260709 12:21:23.831915 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:23.804193 29727 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:23.841081 30106 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:23.801071 29901 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.812652 30118 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12.
W20260709 12:21:23.809476 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.889770 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 57933.8us
I20260709 12:21:23.824812 29997 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:23.842949 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 449422us
I20260709 12:21:23.893642 25241 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:21:23.843283 25092 connection.cc:256] RPC call timeout handler was delayed by -1.203560533999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 12:21:23.895197 25092 connection.cc:256] RPC call timeout handler was delayed by -1.1243605340000613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
I20260709 12:21:23.847631 30133 consensus_queue.cc:1059] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:21:23.842476 25120 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:23.818117 30097 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:23.822639 30029 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:23.811779 30156 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:23.842428 29729 raft_consensus.cc:697] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:23.840301 30100 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.843740 30018 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:23.855422 25126 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:23.882340 30170 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.846181 30034 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:23.807281 30096 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.816751 29803 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.837776 29977 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:21:23.927143 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:23.843989 29912 consensus_queue.cc:1059] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:21:23.839241 30165 consensus_queue.cc:1059] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:21:23.795606 29889 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.902554 30062 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:23.800225 29996 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:23.892653 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 53248.3us
I20260709 12:21:23.896824 25241 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:21:23.986290 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 89560.5us
I20260709 12:21:23.987319 25241 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:23.897948 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:23.897922 30164 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:23.899149 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:23.899369 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 75159.9us
I20260709 12:21:23.909298 30171 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:23.899451 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:23.857004 25859 rpcz_store.cc:269] 0709 12:21:21.771400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.771656 (+   256us) service_pool.cc:224] Handling call
0709 12:21:23.812452 (+2040796us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400373054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:23.812580 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2290569472}
I20260709 12:21:23.890172 30103 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:23.909411 25852 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:21:24.004153 25852 pending_rounds.cc:85] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 7
I20260709 12:21:24.004463 25852 pending_rounds.cc:107] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:21:24.004756 25852 raft_consensus.cc:2889] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:23.900101 29925 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:23.811316 30143 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:23.967624 30172 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:21:23.968740 30166 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:21:23.969005 30008 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:23.969322 30163 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:21:23.970472 30020 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:23.971262 29901 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:23.893500 30063 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 12:21:23.911029 30160 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
W20260709 12:21:23.895694 25092 connection.cc:256] RPC call timeout handler was delayed by -1.0532605339999463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 12:21:23.899042 30174 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:23.903465 30156 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:23.990586 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 99475us
I20260709 12:21:24.036626 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.037282 25120 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:24.038182 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:23.992676 25822 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:21:24.039119 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 46538.2us
W20260709 12:21:24.027510 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 100443us
I20260709 12:21:23.956882 29999 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:23.988234 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:24.002127 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:24.048904 25124 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:21:24.049224 25859 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:24.003152 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:24.014719 25009 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1f471cfad2348a09c4b699f01f9dfa9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 12:21:23.909811 30018 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.050737 30059 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.984128 30027 raft_consensus.cc:3055] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:24.019789 30008 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:24.019510 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 139375us
I20260709 12:21:23.909744 30100 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:23.995707 30133 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:24.006055 30177 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:24.029767 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.032339 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.038388 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:24.019111 30043 consensus_queue.cc:260] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.063560 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:24.064721 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:24.065342 25118 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:24.062515 25268 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:24.066383 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.042783 25122 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:21:24.057992 30008 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:24.067881 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.068814 25122 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:24.069248 25167 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:24.069622 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.042347 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:24.070879 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.071732 30182 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:24.071858 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:23.957752 30170 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.052044 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.046344 29842 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:24.052613 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:24.018435 30171 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:24.092088 25168 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:24.054386 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:23.994808 29996 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.057096 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:24.041234 25822 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:24.058410 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.059214 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.059819 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:24.066490 30180 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:21:24.055373 30027 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:24.072890 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:23.991845 29953 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.709s	user 0.003s	sys 0.007s
I20260709 12:21:23.908113 30169 consensus_queue.cc:1059] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 12:21:24.053525 29901 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:24.089720 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.117902 25118 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:24.074566 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:24.073710 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 85547.8us
I20260709 12:21:24.093010 25123 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:24.121133 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.095121 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.095705 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:24.124068 30113 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:24.124336 25092 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:24.124727 30113 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:24.126227 29895 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:24.126776 30155 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:24.127592 30176 log.cc:927] Time spent T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:24.016201 29729 consensus_queue.cc:237] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.130180 25270 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:24.066654 30018 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:24.134989 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.135649 25118 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:24.136950 25118 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:24.115326 25120 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:24.048255 30034 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.116246 25127 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:24.081434 25167 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:24.118976 25168 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:24.121750 25122 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:24.051278 30059 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.133188 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:24.152196 25092 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:24.144706 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 103532us
I20260709 12:21:24.132395 29901 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.133219 30104 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:24.145732 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 64384.7us
I20260709 12:21:24.161533 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:24.092316 30181 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:24.146703 25168 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:24.172406 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:24.172621 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:24.173192 25196 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:24.173614 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:24.147141 30107 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:21:24.174536 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 139963us
I20260709 12:21:24.175124 30107 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:24.175784 25822 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:24.175995 30107 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.176977 25241 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:24.108953 30186 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.135294 29925 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:24.177929 30186 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.178524 29925 raft_consensus.cc:697] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:24.073117 30046 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:21:24.164024 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:24.181813 25198 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:24.164729 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:24.146612 30169 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:24.174837 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.147253 30063 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:24.177232 30107 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:24.157331 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.180351 25822 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:24.198108 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:24.198917 25859 raft_consensus.cc:2410] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:21:24.181134 25276 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:21:24.162601 29901 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:24.178251 30192 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:24.113234 30171 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.097402 29912 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:21:24.097500 29842 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.143193 29997 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:24.186924 25120 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:24.160552 29727 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:24.132458 30103 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:24.200462 25118 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:21:24.180299 30018 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
W20260709 12:21:24.228317 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 133387us
I20260709 12:21:24.159194 30101 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:24.178187 30073 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:24.204171 29889 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:24.202219 30100 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:24.180402 30047 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:24.168753 30181 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:24.213524 25198 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:24.182979 30104 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:24.277551 29984 consensus_meta.cc:287] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.919s	user 0.012s	sys 0.000s
I20260709 12:21:24.132187 29953 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.158535 30034 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.277292 29803 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:24.199373 30027 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.161800 30097 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:21:24.194634 30174 raft_consensus.cc:697] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:21:24.248610 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.179005 29999 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:21:24.201818 29729 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:24.313858 30174 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.323416 30170 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:24.262100 29727 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:24.264249 25859 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:24.264703 29802 consensus_meta.cc:287] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.905s	user 0.014s	sys 0.001s
I20260709 12:21:24.267294 29996 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:24.268601 30106 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.272287 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.162773 29977 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:24.210289 30148 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:24.204807 30192 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.184950 25123 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:24.276911 25126 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:24.355780 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2562) took 2522 ms. Trace:
I20260709 12:21:24.216672 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.284614 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:24.356410 25121 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: [12.14-12.14]
W20260709 12:21:24.357044 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 72511.4us
I20260709 12:21:24.290437 29842 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:24.360283 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:24.273033 30103 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.360867 25202 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:24.361749 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:24.362313 25202 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:24.362457 30103 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:24.363226 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:24.225421 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:24.274506 30164 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:21:24.305735 30186 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:24.306598 30027 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:24.307485 30171 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:24.307518 30034 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:24.310807 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:24.333650 29727 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.335084 30156 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.369246 29727 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:24.298343 29984 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.343107 25199 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:21:24.286432 30181 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:24.384402 25268 raft_consensus.cc:2393] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:24.286809 30073 raft_consensus.cc:697] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:24.385911 30073 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.348627 25124 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:24.185864 30184 consensus_queue.cc:1059] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 11.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.103s
I20260709 12:21:24.389441 30184 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:24.389931 30184 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:24.391052 30184 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.14, Last appended by leader: 14, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.392740 30184 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:24.356154 25201 rpcz_store.cc:276] 0709 12:21:21.828948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.829888 (+   940us) service_pool.cc:224] Handling call
0709 12:21:21.830201 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.522617 (+1692416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.351341 (+828724us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540016d0d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:24.351536 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3844785408}
I20260709 12:21:24.373831 25119 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:24.370007 30156 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:24.396203 30200 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:24.396798 30200 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:24.397647 30200 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.401362 30001 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:24.405215 30125 consensus_meta.cc:287] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.719s	user 0.006s	sys 0.004s
I20260709 12:21:24.378459 29984 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:24.409211 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:19.977435 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:24.352012 30170 raft_consensus.cc:476] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 12:21:24.354889 30113 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:24.409875 25274 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:24.439065 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:24.440423 25852 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:24.419874 29953 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:24.418701 30142 consensus_meta.cc:287] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.829s	user 0.008s	sys 0.002s
I20260709 12:21:24.444536 25856 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:21:24.371819 30192 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:24.415210 30022 consensus_meta.cc:287] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.819s	user 0.005s	sys 0.005s
W20260709 12:21:24.450399 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 288935us
W20260709 12:21:24.409474 30036 consensus_meta.cc:287] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.649s	user 0.005s	sys 0.002s
I20260709 12:21:24.422825 30111 raft_consensus.cc:3055] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:24.428421 30059 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:24.352988 29802 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.469308 29727 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.482214 29727 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.484534 29727 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:24.481429 25852 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 9.
I20260709 12:21:24.458323 25092 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:24.452569 25822 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:24.416142 30118 raft_consensus.cc:3055] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:24.486737 30118 raft_consensus.cc:740] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:24.355008 30106 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.455883 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.490537 25274 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:24.491758 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.493096 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.302196 29925 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.429301 29977 raft_consensus.cc:697] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:24.489717 30106 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:24.405642 30125 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.459113 30142 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.494015 25274 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 14: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:21:24.495764 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.512667 25822 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:24.513940 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:24.496538 30096 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:24.516849 30096 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.517316 30096 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:24.521627 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 63388.6us
I20260709 12:21:24.522815 30169 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:24.523334 25092 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:24.523566 30169 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:24.523923 30169 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:24.524261 30169 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:24.524750 30059 raft_consensus.cc:2764] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:21:24.459700 30022 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.526751 30194 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:24.527137 30194 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:24.527479 30194 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:24.528330 30022 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:24.437913 30008 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.528684 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.530182 25092 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:24.530663 30008 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:24.531052 30020 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:24.531258 30008 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:24.531620 30020 raft_consensus.cc:697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:24.412405 30181 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.532621 30020 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.533650 30181 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:24.448364 29984 consensus_queue.cc:1059] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:21:24.469386 30111 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:24.538290 30111 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.538800 25092 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:24.539649 30111 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:24.542258 30034 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:24.545590 25090 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:24.545825 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.546809 25270 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:24.547719 25092 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:24.548192 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:24.550587 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:24.498098 25241 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:21:24.556473 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 58523.7us
I20260709 12:21:24.568408 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:24.569341 25852 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:24.572772 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:24.573956 25090 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:24.572976 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:24.577474 25853 raft_consensus.cc:2393] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:24.581490 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 146612us
I20260709 12:21:24.584863 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:24.586923 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:24.595386 25859 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:24.571391 30022 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:24.598110 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:24.598320 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:24.471724 30036 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.608963 25852 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:24.509653 30142 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:24.637490 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:24.642333 25274 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:24.568419 30034 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.572327 30156 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:24.500417 30125 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:24.568050 30018 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.639364 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.576592 30017 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:24.610268 30022 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.672122 25267 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:24.636850 29803 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:24.678468 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1635) took 2385 ms. Trace:
I20260709 12:21:24.679031 25854 rpcz_store.cc:276] 0709 12:21:22.288582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.327986 (+ 39404us) service_pool.cc:224] Handling call
0709 12:21:23.038411 (+710425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.038582 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.038606 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:23.038647 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:23.038678 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.038727 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:24.673682 (+1634955us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400590950. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:24.673807 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633099520}
I20260709 12:21:24.660887 29842 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:24.672555 30059 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:24.498091 29977 consensus_queue.cc:237] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.677168 30022 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:24.704316 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:24.707100 25854 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:24.641928 30107 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:21:24.705629 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:24.676887 30156 raft_consensus.cc:697] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:24.700083 29842 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.709807 25851 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
W20260709 12:21:24.711699 30202 log.cc:927] Time spent T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:21:24.669055 30034 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:24.733685 29901 consensus_meta.cc:287] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.000s
I20260709 12:21:24.737887 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:24.773762 25855 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.739883 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:24.747798 30036 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:24.658376 30018 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:24.753618 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 622024us
I20260709 12:21:24.735455 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:24.827787 25854 raft_consensus.cc:2410] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 16 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:21:24.763264 25167 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
W20260709 12:21:24.771327 25242 leader_election.cc:336] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.132s (SENT)
I20260709 12:21:24.828613 25242 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:21:24.778712 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 205782us
I20260709 12:21:24.751883 29842 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:24.806144 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.830651 25092 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:24.815399 25274 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
W20260709 12:21:24.829653 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 58386.1us
W20260709 12:21:24.832103 25242 leader_election.cc:336] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.170s (SENT)
I20260709 12:21:24.832464 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:24.832615 25090 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:24.827934 25165 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:24.834568 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 71426.9us
I20260709 12:21:24.845038 25165 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:24.846639 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.847661 25167 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:24.846982 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:24.848265 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:24.848997 30171 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:24.849093 25274 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:24.849426 30171 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.849995 30171 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.850210 30017 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:24.850865 30017 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:21:24.853247 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 266432us
I20260709 12:21:24.854084 25093 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:24.859809 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.860476 25123 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:24.863034 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:24.863993 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 225625us
W20260709 12:21:24.864451 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.867535 25123 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:21:24.868677 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.733794 30022 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.870203 25855 raft_consensus.cc:2410] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:21:24.737553 30194 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.877118 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:24.879541 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.881039 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.882771 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:24.884862 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:24.852579 30073 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:24.852699 29984 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:24.843855 30155 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:24.875733 30189 consensus_queue.cc:1059] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:21:24.890336 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:24.867700 29997 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.759474 29925 consensus_queue.cc:1059] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 12:21:24.858160 30142 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:24.860644 29727 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:24.863276 29912 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:24.833593 30072 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:24.788699 29901 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.860636 29788 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:24.939512 30208 log.cc:927] Time spent T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:21:24.939437 29788 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.944370 29901 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:24.945245 30207 log.cc:927] Time spent T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:21:24.945585 25853 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:24.948438 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2187) took 1226 ms. Trace:
W20260709 12:21:24.950600 30209 log.cc:927] Time spent T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:21:24.951167 30072 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.951886 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.952642 25268 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:24.953323 30072 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:24.902243 25118 raft_consensus.cc:2368] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13.
I20260709 12:21:24.868801 30059 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:24.877548 29729 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:24.891382 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:24.900274 30036 consensus_queue.cc:1059] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 12:21:24.926241 30204 log.cc:927] Time spent T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:21:24.898775 30073 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:24.948945 25271 rpcz_store.cc:276] 0709 12:21:23.731973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.733800 (+  1827us) service_pool.cc:224] Handling call
0709 12:21:23.734192 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:23.822381 (+ 88189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.822419 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:23.834621 (+ 12202us) log.cc:844] Serialized 26 byte log entry
0709 12:21:23.898058 (+ 63437us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:23.898099 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.947915 (+1049816us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b5400123ed4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:24.947976 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:24.948041 (+    65us) raft_consensus.cc:1685] finished
0709 12:21:24.948062 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:24.948357 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3844,"raft.queue_time_us":22922,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4291,"spinlock_wait_cycles":171176832,"thread_start_us":49057,"threads_started":1,"wal-append.queue_time_us":121130}
I20260709 12:21:24.932260 29912 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:24.925061 30096 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.962533 25274 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:24.927477 29727 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.922762 30142 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:24.965773 25197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 935) took 2228 ms (client timeout 2195 ms). Trace:
W20260709 12:21:24.975340 25197 rpcz_store.cc:269] 0709 12:21:22.732222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.732350 (+   128us) service_pool.cc:224] Handling call
0709 12:21:24.959900 (+2227550us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b5400361354. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:24.960060 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267317120}
I20260709 12:21:24.933691 30174 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:24.953791 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.970453 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.964231 29729 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.972834 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:24.977429 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.979964 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.982945 25268 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:24.919824 29997 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:24.980443 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:24.971706 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 80437.2us
I20260709 12:21:24.988238 25119 raft_consensus.cc:2368] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12.
I20260709 12:21:24.988713 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:24.970945 30073 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.971956 30059 raft_consensus.cc:697] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:24.989609 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:24.997110 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:24.974037 29912 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:24.995304 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:25.000087 25119 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:24.973910 30106 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:24.974803 29727 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:24.984508 25274 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:21:25.007458 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.008467 25201 raft_consensus.cc:2368] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15.
I20260709 12:21:24.997845 25268 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:24.893540 30156 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:24.978492 30142 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.998983 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:25.002954 25271 raft_consensus.cc:2393] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 15: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:24.987881 29729 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.008224 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.016240 25198 raft_consensus.cc:2368] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12.
W20260709 12:21:24.997191 25194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 931) took 2281 ms (client timeout 1645 ms). Trace:
W20260709 12:21:25.016924 25194 rpcz_store.cc:269] 0709 12:21:22.715572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.717906 (+  2334us) service_pool.cc:224] Handling call
0709 12:21:24.996987 (+2279081us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54004132d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:24.997125 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2318047488}
I20260709 12:21:25.010823 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.011010 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.011708 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.017675 25825 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:24.991356 29788 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:24.989038 30174 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:21:25.017479 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 127232us
I20260709 12:21:25.023597 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:25.022171 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.027490 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:25.025689 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.028612 25194 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 15: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:25.027627 25197 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:25.029635 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:25.030651 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.018096 25201 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:25.033308 25202 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:25.035370 25852 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:25.035785 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:25.033584 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:25.036966 25271 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:25.033984 25194 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:21:25.038275 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.039599 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.040241 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.041170 25268 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:25.041898 25202 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:21:25.015913 30034 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.018633 30106 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:25.046358 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.046779 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.048302 25200 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:25.048485 25198 raft_consensus.cc:2393] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 12: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:25.026540 30125 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:25.066895 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.069064 30189 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:25.069825 30189 consensus_queue.cc:1059] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:25.069938 30074 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:21:25.071766 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.071465 25271 raft_consensus.cc:2410] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:21:25.035200 30036 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:25.081123 25242 leader_election.cc:400] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15.
I20260709 12:21:25.081620 25242 leader_election.cc:403] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:21:25.085095 30110 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:25.085002 30189 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15.
I20260709 12:21:25.086709 25242 leader_election.cc:400] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12.
I20260709 12:21:25.087121 25242 leader_election.cc:403] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:25.087811 30169 consensus_meta.cc:287] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
W20260709 12:21:25.110165 30217 log.cc:927] Time spent T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:21:25.094105 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:25.176824 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 82858.9us
I20260709 12:21:25.049578 30022 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:25.099906 29984 raft_consensus.cc:3055] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:25.123451 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2722) took 1087 ms. Trace:
I20260709 12:21:25.120656 25165 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:25.068212 30125 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.184903 25126 rpcz_store.cc:276] 0709 12:21:24.035988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.038125 (+  2137us) service_pool.cc:224] Handling call
0709 12:21:25.123261 (+1085136us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54000f2654. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:25.123387 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371144064}
W20260709 12:21:25.138875 30192 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.669s	user 0.011s	sys 0.000s
I20260709 12:21:25.088145 30189 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12.
I20260709 12:21:25.131193 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:25.141379 30036 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.120956 29802 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.059710 30059 consensus_queue.cc:237] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:25.140066 25269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2177) took 2435 ms (client timeout 3013 ms). Trace:
W20260709 12:21:25.234984 25269 rpcz_store.cc:269] 0709 12:21:22.704642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.721565 (+ 16923us) service_pool.cc:224] Handling call
0709 12:21:25.139861 (+2418296us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b540002b054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:25.139990 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1939654912}
I20260709 12:21:25.042752 30155 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:21:25.043020 30018 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.126425 25273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1278) took 2562 ms. Trace:
I20260709 12:21:25.243474 25273 rpcz_store.cc:276] 0709 12:21:22.564212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.564381 (+   169us) service_pool.cc:224] Handling call
0709 12:21:22.564701 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.669538 (+1104837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.126182 (+1456644us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400121454. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:25.126339 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2525793664}
I20260709 12:21:25.043530 30107 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 12:21:25.127839 30096 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:25.096689 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:25.104665 25012 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:21:25.297406 25012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 192902us
I20260709 12:21:25.137607 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:25.298290 25122 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 7.
I20260709 12:21:25.126353 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:25.299216 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:25.114782 30194 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:25.109283 30167 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 1.259s	user 0.000s	sys 0.005s
I20260709 12:21:25.116056 29997 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:25.107781 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:25.302903 25269 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 13: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:25.303383 25119 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:25.303716 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:25.305096 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:25.167248 25090 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:25.178076 25242 leader_election.cc:400] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13.
I20260709 12:21:25.306833 25242 leader_election.cc:403] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:25.307570 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 129686us
I20260709 12:21:25.308835 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:25.309398 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:25.073923 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:25.178851 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.182190 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.310415 25198 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:25.183811 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:25.311369 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:25.311720 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:25.237571 30189 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.313445 25127 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:21:25.176647 30214 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:25.313735 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 146592us
W20260709 12:21:25.185626 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 65045.4us
W20260709 12:21:25.231199 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:25.232481 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 204587us
I20260709 12:21:25.314750 25090 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:25.314929 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:25.178504 30181 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.247344 30142 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.252552 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 905) took 1209 ms. Trace:
I20260709 12:21:25.317510 25121 rpcz_store.cc:276] 0709 12:21:24.043341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.122676 (+ 79335us) service_pool.cc:224] Handling call
0709 12:21:24.356196 (+233520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:24.356960 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.252279 (+895319us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54001fac50. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:25.252473 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536268672}
I20260709 12:21:25.318145 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:25.318976 25122 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:25.254272 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1297) took 1221 ms. Trace:
I20260709 12:21:25.320281 25825 leader_election.cc:400] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12.
I20260709 12:21:25.320822 25825 leader_election.cc:403] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:21:25.320289 25275 rpcz_store.cc:276] 0709 12:21:24.032854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.119055 (+ 86201us) service_pool.cc:224] Handling call
0709 12:21:24.534881 (+415826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:24.535140 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:24.535181 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:24.535243 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:24.535292 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.535370 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.254018 (+718648us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400299d50. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:25.254193 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955510144}
I20260709 12:21:25.259627 30043 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:25.260938 30091 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:25.267117 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:25.270685 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2570) took 1098 ms. Trace:
I20260709 12:21:25.271956 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.236811 30036 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.184636 29984 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:25.196146 30164 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:25.177382 30169 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.233336 30192 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.276168 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.121824 30171 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.277266 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:25.346463 25126 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:25.346758 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.187580 30125 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.280741 25856 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:25.348153 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2573) took 1157 ms. Trace:
I20260709 12:21:25.286283 30222 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:25.286895 30221 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:25.286947 30224 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:25.287719 30133 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.292521 29727 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.244653 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:25.301678 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:25.372696 25274 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:25.372891 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:25.298169 25093 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:25.374059 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 76002us
I20260709 12:21:25.325439 30091 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:25.304908 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:25.174607 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.376820 25202 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.373783 25857 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:25.238262 25276 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 14: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:25.316069 25090 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:25.325845 25199 rpcz_store.cc:276] 0709 12:21:24.171793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.171930 (+   137us) service_pool.cc:224] Handling call
0709 12:21:24.172372 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:24.379126 (+206754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.270405 (+891279us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54000a6254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:25.270616 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365251456}
I20260709 12:21:25.327162 25121 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:21:25.378094 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 62108.2us
I20260709 12:21:25.328751 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:25.335331 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:25.337405 25194 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.379439 25271 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 16: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:25.352286 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.352487 25198 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:25.352924 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:25.307487 29842 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:25.353922 25197 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:25.348917 25196 rpcz_store.cc:276] 0709 12:21:24.190871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.191163 (+   292us) service_pool.cc:224] Handling call
0709 12:21:24.191425 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:24.191613 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:24.214484 (+ 22871us) log.cc:844] Serialized 14 byte log entry
0709 12:21:25.133254 (+918770us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b18001e4a80. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f21079063c7 00007f2103f189a7 00007f2103f280bf 00007f2103f28038
0709 12:21:25.308064 (+174810us) log.cc:844] Serialized 14 byte log entry
0709 12:21:25.347728 (+ 39664us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:25.347782 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:25.347830 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.347918 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.348063 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54358,"prepare.queue_time_us":23134,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2214,"raft.queue_time_us":8755,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":5033344,"thread_start_us":395008,"threads_started":2,"wal-append.queue_time_us":332100}
I20260709 12:21:25.321969 29802 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.359860 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:25.316599 30018 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:25.324563 30194 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:21:25.367523 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 50738.2us
W20260709 12:21:25.367758 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 52915.2us
I20260709 12:21:25.382843 25276 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:25.406536 25165 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:25.379375 25269 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:25.322762 29729 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.397485 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.398228 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.412922 25202 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:25.398990 25854 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:25.415622 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.417124 25202 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:25.399953 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.193949 30174 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.408825 25276 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:25.419301 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:25.431542 25851 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:25.374167 30221 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:25.419925 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.381845 29997 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.420707 29729 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.408130 30143 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:25.444406 25857 raft_consensus.cc:1240] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:25.327240 30214 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.377360 29977 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:25.423439 30169 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:25.424500 25194 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:25.470592 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.471568 25194 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 12: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:25.425024 30192 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.326398 30189 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.425935 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:25.403743 30194 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:25.405376 30156 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:25.489710 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:25.490965 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:25.491387 30223 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:25.491916 30223 raft_consensus.cc:697] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:25.492444 25165 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:25.492798 30223 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.327170 30181 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.381837 29811 raft_consensus.cc:2764] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:21:25.421396 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.494261 25197 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.495195 30181 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.495740 30181 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:25.496479 30181 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:25.382225 30222 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:25.397003 30022 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:25.497466 30022 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.497838 30022 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:25.467393 25200 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:25.502153 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 61723.6us
I20260709 12:21:25.502830 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.504267 25200 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:25.505335 25200 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:25.506819 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:25.507802 25851 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 13: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:25.507594 25197 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:25.509320 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:25.510492 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 194615us
I20260709 12:21:25.438090 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.480472 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.512461 25197 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.513670 25194 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:21:25.511826 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 200541us
I20260709 12:21:25.515538 29811 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:25.516374 25196 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:25.518776 25196 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:25.518849 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:25.520735 30222 raft_consensus.cc:2764] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:21:25.522894 25242 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:25.523414 30022 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.526764 25242 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:25.528896 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:25.530185 30223 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:25.530725 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:25.536334 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 227756us
I20260709 12:21:25.537791 25168 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:25.538363 25118 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.528121 25201 raft_consensus.cc:1240] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:25.378904 30224 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:25.468945 29925 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:25.428061 30120 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 12:21:25.565316 25275 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:25.567889 25197 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:25.381930 30133 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:25.557489 30199 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:21:25.533955 30194 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:25.576170 25093 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:25.443485 29997 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.559190 30169 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:25.588582 25822 leader_election.cc:336] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Timed out: RequestConsensusVote RPC to 127.23.81.195:44749 timed out after 1.712s (SENT)
I20260709 12:21:25.589112 25822 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:25.489444 30067 consensus_queue.cc:1059] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:21:25.440023 29984 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:25.595989 25268 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:25.533591 30155 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:21:25.599268 25118 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:25.599444 25851 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:21:25.600118 25851 pending_rounds.cc:85] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 8
I20260709 12:21:25.600427 25851 pending_rounds.cc:107] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:21:25.573976 30181 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:25.600733 25851 raft_consensus.cc:2889] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:25.579296 30156 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:25.585179 30113 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:25.575163 30192 consensus_queue.cc:1059] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:21:25.596907 30008 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:25.605707 25200 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:25.607369 30224 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:25.609083 30133 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.488443 30091 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:25.610338 29727 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.594691 30235 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:21:25.617492 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.594844 30120 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:21:25.620796 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 90085.6us
I20260709 12:21:25.624132 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:25.609895 25269 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:25.640247 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:25.602990 30155 consensus_queue.cc:1243] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:21:25.619091 30113 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:25.595613 30169 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.638726 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2698) took 1084 ms. Trace:
I20260709 12:21:25.650601 25276 rpcz_store.cc:276] 0709 12:21:24.554762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.430839 (+876077us) service_pool.cc:224] Handling call
0709 12:21:25.431090 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.566356 (+135266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.566402 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:25.566451 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:25.566480 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.638424 (+ 71944us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400120554. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:25.638486 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.638656 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310531840}
I20260709 12:21:25.652374 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:25.653402 25276 raft_consensus.cc:2410] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:21:25.634486 30133 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:25.639557 30091 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:25.638041 29984 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:25.634102 30022 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.646548 30120 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:25.654752 30235 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:25.661243 29842 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:25.670585 30113 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:25.633721 30222 consensus_queue.cc:1175] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b83c12959b9848b3b7bbc680f5ee6225" responder_term: 12 status { last_received { term: 9 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: [11.6-11.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:25.679649 30221 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:25.666494 30133 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:21:25.683056 30073 consensus_meta.cc:287] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.000s
I20260709 12:21:25.682839 30133 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:25.683506 30073 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.685695 30073 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.686259 30189 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.686864 30169 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:25.677696 30171 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.688112 30125 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.690363 30125 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:25.690804 30120 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.694593 30235 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.691094 30214 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.681125 30113 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:25.698257 30194 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:25.700451 30194 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:25.752971 25194 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:25.754933 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 158108us
W20260709 12:21:25.760507 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 145119us
I20260709 12:21:25.761988 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.763505 25197 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:25.639310 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.767243 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.768553 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:25.769207 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:25.769438 25276 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:25.778002 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:25.779387 25121 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:25.780387 25269 raft_consensus.cc:1240] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:25.781136 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2700) took 1168 ms. Trace:
I20260709 12:21:25.782011 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:25.787588 25269 rpcz_store.cc:276] 0709 12:21:24.612345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.779463 (+1167118us) service_pool.cc:224] Handling call
0709 12:21:25.779986 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.780849 (+   863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.781040 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:25.786733 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.793195 25119 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:21:25.794490 25242 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.546s (SENT) [suppressed 29 similar messages]
I20260709 12:21:25.803411 25121 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:25.690924 30036 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.807412 25269 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:25.811056 30235 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:25.812250 30235 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.813683 30133 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:25.814489 30133 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.817111 30133 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.819137 25197 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:25.820686 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.821607 25197 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.826172 25276 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:25.831053 30036 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.838466 30235 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:25.838750 30046 consensus_queue.cc:1059] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:25.840217 30046 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:21:25.842218 30225 log.cc:927] Time spent T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:21:25.846519 30073 raft_consensus.cc:3055] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:25.847034 30073 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:25.850775 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:25.859457 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:25.861178 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:25.864357 30228 log.cc:927] Time spent T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:21:25.859457 25025 catalog_manager.cc:5697] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:25.865846 25025 catalog_manager.cc:5697] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:25.871416 25201 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 13: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:25.872069 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 77768.9us
I20260709 12:21:25.875006 25197 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
W20260709 12:21:25.849789 29912 consensus_meta.cc:287] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.837s	user 0.007s	sys 0.003s
I20260709 12:21:25.875970 25025 catalog_manager.cc:5697] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:25.879340 25025 catalog_manager.cc:5697] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.882177 29727 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.882666 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:25.882946 29727 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:25.884629 30239 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:21:25.848548 30073 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:25.891774 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:25.893307 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:25.894168 25276 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 13: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:25.894939 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 911) took 1850 ms. Trace:
I20260709 12:21:25.895370 25125 rpcz_store.cc:276] 0709 12:21:24.044748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.129154 (+ 84406us) service_pool.cc:224] Handling call
0709 12:21:24.157971 (+ 28817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:24.162448 (+  4477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:24.162477 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:24.182528 (+ 20051us) log.cc:844] Serialized 26 byte log entry
0709 12:21:24.354338 (+171810us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:24.354385 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.355421 (+  1036us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:24.483633 (+128212us) raft_consensus.cc:1685] finished
0709 12:21:24.483656 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.894488 (+1410832us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b5400454550. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:25.894737 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6043,"raft.queue_time_us":11449,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3820,"spinlock_wait_cycles":65501568,"thread_start_us":127481,"threads_started":1,"wal-append.queue_time_us":242446,"wal-append.run_cpu_time_us":1719,"wal-append.run_wall_time_us":1025273}
W20260709 12:21:25.900106 25124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2732) took 1857 ms (client timeout 1546 ms). Trace:
W20260709 12:21:25.900440 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 85562.8us
W20260709 12:21:25.900596 25124 rpcz_store.cc:269] 0709 12:21:24.042864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.056873 (+ 14009us) service_pool.cc:224] Handling call
0709 12:21:25.899711 (+1842838us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540009d154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:25.899866 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481195392}
W20260709 12:21:26.000342 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.015285 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2202) took 1073 ms. Trace:
I20260709 12:21:25.935207 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1295) took 1902 ms. Trace:
I20260709 12:21:25.974264 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:26.015807 25276 rpcz_store.cc:276] 0709 12:21:24.939955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.894753 (+954798us) service_pool.cc:224] Handling call
0709 12:21:25.895118 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.895521 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.895547 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:25.895588 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:25.895632 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.895687 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:26.013511 (+117824us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:25.903861 25165 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:26.019493 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:26.020179 25276 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:26.020898 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:26.021399 25276 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:26.026361 29912 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.029587 29912 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.032171 25858 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:26.056241 30125 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.057072 30125 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:26.040656 29802 consensus_meta.cc:287] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.011s
I20260709 12:21:26.062562 29802 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13.
I20260709 12:21:26.064064 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:26.066154 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:26.067550 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:26.032204 25856 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:25.901717 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:26.070307 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:26.070655 29984 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:26.071718 29984 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:26.073117 29984 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.073947 25273 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:26.034425 25195 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:26.035178 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:26.061697 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:26.080976 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:26.081311 30221 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:26.081682 25851 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:26.082078 30221 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:26.083298 30221 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:26.085398 29802 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:26.086630 29802 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.077469 25201 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:26.087488 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:26.088722 29997 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.090233 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:26.091279 25125 raft_consensus.cc:2410] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:21:26.078455 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:26.070328 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 168887us
I20260709 12:21:26.034807 25127 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:25.935794 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:25.995643 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:26.001543 25822 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:26.012827 30073 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.991070 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:26.043747 25168 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:26.016528 25267 rpcz_store.cc:276] 0709 12:21:24.032253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.073935 (+ 41682us) service_pool.cc:224] Handling call
0709 12:21:24.097172 (+ 23237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:24.675196 (+578024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.934640 (+1259444us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b5400027e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:25.934992 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321602944}
I20260709 12:21:26.103027 25851 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:26.103317 29802 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.104923 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:26.105928 30118 consensus_queue.cc:260] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.114933 30118 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:26.000633 29727 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.109122 30143 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:26.029915 30043 consensus_meta.cc:287] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.005s
I20260709 12:21:26.118496 25276 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:26.039438 29925 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.934619 30194 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.121209 29925 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:25.904372 29909 consensus_queue.cc:1059] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.217s
I20260709 12:21:26.120371 30143 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:26.042884 30027 consensus_queue.cc:1059] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:21:26.149539 29901 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:26.150141 25193 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:26.153955 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1313) took 1275 ms. Trace:
I20260709 12:21:26.154311 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2704) took 1070 ms. Trace:
W20260709 12:21:26.154585 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 250913us
I20260709 12:21:26.155370 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2199) took 1216 ms. Trace:
I20260709 12:21:26.158349 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1306) took 1750 ms. Trace:
I20260709 12:21:26.161711 25269 rpcz_store.cc:276] 0709 12:21:24.878849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.838442 (+959593us) service_pool.cc:224] Handling call
0709 12:21:25.839052 (+   610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:25.839716 (+   664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.839756 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:25.840412 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 12:21:26.010551 (+170139us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:26.010601 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.010664 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:26.153675 (+143011us) raft_consensus.cc:1685] finished
0709 12:21:26.153696 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:26.153845 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19481,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":274,"thread_start_us":169593,"threads_started":1,"wal-append.queue_time_us":310971}
I20260709 12:21:26.162292 25271 rpcz_store.cc:276] 0709 12:21:24.939139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.073619 (+134480us) service_pool.cc:224] Handling call
0709 12:21:26.154972 (+1081353us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b540034e4d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:26.155182 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158509312}
I20260709 12:21:26.165428 25269 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:26.166188 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1315) took 1076 ms. Trace:
I20260709 12:21:26.166592 25269 rpcz_store.cc:276] 0709 12:21:25.089500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.163989 (+1074489us) service_pool.cc:224] Handling call
0709 12:21:26.164915 (+   926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:26.165909 (+   994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.166117 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:26.162809 25275 rpcz_store.cc:276] 0709 12:21:24.407806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.321837 (+914031us) service_pool.cc:224] Handling call
0709 12:21:25.322136 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.574294 (+252158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.157800 (+583506us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400298e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:26.158153 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555455232}
I20260709 12:21:26.161803 25268 rpcz_store.cc:276] 0709 12:21:25.084021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.266848 (+182827us) service_pool.cc:224] Handling call
0709 12:21:26.153926 (+887078us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b540002bf54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:26.154104 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621538688}
I20260709 12:21:26.146896 29727 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:21:26.177531 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 176207us
I20260709 12:21:26.178740 30125 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:26.189492 25272 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:26.190285 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2702) took 1106 ms. Trace:
I20260709 12:21:26.181807 29950 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.171406 30043 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:26.193615 25272 rpcz_store.cc:276] 0709 12:21:25.083407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.129618 (+1046211us) service_pool.cc:224] Handling call
0709 12:21:26.182525 (+ 52907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:26.189952 (+  7427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.190224 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:26.198530 29950 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:26.199831 25273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2706) took 1115 ms. Trace:
I20260709 12:21:26.200901 25275 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:26.203510 30142 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.206293 25123 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
W20260709 12:21:26.208035 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 164435us
I20260709 12:21:26.173522 29909 consensus_queue.cc:1243] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:21:26.210256 25273 rpcz_store.cc:276] 0709 12:21:25.084628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.244414 (+159786us) service_pool.cc:224] Handling call
0709 12:21:26.199562 (+955148us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b540034e9d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:26.199762 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1589305728}
I20260709 12:21:26.190302 29727 raft_consensus.cc:697] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:26.221148 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:26.175355 30194 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.227227 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:26.228667 25242 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:26.231498 25822 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:21:26.237066 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.237919 29925 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.238188 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:26.239105 25860 raft_consensus.cc:2410] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:26.240056 29802 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:26.240473 29802 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.240795 29802 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:26.243461 25272 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:26.245157 25272 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:21:26.245469 25272 pending_rounds.cc:85] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 8
I20260709 12:21:26.245734 25272 pending_rounds.cc:107] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 13.9
W20260709 12:21:26.248910 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.256668 25193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36434 (request call id 2565) took 2093 ms (client timeout 1733 ms). Trace:
W20260709 12:21:26.257122 25193 rpcz_store.cc:269] 0709 12:21:24.162908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.164513 (+  1605us) service_pool.cc:224] Handling call
0709 12:21:26.256449 (+2091936us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b540035ff54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:26.256585 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4462507264}
I20260709 12:21:26.258754 30133 consensus_queue.cc:1059] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:26.260097 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:26.260476 30174 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:26.260922 25199 raft_consensus.cc:2393] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 10: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:26.261121 30174 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:26.262243 25199 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:26.262935 30096 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12.
I20260709 12:21:26.263203 30222 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:26.263877 30222 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.264691 30096 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:26.265278 30096 raft_consensus.cc:697] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:21:26.266412 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.267148 30261 log.cc:927] Time spent T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:21:26.262260 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 49305.5us
I20260709 12:21:26.266434 25201 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:26.271806 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:26.223381 30027 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:21:26.272645 25272 raft_consensus.cc:2889] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:26.277420 25822 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:26.285945 25193 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:21:26.287488 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 56632.3us
I20260709 12:21:26.281474 30043 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:26.295698 29802 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.275507 29901 consensus_queue.cc:1059] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:21:26.290836 30222 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.309237 25269 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:26.324150 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:26.324839 25201 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:26.321979 30067 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:21:26.330754 25202 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:26.330395 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1307) took 1868 ms. Trace:
I20260709 12:21:26.333671 30125 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:26.334293 30125 raft_consensus.cc:697] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:26.336462 25273 raft_consensus.cc:2410] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:26.338488 30235 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.342207 25201 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:26.342478 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:26.348292 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 916) took 2302 ms. Trace:
I20260709 12:21:26.348869 25120 rpcz_store.cc:276] 0709 12:21:24.045861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.138721 (+ 92860us) service_pool.cc:224] Handling call
0709 12:21:24.139070 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:24.223470 (+ 84400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.347699 (+2124229us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b54003237d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:26.348068 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109352832}
I20260709 12:21:26.351704 30174 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:26.352833 29788 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:26.356237 25168 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:26.373272 25272 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:21:26.374578 25272 pending_rounds.cc:85] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 6
I20260709 12:21:26.380743 25272 pending_rounds.cc:107] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:21:26.381090 25272 raft_consensus.cc:2889] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:26.335429 30125 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.296844 30096 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.346230 30133 consensus_queue.cc:1243] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:21:26.356571 30164 raft_consensus.cc:3055] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:26.331192 25274 rpcz_store.cc:276] 0709 12:21:24.408048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.382245 (+974197us) service_pool.cc:224] Handling call
0709 12:21:25.439533 (+ 57288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:25.439885 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.439914 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:25.991740 (+551826us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b2c0003d328. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:21:25.992465 (+   725us) log.cc:844] Serialized 26 byte log entry
0709 12:21:26.140360 (+147895us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:26.145590 (+  5230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.167721 (+ 22131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:26.270414 (+102693us) raft_consensus.cc:1685] finished
0709 12:21:26.270444 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:26.276820 (+  6376us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50457,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":25478,"spinlock_wait_cycles":5523840,"thread_start_us":145384,"threads_started":1,"wal-append.queue_time_us":201900}
I20260709 12:21:26.392328 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:26.392524 25242 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.864s (SENT)
I20260709 12:21:26.394834 25168 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:26.384841 29788 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:26.385067 29901 raft_consensus.cc:3055] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:26.398540 30264 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.402537 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:26.340312 30235 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:26.409320 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 139399us
I20260709 12:21:26.396327 30164 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:26.419165 25269 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:26.410096 30027 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:26.423640 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2204) took 1311 ms. Trace:
I20260709 12:21:26.397410 29984 consensus_queue.cc:1059] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:21:26.424521 25271 rpcz_store.cc:276] 0709 12:21:25.111857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.164108 (+1052251us) service_pool.cc:224] Handling call
0709 12:21:26.164535 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:26.164902 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:21:26.303011 (+138109us) log.cc:844] Serialized 14 byte log entry
0709 12:21:26.423048 (+120037us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:26.423128 (+    80us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:26.423198 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.423312 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:26.423527 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":234853,"thread_start_us":215878,"threads_started":2}
I20260709 12:21:26.429283 30189 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:26.430601 30264 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.432204 30272 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:26.433604 30272 raft_consensus.cc:3055] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:26.393216 29727 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.434058 30272 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:26.433612 30264 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.436182 30272 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.438758 30272 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:26.442800 30036 raft_consensus.cc:3055] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:26.443341 30036 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:26.444468 30036 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.438604 30164 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.456552 30194 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.460515 30164 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:26.461730 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.462608 30263 log.cc:927] Time spent T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 12:21:26.463297 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.438905 25198 raft_consensus.cc:3055] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:26.473317 25198 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:26.445834 30036 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:26.404150 29901 raft_consensus.cc:740] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:26.446646 30244 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:21:26.486258 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:26.488142 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:26.489207 25853 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:26.494437 25860 pending_rounds.cc:85] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 12
I20260709 12:21:26.494917 25860 pending_rounds.cc:107] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 12:21:26.495249 25860 raft_consensus.cc:2889] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:26.497978 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1665) took 1205 ms. Trace:
I20260709 12:21:26.498637 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:26.498528 25198 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.499621 25198 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:26.500027 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:26.501396 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:26.502383 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:26.509699 25856 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 13: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:26.511476 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 68313.6us
I20260709 12:21:26.513747 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:26.522156 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.526342 25025 catalog_manager.cc:5697] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:26.528651 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2701) took 1445 ms. Trace:
I20260709 12:21:26.528348 25025 catalog_manager.cc:5697] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:26.529117 25267 rpcz_store.cc:276] 0709 12:21:25.083088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.119715 (+1036627us) service_pool.cc:224] Handling call
0709 12:21:26.155399 (+ 35684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:26.155811 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:26.155838 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:26.156431 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 12:21:26.310739 (+154308us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:26.310793 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.310881 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:26.528383 (+217502us) raft_consensus.cc:1685] finished
0709 12:21:26.528407 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:26.528560 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":146349,"threads_started":1,"wal-append.queue_time_us":356843}
I20260709 12:21:26.507979 30243 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:26.530949 30243 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:26.515193 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:26.535763 30243 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:26.537361 30243 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:26.537227 25825 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:26.493321 30106 consensus_queue.cc:1059] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:21:26.498461 25859 rpcz_store.cc:276] 0709 12:21:25.292657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.292815 (+   158us) service_pool.cc:224] Handling call
0709 12:21:25.293141 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:25.293483 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.293510 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:25.294004 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:21:26.025607 (+731603us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b180037f840. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae0d1 00007f2103ec9a0f
0709 12:21:26.250156 (+224549us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:26.250226 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.255371 (+  5145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:26.497298 (+241927us) raft_consensus.cc:1685] finished
0709 12:21:26.497328 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:26.497690 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11244,"raft.queue_time_us":3897,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4418,"spinlock_wait_cycles":8237312,"thread_start_us":185530,"threads_started":1,"wal-append.queue_time_us":1010357}
I20260709 12:21:26.543366 25198 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:21:26.545151 30182 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:21:26.545943 25241 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:26.547050 25241 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:26.548522 25241 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:26.549135 30222 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:26.549335 30133 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:26.549805 30133 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.549902 30222 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:26.550288 30133 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:26.552125 25858 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 12 index: 14. Preceding OpId from leader: term: 13 index: 14. (term mismatch)
I20260709 12:21:26.552486 25858 pending_rounds.cc:85] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 13
I20260709 12:21:26.552724 25858 pending_rounds.cc:107] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 12.14
I20260709 12:21:26.552948 25858 raft_consensus.cc:2889] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:26.554822 25853 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:26.559787 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2582) took 1682 ms. Trace:
I20260709 12:21:26.560240 25195 rpcz_store.cc:276] 0709 12:21:24.877277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.878663 (+  1386us) service_pool.cc:224] Handling call
0709 12:21:24.904603 (+ 25940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:26.078623 (+1174020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.557146 (+478523us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002db254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:26.559702 (+  2556us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2597363584}
W20260709 12:21:26.567483 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.567947 25118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 925) took 1701 ms (client timeout 2193 ms). Trace:
W20260709 12:21:26.568379 25118 rpcz_store.cc:269] 0709 12:21:24.866702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.309088 (+442386us) service_pool.cc:224] Handling call
0709 12:21:26.567601 (+1258513us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540009cc54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:26.567765 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524782976}
I20260709 12:21:26.570932 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2206) took 1020 ms. Trace:
I20260709 12:21:26.571493 25275 rpcz_store.cc:276] 0709 12:21:25.550415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.171362 (+620947us) service_pool.cc:224] Handling call
0709 12:21:26.200598 (+ 29236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:26.212115 (+ 11517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.570644 (+358529us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b540034e9d0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:26.570838 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54270848}
I20260709 12:21:26.580364 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2593) took 1062 ms. Trace:
I20260709 12:21:26.581161 25194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2591) took 1296 ms. Trace:
I20260709 12:21:26.581646 25194 rpcz_store.cc:276] 0709 12:21:25.284547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.514414 (+229867us) service_pool.cc:224] Handling call
0709 12:21:25.514757 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.754340 (+239583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.580920 (+826580us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54002da854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:26.581108 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545863552}
I20260709 12:21:26.580997 25196 rpcz_store.cc:276] 0709 12:21:25.518106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.539522 (+ 21416us) service_pool.cc:224] Handling call
0709 12:21:25.539884 (+   362us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:25.588446 (+ 48562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.588576 (+   130us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:21:25.620754 (+ 32178us) log.cc:844] Serialized 78 byte log entry
0709 12:21:26.016384 (+395630us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:26.022808 (+  6424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.022945 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:26.579387 (+556442us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b540045a4a0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e83dbe 00007f2103e8e930 00007f2103e8e8d8 00007f2103e8e858 00007f2103e8e813 00007f2103e8da9c 00007f2109d792f6 00007f2109d73aa8 00007f2103eca7cb 00007f2103ecd2c0
0709 12:21:26.579735 (+   348us) raft_consensus.cc:1685] finished
0709 12:21:26.579770 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:26.580119 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18965,"raft.queue_time_us":40613,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":13612,"spinlock_wait_cycles":10975744,"thread_start_us":111538,"threads_started":1,"wal-append.queue_time_us":115934}
I20260709 12:21:26.591352 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:26.595631 25242 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:26.597400 29950 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:26.597848 30269 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:26.598701 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:26.603469 29802 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.604408 30222 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:26.607823 30272 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:26.608616 30272 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:26.545239 29901 consensus_queue.cc:260] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.610940 29901 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:26.610960 25854 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:26.619175 25123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 921) took 1753 ms (client timeout 1716 ms). Trace:
W20260709 12:21:26.619748 25123 rpcz_store.cc:269] 0709 12:21:24.865356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.882199 (+ 16843us) service_pool.cc:224] Handling call
0709 12:21:26.618903 (+1736704us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540021e3d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:26.619085 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2995524992}
I20260709 12:21:26.623997 30143 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.626358 30214 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:26.627223 30214 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.631675 25200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 952) took 1554 ms. Trace:
I20260709 12:21:26.640040 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:26.644217 25241 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:26.645159 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 54369.8us
I20260709 12:21:26.632077 25200 rpcz_store.cc:276] 0709 12:21:25.076825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.505907 (+429082us) service_pool.cc:224] Handling call
0709 12:21:25.512307 (+  6400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.624351 (+112044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.631239 (+1006888us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b54000a7b54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:26.631512 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210773376}
I20260709 12:21:26.653520 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:26.654808 25241 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:26.659276 25199 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:26.671516 25859 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:26.660761 29984 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:26.683012 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:26.686122 30235 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.685943 30269 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:26.687595 30189 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:26.697836 25025 catalog_manager.cc:5697] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 5 to 6, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 6 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.703066 30264 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:26.703761 29895 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.703773 25090 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:26.753908 25120 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:26.706400 29803 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.710739 25276 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:21:26.711405 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:26.713528 25021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41756 (request call id 375) took 35117 ms (client timeout 15000 ms). Trace:
W20260709 12:21:26.714776 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 116151us
I20260709 12:21:26.671763 30222 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:26.728160 25852 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:26.731958 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:26.670256 30143 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:26.759104 25856 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:26.767303 25025 catalog_manager.cc:5697] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.773273 25242 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:26.753846 30120 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:26.776826 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:26.777642 25276 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 15: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:26.754370 30235 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.759351 29909 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:26.782114 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 78600.4us
W20260709 12:21:26.786664 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.787797 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.789211 25270 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:26.791908 29984 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:26.792517 29984 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:26.792214 30264 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.793629 29984 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.794507 30264 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.796754 30058 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:26.798343 25167 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:26.801648 30178 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:26.802446 25199 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:26.803574 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:26.803411 30067 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:26.806140 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:26.807801 30221 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:26.809307 30221 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:26.770569 29895 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.812084 25122 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:26.811831 25025 catalog_manager.cc:5697] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:26.817387 30120 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.813432 29895 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.781548 29803 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.820354 30120 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.821498 30133 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.779626 30118 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:21:26.823648 30133 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.829335 30235 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:26.835903 30260 log.cc:927] Time spent T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:21:26.840296 29909 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:26.847177 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 310243us
I20260709 12:21:26.809768 30221 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:26.802217 29997 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:21:26.893445 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.813548 25025 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:21:26.933364 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.940639 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:26.821720 29803 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:26.943397 30277 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:26.950133 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:26.941459 25193 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:26.941094 25025 catalog_manager.cc:5697] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:26.957019 30277 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:26.960440 30120 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:21:26.971782 25165 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:26.944188 30264 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.976378 30264 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:26.969882 30277 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:26.974016 25854 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:26.977852 29925 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:26.987859 25025 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 7 to 8, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 8 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:26.948340 30194 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:26.955463 30214 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:26.757985 25021 rpcz_store.cc:269] 0709 12:20:51.595615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.598200 (+  2585us) service_pool.cc:224] Handling call
0709 12:21:26.693996 (+35095796us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:16.943878 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:16.944826 (+   948us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:16.944897 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:21:16.944926 (+    29us) tablet.cc:662] Decoding operations
0709 12:21:17.008103 (+ 63177us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:17.050627 (+ 42524us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:17.052349 (+  1722us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:21:17.119192 (+ 66843us) tablet.cc:701] Row locks acquired
0709 12:21:17.119255 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:21:17.119468 (+   213us) write_op.cc:270] Start()
0709 12:21:17.119643 (+   175us) write_op.cc:276] Timestamp: P: 1783599677119400 usec, L: 0
0709 12:21:17.119665 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:17.120449 (+   784us) log.cc:844] Serialized 4372 byte log entry
0709 12:21:17.574703 (+454254us) op_driver.cc:464] REPLICATION: finished
0709 12:21:17.638737 (+ 64034us) write_op.cc:301] APPLY: starting
0709 12:21:17.645850 (+  7113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:17.781633 (+135783us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:17.781745 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:18.658779 (+877034us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:18.743387 (+ 84608us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:21:18.743432 (+    45us) write_op.cc:312] APPLY: finished
0709 12:21:18.743814 (+   382us) log.cc:844] Serialized 105 byte log entry
0709 12:21:18.856122 (+112308us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:18.879757 (+ 23635us) write_op.cc:454] Released schema lock
0709 12:21:18.902813 (+ 23056us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:18.976503 (+ 73690us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:18.979849 (+  3346us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1409028,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":10874,"apply.run_cpu_time_us":33516,"apply.run_wall_time_us":1334718,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50195,"num_ops":11,"prepare.queue_time_us":63205,"prepare.run_cpu_time_us":43877,"prepare.run_wall_time_us":384446,"raft.queue_time_us":120634,"raft.run_cpu_time_us":2621,"raft.run_wall_time_us":72981,"replication_time_us":432452,"thread_start_us":441882,"threads_started":5,"wal-append.queue_time_us":427797,"wal-append.run_cpu_time_us":41044,"wal-append.run_wall_time_us":2254449}]]}
I20260709 12:21:26.989413 30277 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:27.008877 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.991883 30194 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.015661 25854 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:27.017310 25856 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:21:27.014385 25025 catalog_manager.cc:5697] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 9 to 10, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 10 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:27.002126 30244 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:21:26.999639 30182 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:27.021955 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 88157.5us
I20260709 12:21:27.027282 25165 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:26.990258 30067 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:21:27.041999 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:27.042661 25856 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:21:27.017148 30120 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:27.002683 29895 consensus_queue.cc:1059] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:21:27.048390 30235 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:27.044154 30280 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.265s	user 0.002s	sys 0.004s
I20260709 12:21:27.016031 30194 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:27.001266 30221 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:27.017385 30243 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:21:27.046486 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:27.052791 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 118634us
I20260709 12:21:27.032169 30264 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:27.033030 29925 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:27.090912 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.095541 25267 raft_consensus.cc:2393] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 15: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:27.116331 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:27.091843 30235 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:21:27.106266 30133 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:21:27.115401 29802 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.094403 30214 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:21:27.127832 29802 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.088061 30120 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.131137 25267 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:21:27.131332 30164 consensus_meta.cc:287] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.670s	user 0.015s	sys 0.000s
I20260709 12:21:27.131811 30120 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:27.052634 30182 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.110894 30189 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.133083 30189 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.134760 30182 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:27.137745 30125 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:21:27.110802 30283 log.cc:927] Time spent T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 12:21:27.148869 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 375698us
W20260709 12:21:27.154724 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.162253 30125 consensus_queue.cc:1059] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:27.104228 30118 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:27.167200 30133 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.161561 30221 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:27.172956 29909 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:27.172857 30118 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:27.157830 25856 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:27.169543 30235 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:27.168105 30036 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:21:27.172215 29925 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.186414 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:27.189275 25241 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:27.172407 30133 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:27.205561 30106 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:27.185721 29925 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:27.244422 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 253421us
W20260709 12:21:27.257282 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 225920us
W20260709 12:21:27.263454 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 215160us
I20260709 12:21:27.213757 30106 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.084s
W20260709 12:21:27.293979 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 259087us
I20260709 12:21:27.294950 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:27.188803 30235 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.293239 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:27.301817 25859 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
W20260709 12:21:27.305506 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 116310us
I20260709 12:21:27.202603 30289 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 12:21:27.256927 29802 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:27.249985 30189 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:27.320094 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:27.296945 29909 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:27.324942 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.325004 25270 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 12:21:27.326237 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:27.327024 25852 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
W20260709 12:21:27.341868 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 43831.9us
I20260709 12:21:27.338639 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:27.348881 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:27.360427 25199 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:21:27.361436 25200 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:27.366170 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:27.334869 29984 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.325565 29895 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.329665 30189 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:27.367091 25196 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:27.356709 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:27.373517 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 78699.2us
I20260709 12:21:27.380825 25124 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:21:27.350575 29802 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:27.386576 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:27.385023 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.387362 25122 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:27.392488 29922 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.393155 29922 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:27.395898 29922 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:27.311349 30282 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 12:21:27.406111 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 105110us
I20260709 12:21:27.363005 30106 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:21:27.410108 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 103942us
I20260709 12:21:27.397514 29802 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.430287 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:27.433962 25273 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:27.428179 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:27.429204 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 135263us
I20260709 12:21:27.368517 29909 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.444710 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.445328 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:27.446597 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:27.429518 30118 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:27.438177 29802 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:27.461668 25118 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:27.475385 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:27.474565 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 75732.6us
I20260709 12:21:27.470009 25269 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:27.460563 30308 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.397634 29984 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.481705 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.467620 30289 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.481616 30189 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:27.489259 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.498356 29925 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:27.499744 30306 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:21:27.502228 30304 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.503223 30235 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:27.502926 30304 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.457609 29895 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.508047 29895 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:27.508613 29895 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:27.510113 30310 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:27.510632 25120 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:27.510854 30310 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.513535 30310 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:27.514249 30058 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:27.514722 30058 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:27.515571 30058 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.516822 30058 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:27.518451 30276 log.cc:927] Time spent T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.819s	user 0.008s	sys 0.000s
I20260709 12:21:27.520366 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:27.521965 25852 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:27.522397 25852 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:21:27.522471 30287 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.217s	user 0.001s	sys 0.001s
I20260709 12:21:27.523270 25852 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.524215 25852 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:27.526286 29909 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:27.528259 29984 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:27.485139 30133 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:27.530627 30289 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.489945 25124 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:27.505867 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:27.533529 25122 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:27.538689 25165 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:27.543069 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 57358.3us
I20260709 12:21:27.545957 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:27.547171 25124 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:21:27.549106 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:27.550256 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.552546 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:27.551549 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:27.556344 30106 raft_consensus.cc:697] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:27.562513 30106 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.564222 25860 raft_consensus.cc:2393] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:27.556761 25267 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:27.532265 30304 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:27.568197 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 144657us
I20260709 12:21:27.544601 29922 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:27.575350 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:27.576671 30289 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:27.581317 25242 leader_election.cc:336] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.546s (SENT)
I20260709 12:21:27.582446 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.565989 30311 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:27.592242 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:27.590165 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:27.595141 25122 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:27.595598 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:27.575380 30189 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.582913 30312 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:27.598774 30312 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:27.600497 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:27.591218 30282 consensus_queue.cc:1059] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:21:27.573474 29922 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.614845 25120 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:27.486805 30308 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:27.614979 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:27.628717 25857 raft_consensus.cc:3055] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:27.629318 25857 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:27.630460 29803 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:27.632942 25857 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.631053 25090 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:27.631871 30289 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.634864 30289 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:27.635473 30277 raft_consensus.cc:3055] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:27.635876 30277 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:27.636749 30277 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.637207 30289 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:27.636813 25857 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:27.642740 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.646581 30214 raft_consensus.cc:3055] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:27.648167 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.648481 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.649225 25125 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:27.646888 25090 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:27.649956 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.653815 25275 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:21:27.605518 29802 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.654984 25118 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:21:27.657101 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.658939 25852 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:21:27.659991 25852 pending_rounds.cc:85] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 9
I20260709 12:21:27.660840 25852 pending_rounds.cc:107] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:21:27.661582 25852 raft_consensus.cc:2889] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:27.662686 25852 pending_rounds.cc:107] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:21:27.663443 25852 raft_consensus.cc:2889] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:27.665143 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:27.664414 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 83143us
I20260709 12:21:27.669312 25198 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:27.669534 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:27.615996 29922 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:27.631001 29803 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:27.638166 30277 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:27.705803 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.706585 25125 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:27.706601 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:27.707664 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 48895.4us
I20260709 12:21:27.647046 30214 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:27.707350 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:27.712129 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:27.713932 25119 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:27.714184 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 137104us
I20260709 12:21:27.718194 30298 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:27.718469 30308 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:27.718987 30305 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:27.719748 30293 consensus_queue.cc:1059] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.165s
I20260709 12:21:27.720531 30316 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:21:27.722906 30214 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.671927 30289 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:27.703773 30304 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:27.724043 30214 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:27.746174 25168 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:27.620612 30311 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:27.714846 30189 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:27.754778 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:27.761389 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 94599.2us
W20260709 12:21:27.763548 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 56813.3us
I20260709 12:21:27.741295 30307 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:27.774703 25090 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:27.772487 25127 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:27.776306 25168 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:27.777570 25168 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:27.760519 30189 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.785693 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.739404 30289 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:27.772383 30307 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:27.751628 30304 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:27.782411 30182 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:21:27.789465 30221 consensus_meta.cc:287] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.616s	user 0.006s	sys 0.009s
I20260709 12:21:27.781136 30243 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:27.768739 30293 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:21:27.803925 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.788285 30189 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:27.775244 29909 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:21:27.768162 29803 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:27.807582 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 68698.2us
I20260709 12:21:27.808776 25124 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:27.800906 30307 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:27.804257 30182 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.798271 30310 raft_consensus.cc:3055] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:27.807853 30074 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:27.806202 30319 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:21:27.833884 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.838809 25857 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:21:27.839432 25857 pending_rounds.cc:85] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 10
I20260709 12:21:27.839646 25857 pending_rounds.cc:107] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:21:27.839897 25857 raft_consensus.cc:2889] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:27.832113 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.838696 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.842338 25119 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
W20260709 12:21:27.843344 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.822526 30182 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:27.844852 25122 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
W20260709 12:21:27.832381 30328 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:27.819283 29803 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:27.823544 30310 raft_consensus.cc:740] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:27.845868 30334 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:27.851193 30304 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:27.852211 29802 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:27.853184 30311 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:27.864719 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:27.876346 30194 consensus_meta.cc:287] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.787s	user 0.009s	sys 0.004s
I20260709 12:21:27.883867 25857 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:27.882330 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 54177.3us
I20260709 12:21:27.888767 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:27.878470 30272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.179s	user 0.012s	sys 0.015s
I20260709 12:21:27.863945 30305 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.889539 25126 raft_consensus.cc:2376] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10. Re-sending same reply.
I20260709 12:21:27.831852 30297 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:21:27.898222 29922 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:27.899230 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.903303 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:27.912074 30324 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:21:27.913189 29922 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:27.892670 30194 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:27.913728 30329 log.cc:927] Time spent T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:21:27.914059 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:27.909917 30297 consensus_queue.cc:1243] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:27.915434 30194 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:27.916600 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.884284 30334 raft_consensus.cc:697] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:27.911957 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.933646 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:27.901505 30300 log.cc:927] Time spent T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
W20260709 12:21:27.909085 30272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.196s	user 0.013s	sys 0.015s
I20260709 12:21:27.877004 30335 consensus_queue.cc:1059] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:21:27.903366 30319 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:21:27.938669 30289 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:27.940378 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:27.957515 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:27.943887 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:27.948822 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:27.949456 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:27.952162 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:27.903581 30323 raft_consensus.cc:2764] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 12:21:27.943243 30271 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 12:21:27.994554 30333 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:21:27.995415 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:27.994879 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:28.009380 25123 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:21:27.997390 25275 raft_consensus.cc:2393] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 10: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:28.000977 25857 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
W20260709 12:21:28.007311 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 51380.3us
I20260709 12:21:28.017053 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:28.014779 25272 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
W20260709 12:21:27.957202 25825 connection.cc:256] RPC call timeout handler was delayed by -2.3128357919999871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
I20260709 12:21:28.018936 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:28.020193 25269 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 13: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:28.028578 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:28.029361 25197 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:28.031874 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:28.031157 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:28.032501 25202 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
W20260709 12:21:28.042326 25825 connection.cc:256] RPC call timeout handler was delayed by -2.15533579199996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 12:21:28.120090 25825 connection.cc:256] RPC call timeout handler was delayed by -2.0437357920000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260709 12:21:28.120837 25825 connection.cc:256] RPC call timeout handler was delayed by -1.8835357919999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260709 12:21:28.121265 25825 connection.cc:256] RPC call timeout handler was delayed by -1.8547357919999286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
I20260709 12:21:28.112035 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:28.015465 30058 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:28.166740 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 82052.2us
I20260709 12:21:28.030313 30334 consensus_queue.cc:237] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:28.121623 25825 connection.cc:256] RPC call timeout handler was delayed by -1.4615926320000199s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 12:21:28.144238 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:28.163292 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1334) took 1140 ms. Trace:
I20260709 12:21:28.144021 30313 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.280807 25195 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:28.114102 30271 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.038764 29909 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:28.166551 30332 log.cc:927] Time spent T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 12:21:28.293828 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:28.167021 30292 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:28.167812 30321 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:21:28.159384 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:28.120679 30333 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:21:27.937251 30305 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:28.167469 30340 log.cc:927] Time spent T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:21:27.958248 30310 consensus_queue.cc:260] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.299243 25269 raft_consensus.cc:2393] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 14: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:28.299175 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:28.274349 30269 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.302073 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:28.304073 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:28.288746 30336 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.313233 25272 raft_consensus.cc:1217] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 8.4->[9.5-12.7]   Dedup: 9.5->[10.6-12.7]
I20260709 12:21:28.313906 25272 pending_rounds.cc:85] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 5
I20260709 12:21:28.314250 25272 pending_rounds.cc:107] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:21:28.314560 25272 raft_consensus.cc:2889] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:28.304908 30271 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.329700 25274 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:28.332007 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:28.333390 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:28.298476 30293 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:28.284480 30058 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.288805 30313 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:28.343743 25858 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:28.311977 30297 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:28.352212 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.353628 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:28.358596 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:28.305186 30292 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:28.361713 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.299011 29909 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:28.353963 30243 consensus_meta.cc:287] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 12:21:28.366995 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:28.280676 25854 rpcz_store.cc:276] 0709 12:21:27.023286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.024983 (+  1697us) service_pool.cc:224] Handling call
0709 12:21:27.034223 (+  9240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:27.050805 (+ 16582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:27.050862 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:27.109065 (+ 58203us) log.cc:844] Serialized 26 byte log entry
0709 12:21:27.321542 (+212477us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:27.321586 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.321657 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:27.900782 (+579125us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:28.135577 (+234795us) raft_consensus.cc:1685] finished
0709 12:21:28.135607 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.163197 (+ 27590us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11242,"raft.queue_time_us":5363,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"spinlock_wait_cycles":65401216,"thread_start_us":199795,"threads_started":1,"wal-append.queue_time_us":359941}
I20260709 12:21:28.328015 30336 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.368261 25093 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:28.325650 30269 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:28.368891 30345 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:21:28.382284 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2622) took 1059 ms. Trace:
I20260709 12:21:28.366581 29922 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.346938 30293 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.401262 30313 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:28.403331 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.389472 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:28.391175 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:28.388113 25193 rpcz_store.cc:276] 0709 12:21:27.322408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.322587 (+   179us) service_pool.cc:224] Handling call
0709 12:21:27.323036 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:27.355608 (+ 32572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:27.355653 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:27.410419 (+ 54766us) log.cc:844] Serialized 26 byte log entry
0709 12:21:27.528955 (+118536us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4800061ed8. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2108e37aa1 00007f2108e2eb37 00007f2108e2e9ca 00007f2108f2626f 00007f2108f25f37 00007f2108f3a55c 00007f2108f3a508 00007f2108f3a488 00007f2108f3a443 00007f2108f396ec 00007f2107e63a96
0709 12:21:27.543614 (+ 14659us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:27.543680 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.543774 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:28.374054 (+830280us) raft_consensus.cc:1685] finished
0709 12:21:28.374079 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.382203 (+  8124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15832,"raft.queue_time_us":38462,"raft.run_cpu_time_us":2476,"raft.run_wall_time_us":156470,"spinlock_wait_cycles":8985984,"thread_start_us":97730,"threads_started":1,"wal-append.queue_time_us":241723}
I20260709 12:21:28.410632 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:28.373065 30243 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:28.412176 25195 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:28.372277 30125 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:28.442482 25196 raft_consensus.cc:2368] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 14. Current term is 15.
I20260709 12:21:28.381682 29803 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:28.358585 30297 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:28.454411 25195 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 12:21:28.462064 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:28.462960 25270 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:28.412966 29922 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.467928 25201 raft_consensus.cc:2410] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:28.488090 29909 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:28.489832 29922 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:28.492511 25193 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:28.495247 30292 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:28.507479 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:28.508456 30350 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:21:28.451328 30125 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:28.539341 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:28.553516 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:28.548564 30345 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 12:21:28.554708 30339 log.cc:927] Time spent T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.424s	user 0.006s	sys 0.000s
W20260709 12:21:28.556023 30302 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 1.057s	user 0.000s	sys 0.008s
I20260709 12:21:28.472564 30120 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:28.557397 30120 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.557999 30120 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:28.558512 25851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1337) took 1421 ms. Trace:
I20260709 12:21:28.559054 25851 rpcz_store.cc:276] 0709 12:21:27.137558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.140312 (+  2754us) service_pool.cc:224] Handling call
0709 12:21:27.140776 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:27.141295 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:27.141338 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:27.141964 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 12:21:27.310225 (+168261us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:27.310296 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.310397 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:28.508244 (+1197847us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:28.558109 (+ 49865us) raft_consensus.cc:1685] finished
0709 12:21:28.558142 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.558430 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4750,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"spinlock_wait_cycles":75831680,"thread_start_us":167744,"threads_started":1,"wal-append.queue_time_us":315744}
I20260709 12:21:28.469493 30289 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:28.540092 25195 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 12:21:28.562788 30058 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:28.470558 30311 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:28.472406 29803 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.567756 30297 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:28.569283 29803 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:28.574110 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:28.575021 25269 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:28.576403 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:28.577100 25269 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:28.583124 25268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2222) took 1209 ms. Trace:
I20260709 12:21:28.540958 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:28.550386 25202 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:28.442557 30296 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:21:28.539824 30285 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:28.545583 25274 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:28.607779 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:28.591194 25123 consensus_meta.cc:287] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.006s
I20260709 12:21:28.608691 25269 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:28.608783 25123 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:28.583542 25268 rpcz_store.cc:276] 0709 12:21:27.373818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.382553 (+  8735us) service_pool.cc:224] Handling call
0709 12:21:27.411350 (+ 28797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:27.527288 (+115938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:27.527320 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:27.527795 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:21:27.671261 (+143466us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:27.671312 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.582724 (+911412us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400123754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:28.582768 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:28.582810 (+    42us) raft_consensus.cc:1685] finished
0709 12:21:28.582823 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.583060 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48,"raft.queue_time_us":1627,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":265629440,"thread_start_us":92976,"threads_started":1,"wal-append.queue_time_us":242018}
W20260709 12:21:28.596549 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 263211us
I20260709 12:21:28.565713 30271 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:28.584393 30125 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:28.586988 30325 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.874s	user 0.004s	sys 0.000s
W20260709 12:21:28.606779 30352 log.cc:927] Time spent T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.230s	user 0.003s	sys 0.000s
W20260709 12:21:28.615057 30307 consensus_meta.cc:287] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.789s	user 0.008s	sys 0.003s
I20260709 12:21:28.634235 25271 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:21:28.623024 30214 consensus_meta.cc:287] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.882s	user 0.013s	sys 0.000s
I20260709 12:21:28.561766 30289 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:28.643448 30189 consensus_meta.cc:287] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.825s	user 0.012s	sys 0.000s
I20260709 12:21:28.643921 30189 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:28.640338 30182 consensus_meta.cc:287] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.759s	user 0.010s	sys 0.002s
I20260709 12:21:28.647092 30182 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:28.649250 30182 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:28.651247 30289 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:28.632489 30292 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.652124 25273 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 12:21:28.662667 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 280536us
W20260709 12:21:28.660889 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 162964us
I20260709 12:21:28.635105 29727 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:28.623054 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 254062us
I20260709 12:21:28.671353 25270 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:28.668318 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:28.646013 30189 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:28.671790 30295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.165s	user 0.006s	sys 0.010s
I20260709 12:21:28.663967 30289 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.686116 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:28.636845 30307 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:28.686666 30295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.007s	sys 0.010s
I20260709 12:21:28.694964 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:28.696568 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.693114 29997 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.698467 29997 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.693389 29909 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.700217 30307 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:28.700819 30307 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.701048 30363 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:28.695158 30221 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:28.702090 25276 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:28.672842 29727 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.696189 30289 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.666320 30292 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.701277 30307 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:28.700242 29909 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.711426 30189 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:28.678372 30214 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:28.712149 30189 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:28.712641 30214 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.713021 30214 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:28.715085 30293 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:28.719058 25825 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:28.720059 30074 consensus_meta.cc:287] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.880s	user 0.009s	sys 0.004s
I20260709 12:21:28.719976 30370 raft_consensus.cc:2764] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:21:28.720655 30074 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:28.721704 25198 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:21:28.759610 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.761351 30310 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:28.765434 30316 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.766006 30316 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:28.815616 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.818524 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:28.840277 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 401781us
I20260709 12:21:28.857806 30106 raft_consensus.cc:3055] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:28.858372 30106 raft_consensus.cc:740] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:28.864753 30269 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:28.866521 30305 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:28.861835 30336 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:28.885962 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:28.886746 25127 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:28.866111 30106 consensus_queue.cc:260] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:28.913508 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 227518us
I20260709 12:21:28.915270 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:28.923095 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 204054us
I20260709 12:21:28.917462 25165 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:28.924374 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 218802us
I20260709 12:21:28.927421 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:28.928393 25851 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:28.937119 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:28.939201 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:28.940047 25857 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:28.918378 30106 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:28.938134 25858 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:28.960932 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:28.962793 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:28.963455 25127 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:28.926905 30074 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:28.966231 25167 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:28.967223 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 49862.9us
W20260709 12:21:28.968462 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 294158us
I20260709 12:21:28.973551 25090 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:28.970082 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:28.974576 25167 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:28.975744 25167 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:28.987085 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.004135 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:28.970479 30067 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:29.009539 30364 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:29.019896 30364 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:29.020284 30364 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:29.022636 30323 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.023183 30323 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:29.023897 25242 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:29.025394 25092 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:28.988662 30221 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:29.026398 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.009712 30189 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:29.028570 30189 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:28.979074 30341 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:28.986557 30313 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:29.031915 30313 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.032281 30313 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:29.033335 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 55015.4us
I20260709 12:21:29.015467 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:29.035161 25124 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:29.016302 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:29.015997 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:29.037199 25009 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1f471cfad2348a09c4b699f01f9dfa9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2e30bdd4cd1b45299f50b9bcfc9c1667 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:29.018249 30289 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:29.026439 30221 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:29.040926 30221 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:29.042467 30307 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:29.042752 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:29.042922 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:29.043193 30369 log.cc:927] Time spent T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:21:29.044442 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:29.045285 30074 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:29.045749 30074 raft_consensus.cc:697] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:29.046633 30074 consensus_queue.cc:237] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:29.046953 30272 consensus_queue.cc:1059] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:29.012125 30378 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:29.013008 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:29.049932 30272 raft_consensus.cc:3055] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:29.050371 25125 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:29.050506 30272 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:29.010617 30067 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:29.051590 30366 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:21:28.978224 30243 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:29.053239 30243 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.051678 30272 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:28.984762 30319 consensus_queue.cc:1059] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:21:28.972316 30305 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:21:29.054803 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:29.055418 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:29.019305 30316 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:29.055305 30269 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:29.048695 29909 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:29.048218 30375 log.cc:927] Time spent T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:29.053576 30243 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:29.061805 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:29.061980 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:29.062671 25855 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:29.062856 25856 raft_consensus.cc:2410] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:29.064231 25857 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:21:29.051824 30067 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:29.067250 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:29.068974 29895 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:29.068725 30297 consensus_queue.cc:1059] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:29.070739 30297 raft_consensus.cc:3055] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:29.071175 30297 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:29.073390 29803 raft_consensus.cc:3055] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:29.073892 29803 raft_consensus.cc:740] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:29.075102 29803 consensus_queue.cc:260] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:29.076814 30341 raft_consensus.cc:697] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:29.077986 30341 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:29.010334 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 49534.1us
I20260709 12:21:29.084937 30327 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:29.087095 25273 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:29.088769 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:29.089713 25273 raft_consensus.cc:2393] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 14: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:21:29.091758 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.094614 25093 leader_election.cc:400] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 14. Current term is 15.
I20260709 12:21:29.094990 25093 leader_election.cc:403] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:29.095173 25858 raft_consensus.cc:2410] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:21:29.095518 30319 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 14. Current term is 15.
I20260709 12:21:29.099609 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:29.104563 30272 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:29.106197 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 82425.4us
I20260709 12:21:29.107100 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:29.107913 30316 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:29.108376 30316 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:29.108793 30316 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:29.116672 30243 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:29.118134 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 72420.1us
I20260709 12:21:29.119735 25168 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:29.120224 30125 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:29.121021 29909 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:29.121412 29909 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.121778 29909 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:29.122130 30370 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.122800 30370 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:29.124327 30120 consensus_meta.cc:287] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.566s	user 0.019s	sys 0.001s
W20260709 12:21:29.126189 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 100885us
W20260709 12:21:29.132647 25825 connection.cc:256] RPC call timeout handler was delayed by -1.1086352089998854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28350000000000003s for a response
I20260709 12:21:29.161372 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:29.162781 25272 raft_consensus.cc:2410] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:21:29.170936 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:29.187049 29727 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:29.187361 29997 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:29.189383 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:29.189553 30327 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:29.190335 25853 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:29.192981 25167 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:29.189476 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:29.171909 25860 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:29.129554 30336 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:29.072237 30297 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:29.203411 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 48668.3us
I20260709 12:21:29.211117 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:29.211377 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:29.211970 25200 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:29.213300 29727 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:29.161360 29803 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:29.218557 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.219646 25241 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:29.213795 29727 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.124752 30120 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:29.234197 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:29.116695 30316 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:29.246137 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.238323 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:29.241760 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:29.247356 25272 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:29.237244 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:29.243259 25241 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:29.248273 25275 raft_consensus.cc:2410] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:21:29.215040 29950 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:29.247391 25201 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:29.244263 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:29.250838 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:29.257824 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:29.260082 25202 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:29.235481 29727 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:29.262634 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:29.264554 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 109925us
I20260709 12:21:29.264909 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:29.265029 25195 raft_consensus.cc:2393] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:29.237891 30125 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:29.265776 25268 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:29.237936 30376 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:29.266856 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:29.240728 30292 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:29.267302 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.280772 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:29.281797 25195 raft_consensus.cc:2410] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:29.266644 25854 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
W20260709 12:21:29.273535 30214 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.560s	user 0.000s	sys 0.018s
I20260709 12:21:29.261281 30269 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:29.263948 30297 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:29.260847 30323 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:29.275087 25200 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:29.279443 25268 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:29.261698 29950 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:29.252732 30372 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:29.257153 30310 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:21:29.259790 30307 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:21:29.298254 30269 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.336637 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:29.298530 30309 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.301796 30372 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.351493 25860 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:29.283545 30376 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:29.366531 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:29.367776 25858 raft_consensus.cc:2410] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:21:29.369602 30383 log.cc:927] Time spent T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:21:29.298153 30214 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:29.379765 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:29.380585 25860 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:29.381453 25268 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:29.350358 30269 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:29.390525 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 187205us
I20260709 12:21:29.361186 30372 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:29.394413 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 172018us
I20260709 12:21:29.374933 30243 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:29.415551 25093 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:29.420277 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:29.425681 30386 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:29.426297 30386 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:29.426555 30364 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:29.428501 30386 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:29.429081 25825 leader_election.cc:336] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.813s (SENT)
W20260709 12:21:29.430105 25825 leader_election.cc:336] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.961s (SENT)
I20260709 12:21:29.413403 30348 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:21:29.393116 25274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:29.433655 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:29.433837 25197 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:29.433578 30358 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:29.430542 25825 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:29.454160 25860 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:29.363407 30309 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:29.478893 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 54568.8us
I20260709 12:21:29.481328 25093 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:29.491009 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 316445us
W20260709 12:21:29.494323 25242 leader_election.cc:336] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.943s (SENT)
I20260709 12:21:29.499307 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:29.500144 25168 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:29.416402 30120 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:29.390700 30178 consensus_queue.cc:1059] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
W20260709 12:21:29.520641 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 126116us
I20260709 12:21:29.521759 25092 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:29.523358 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 93297.3us
I20260709 12:21:29.491508 30386 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:29.502470 30243 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.508652 30074 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:29.498438 30298 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:29.551712 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.544919 25125 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:29.459286 30313 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:29.529394 30316 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:29.560505 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:29.562925 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 68646.9us
I20260709 12:21:29.551136 30074 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:29.559511 25825 leader_election.cc:336] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.120s (SENT)
I20260709 12:21:29.565110 25125 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:29.566972 25168 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:29.549021 30289 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:29.556176 25092 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:29.566828 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:29.568370 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:29.564182 25242 leader_election.cc:336] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.041s (SENT)
I20260709 12:21:29.555760 30120 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:29.569303 25242 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:29.575255 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:29.578086 30316 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:29.551177 30243 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:29.569365 30074 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:29.589143 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 160912us
I20260709 12:21:29.591531 25092 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:29.592954 30382 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 12:21:29.593241 25825 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.186s (SENT)
I20260709 12:21:29.593746 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:29.593991 30214 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:29.594547 30336 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:29.595691 25825 leader_election.cc:336] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.190s (SENT)
I20260709 12:21:29.596088 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:29.597381 30376 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:29.597718 30336 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:29.604532 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:29.579666 30314 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:29.564720 29727 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:29.581285 30272 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:29.586267 30298 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:29.628211 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 63948.9us
W20260709 12:21:29.629482 25242 leader_election.cc:336] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.060s (SENT)
I20260709 12:21:29.587857 29950 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:29.633780 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:29.631909 25202 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:29.633203 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:29.663506 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 123902us
I20260709 12:21:29.622916 30386 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:29.669901 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 74241.1us
I20260709 12:21:29.671816 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:29.630846 30120 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:29.640544 25269 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 12:21:29.675101 25120 raft_consensus.cc:1240] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:29.679720 25125 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:29.685710 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:29.688501 25860 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:29.666222 30391 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:29.694195 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:29.637796 30323 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:21:29.700546 25274 raft_consensus.cc:606] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:29.702642 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 73203.2us
I20260709 12:21:29.702863 25124 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:29.706379 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:29.707029 25825 leader_election.cc:336] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 2.195s (SENT)
I20260709 12:21:29.707480 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:29.710551 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:29.711292 25120 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:29.716845 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:29.717494 25125 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:29.682528 30309 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:29.722154 25242 leader_election.cc:336] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.527s (SENT)
I20260709 12:21:29.730234 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:29.731096 25125 raft_consensus.cc:2410] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:21:29.732360 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:29.733125 30313 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:29.739125 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.739780 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:29.719396 30327 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:21:29.745733 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.732087 30384 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 12:21:29.729796 29909 consensus_meta.cc:287] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.000s
I20260709 12:21:29.765277 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:29.765734 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:29.691540 30386 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:29.781018 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:29.763342 30272 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:29.784591 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:29.785858 25120 raft_consensus.cc:2410] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 15 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:21:29.787703 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:29.773754 30387 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:21:29.791796 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:29.768520 30189 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:29.771929 30277 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:29.793502 25120 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 13: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:29.778141 30243 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:29.804503 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 72196.8us
I20260709 12:21:29.775804 30370 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:29.768450 29909 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:29.806565 25242 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:29.809610 30269 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:29.819613 30397 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:21:29.823213 30401 log.cc:927] Time spent T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.245s	user 0.003s	sys 0.000s
I20260709 12:21:29.839208 25123 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:21:29.840766 30403 log.cc:927] Time spent T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 12:21:29.841696 30402 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 12:21:29.842211 30297 consensus_meta.cc:287] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.004s
I20260709 12:21:29.842960 30368 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:29.794831 30272 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:29.829476 30393 log.cc:927] Time spent T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:21:29.832273 25241 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:29.836392 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:29.802649 29727 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:29.829200 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:29.863517 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:29.856400 25118 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:21:29.857769 30272 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:29.843019 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:29.859112 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.873347 25127 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:29.872450 25120 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:29.858389 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:29.882584 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:29.883308 25860 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:29.887115 25199 raft_consensus.cc:2368] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 15. Current term is 16.
I20260709 12:21:29.887825 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:29.858632 30370 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 12:21:29.845971 29803 consensus_meta.cc:287] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.622s	user 0.004s	sys 0.004s
W20260709 12:21:29.849046 30067 consensus_meta.cc:287] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.783s	user 0.011s	sys 0.000s
W20260709 12:21:29.897181 25242 leader_election.cc:336] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.678s (SENT)
I20260709 12:21:29.897835 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:29.899211 25860 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:29.871436 30368 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:29.850883 30269 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:29.907356 25120 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:29.848984 29925 raft_consensus.cc:3055] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:29.909039 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:29.888449 30289 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:29.911772 25123 raft_consensus.cc:2376] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13. Re-sending same reply.
I20260709 12:21:29.922367 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:29.910610 30106 consensus_meta.cc:287] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.942s	user 0.014s	sys 0.000s
I20260709 12:21:29.908540 30368 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.944761 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:29.950454 25268 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:29.944931 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:29.952181 25276 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:29.945513 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:29.947134 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:29.954767 25123 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:29.911026 30409 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.915501 30305 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:29.942068 30277 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:21:29.958892 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 57979.8us
I20260709 12:21:29.913355 29925 raft_consensus.cc:740] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:29.906297 30067 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:29.951745 30368 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:29.943421 30364 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:29.958596 30189 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:29.982196 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 85073.7us
I20260709 12:21:29.976869 25241 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:29.944041 30392 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:21:29.985615 25195 raft_consensus.cc:2393] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 14: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:29.980145 29909 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:29.988831 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.990773 25276 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
I20260709 12:21:29.975732 30305 raft_consensus.cc:697] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:29.996985 30272 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:29.999051 30272 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:29.999818 30067 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:30.001081 30386 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:29.963435 30409 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.001178 30272 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:30.003958 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:30.007861 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:30.011754 25276 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:30.019367 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.020941 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.021981 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.023083 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:30.023206 30074 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:30.025157 30372 consensus_meta.cc:287] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 12:21:30.025574 30372 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.025965 30074 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:30.027199 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.029465 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.034482 25118 raft_consensus.cc:2393] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 15: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:30.036412 25275 raft_consensus.cc:2393] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:30.038341 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:30.040014 25118 raft_consensus.cc:2410] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:21:30.042054 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:30.042876 25118 raft_consensus.cc:2376] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13. Re-sending same reply.
I20260709 12:21:30.050148 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.051185 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.051759 25118 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:30.052551 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.053117 25118 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:30.055825 30409 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:30.015209 30305 consensus_queue.cc:237] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.034250 30277 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.062711 30368 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.065152 30368 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:30.099146 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 518572us
I20260709 12:21:30.100579 30314 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:30.101395 30178 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:30.101616 30314 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.101956 30178 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.104015 30178 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:30.109414 30372 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:30.109488 25168 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:30.134207 30313 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:30.134853 30313 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.136039 29909 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:30.137202 30313 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:30.115096 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.137835 30313 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:30.154973 30313 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.157606 25196 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:30.158298 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:30.159103 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:30.159765 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:30.162724 25202 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:30.161929 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:30.168843 25197 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:30.177567 30313 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:30.187105 30067 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:30.187866 30067 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.190586 30067 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:30.191193 30067 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:30.193562 30067 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.209056 30067 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:30.202644 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:30.244576 25202 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:30.245431 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:30.246178 25272 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:30.247006 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:30.247589 25196 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:30.247988 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.203338 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:30.206281 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:30.249192 25201 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:30.252454 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:30.252753 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:30.253314 25858 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:30.254122 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:30.254673 25859 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:30.254911 25202 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:30.256403 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:30.256541 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:30.256920 25851 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:21:30.257166 25199 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:21:30.259033 25090 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:30.213861 30269 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:30.259747 30269 raft_consensus.cc:697] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:30.259644 29925 consensus_queue.cc:260] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.260759 29925 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:30.260787 30269 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:30.217783 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 223727us
I20260709 12:21:30.262717 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:30.263336 25854 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:21:30.263242 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:30.264608 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:30.265831 30189 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:30.266492 30189 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:30.218401 30376 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:30.269928 25242 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:30.272455 30425 raft_consensus.cc:993] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:30.272826 30426 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:30.272994 30425 raft_consensus.cc:1081] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:30.273285 30426 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:30.213012 30074 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:30.233472 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:30.274900 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:30.275942 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:30.276587 25276 raft_consensus.cc:2393] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 16: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:30.276947 25860 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:30.277256 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:30.277741 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:30.279500 25242 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:30.280006 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:30.280462 30424 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:30.280619 25860 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:30.287261 25201 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
W20260709 12:21:30.229988 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 211451us
I20260709 12:21:30.235713 25268 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:21:30.192440 30313 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:30.240392 30305 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:30.296839 30305 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.237416 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:30.299368 30305 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:30.241911 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:30.301477 25270 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:21:30.240917 30307 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:30.302189 30307 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.304351 30307 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:30.255746 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:30.258898 30392 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:30.306003 30313 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.273726 30426 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:30.305496 25267 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 13: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:30.668476 30334 consensus_queue.cc:1059] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:30.669413 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:30.670136 25267 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:30.674446 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:30.675081 25202 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:30.234706 25269 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:29.949702 25127 raft_consensus.cc:2376] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15. Re-sending same reply.
I20260709 12:21:30.686492 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.687743 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.688755 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:30.689231 25127 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:30.248562 25126 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
W20260709 12:21:30.334101 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 75146.7us
I20260709 12:21:30.691119 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.692204 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:30.692675 25126 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:30.338065 30424 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:30.694265 30392 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:30.695169 25118 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:21:30.695637 30392 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:30.340095 30426 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.328589 25851 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:30.323745 25858 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:30.327054 25859 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:30.322505 30313 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:30.333662 30214 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:30.859048 30214 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:30.860005 30214 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.364761 25124 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:30.453510 25125 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:30.454589 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:30.237804 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.864215 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:30.457437 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.864776 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:30.458179 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:30.463065 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 183633us
I20260709 12:21:30.865517 25120 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:30.866398 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:30.473006 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.487442 30419 raft_consensus.cc:3055] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:30.505090 30125 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:30.525192 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:30.872735 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:30.537640 30374 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.540899 25165 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:30.873999 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:30.565482 25854 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:30.615980 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2648) took 1280 ms. Trace:
I20260709 12:21:30.617183 25272 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:30.628041 25270 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:30.874671 25195 rpcz_store.cc:276] 0709 12:21:29.335579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.336355 (+   776us) service_pool.cc:224] Handling call
0709 12:21:30.615778 (+1279423us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b540016dad4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:30.615916 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478885632}
I20260709 12:21:30.631732 25194 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
W20260709 12:21:30.638954 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.875931 25273 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:21:30.660506 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:30.699275 30426 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:30.699888 25271 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: []
W20260709 12:21:30.878814 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 337969us
I20260709 12:21:30.669445 30334 raft_consensus.cc:3055] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:30.716830 25167 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:30.717135 25202 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:21:30.719368 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:30.880493 25196 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:21:30.721138 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.726840 30120 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.734611 25198 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:30.879786 25165 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:30.736934 25267 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:30.744509 25127 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:30.746718 25197 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:21:30.751724 25123 consensus_meta.cc:287] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.796s	user 0.012s	sys 0.000s
I20260709 12:21:30.756877 30319 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:30.884891 30426 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:30.885285 30319 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:30.885946 25200 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 12:21:30.886205 30319 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.887234 30319 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:30.887050 30120 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.882411 30334 raft_consensus.cc:740] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:30.765703 30394 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.765702 30425 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:30.767140 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2247) took 1163 ms. Trace:
I20260709 12:21:30.893319 25275 rpcz_store.cc:276] 0709 12:21:29.604044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.604189 (+   145us) service_pool.cc:224] Handling call
0709 12:21:30.766905 (+1162716us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b5400299d54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:30.767077 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978295680}
I20260709 12:21:30.780812 25126 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:30.872359 30370 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.788136 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:30.809338 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:30.894615 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:30.895063 25118 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:30.817946 29895 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:30.819895 30408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.010s	sys 0.013s
W20260709 12:21:30.837190 30314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.001s	sys 0.014s
I20260709 12:21:30.884059 30313 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:30.865048 25851 raft_consensus.cc:2410] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:30.869120 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:30.869881 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:30.870123 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:30.877282 25122 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:30.883849 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.910778 25127 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:30.878348 30125 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.882428 30374 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:30.883123 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 166392us
I20260709 12:21:30.888948 25168 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:30.890589 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:30.883872 25123 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:30.915045 25167 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:30.872462 30421 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.870741 30269 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:30.895550 25854 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 13: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:30.871238 30419 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:30.922331 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:30.922645 30244 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:30.923099 25859 raft_consensus.cc:2393] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 8: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:30.923161 30244 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 16 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:30.924063 30244 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.925408 25857 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:30.897029 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.926162 30421 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.916465 30297 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:30.927935 30297 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.928299 30421 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:30.928846 30421 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:30.929280 30421 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.930944 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:30.931059 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:30.931707 30125 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:30.932047 25267 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:30.932243 30125 consensus_queue.cc:1059] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:30.933990 25822 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:30.896961 30370 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.936316 30370 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:30.936673 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 46141.2us
I20260709 12:21:30.936862 30370 raft_consensus.cc:3055] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:30.937314 30370 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:30.899677 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:30.898258 30425 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.938237 30434 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:30.856388 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48124 (request call id 5) took 1474 ms. Trace:
I20260709 12:21:30.938673 30434 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:30.895859 30394 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.886205 29925 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:30.900307 30408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.011s	sys 0.014s
W20260709 12:21:30.906169 30314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.001s	sys 0.019s
I20260709 12:21:30.906428 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:31.079523 25120 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:30.897979 29895 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:30.914811 25168 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:31.080806 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 166060us
I20260709 12:21:31.081485 25168 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:31.083190 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:30.917922 30363 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:30.888552 30334 consensus_queue.cc:260] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.919695 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:31.086655 25860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:21:31.087333 25860 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:31.087677 25860 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:31.089051 25025 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33480 (request call id 271) took 29406 ms (client timeout 15000 ms). Trace:
I20260709 12:21:30.920361 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:30.920811 25852 raft_consensus.cc:1240] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:21:30.893319 30067 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:31.092072 30067 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:21:31.089435 25025 rpcz_store.cc:269] 0709 12:21:01.706374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.715914 (+  9540us) service_pool.cc:224] Handling call
0709 12:21:31.088962 (+29373048us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:27.393575 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:27.394539 (+   964us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:27.394604 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:21:27.394636 (+    32us) tablet.cc:662] Decoding operations
0709 12:21:27.396274 (+  1638us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:27.396394 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:27.396448 (+    54us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:21:27.530045 (+133597us) tablet.cc:701] Row locks acquired
0709 12:21:27.530099 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:21:27.530292 (+   193us) write_op.cc:270] Start()
0709 12:21:27.530466 (+   174us) write_op.cc:276] Timestamp: P: 1783599687530217 usec, L: 0
0709 12:21:27.530514 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 12:21:27.531281 (+   767us) log.cc:844] Serialized 5133 byte log entry
0709 12:21:28.414149 (+882868us) op_driver.cc:464] REPLICATION: finished
0709 12:21:28.818645 (+404496us) write_op.cc:301] APPLY: starting
0709 12:21:28.818750 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:29.192000 (+373250us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b1800404500. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2103c4d0ec 00007f2103c99c0a 00007f2103c994f7 00007f2103c99490 00007f2103c50f48 00007f21079651bb 00007f2107965532 00007f21079acb93 00007f2107859de3
0709 12:21:29.337734 (+145734us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:29.360949 (+ 23215us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:30.008437 (+647488us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:30.008926 (+   489us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:21:30.009003 (+    77us) write_op.cc:312] APPLY: finished
0709 12:21:30.009624 (+   621us) log.cc:844] Serialized 121 byte log entry
0709 12:21:30.040686 (+ 31062us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:30.040902 (+   216us) write_op.cc:454] Released schema lock
0709 12:21:30.040998 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:30.067920 (+ 26922us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:30.068486 (+   566us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1761320,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":360283,"apply.run_cpu_time_us":47459,"apply.run_wall_time_us":1228798,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58571,"num_ops":13,"prepare.queue_time_us":221509,"prepare.run_cpu_time_us":36900,"prepare.run_wall_time_us":402588,"raft.queue_time_us":232261,"raft.run_cpu_time_us":19719,"raft.run_wall_time_us":565917,"replication_time_us":847279,"spinlock_wait_cycles":14382464,"thread_start_us":936711,"threads_started":5,"wal-append.queue_time_us":258334,"wal-append.run_cpu_time_us":68305,"wal-append.run_wall_time_us":2616603}]]}
I20260709 12:21:31.092545 30067 raft_consensus.cc:697] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:31.034850 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:31.028333 25122 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:21:31.035109 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:31.013226 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:30.978168 30419 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.043541 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 940) took 1261 ms. Trace:
I20260709 12:21:31.100816 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:31.100538 25124 rpcz_store.cc:276] 0709 12:21:29.780292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.780792 (+   500us) service_pool.cc:224] Handling call
0709 12:21:31.041790 (+1260998us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400454054. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:31.041948 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287384448}
I20260709 12:21:31.000133 30370 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:30.940399 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:31.104123 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 232153us
I20260709 12:21:31.038543 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:30.986356 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:31.005481 25127 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 12:21:30.999253 30421 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:30.988107 30425 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:30.929950 30297 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:30.938802 25274 rpcz_store.cc:276] 0709 12:21:29.392861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.392975 (+   114us) service_pool.cc:224] Handling call
0709 12:21:30.827867 (+1434892us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b5400120f54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f08853 00007f2108ed660a 00007f210245c7d4 00007f210245c762 00007f210245c691 00007f210245c60c 00007f210245b8c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:30.852654 (+ 24787us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615133568}
I20260709 12:21:30.991922 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:30.977686 30434 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:31.008339 25118 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:31.047816 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:31.054243 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:31.145969 25269 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:31.029145 25196 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
I20260709 12:21:31.068653 30447 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:31.069442 25857 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:31.077855 30293 consensus_queue.cc:1059] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:30.979463 30394 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:31.105266 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 183482us
I20260709 12:21:31.106247 25851 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:21:31.149611 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 233714us
W20260709 12:21:31.111166 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 173319us
I20260709 12:21:31.152185 25165 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:31.154603 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:31.105453 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:31.148991 30447 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:31.117621 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.114147 25860 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.105094 29925 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:31.109943 25120 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:31.112337 30419 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:31.149302 25855 raft_consensus.cc:2393] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:21:31.169773 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 86636.1us
W20260709 12:21:31.169108 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.102461 30067 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.145498 30421 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:31.121994 30370 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:31.169044 25851 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
W20260709 12:21:31.178671 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 92279.9us
I20260709 12:21:31.179466 25860 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:31.180079 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:31.180716 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.150794 30453 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:31.181614 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:31.162163 30447 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:31.173341 29925 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:31.196993 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 44898.4us
I20260709 12:21:31.205610 25853 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:31.204509 30455 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:31.200277 29925 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:31.216053 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 61543.8us
I20260709 12:21:31.181280 30421 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.219573 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:31.216553 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 63852.3us
I20260709 12:21:31.222978 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:31.223417 25167 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:31.225898 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 47605.3us
I20260709 12:21:31.190332 30452 consensus_queue.cc:1059] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:21:31.237190 25853 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:31.244915 30394 raft_consensus.cc:3055] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:31.245527 30394 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:31.233067 30374 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:31.255259 25167 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:31.225363 30455 raft_consensus.cc:697] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:21:31.268620 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 49111.7us
I20260709 12:21:31.247579 29895 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:31.249743 30313 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:31.280755 30468 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.293097 30465 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:31.293651 30468 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.293764 30465 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.296054 30465 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:31.281646 30464 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:31.296065 30468 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:31.274048 30461 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:31.276374 30460 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:31.313081 30454 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:21:31.314347 30421 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:31.288082 30463 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.283572 30120 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:31.286002 30313 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.359439 30470 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.360232 30470 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:31.366485 25148 debug-util.cc:398] Leaking SignalData structure 0x7b0800059460 after lost signal to thread 23879
W20260709 12:21:31.367079 25148 debug-util.cc:398] Leaking SignalData structure 0x7b0800129f20 after lost signal to thread 23882
W20260709 12:21:31.368237 25148 debug-util.cc:398] Leaking SignalData structure 0x7b08000cbb00 after lost signal to thread 25059
W20260709 12:21:31.369853 25148 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4b00 after lost signal to thread 25151
W20260709 12:21:31.371628 25148 debug-util.cc:398] Leaking SignalData structure 0x7b08003558e0 after lost signal to thread 25226
W20260709 12:21:31.381028 25148 debug-util.cc:398] Leaking SignalData structure 0x7b080030a5c0 after lost signal to thread 25300
W20260709 12:21:31.381574 25148 debug-util.cc:398] Leaking SignalData structure 0x7b0800384360 after lost signal to thread 25301
I20260709 12:21:31.350998 30455 consensus_queue.cc:237] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:31.389122 25148 debug-util.cc:398] Leaking SignalData structure 0x7b08000cf7e0 after lost signal to thread 25884
W20260709 12:21:31.393487 25092 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.536s (SENT) [suppressed 20 similar messages]
I20260709 12:21:31.297148 30394 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:31.397635 29925 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:31.400002 30313 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:31.400903 29925 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:31.395031 25148 debug-util.cc:398] Leaking SignalData structure 0x7b08003fe160 after lost signal to thread 25885
I20260709 12:21:31.401634 30394 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:31.403116 25148 debug-util.cc:398] Leaking SignalData structure 0x7b080006ffa0 after lost signal to thread 30388
I20260709 12:21:31.354566 30451 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:31.352312 30463 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.420779 30463 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:31.414383 25856 raft_consensus.cc:2410] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:21:31.422183 30463 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:31.422784 30463 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.425341 30463 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:31.431457 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:31.432098 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.440510 25023 catalog_manager.cc:5697] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 8 to 10, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 10 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:31.447695 30470 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:31.447826 25023 catalog_manager.cc:5697] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 11 to 14, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 14 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:31.450228 25023 catalog_manager.cc:5697] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:31.452064 25023 catalog_manager.cc:5697] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 11 to 13, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 13 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
W20260709 12:21:31.456365 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 186842us
W20260709 12:21:31.482664 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 248612us
W20260709 12:21:31.482172 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 210874us
I20260709 12:21:31.491211 25859 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:21:31.491781 25859 pending_rounds.cc:85] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 9
I20260709 12:21:31.492087 25859 pending_rounds.cc:107] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:21:31.492383 25859 raft_consensus.cc:2889] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:31.494848 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:31.494688 29925 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:31.495951 25167 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:31.498142 25168 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:31.508824 25023 catalog_manager.cc:5697] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:31.497305 30120 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.512123 30120 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.512816 25023 catalog_manager.cc:5697] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 10 to 13, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 13 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:31.514611 30120 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:31.498834 30470 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.515666 25023 catalog_manager.cc:5697] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 7 to 10, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 10 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:31.516115 30470 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.518317 25023 catalog_manager.cc:5697] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 4 to 7, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 7 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:31.507982 30363 raft_consensus.cc:697] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:31.511337 30453 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:31.519691 30453 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:31.520064 30453 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:31.520145 30363 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.525282 25825 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:31.526557 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 133102us
I20260709 12:21:31.527055 25023 catalog_manager.cc:5697] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 7 to 10, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 10 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:31.527905 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.529934 25825 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:31.531198 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:31.528796 25023 catalog_manager.cc:5697] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 9 to 10, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 10 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:31.531569 30456 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:21:31.533025 30419 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:31.538496 30419 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:31.538900 30419 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:31.522243 30472 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:31.541412 30470 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:31.541978 30447 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.545608 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:31.546200 25275 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:31.493747 30434 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:31.552680 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:31.551378 25023 catalog_manager.cc:5697] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 8 to 10, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 10 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:31.554093 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:31.554870 25275 raft_consensus.cc:2393] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 13: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:21:31.556563 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.557381 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:31.559065 25127 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:31.560809 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:31.551388 30244 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:31.563575 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:31.551565 30370 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:21:31.570461 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 465026us
I20260709 12:21:31.572124 25853 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:31.551821 30447 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:31.561474 30455 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:31.594830 25241 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:31.604087 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:31.605324 25196 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:31.611986 30474 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:21:31.612365 25270 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:21:31.612291 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:31.613189 25200 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:31.614145 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:31.596002 25242 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:31.574864 25126 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:31.587769 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:31.614809 25199 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:31.561663 30067 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:21:31.591849 30408 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:31.617655 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:31.623762 25825 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:31.624274 25092 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:31.625136 30485 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:31.625496 25092 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:31.574221 30363 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:31.574086 30244 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:31.625974 30463 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:31.626394 30363 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.626978 30463 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:31.626890 30244 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.628670 30363 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:31.630632 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:31.631467 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:31.631705 25168 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:31.621025 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:31.621654 25270 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:21:31.632092 25198 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:31.633906 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:31.634204 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:31.634927 25197 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:31.631515 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:31.592424 25822 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:31.636492 25092 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:31.650569 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:31.651428 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:31.639734 25825 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:31.652572 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 60211.6us
I20260709 12:21:31.656623 25825 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:31.657241 30474 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:31.660657 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:31.660698 25198 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:31.661895 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:31.659132 30469 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:31.650812 30120 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:31.664494 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:31.669071 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:31.669586 25825 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:31.671664 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:31.664700 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:31.665508 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:31.677172 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.679473 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:31.638752 30425 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:31.619963 30374 raft_consensus.cc:2804] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:31.619258 30461 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:31.677616 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 147144us
I20260709 12:21:31.670590 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:31.681058 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:31.632431 30460 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:31.650949 30472 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:31.687099 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:31.706629 25270 raft_consensus.cc:2410] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:21:31.693962 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:31.652197 30424 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:31.709813 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:31.709443 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 84144.9us
I20260709 12:21:31.696928 25242 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:31.698920 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:31.702235 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:31.633172 30297 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:31.650451 30370 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:31.715673 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:31.702068 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:31.704044 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:31.717341 25200 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:31.638387 30455 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:31.695779 25275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:31.666524 30408 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:31.719897 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:31.720791 25275 raft_consensus.cc:606] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:31.703681 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:31.663746 30452 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:31.667832 30474 raft_consensus.cc:2764] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:21:31.715579 25090 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:31.721732 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:31.719756 25201 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:21:31.659740 30310 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:31.705143 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:31.721084 25858 raft_consensus.cc:2393] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 10: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:31.724691 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:31.725754 25118 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 13: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:31.681706 30434 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:31.681464 30464 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:31.726583 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:31.727763 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:31.736272 25275 raft_consensus.cc:614] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:31.736831 25122 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:31.728078 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:31.728457 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:31.728849 30483 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:21:31.729161 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:31.764932 25124 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:31.729730 30463 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:31.730813 25119 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:31.704802 30471 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:31.728123 30120 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:21:31.732189 30334 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:31.703912 30460 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:31.704914 30125 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:31.741499 30323 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:31.743680 30465 raft_consensus.cc:3055] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:31.801793 30448 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:31.802241 30465 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:31.772428 30471 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:31.803354 30471 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:31.802605 30448 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.803157 30465 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.804487 30465 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:31.745687 30425 consensus_queue.cc:1059] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:31.771660 30463 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:31.806353 30448 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:31.709575 30214 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:31.710033 30426 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:31.807437 30426 raft_consensus.cc:697] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:31.808812 30125 raft_consensus.cc:697] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:31.770548 25274 raft_consensus.cc:2393] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 16: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:31.716333 30472 raft_consensus.cc:697] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 16 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:31.809769 30125 consensus_queue.cc:237] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.758603 25200 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:21:31.810714 30472 consensus_queue.cc:237] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:31.776903 30460 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:31.726643 30452 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:31.787158 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 48671.2us
I20260709 12:21:31.813560 30452 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:31.814075 25241 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:31.814592 25126 raft_consensus.cc:2410] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 15 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:21:31.719556 30374 raft_consensus.cc:697] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:31.815618 30374 consensus_queue.cc:237] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.806453 30463 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:31.787806 30269 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:31.817307 30269 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:31.711114 30461 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.817746 30269 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:31.818310 30269 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:31.818738 30408 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:31.793428 30419 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.819923 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:31.822235 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:31.822413 30464 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:31.823004 25271 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:31.823133 30464 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.824371 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2263) took 1286 ms. Trace:
I20260709 12:21:31.824841 25276 rpcz_store.cc:276] 0709 12:21:30.542667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.642196 (+ 99529us) service_pool.cc:224] Handling call
0709 12:21:30.642579 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:31.542218 (+899639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:31.542248 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:31.542749 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:21:31.611856 (+ 69107us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:31.611902 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.733071 (+121169us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400418f54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:31.733141 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:31.824043 (+ 90902us) raft_consensus.cc:1685] finished
0709 12:21:31.824070 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:31.824303 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":443898,"raft.queue_time_us":445028,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":1006342016,"thread_start_us":55812,"threads_started":1,"wal-append.queue_time_us":78259}
I20260709 12:21:31.799557 30486 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:31.827672 30486 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:31.829962 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:31.796270 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.806622 30425 raft_consensus.cc:3055] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:31.834355 30425 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:31.835388 30425 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.836966 30425 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:31.815474 30455 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.819492 30408 consensus_queue.cc:1243] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:21:31.808432 30426 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:31.789479 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 92620.7us
I20260709 12:21:31.855684 30486 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:31.859807 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:31.861884 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:31.862738 25276 raft_consensus.cc:3060] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:21:31.863945 30464 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:31.752162 25275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:31.866875 25275 raft_consensus.cc:606] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:31.788556 30453 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.877605 25822 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:31.880878 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:31.887506 25855 pending_rounds.cc:85] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 8
I20260709 12:21:31.887841 25855 pending_rounds.cc:107] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:21:31.888384 25276 raft_consensus.cc:2468] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:21:31.887367 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:31.893453 25242 connection.cc:256] RPC call timeout handler was delayed by -1.1688126779997674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260709 12:21:31.888115 25855 raft_consensus.cc:2889] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:31.898451 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:31.891041 25822 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:31.899264 25121 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:31.900539 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:31.909430 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:31.910127 25119 raft_consensus.cc:3060] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:31.878928 30486 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:31.897640 30370 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.902161 30424 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.901911 30464 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:31.904145 30421 raft_consensus.cc:2804] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:31.929932 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:31.936789 25126 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:31.938341 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:31.938687 30419 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:31.937829 30486 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:31.940224 25276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:31.940992 25276 raft_consensus.cc:606] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:31.963729 30310 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:31.967538 30463 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:31.974301 25119 raft_consensus.cc:2468] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:31.976651 25121 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:31.897455 30448 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:21:31.980762 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:31.989549 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 262431us
I20260709 12:21:32.014415 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:32.019079 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:32.021620 25274 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:31.933058 30464 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.025825 25125 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:32.039197 25825 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:32.046617 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:31.982717 30421 raft_consensus.cc:697] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:32.052942 30421 consensus_queue.cc:237] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.049304 30323 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:32.036679 30464 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:32.051463 30459 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:32.059942 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.062696 30459 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.053109 30269 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.065656 30269 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:32.068419 30453 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:32.070259 30461 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:32.067765 25276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:32.071326 25276 raft_consensus.cc:606] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:32.071761 25276 raft_consensus.cc:614] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:32.068522 30459 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:32.079748 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:32.080984 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:32.081619 25859 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:32.084012 30460 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.085815 25121 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:21:32.091886 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:32.093793 25092 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:32.093825 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:32.102320 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:32.102698 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 56179.8us
I20260709 12:21:31.935374 30424 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:32.039085 30477 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.941130 30370 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.044355 30125 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.103106 25125 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:32.039731 30408 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:32.104086 25093 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:32.110013 25167 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:32.110415 25092 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:32.108886 25825 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:32.114524 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 214053us
I20260709 12:21:32.115341 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:32.116289 30419 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:32.119195 25193 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 14: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:32.091380 30465 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:32.120270 25242 leader_election.cc:400] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 15. Current term is 16.
I20260709 12:21:32.120664 25242 leader_election.cc:403] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:32.122305 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:32.124261 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:32.124351 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:32.125507 25825 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:32.125859 25242 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:32.127630 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:31.986341 30471 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.143033 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:32.143362 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:32.143909 25202 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:32.144786 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:32.148581 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:32.148890 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:32.150122 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:32.112439 30214 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:32.119899 30461 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:32.094286 30334 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:21:32.153079 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:32.187014 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 44847.3us
I20260709 12:21:32.132943 30448 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.207921 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:32.189790 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 64347.5us
I20260709 12:21:32.121356 30474 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:32.120743 30323 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:32.185371 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:32.213286 25196 raft_consensus.cc:2410] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:21:32.184743 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:32.104740 30447 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:21:32.186261 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:32.217154 25194 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:32.201918 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:32.130867 30374 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 15. Current term is 16.
I20260709 12:21:32.217967 25199 raft_consensus.cc:2376] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17. Re-sending same reply.
I20260709 12:21:32.130926 30456 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:32.186614 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 59087.9us
W20260709 12:21:32.209621 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 286272us
I20260709 12:21:32.210176 25825 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:32.134279 30408 raft_consensus.cc:697] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:32.137941 30297 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:32.212217 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:32.221632 25125 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:32.184248 30434 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:32.130236 30125 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.230341 30214 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:32.230993 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:32.119688 30358 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 12:21:32.235245 30424 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:32.305378 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:32.305900 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 95792.3us
I20260709 12:21:32.120379 30477 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.239045 30486 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:32.200032 30473 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:32.243235 30471 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:32.251992 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:32.342728 30447 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.257751 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:32.259488 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:32.343269 30447 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.155088 30461 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:32.345093 30461 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:32.347450 30425 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:32.351841 30408 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.345526 30464 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.297729 30120 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
W20260709 12:21:32.357086 30452 consensus_meta.cc:287] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.543s	user 0.004s	sys 0.008s
I20260709 12:21:32.357702 30452 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.359205 25857 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 15: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:32.359812 30494 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:21:32.249509 30453 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 12:21:32.365183 25126 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:32.290640 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:32.370237 25125 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:32.285250 25201 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:32.371462 25125 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:32.294181 25197 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 12:21:32.307289 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:32.372828 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 65611.3us
I20260709 12:21:32.295701 25194 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:32.373811 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:32.249753 30293 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.374563 30293 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.376583 25856 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:21:32.376672 30293 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:32.309039 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 102818us
W20260709 12:21:32.237563 30490 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.462s	user 0.004s	sys 0.000s
I20260709 12:21:32.378408 25857 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:32.378934 25858 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:32.255463 30474 raft_consensus.cc:697] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:32.380052 30474 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.381510 25093 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:32.246018 30370 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:32.382491 30507 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.062s	user 0.000s	sys 0.003s
I20260709 12:21:32.382614 30471 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:32.383391 30447 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:32.248296 30502 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:32.383927 30447 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:32.384284 30502 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:32.385186 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:32.385387 30502 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:32.322918 25119 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:32.286517 30434 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:32.387575 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:32.383941 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:32.382432 30370 raft_consensus.cc:2764] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:21:32.382378 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:32.393160 25127 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:32.326305 30456 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:32.328190 30477 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:32.366151 30463 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:32.325205 30504 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:21:32.394784 25119 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:32.387687 30434 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:32.393828 30456 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:32.385825 25121 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:32.397347 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:32.332015 30460 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:32.340829 30125 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:32.410181 25197 raft_consensus.cc:1240] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
W20260709 12:21:32.414564 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 156867us
W20260709 12:21:32.414974 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 304636us
I20260709 12:21:32.418744 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:32.400255 25270 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 10.
I20260709 12:21:32.435488 25125 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:32.404917 30456 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:32.439253 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:32.446554 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:32.449074 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:32.460690 25168 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:32.463253 25092 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:32.464648 25092 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:32.436223 30464 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:32.436717 30473 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.471493 30473 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.472280 30503 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.473014 30503 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.475618 30503 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:32.478835 29925 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:32.459712 30125 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:32.480844 30125 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.482801 29803 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:32.482995 30125 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:32.483536 29803 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:32.485646 30310 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:32.487809 25275 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
W20260709 12:21:32.491498 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 57706.2us
I20260709 12:21:32.493031 30470 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:32.491547 30293 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:32.494220 30455 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:32.496100 25093 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:32.497200 30470 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.497947 30394 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:32.498692 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:32.499209 30067 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:32.500519 30067 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:32.500790 25168 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:32.500557 30461 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.502290 30457 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:32.503383 30457 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:32.503939 30457 consensus_queue.cc:1243] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 897be935c42e41b995f177155b042be0 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:32.504410 29925 consensus_queue.cc:1059] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:32.505199 30313 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:32.505716 29925 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:32.505848 25090 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:32.506337 29925 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.506822 29925 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:32.507601 30476 raft_consensus.cc:3055] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:32.508023 30476 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:32.465890 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:32.520730 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 86798us
I20260709 12:21:32.521759 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:32.525519 25853 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:32.535521 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:32.536299 25200 raft_consensus.cc:606] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:32.538823 30473 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:32.509392 30452 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:32.541177 30434 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.508946 30476 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:32.550885 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 85075.6us
I20260709 12:21:32.552277 25092 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:32.525785 30334 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:32.538857 30461 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:32.571552 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 43849.8us
I20260709 12:21:32.576864 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:32.606657 25270 raft_consensus.cc:3060] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:32.578302 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:32.574457 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 52782.6us
I20260709 12:21:32.609467 25242 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:32.604377 30460 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.611992 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:21:32.613937 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 97186.8us
I20260709 12:21:32.549463 30269 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:32.570720 30334 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.623734 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:32.617583 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 367798us
I20260709 12:21:32.629524 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:21:32.661988 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.665004 30508 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:32.669925 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60561.7us
W20260709 12:21:32.672080 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 119912us
I20260709 12:21:32.683037 25123 pending_rounds.cc:85] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 7
I20260709 12:21:32.683408 25123 pending_rounds.cc:107] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:21:32.683632 25123 raft_consensus.cc:2889] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:32.689459 25194 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:32.693869 25853 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:32.695799 25270 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:32.612576 30509 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:32.701825 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:32.704279 25856 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:32.667050 30334 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:32.632320 30269 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:32.667402 30447 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:32.605680 30478 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:21:32.684914 30502 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:32.709647 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:32.735298 25270 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:32.681641 30214 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:32.632855 29727 consensus_queue.cc:1059] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 12:21:32.687029 30476 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:32.709066 30421 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:32.707717 30455 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.689980 30461 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:32.661406 30460 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.729591 30269 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:32.748052 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:32.809541 30487 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.071s	user 0.006s	sys 0.005s
I20260709 12:21:32.689663 30491 consensus_queue.cc:1059] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:21:32.730783 30503 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:21:32.881503 25270 raft_consensus.cc:2468] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:32.747304 30502 raft_consensus.cc:697] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:21:32.908710 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 244519us
I20260709 12:21:32.932513 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:32.942802 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:32.943485 25127 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:21:32.943820 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:32.941597 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:32.946261 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:32.734215 30447 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.971887 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:32.939293 30470 raft_consensus.cc:3055] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:32.760368 30421 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:32.959699 30518 log.cc:927] Time spent T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 12:21:32.967235 30494 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:21:32.994894 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:32.807367 30455 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:32.998414 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:32.818188 30461 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.007974 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:33.010447 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:33.011418 25275 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:21:33.005321 30434 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:33.012310 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:33.012852 25271 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:33.012966 30434 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.991585 30470 raft_consensus.cc:740] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:33.013566 30434 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:33.014201 30470 consensus_queue.cc:260] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.015511 30470 raft_consensus.cc:3060] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:33.015702 30434 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:32.972560 30459 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:33.001842 25127 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:33.009606 25119 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:33.031574 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:33.006783 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:33.005882 30520 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:21:33.034581 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:33.038463 25127 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:33.042510 25119 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 12:21:33.048866 30515 log.cc:927] Time spent T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:21:33.050712 30516 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:21:33.052536 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2797) took 1166 ms. Trace:
I20260709 12:21:33.053555 30447 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:33.057709 30455 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:33.058679 30426 raft_consensus.cc:993] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:33.059159 30426 raft_consensus.cc:1081] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:33.062541 30461 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:33.067356 29803 consensus_meta.cc:287] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.000s
I20260709 12:21:33.067905 29803 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:33.069023 30460 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:33.074152 30421 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:33.076251 30502 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.052886 25122 rpcz_store.cc:276] 0709 12:21:31.886346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.987119 (+100773us) service_pool.cc:224] Handling call
0709 12:21:32.041680 (+ 54561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:32.094512 (+ 52832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.094541 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:32.105472 (+ 10931us) log.cc:844] Serialized 26 byte log entry
0709 12:21:32.550676 (+445204us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:32.604125 (+ 53449us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.627548 (+ 23423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.627625 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:33.052308 (+424683us) raft_consensus.cc:1685] finished
0709 12:21:33.052327 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:33.052466 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132226,"prepare.queue_time_us":60248,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":81212,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":15892,"thread_start_us":412506,"threads_started":1,"wal-append.queue_time_us":611728}
I20260709 12:21:33.039081 30459 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:33.084321 30459 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:33.094111 30456 consensus_meta.cc:287] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.004s
I20260709 12:21:33.094892 30456 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.099845 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:33.100755 25860 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:33.102602 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:33.142712 25853 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:33.145560 25167 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:33.146160 30503 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:33.151603 30459 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:21:33.163584 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 224636us
I20260709 12:21:33.169014 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:33.157259 30448 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:33.167793 30506 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:33.167145 30453 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.009s	sys 0.007s
W20260709 12:21:33.179528 25168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.016s
W20260709 12:21:33.180325 25168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.003s	sys 0.017s
W20260709 12:21:33.182101 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 164400us
I20260709 12:21:33.182627 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:33.188560 25858 raft_consensus.cc:1275] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:21:33.189312 25853 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:33.168704 30503 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:33.177410 30459 raft_consensus.cc:697] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:33.181726 30455 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:33.194068 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:33.186527 29925 consensus_meta.cc:287] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.679s	user 0.007s	sys 0.006s
I20260709 12:21:33.196408 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 1227) took 1078 ms. Trace:
I20260709 12:21:33.202446 25858 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:33.200708 25859 rpcz_store.cc:276] 0709 12:21:32.118571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.118730 (+   159us) service_pool.cc:224] Handling call
0709 12:21:32.119095 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:32.130713 (+ 11618us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:32.188396 (+ 57683us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.547068 (+358672us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:32.566708 (+ 19640us) log.cc:844] Serialized 26 byte log entry
0709 12:21:32.566888 (+   180us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:32.567122 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.607841 (+ 40719us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b1800489220. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287 00007f2103f29208
0709 12:21:32.608010 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.608079 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:33.196197 (+588118us) raft_consensus.cc:1685] finished
0709 12:21:33.196220 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:33.196351 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42082,"prepare.queue_time_us":50843,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":43590,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":35456,"spinlock_wait_cycles":12205184,"thread_start_us":249868,"threads_started":1,"wal-append.queue_time_us":521631}
I20260709 12:21:33.178682 30448 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.212872 25853 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:33.214722 30125 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:33.215741 25853 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:33.215552 30125 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.217271 25859 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:33.218683 25822 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:33.262396 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 43768.4us
I20260709 12:21:33.263295 25822 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:33.264580 30370 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.224295 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:33.265067 30370 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.224565 30503 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:33.225040 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:33.225350 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:33.207937 29925 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.228024 30448 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:33.228813 30456 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:33.233568 30334 consensus_meta.cc:287] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.501s	user 0.004s	sys 0.004s
W20260709 12:21:33.234625 30539 log.cc:927] Time spent T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:21:33.183861 30506 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.234443 30459 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.246232 30546 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:33.252530 30500 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:33.253641 25241 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:33.278540 25859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:21:33.253835 30269 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.295982 25242 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:33.281147 30421 raft_consensus.cc:2804] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:21:33.305533 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 51973.3us
I20260709 12:21:33.298682 30536 raft_consensus.cc:2804] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:33.373059 25269 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
W20260709 12:21:33.374655 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 68237.5us
I20260709 12:21:33.281270 30461 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:21:33.283845 30503 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
W20260709 12:21:33.378105 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 82200.5us
I20260709 12:21:33.315629 30421 raft_consensus.cc:697] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:33.300175 30334 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.389268 25859 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:33.396682 25859 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:33.377048 30536 raft_consensus.cc:697] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:33.386392 30370 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:33.307060 30546 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:33.416707 25118 raft_consensus.cc:2393] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:33.411231 30421 consensus_queue.cc:237] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.415529 25859 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.387709 30448 consensus_queue.cc:1048] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:21:33.415943 30558 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:33.424963 30560 raft_consensus.cc:3055] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:33.432197 30561 consensus_queue.cc:1059] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:33.435006 30562 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:33.436975 30546 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:33.437536 30536 consensus_queue.cc:237] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.439078 30269 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:33.440390 30334 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:33.423025 30500 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:33.444711 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:33.447265 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2648) took 1305 ms. Trace:
I20260709 12:21:33.442806 30558 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.481664 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:33.451781 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 256988us
W20260709 12:21:33.452497 30526 log.cc:927] Time spent T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.474s	user 0.001s	sys 0.002s
I20260709 12:21:33.452986 29727 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:33.454909 30513 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:33.455067 29925 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:33.443378 30560 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:33.475076 25851 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:33.477546 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:33.479476 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:33.480448 25853 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
W20260709 12:21:33.450917 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 268349us
I20260709 12:21:33.468832 25198 rpcz_store.cc:276] 0709 12:21:32.141913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.142039 (+   126us) service_pool.cc:224] Handling call
0709 12:21:32.201212 (+ 59173us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:32.208904 (+  7692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.208951 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:32.254358 (+ 45407us) log.cc:844] Serialized 52 byte log entry
0709 12:21:32.717806 (+463448us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:33.159729 (+441923us) log.cc:844] Serialized 14 byte log entry
0709 12:21:33.176089 (+ 16360us) log.cc:844] Serialized 14 byte log entry
0709 12:21:33.446731 (+270642us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b180041b480. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287 00007f2103f29208
0709 12:21:33.446898 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:33.446962 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:33.447069 (+   107us) raft_consensus.cc:1685] finished
0709 12:21:33.447082 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:33.447210 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90879,"prepare.queue_time_us":255753,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":79,"raft.queue_time_us":298202,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":8044,"spinlock_wait_cycles":10688256,"thread_start_us":787045,"threads_started":2,"wal-append.queue_time_us":759983}
I20260709 12:21:33.505803 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:33.506314 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:33.443946 30562 consensus_queue.cc:1243] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:21:33.514998 30478 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:33.517037 30564 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:33.518232 30564 consensus_queue.cc:1059] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:33.519944 30563 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:33.520414 30563 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:33.521193 25854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1778) took 1006 ms. Trace:
I20260709 12:21:33.503463 30461 consensus_queue.cc:1059] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:21:33.521588 25854 rpcz_store.cc:276] 0709 12:21:32.515021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.516354 (+  1333us) service_pool.cc:224] Handling call
0709 12:21:32.547213 (+ 30859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:32.559226 (+ 12013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.559273 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:32.559887 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 12:21:32.733571 (+173684us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:32.733637 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.733725 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:33.451913 (+718188us) spinlock_profiling.cc:243] Waited 9.12 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:33.520900 (+ 68987us) raft_consensus.cc:1685] finished
0709 12:21:33.520921 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:33.521132 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2292,"raft.queue_time_us":20007,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6457,"spinlock_wait_cycles":20983552,"thread_start_us":122581,"threads_started":1,"wal-append.queue_time_us":236356}
I20260709 12:21:33.523082 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:33.519507 30560 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:33.524140 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 783022us
I20260709 12:21:33.523772 30502 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:33.493283 30558 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:33.541013 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:33.542635 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:33.534221 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:33.543803 25825 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:33.544246 25269 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:33.545611 25271 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:33.550151 25267 raft_consensus.cc:1240] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:33.550666 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:33.552191 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:33.552525 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:33.552821 25274 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:33.556501 25242 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:33.538626 30470 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:33.521337 30563 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.541390 30478 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:33.562310 25242 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:33.561815 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:33.547268 30214 raft_consensus.cc:3055] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:33.547384 30370 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:33.569162 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:33.573727 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:33.573951 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:33.574631 25195 raft_consensus.cc:2410] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:21:33.562136 30561 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:33.571732 25194 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:33.559197 30546 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:33.564133 30560 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:33.575270 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:33.591032 25196 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:33.575372 25202 raft_consensus.cc:1275] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:33.572525 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:33.580195 25198 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:21:33.572834 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:33.571911 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:33.574741 25201 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 9: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:33.596541 25200 raft_consensus.cc:2410] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:21:33.589860 30563 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:33.541265 30502 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.560057 30461 consensus_queue.cc:1059] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:21:33.572435 30214 raft_consensus.cc:740] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:33.580924 30561 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:33.588011 29803 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.601763 30538 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.625514 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:33.621052 30567 log.cc:927] Time spent T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:21:33.616068 30561 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:33.599349 30531 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.601649 30530 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:33.601543 30512 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:33.626547 30568 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:33.612390 25196 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:33.597955 30546 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.657760 25853 pending_rounds.cc:85] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 9
I20260709 12:21:33.658169 25853 pending_rounds.cc:107] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:21:33.658411 25853 raft_consensus.cc:2889] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:33.617794 30297 consensus_queue.cc:1059] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:21:33.687372 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:33.687883 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 66138us
I20260709 12:21:33.652559 29727 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:33.628121 29803 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.656405 30512 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.720178 30566 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:33.639703 30531 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:33.720700 30565 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 12:21:33.745743 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 183499us
I20260709 12:21:33.747087 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:33.751227 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 133980us
I20260709 12:21:33.754829 30580 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:33.755497 30580 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:33.724220 25196 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:33.636480 30538 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.760980 25197 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:33.762836 30538 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:33.764521 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:33.772176 30310 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:33.772796 30310 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.775010 30310 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:33.776000 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:33.777841 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:33.778252 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:33.778589 25124 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:33.779678 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:33.780228 25124 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 8.
I20260709 12:21:33.733625 30293 consensus_queue.cc:1059] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:21:33.783782 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:33.798463 25196 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:33.798377 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:33.802543 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:33.804935 25851 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:33.812016 25122 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:33.794553 30370 raft_consensus.cc:3055] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:33.787559 30513 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:33.788323 30506 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:33.785686 30509 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:33.785755 30546 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:33.818982 30310 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:33.683346 30214 consensus_queue.cc:260] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:33.827553 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:33.818394 30568 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:33.841573 30310 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.820592 30370 raft_consensus.cc:740] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:33.872473 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:33.874176 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:33.874821 25123 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:33.875481 25199 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:33.879063 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:33.879765 25124 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:33.892665 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:33.820999 30566 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:21:33.931517 25196 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:33.836510 30546 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 12:21:33.824725 30509 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.940058 29803 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:33.947016 25271 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:33.946986 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:33.974232 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.949793 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 328952us
I20260709 12:21:33.952188 30562 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:33.936049 30536 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:33.991415 30536 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:33.932597 30425 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:33.998579 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:33.999037 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:33.999840 25201 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 13: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:34.000357 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:34.001066 25127 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:34.002315 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:34.002835 25127 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:34.033574 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:34.034525 25121 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:34.041262 25124 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:34.056347 25271 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:21:34.096860 30570 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.070s	user 0.000s	sys 0.002s
W20260709 12:21:34.097532 30577 log.cc:927] Time spent T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:21:34.098834 30244 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:34.099370 30590 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:21:34.099450 30244 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:34.102672 30573 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:34.103307 30573 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:34.105602 30573 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:34.106670 30447 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:34.031879 30475 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:34.032085 30067 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:33.993733 30562 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:34.110085 30575 log.cc:927] Time spent T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:21:34.000424 30530 consensus_queue.cc:1059] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 12:21:33.953261 30370 consensus_queue.cc:260] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:34.066954 30503 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:34.139371 25127 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:34.140843 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:34.155966 25121 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:34.156597 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:34.129916 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:34.160105 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:34.160689 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:34.157775 25127 raft_consensus.cc:2393] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 10: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:34.162379 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:34.156648 25168 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:34.161314 25195 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:34.166280 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:34.168426 25198 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:34.167182 25851 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:21:34.174575 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:34.175189 25121 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:34.147389 30310 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:34.181170 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:34.128316 30475 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:34.154989 30536 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:34.159363 30370 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:34.158746 29925 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:21:34.184783 30583 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:21:34.131285 30067 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:34.190927 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:34.205132 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:34.154858 30503 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:34.217681 30563 consensus_meta.cc:287] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.000s
I20260709 12:21:34.211606 30477 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:34.225005 25276 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:34.224998 30585 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:34.228114 30512 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:34.227887 30585 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:34.230297 25126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2802) took 1289 ms. Trace:
I20260709 12:21:34.230717 25126 rpcz_store.cc:276] 0709 12:21:32.940938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.941097 (+   159us) service_pool.cc:224] Handling call
0709 12:21:32.941436 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:33.547519 (+606083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:33.547565 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:33.558479 (+ 10914us) log.cc:844] Serialized 26 byte log entry
0709 12:21:33.699769 (+141290us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:21:33.769248 (+ 69479us) log.cc:844] Serialized 14 byte log entry
0709 12:21:33.769815 (+   567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:33.769950 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:34.230050 (+460100us) raft_consensus.cc:1685] finished
0709 12:21:34.230081 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:34.230237 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":638407,"prepare.queue_time_us":252701,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":72,"raft.queue_time_us":608452,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":9863,"thread_start_us":163245,"threads_started":2,"wal-append.queue_time_us":406308}
I20260709 12:21:34.206827 25127 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
W20260709 12:21:34.258059 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 101456us
I20260709 12:21:34.259048 25168 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:34.225924 30477 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.199501 29925 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:34.274663 30594 log.cc:927] Time spent T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:21:34.264432 30477 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:34.311223 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.268842 30538 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:21:34.360726 25168 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:34.374159 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 100655us
I20260709 12:21:34.371685 25121 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:34.374876 25168 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:34.375005 25127 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
W20260709 12:21:34.380993 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 107686us
W20260709 12:21:34.373093 30595 log.cc:927] Time spent T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.101s	user 0.000s	sys 0.005s
W20260709 12:21:34.374001 30535 log.cc:927] Time spent T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.108s	user 0.000s	sys 0.009s
W20260709 12:21:34.374330 30558 consensus_meta.cc:287] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.827s	user 0.006s	sys 0.013s
I20260709 12:21:34.369611 30530 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.361375 30604 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:21:34.387693 30561 consensus_meta.cc:287] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.008s
I20260709 12:21:34.411255 30475 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:34.412144 30560 consensus_meta.cc:287] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.812s	user 0.015s	sys 0.026s
I20260709 12:21:34.391710 30512 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:34.414547 30512 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:34.417353 30512 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:34.453423 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.398765 30530 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:34.401976 30558 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:34.559525 30610 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:34.560074 30610 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.560400 30610 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:34.561025 30558 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:34.562377 25275 raft_consensus.cc:2393] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:34.573314 30503 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:34.491290 30607 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.108s	user 0.000s	sys 0.003s
W20260709 12:21:34.500036 30595 log.cc:927] Time spent T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:21:34.618283 30536 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:34.640594 30536 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:34.641469 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:34.642186 25271 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:34.643146 30536 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:34.643579 25268 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:34.648429 30585 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:34.649935 29925 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:34.651268 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:34.433559 30561 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:34.654142 30561 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:34.663698 30530 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:34.670924 25123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.006s	sys 0.018s
W20260709 12:21:34.671451 25123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.006s	sys 0.018s
I20260709 12:21:34.679702 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:34.667606 25822 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:34.689092 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:34.530361 30612 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:21:34.795650 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 128173us
W20260709 12:21:34.804054 30607 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:21:34.806318 30593 log.cc:927] Time spent T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.693s	user 0.007s	sys 0.004s
I20260709 12:21:34.810606 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2433) took 1033 ms. Trace:
I20260709 12:21:34.812342 30580 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:34.819904 30536 consensus_queue.cc:1059] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:34.811133 25125 rpcz_store.cc:276] 0709 12:21:33.776958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.777411 (+   453us) service_pool.cc:224] Handling call
0709 12:21:33.777696 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:33.778097 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:33.778126 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:33.778544 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 12:21:33.913889 (+135345us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:33.913949 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:33.914063 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:34.805407 (+891344us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:34.810140 (+  4733us) raft_consensus.cc:1685] finished
0709 12:21:34.810176 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:34.810511 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7469,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":34066304,"thread_start_us":134920,"threads_started":1,"wal-append.queue_time_us":216397}
I20260709 12:21:34.689638 30457 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:34.794760 30530 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:34.802177 30612 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:34.827783 30370 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:34.852439 30370 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:34.852610 30612 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:34.870433 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.850837 30530 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:34.849274 30457 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:34.885149 25268 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:34.869589 30370 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:34.957824 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.965179 25168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.039s	sys 0.061s
W20260709 12:21:34.966526 25168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.040s	sys 0.062s
W20260709 12:21:34.967886 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 568484us
I20260709 12:21:35.017343 30614 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 12:21:35.041754 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.044054 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2807) took 1015 ms. Trace:
I20260709 12:21:35.044494 25121 rpcz_store.cc:276] 0709 12:21:34.028544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.384938 (+356394us) service_pool.cc:224] Handling call
0709 12:21:34.385440 (+   502us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:34.388597 (+  3157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:34.388667 (+    70us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:34.395467 (+  6800us) log.cc:844] Serialized 52 byte log entry
0709 12:21:34.867469 (+472002us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:34.867531 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.867626 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:35.043832 (+176206us) raft_consensus.cc:1685] finished
0709 12:21:35.043853 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:35.043995 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15888,"raft.queue_time_us":3143,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":8730,"spinlock_wait_cycles":39296,"thread_start_us":368781,"threads_started":1,"wal-append.queue_time_us":592364}
I20260709 12:21:35.050796 25121 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:21:35.052234 30585 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:35.055593 30408 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:35.040843 29925 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 12:21:35.076839 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60072.1us
W20260709 12:21:35.078565 25825 connection.cc:256] RPC call timeout handler was delayed by -1.3218334040002446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 12:21:35.079001 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:35.069854 30610 consensus_meta.cc:287] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.005s
W20260709 12:21:35.077773 30477 consensus_meta.cc:287] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.694s	user 0.012s	sys 0.000s
W20260709 12:21:35.087867 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 204154us
W20260709 12:21:35.099993 30474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.064s	user 0.043s	sys 0.041s
I20260709 12:21:35.100486 30606 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:35.108839 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 216408us
I20260709 12:21:35.116205 25271 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:35.092097 30530 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:35.123037 30621 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:35.094440 30550 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:35.074100 30585 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:35.103693 30474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.068s	user 0.043s	sys 0.041s
W20260709 12:21:35.128661 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 79528.5us
I20260709 12:21:35.107784 30615 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.089162 30536 consensus_queue.cc:1059] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:21:35.080248 30408 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.138041 30561 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.152115 30531 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.132272 30624 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:35.171798 30408 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.133831 30530 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:35.172559 30614 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:35.172756 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 985) took 1144 ms. Trace:
I20260709 12:21:35.164826 30615 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.173327 30472 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.173163 30614 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.173352 30561 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.176110 30623 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:35.176363 30561 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.176697 30623 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:35.177783 30451 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:35.178313 30451 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.179004 30623 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.180287 30451 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.086751 30610 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.095350 30477 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.189149 30600 raft_consensus.cc:993] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:21:35.189719 30600 raft_consensus.cc:1081] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:21:35.134882 30621 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.190649 30477 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.157692 30585 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.191655 30610 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.136588 30457 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.171505 30624 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.108839 30606 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:34.093381 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:35.193940 30624 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.193982 30615 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.153631 30550 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.196049 30550 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.196534 30550 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:35.191676 30621 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.173878 30472 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.173184 25127 rpcz_store.cc:276] 0709 12:21:34.027967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.259355 (+231388us) service_pool.cc:224] Handling call
0709 12:21:34.374779 (+115424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:34.375597 (+   818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.172582 (+796985us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400454550. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:35.172703 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264765824}
I20260709 12:21:35.186092 30614 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.169937 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2448) took 1019 ms. Trace:
I20260709 12:21:35.188058 30421 raft_consensus.cc:3055] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:35.200591 30421 raft_consensus.cc:740] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:35.200489 25125 rpcz_store.cc:276] 0709 12:21:34.148975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.081325 (+932350us) service_pool.cc:224] Handling call
0709 12:21:35.102046 (+ 20721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:35.102310 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:35.121053 (+ 18743us) log.cc:844] Serialized 14 byte log entry
0709 12:21:35.167708 (+ 46655us) log.cc:844] Serialized 14 byte log entry
0709 12:21:35.168120 (+   412us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:35.168207 (+    87us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:35.168272 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.168355 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:35.168500 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20320,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":294,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":5202,"thread_start_us":43228,"threads_started":1}
I20260709 12:21:35.201604 30421 consensus_queue.cc:260] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.172410 30530 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.202610 30472 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.202867 30421 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:35.203351 30569 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:35.204140 30530 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.203923 30569 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:35.191886 30474 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:21:35.206331 30584 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.946s	user 0.000s	sys 0.018s
I20260709 12:21:35.194453 30606 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:35.161482 25825 connection.cc:256] RPC call timeout handler was delayed by -1.0542520219999005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
I20260709 12:21:35.209180 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2291) took 1654 ms. Trace:
W20260709 12:21:35.212332 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 93423.1us
I20260709 12:21:35.212783 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:35.213971 25852 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:35.214587 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:35.197088 30550 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.218393 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.219224 25271 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:35.209591 25267 rpcz_store.cc:276] 0709 12:21:33.554592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.554706 (+   114us) service_pool.cc:224] Handling call
0709 12:21:33.554998 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:33.558116 (+  3118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:33.558150 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:33.571573 (+ 13423us) log.cc:844] Serialized 26 byte log entry
0709 12:21:33.983372 (+411799us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:33.996263 (+ 12891us) log.cc:844] Serialized 14 byte log entry
0709 12:21:34.032390 (+ 36127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.032463 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:35.183607 (+1151144us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b180033bec0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:35.205737 (+ 22130us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:35.208973 (+  3236us) raft_consensus.cc:1685] finished
0709 12:21:35.208995 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:35.209121 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24715,"prepare.queue_time_us":12853,"prepare.run_cpu_time_us":2167,"prepare.run_wall_time_us":23637,"raft.queue_time_us":65450,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":8110,"spinlock_wait_cycles":36753024,"thread_start_us":381012,"threads_started":1,"wal-append.queue_time_us":608432}
I20260709 12:21:35.213042 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:35.220976 25860 raft_consensus.cc:2393] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 14: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:35.215344 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.215324 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.215775 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:35.203936 30608 log.cc:927] Time spent T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.613s	user 0.006s	sys 0.002s
I20260709 12:21:35.222118 25858 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:35.222874 25822 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:35.213578 30530 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:35.225065 30530 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.227385 30421 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:35.227648 30530 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.227851 30421 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:35.228461 30421 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:35.213455 30622 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.229148 30622 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.231657 30622 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:35.216454 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:35.234486 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:35.235276 30622 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:35.235813 30530 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:35.238197 30622 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:35.238749 30550 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.237021 30421 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.239878 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2447) took 1098 ms. Trace:
I20260709 12:21:35.218084 30569 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:35.250379 25121 rpcz_store.cc:276] 0709 12:21:34.142083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.056044 (+913961us) service_pool.cc:224] Handling call
0709 12:21:35.056455 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:35.056936 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:35.074684 (+ 17748us) log.cc:844] Serialized 14 byte log entry
0709 12:21:35.239518 (+164834us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:35.239570 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:35.239609 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.239710 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:35.239822 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17556,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":97,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":3080,"thread_start_us":164425,"threads_started":1}
I20260709 12:21:35.244307 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.254456 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:35.256732 30619 log.cc:927] Time spent T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:21:35.257030 30269 raft_consensus.cc:3055] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:35.257592 30269 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:35.260360 30269 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:35.261457 25275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2785) took 1728 ms (client timeout 1925 ms). Trace:
I20260709 12:21:35.261505 30269 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:35.262104 25275 rpcz_store.cc:269] 0709 12:21:33.532678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.533814 (+  1136us) service_pool.cc:224] Handling call
0709 12:21:35.261257 (+1727443us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400299854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:35.261396 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342361472}
I20260709 12:21:35.244872 30067 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.274070 25852 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:35.275686 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:35.277300 25275 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:35.239071 30622 consensus_queue.cc:1048] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:21:35.239210 30530 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:21:35.251062 30612 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:35.261554 30421 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.304127 30604 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:35.314662 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 139054us
I20260709 12:21:35.307370 30622 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.316756 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:35.317365 25852 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:35.318732 25200 raft_consensus.cc:1275] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:21:35.319258 25200 pending_rounds.cc:85] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 9
I20260709 12:21:35.319458 25200 pending_rounds.cc:107] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:21:35.320375 25200 raft_consensus.cc:2889] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:35.319389 25201 raft_consensus.cc:1240] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
W20260709 12:21:35.321835 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 84486us
I20260709 12:21:35.319525 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:35.310158 30632 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:35.324198 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:35.333237 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:35.340764 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:35.382789 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:35.383452 25857 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:35.384279 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:35.385351 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:35.325219 30622 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.386332 25857 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:35.387488 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:35.387661 30606 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:35.387809 30627 log.cc:927] Time spent T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:21:35.387952 30622 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.388301 30606 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.388741 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:35.323362 30604 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.389297 25200 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:35.390239 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:35.390645 30606 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.390724 25200 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:35.391637 25198 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:35.391884 30604 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.325019 30632 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:35.393712 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:35.394939 30606 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.381016 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:35.379022 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:35.398357 30631 log.cc:927] Time spent T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:21:35.398713 30319 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:35.399115 30358 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:35.401697 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:35.409297 25199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 1002) took 1837 ms (client timeout 1966 ms). Trace:
I20260709 12:21:35.457532 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.409605 25193 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:35.402547 25200 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:35.454581 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.426970 25852 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:35.463321 25267 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:35.462858 25271 raft_consensus.cc:2393] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 14: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:35.463608 25275 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:35.402900 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:35.465190 25269 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: []
W20260709 12:21:35.463096 25199 rpcz_store.cc:269] 0709 12:21:33.571529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.572307 (+   778us) service_pool.cc:224] Handling call
0709 12:21:35.409112 (+1836805us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54000a7154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:35.409239 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290042112}
I20260709 12:21:35.426790 25859 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.445719 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:35.408787 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.469221 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:46484 (request call id 1409) took 2214 ms. Trace:
I20260709 12:21:35.470106 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:35.470702 25125 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:35.469628 25859 rpcz_store.cc:276] 0709 12:21:33.266169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.278403 (+ 12234us) service_pool.cc:224] Handling call
0709 12:21:35.425343 (+2146940us) spinlock_profiling.cc:243] Waited 87.9 ms on lock 0x7b54002b4b54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f05a3d 00007f2108ed5cd0 00007f210245a254 00007f210245a1e2 00007f210245a111 00007f210245a08c 00007f2102459342 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:35.466790 (+ 41447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202127744}
I20260709 12:21:35.470698 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:35.472059 25275 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:35.471422 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:35.447679 30370 consensus_meta.cc:287] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 12:21:35.381564 25853 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:21:35.472371 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 78751.3us
I20260709 12:21:35.471908 25201 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:35.508545 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.474050 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.472352 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:35.509264 25267 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:35.509454 25268 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:35.510464 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:35.511070 25121 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:35.509123 25167 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:35.511933 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:35.413995 30612 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.408402 30244 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:35.402405 30625 log.cc:927] Time spent T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:21:35.518419 25125 raft_consensus.cc:2393] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:35.472664 30580 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.513772 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:35.512883 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:35.440860 30459 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.487083 30599 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:35.513176 30634 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:35.516261 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.526401 25275 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:35.490216 30509 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.520715 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.526939 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:35.478085 30455 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:35.478992 30293 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.420325 30125 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:35.514201 30587 log.cc:927] Time spent T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 1.412s	user 0.010s	sys 0.010s
I20260709 12:21:35.324250 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:35.523346 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.533473 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.527576 25274 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:21:35.534257 25853 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:35.525206 25125 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:35.512493 25167 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:35.467744 30319 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.467289 30358 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:35.535950 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.540683 30612 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:35.541731 30612 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.515615 30370 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.542204 30612 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:35.528155 30599 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:35.543642 30562 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.544071 30599 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.523684 30580 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:35.528527 30634 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:35.545809 30634 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:21:35.547009 25122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 2434) took 1769 ms (client timeout 1682 ms). Trace:
I20260709 12:21:35.547251 25123 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:21:35.547461 25122 rpcz_store.cc:269] 0709 12:21:33.777227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.777991 (+   764us) service_pool.cc:224] Handling call
0709 12:21:35.546811 (+1768820us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b5400452c54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:35.546940 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76035456}
I20260709 12:21:35.548691 25856 raft_consensus.cc:1240] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:35.548899 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2811) took 1519 ms. Trace:
I20260709 12:21:35.549288 25123 rpcz_store.cc:276] 0709 12:21:34.029594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.846867 (+817273us) service_pool.cc:224] Handling call
0709 12:21:35.546940 (+700073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:35.547675 (+   735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.548727 (+  1052us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400452c50. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:35.548845 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588099840}
I20260709 12:21:35.468338 30606 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:35.535507 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 211309us
W20260709 12:21:35.550237 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.551002 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:35.538722 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 176162us
I20260709 12:21:35.540544 30125 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:35.536263 30293 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.556509 25822 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:21:35.556661 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 310124us
I20260709 12:21:35.558228 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:35.552491 30370 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.554808 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:35.555039 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:35.559285 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:35.560078 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:35.561517 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:35.528262 30455 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:35.562116 25121 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:35.564404 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.567245 25122 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:21:35.565018 25825 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:35.572839 25126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:21:35.573383 25126 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:35.556922 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:35.573756 25126 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:35.574909 25274 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:35.577713 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:35.578430 25274 raft_consensus.cc:3055] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:35.578773 25274 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:35.578776 25825 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:35.579484 25197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 999) took 2010 ms (client timeout 2378 ms). Trace:
I20260709 12:21:35.582446 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:35.526796 30459 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:35.582706 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:35.581535 25197 rpcz_store.cc:269] 0709 12:21:33.568831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.568941 (+   110us) service_pool.cc:224] Handling call
0709 12:21:35.579319 (+2010378us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54003615d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:35.579432 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430387456}
I20260709 12:21:35.552950 30617 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.587657 30622 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:35.570417 30455 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:35.588449 30293 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.591364 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.591714 30474 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:35.592101 29727 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:35.593704 30502 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.594153 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:35.557981 30323 raft_consensus.cc:3055] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:35.557578 30452 consensus_queue.cc:1048] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:21:35.576467 30421 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:21:35.596251 30358 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.648869 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:35.567903 30530 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:35.562484 30621 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:35.597708 30319 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:35.598066 25276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2789) took 1822 ms (client timeout 1902 ms). Trace:
W20260709 12:21:35.657660 25276 rpcz_store.cc:269] 0709 12:21:33.775525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.775673 (+   148us) service_pool.cc:224] Handling call
0709 12:21:35.597873 (+1822200us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b5400026f54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:35.597985 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031069952}
I20260709 12:21:35.580498 25274 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.642866 30474 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:35.655170 30293 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:35.661742 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:35.661764 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:35.662824 25124 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:35.599439 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:35.570413 30471 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:35.558851 30638 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:35.631657 30622 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:35.638568 25275 raft_consensus.cc:2393] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 17: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:35.639274 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:35.639973 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:35.643381 25121 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 9.
I20260709 12:21:35.671175 25125 raft_consensus.cc:3060] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:35.601879 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.587188 25825 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:35.644550 25126 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.585826 30370 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:35.648924 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 54885.5us
W20260709 12:21:35.672343 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 85226.6us
I20260709 12:21:35.673182 25165 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:35.596005 30632 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.579206 30580 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.659219 25274 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:35.631587 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:35.631798 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 45097.8us
I20260709 12:21:35.646824 30323 raft_consensus.cc:740] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:35.654263 30630 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:35.680961 30630 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:35.681344 30630 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:35.663259 30474 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:35.683760 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:35.684440 25168 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:35.684896 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:35.685531 25199 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:35.685889 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:35.687393 30472 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:35.688048 30472 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:35.661828 30293 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.690516 30293 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:35.693041 25274 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:35.694244 25822 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:35.695168 30536 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:21:35.695449 30639 log.cc:927] Time spent T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:21:35.695678 30536 raft_consensus.cc:697] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:35.696785 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 975) took 2688 ms. Trace:
I20260709 12:21:35.696696 30536 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.697202 25120 rpcz_store.cc:276] 0709 12:21:33.007922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.008146 (+   224us) service_pool.cc:224] Handling call
0709 12:21:33.008433 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:33.556251 (+547818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:33.556280 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:33.562509 (+  6229us) log.cc:844] Serialized 26 byte log entry
0709 12:21:35.259545 (+1697036us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b180048e6e0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae0d1 00007f2103ec9a0f
0709 12:21:35.366531 (+106986us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:35.366593 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.366694 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:35.696494 (+329800us) raft_consensus.cc:1685] finished
0709 12:21:35.696515 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:35.696726 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":582198,"raft.queue_time_us":547922,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":4026,"spinlock_wait_cycles":15675776,"thread_start_us":106727,"threads_started":1,"wal-append.queue_time_us":1988405}
I20260709 12:21:35.698807 30606 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.667620 25276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08989457946a4946811751dc96e31276"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:35.701978 25276 raft_consensus.cc:606] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:35.702358 25276 raft_consensus.cc:614] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:35.656904 30530 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:35.706951 25165 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:35.678412 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:35.674531 30125 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:35.679776 30632 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:35.679965 25126 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.673964 25825 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:35.727326 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 53804.3us
I20260709 12:21:35.708956 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:35.666234 30621 raft_consensus.cc:697] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:35.714354 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.736984 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:35.737644 25124 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:35.737792 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.646392 30617 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.747437 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.748385 25276 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:35.715145 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.718519 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.719525 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.750550 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:35.750735 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 43884.2us
I20260709 12:21:35.751698 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.751816 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:35.734730 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:35.673664 30622 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:35.749577 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.753245 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:35.760185 25276 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:35.712994 30244 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:35.772167 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:35.773602 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:35.758337 25267 raft_consensus.cc:2393] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:35.709373 30530 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:35.706477 30638 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:21:35.761415 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.735982 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:35.764320 25276 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:35.753583 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:35.739787 30471 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:35.778802 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:35.782121 25274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:35.782956 25274 raft_consensus.cc:606] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:35.783382 25274 raft_consensus.cc:614] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:35.783877 25124 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:35.739903 30125 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:35.789376 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:35.787350 30471 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.769752 25197 raft_consensus.cc:2393] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 14: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:21:35.770650 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.767244 25090 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:35.786150 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:35.791356 30643 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:35.860580 25242 connection.cc:256] RPC call timeout handler was delayed by -1.9730369769999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 12:21:35.864305 30572 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 1.758s	user 0.007s	sys 0.014s
I20260709 12:21:35.864128 30643 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:35.864638 25242 connection.cc:256] RPC call timeout handler was delayed by -1.0624199270000645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 12:21:35.780095 29727 consensus_queue.cc:1059] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:21:35.865676 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:35.865944 29727 raft_consensus.cc:3055] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:35.866389 29727 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:21:35.866494 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 99355.2us
I20260709 12:21:35.866786 30643 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.867425 30643 raft_consensus.cc:2764] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:21:35.867275 29727 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.868002 25090 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:35.868852 30643 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:35.869340 30643 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:35.869769 30643 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:35.805197 30604 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:35.871344 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 86393.4us
I20260709 12:21:35.805492 30293 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:35.770776 30394 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:35.879585 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:35.808832 30459 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.808517 30455 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.768613 30472 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:35.757910 29925 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.768101 25125 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:35.776120 30460 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:35.813067 25199 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:35.791546 30629 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:21:35.818969 25200 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:35.785343 30550 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:35.789746 30452 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:35.788261 30067 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:35.825963 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.839051 30617 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:35.840778 30474 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.842934 30125 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.843513 30530 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.849257 30630 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:35.877535 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:35.988426 25860 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
I20260709 12:21:35.903224 30460 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:35.885974 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:35.892961 25859 raft_consensus.cc:2393] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:35.860308 30471 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:35.896237 30502 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:35.900738 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1375) took 2416 ms. Trace:
I20260709 12:21:35.857173 30634 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:35.881448 30370 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:35.996567 25853 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:35.997381 25201 raft_consensus.cc:1240] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:35.996151 25270 rpcz_store.cc:276] 0709 12:21:33.478038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.480037 (+  1999us) service_pool.cc:224] Handling call
0709 12:21:33.499403 (+ 19366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:33.542079 (+ 42676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:33.542111 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:33.542568 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:21:33.799107 (+256539us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:33.799163 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:33.799256 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:35.828171 (+2028915us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:35.874416 (+ 46245us) raft_consensus.cc:1685] finished
0709 12:21:35.874437 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:35.894237 (+ 19800us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38458,"raft.queue_time_us":45870,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8750,"spinlock_wait_cycles":14820224,"thread_start_us":233411,"threads_started":1,"wal-append.queue_time_us":476012}
W20260709 12:21:35.965312 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.827375 30621 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:35.970259 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 196705us
I20260709 12:21:35.973686 30293 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:35.977831 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:36.004197 25200 raft_consensus.cc:1240] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:35.980640 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2658) took 1821 ms. Trace:
I20260709 12:21:36.002614 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.004912 25196 rpcz_store.cc:276] 0709 12:21:34.159427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.159686 (+   259us) service_pool.cc:224] Handling call
0709 12:21:34.160098 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:34.226254 (+ 66156us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:21:34.226586 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 12:21:34.226860 (+   274us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:34.226911 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:34.226966 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.980299 (+1753333us) spinlock_profiling.cc:243] Waited 65.9 ms on lock 0x7b54000a6254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:35.980359 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:35.980545 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":748,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":102,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":84,"spinlock_wait_cycles":151487360,"wal-append.queue_time_us":7984,"wal-append.run_cpu_time_us":10789,"wal-append.run_wall_time_us":1151602}
I20260709 12:21:35.989472 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:35.904171 30472 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:35.868609 29727 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:35.992918 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 109145us
I20260709 12:21:35.898852 30394 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:35.993914 25852 raft_consensus.cc:1240] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:35.992470 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:35.999531 25165 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:35.898284 30628 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:21:35.965072 30067 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:35.967257 30452 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:36.010762 30425 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:36.117928 30644 log.cc:927] Time spent T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.419s	user 0.003s	sys 0.000s
I20260709 12:21:36.095052 30067 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:35.860926 30638 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.031989 30502 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:21:35.992743 30460 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:36.126566 30394 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:36.127472 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 236745us
W20260709 12:21:36.057051 30648 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
W20260709 12:21:36.059340 30646 log.cc:927] Time spent T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 12:21:36.070273 30323 consensus_queue.cc:260] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.076290 30536 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.081307 25860 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:36.090569 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:35.907637 29925 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.011785 30214 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:36.098994 30452 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:36.134593 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.135007 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.135833 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.136080 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.136421 25857 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:36.137148 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.137259 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:36.137804 25857 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:36.100688 30530 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:35.993139 30612 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.012827 30472 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:36.103220 30651 log.cc:927] Time spent T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:21:36.105245 30474 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:36.110903 30634 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:36.111460 30630 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:36.113047 30455 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:36.034017 30620 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:35.992447 30617 consensus_queue.cc:1059] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 12:21:36.115976 30596 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.649s	user 0.006s	sys 0.000s
I20260709 12:21:36.099370 30643 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.152271 30323 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:36.168020 30643 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:36.181195 30653 raft_consensus.cc:3055] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:36.260061 30653 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:35.869050 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:36.215698 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.219856 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.223282 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 223681us
W20260709 12:21:36.264478 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 395370us
I20260709 12:21:36.265218 25165 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:36.226791 25199 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 10. Ops: []
W20260709 12:21:36.065701 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.293553 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.228735 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 261169us
I20260709 12:21:36.031833 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:36.295763 30617 raft_consensus.cc:2804] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:21:36.296833 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 264908us
I20260709 12:21:36.298404 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:36.138367 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.301255 25165 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:36.139830 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.302870 25852 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:36.304690 30478 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:36.131515 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.133045 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.180020 30622 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.307521 25090 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:36.308574 30617 raft_consensus.cc:697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:35.992475 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2439) took 2149 ms. Trace:
I20260709 12:21:36.310606 25855 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:36.224977 25195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:36.310997 30543 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:36.311672 30543 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.311744 25195 raft_consensus.cc:606] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:36.312328 30543 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:36.313230 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.301596 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.281997 29925 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:36.282018 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.295750 30662 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.304834 25852 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:36.138847 30536 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.336297 25851 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:36.312611 25195 raft_consensus.cc:614] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:36.214900 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 407955us
I20260709 12:21:36.314745 30622 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:36.310459 25119 rpcz_store.cc:276] 0709 12:21:33.843828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.844105 (+   277us) service_pool.cc:224] Handling call
0709 12:21:33.844381 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:33.879192 (+ 34811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:33.879223 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:33.879268 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:33.879298 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.992234 (+2112936us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b54001c98d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:35.992284 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:35.992415 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78339968}
I20260709 12:21:36.317548 25858 raft_consensus.cc:2410] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:21:36.290175 30643 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:36.353377 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 55374.6us
I20260709 12:21:36.325361 30658 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:36.355777 25242 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:36.356942 25857 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:36.357184 25242 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:36.337957 30536 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:36.338253 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:36.359517 25195 raft_consensus.cc:2393] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 17: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:36.330600 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:36.334551 30591 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:36.168566 30612 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:36.367684 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:36.368768 25118 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:36.369326 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:36.369616 30310 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.370262 30310 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.352260 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:36.352524 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.338315 30067 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.342424 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:36.350042 30319 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:36.374963 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.375485 30319 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.376536 25193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2670) took 2551 ms. Trace:
I20260709 12:21:36.376957 25193 rpcz_store.cc:276] 0709 12:21:33.825358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.825475 (+   117us) service_pool.cc:224] Handling call
0709 12:21:35.409435 (+1583960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:35.462739 (+ 53304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.365973 (+903234us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54000a7150. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:36.376342 (+ 10369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3606045440}
I20260709 12:21:36.375485 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:36.379122 25200 raft_consensus.cc:2376] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15. Re-sending same reply.
I20260709 12:21:36.380271 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:36.381563 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:36.374842 25852 raft_consensus.cc:2393] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 16: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:36.385517 30067 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:36.378259 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:36.386560 30576 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:36.387342 30576 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.388105 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:36.390926 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 1011) took 1072 ms. Trace:
I20260709 12:21:36.391405 25198 rpcz_store.cc:276] 0709 12:21:35.317926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.324550 (+  6624us) service_pool.cc:224] Handling call
0709 12:21:35.379223 (+ 54673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:35.392007 (+ 12784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.390344 (+998337us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54000a8554. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:36.390740 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27753216}
I20260709 12:21:36.392788 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:36.282433 30653 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.394850 30478 consensus_queue.cc:1059] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:36.395879 30634 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.396215 30310 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:36.397861 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 51834.7us
I20260709 12:21:36.397852 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:36.359480 30658 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:36.402801 30658 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.403369 30658 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:36.408469 30319 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:36.409513 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:36.409461 30643 consensus_queue.cc:1059] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:36.411512 30319 raft_consensus.cc:3055] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:36.412019 30319 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:36.411104 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:36.413313 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:36.401875 30564 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:36.413654 30471 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.415371 25854 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:21:36.415458 25195 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:21:36.396603 30634 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.415649 25274 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:36.413065 30319 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.362901 30591 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:36.423573 30591 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:36.426270 25202 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:36.427364 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:36.430660 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:36.430917 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:36.434684 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:36.437028 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 80022.3us
I20260709 12:21:36.437963 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:36.439164 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:36.439181 30502 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:36.440304 30425 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:36.440732 30425 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:36.441082 30425 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:36.441761 30634 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:36.442734 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:36.416085 30662 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.445990 25200 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 13: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:36.451195 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:36.451988 30662 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:36.452597 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:36.433871 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:36.446712 30562 consensus_queue.cc:1059] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 12:21:36.456380 30562 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:36.456874 30562 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:36.453863 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:36.416940 25241 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:21:36.469645 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.448369 30653 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:36.474437 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:36.460887 30502 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:36.487515 25197 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:21:36.488490 30319 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:36.489104 25200 raft_consensus.cc:3055] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:36.314287 30617 consensus_queue.cc:237] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.493191 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:36.454808 30634 consensus_queue.cc:1059] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:21:36.504240 25202 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:36.500267 25200 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:36.467319 30576 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:36.511876 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.512178 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:36.515358 30472 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.513569 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:36.506234 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:36.454795 30425 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.520540 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:36.498272 25092 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:36.520099 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:36.526683 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 109904us
I20260709 12:21:36.506789 30508 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:36.520566 25118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41032 (request call id 2812) took 2460 ms (client timeout 1775 ms). Trace:
I20260709 12:21:36.505686 30471 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:36.535396 25198 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:36.532614 25196 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 15. Current term is 16. Ops: []
W20260709 12:21:36.533864 25118 rpcz_store.cc:269] 0709 12:21:34.029847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.129597 (+ 99750us) service_pool.cc:224] Handling call
0709 12:21:36.475262 (+2345665us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b540021ded4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:36.490193 (+ 14931us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5063386368}
I20260709 12:21:36.540125 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:36.530313 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 86561.1us
I20260709 12:21:36.541993 25202 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:36.537348 25168 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:36.475533 30562 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.556345 25195 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:36.563354 30634 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:36.563546 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 62133.8us
I20260709 12:21:36.564034 30634 raft_consensus.cc:697] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:36.566432 30576 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:36.567804 25021 catalog_manager.cc:5697] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 9 to 12, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 12 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:36.569636 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:36.570967 30478 raft_consensus.cc:3055] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:36.571493 30478 raft_consensus.cc:740] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:36.572849 30478 consensus_queue.cc:260] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.573655 30452 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.574260 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:36.575253 25119 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 14: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:36.576064 30452 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:36.576958 30508 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.578290 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:36.579059 25860 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:36.582347 25168 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:36.530983 30543 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.587213 30626 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:36.587771 30626 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:36.587862 30543 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:36.590701 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:36.560148 25200 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.603890 25127 raft_consensus.cc:2393] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:36.582245 30564 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:36.520236 30502 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.621130 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:36.622169 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:36.565356 30634 consensus_queue.cc:237] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.632042 25200 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:36.589003 30626 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.615145 30564 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:36.645191 25271 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
W20260709 12:21:36.654217 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 193470us
I20260709 12:21:36.636134 30425 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:36.656147 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:36.658320 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.661072 30478 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:36.661273 30508 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:36.661746 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 113048us
I20260709 12:21:36.662767 25825 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:36.664229 25825 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:36.666375 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 54488.1us
I20260709 12:21:36.646826 30564 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:36.668933 25167 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:36.669589 30452 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:36.670492 30452 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:36.673254 30612 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:36.674439 30527 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:36.676570 30460 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.011s
I20260709 12:21:36.677364 30655 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:36.677918 30655 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:36.679556 30655 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.680768 30655 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:36.677186 30460 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.682628 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:36.683414 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:36.684212 30460 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:36.685391 25194 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 18: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:36.686542 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:36.687252 25120 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:36.689705 30508 raft_consensus.cc:2764] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:21:36.692588 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:36.696050 30503 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:36.696579 30503 raft_consensus.cc:697] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:36.657847 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:36.703161 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:36.708436 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.717332 25198 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
W20260709 12:21:36.720890 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 127130us
I20260709 12:21:36.734470 25167 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:36.735241 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 68463.4us
I20260709 12:21:36.741176 25200 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
W20260709 12:21:36.754573 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 48206.1us
I20260709 12:21:36.755925 25093 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:36.771230 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:36.772466 30617 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:36.773358 30617 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:36.774780 30503 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.779722 25242 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:36.787457 30672 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:36.721288 30576 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:36.791141 30576 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:36.794335 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.794552 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 208079us
I20260709 12:21:36.789691 30672 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:36.798214 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:36.804376 30323 consensus_meta.cc:287] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.560s	user 0.012s	sys 0.002s
W20260709 12:21:36.801824 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 144079us
I20260709 12:21:36.801677 25860 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:36.757931 25093 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:36.809981 25123 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:36.726336 30474 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:36.832664 30269 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:36.837026 30472 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:36.838532 25241 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:36.831425 30452 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:36.841012 25860 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:36.842303 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:36.845009 30591 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.842299 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.847584 30591 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:36.847831 25859 raft_consensus.cc:2410] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:21:36.849373 25193 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:36.852669 25241 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:36.853070 30684 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:36.850020 25200 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:36.850209 25272 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
W20260709 12:21:36.850339 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 92504.6us
I20260709 12:21:36.858325 25093 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:36.869719 25123 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:36.861863 25198 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:36.877156 30471 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:36.882247 30531 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.845902 30564 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.882860 30531 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.883730 25273 raft_consensus.cc:1240] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:36.884780 30564 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:36.862675 30474 raft_consensus.cc:697] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:36.885607 30531 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:36.866920 30323 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:36.886252 30474 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:36.890481 30679 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.157s	user 0.003s	sys 0.000s
I20260709 12:21:36.891034 25825 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:36.892516 25825 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:36.853907 30684 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:36.861774 25242 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.775s (SENT) [suppressed 12 similar messages]
W20260709 12:21:36.899704 25194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2677) took 1558 ms (client timeout 1899 ms). Trace:
I20260709 12:21:36.893803 25197 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:21:36.902593 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.875463 25167 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:36.896272 30471 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:36.910985 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 43663.6us
W20260709 12:21:36.903304 30675 log.cc:927] Time spent T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.324s	user 0.004s	sys 0.001s
W20260709 12:21:36.907476 25194 rpcz_store.cc:269] 0709 12:21:35.340965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.341084 (+   119us) service_pool.cc:224] Handling call
0709 12:21:35.977652 (+636568us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b5800211b98. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9b71 00007f2100de9a22 00007f2109d028d9 00007f2108e5cee0 00007f2108f260ab 00007f2108f26131 00007f2108ed40a0 00007f2108ed3984 00007f210244e6d4 00007f210244e662
0709 12:21:36.899463 (+921811us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54000a6254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:36.899615 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569305216}
I20260709 12:21:36.912593 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:36.893831 30452 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:36.928725 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:36.902299 30576 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:36.915810 30617 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:36.914683 30564 consensus_queue.cc:1059] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:21:36.940456 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:36.941938 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 83730.5us
W20260709 12:21:36.936172 30658 consensus_meta.cc:287] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.532s	user 0.014s	sys 0.000s
I20260709 12:21:36.917086 30478 consensus_queue.cc:1059] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:21:36.941781 30531 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:36.944967 30617 raft_consensus.cc:697] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:36.953847 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:36.956306 30125 consensus_queue.cc:1059] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:21:36.961218 30474 raft_consensus.cc:3055] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:36.961633 30474 raft_consensus.cc:740] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:36.962653 30474 consensus_queue.cc:260] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.948853 30622 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:36.952708 30452 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 12:21:36.982841 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 121081us
I20260709 12:21:36.985948 30471 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:36.989661 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.978989 30310 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:36.950071 30658 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:36.987918 25093 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:36.991464 25859 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:36.989580 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:36.986109 30677 consensus_queue.cc:1059] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
W20260709 12:21:36.993420 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.994712 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:36.996670 30677 raft_consensus.cc:3055] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:36.997118 30677 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:36.964088 30474 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:36.987521 30562 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:37.001462 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:37.006232 30508 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:37.006471 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:37.006923 30508 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.008471 30531 consensus_queue.cc:1059] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:37.009071 30323 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:37.009240 30508 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:37.009786 30323 raft_consensus.cc:3055] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:36.994513 30576 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:37.010138 30319 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:37.010376 30576 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:37.010644 30319 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.010892 30576 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:37.011023 30319 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:37.011366 30425 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:37.012151 30425 consensus_queue.cc:1243] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer b83c12959b9848b3b7bbc680f5ee6225 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:21:37.012372 30672 consensus_queue.cc:1059] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:37.012650 30564 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:37.013161 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:37.013535 30672 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:37.014191 30662 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:37.012693 30425 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:37.014623 30662 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:37.014948 30425 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:37.002869 30310 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.998258 30638 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:37.016029 30425 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.015759 30662 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.026790 30662 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:37.018841 25092 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:37.030927 30425 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:37.031239 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:37.031960 30472 raft_consensus.cc:3055] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:37.032466 30472 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:37.033293 25092 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:37.019497 25273 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 12:21:37.033903 30658 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:37.017848 30638 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.034271 30564 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:37.034621 30638 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:37.034756 30543 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:37.034909 30564 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.035558 30543 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:37.036285 30543 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:37.036692 30543 raft_consensus.cc:697] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:36.989013 30684 consensus_queue.cc:1059] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:21:37.038491 30684 raft_consensus.cc:3055] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:37.039001 30684 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:37.039963 30684 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.041460 30684 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:37.044765 30676 log.cc:927] Time spent T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.317s	user 0.000s	sys 0.002s
I20260709 12:21:37.046538 30564 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:37.048712 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:37.010217 30323 raft_consensus.cc:740] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:37.050244 30323 consensus_queue.cc:260] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.020002 30672 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:37.051561 30323 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:37.053548 30269 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.053642 30672 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.054286 30269 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.055078 30672 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:37.055583 30471 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:37.056476 30269 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:37.057046 30269 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:37.057646 30269 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:36.999526 30677 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.059155 30677 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:37.067165 25194 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 10.
W20260709 12:21:37.086997 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 140315us
I20260709 12:21:37.090770 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:37.095026 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:37.096720 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 88562.3us
I20260709 12:21:37.097466 25093 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:37.106408 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:37.106679 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:37.107476 30658 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:37.107721 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:37.033538 30472 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.037705 30543 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.050923 30617 consensus_queue.cc:237] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.114271 30622 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:37.287560 25092 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:37.279451 30658 raft_consensus.cc:697] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:37.089610 30638 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.337308 30214 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:37.328248 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 230828us
I20260709 12:21:37.344620 25270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:37.345225 25270 raft_consensus.cc:606] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:37.345618 25270 raft_consensus.cc:614] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:37.362710 30214 consensus_queue.cc:1059] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:37.363869 30214 raft_consensus.cc:3055] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:37.364209 30214 raft_consensus.cc:740] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:37.364800 30576 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.365005 30214 consensus_queue.cc:260] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.369485 30319 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.349437 30508 consensus_queue.cc:1059] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:21:37.372224 30638 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:37.372217 30508 raft_consensus.cc:3055] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:37.376621 30508 raft_consensus.cc:740] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:37.377476 30508 consensus_queue.cc:260] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.378743 30508 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:37.386977 30310 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:37.343459 30269 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:37.393232 30673 raft_consensus.cc:3055] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:37.393745 30673 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:37.394739 30673 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.396163 30673 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:37.405206 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:37.341205 30471 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.404942 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:37.416941 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:37.389812 30700 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:37.424021 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:37.424916 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
W20260709 12:21:37.467248 25168 leader_election.cc:336] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.682s (SENT)
I20260709 12:21:37.467767 25168 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:37.464867 30319 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:37.475297 30702 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:37.477291 25276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:21:37.478186 25276 raft_consensus.cc:606] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:37.478674 25276 raft_consensus.cc:614] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:37.483376 30472 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:37.467016 30214 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:37.422902 30531 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:21:37.472069 30700 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:21:37.493000 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 73189us
I20260709 12:21:37.461587 30471 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:37.507421 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 178189us
W20260709 12:21:37.506867 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.473583 30576 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:37.510331 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.513326 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.561390 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.568059 25274 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
W20260709 12:21:37.570179 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.570931 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 108314us
I20260709 12:21:37.513388 30700 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:37.582587 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 311076us
I20260709 12:21:37.498608 30658 consensus_queue.cc:237] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:37.584138 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 84433.4us
I20260709 12:21:37.591331 30697 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:21:37.597757 25092 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:37.606881 25857 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:37.587570 30703 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.600589 30617 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.620940 30617 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.623718 30617 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:37.630671 25859 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:37.632754 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:37.633256 25194 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:37.636071 25274 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:37.632565 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:37.640611 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 53075.3us
W20260709 12:21:37.642400 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.610155 30531 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.648362 30591 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:21:37.645442 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 61112.6us
I20260709 12:21:37.646942 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:37.651335 25168 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:37.652006 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:37.644901 25199 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:37.608224 30543 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:37.649943 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:37.658754 25193 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:37.661404 25124 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:37.654647 30653 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:21:37.663261 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:37.663056 30638 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:37.664125 25121 raft_consensus.cc:2410] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:21:37.665289 25125 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:37.667835 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:37.668448 25200 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:37.670563 25093 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:37.675397 25194 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:37.654323 30711 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:37.679392 30711 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.680272 25093 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:37.681183 30543 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:37.681547 30543 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.681710 30711 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:37.681777 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:37.681538 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:37.683918 30576 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:37.684402 30576 raft_consensus.cc:697] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:37.684738 30712 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.685045 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:37.685217 30576 consensus_queue.cc:237] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.685434 30712 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.687387 30543 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:37.687970 30712 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:37.688797 25122 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:21:37.690562 30699 log.cc:927] Time spent T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:21:37.690907 25119 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:37.676924 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:37.693163 25270 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:21:37.693524 25270 pending_rounds.cc:85] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 11
I20260709 12:21:37.693743 25270 pending_rounds.cc:107] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:21:37.677670 30703 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.693926 25270 raft_consensus.cc:2889] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:37.695909 30703 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:37.695919 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:37.696282 30622 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:37.697005 25270 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 13: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:37.696947 30622 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.699034 25859 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:37.675971 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:37.703153 30471 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:37.705786 30710 log.cc:927] Time spent T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:21:37.677333 30612 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:37.710626 30612 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.710942 25196 raft_consensus.cc:2393] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 14: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:37.712827 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:37.713135 30707 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:37.713562 25276 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:37.713690 30700 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.710995 30612 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:37.719030 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:37.741807 25093 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:37.743571 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:37.720085 25165 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:37.744020 25093 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:37.749922 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 97905.5us
I20260709 12:21:37.751369 25092 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:37.752985 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 99626us
I20260709 12:21:37.753923 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:37.743335 30508 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:37.697845 30543 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.653680 30531 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.769955 30722 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:37.746255 30310 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:37.773608 25168 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:37.771091 25276 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:37.758858 30508 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.754917 30460 raft_consensus.cc:2764] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:21:37.755362 30323 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:37.797595 30508 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:37.807345 30705 raft_consensus.cc:3055] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:37.807859 30705 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:37.808890 30705 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.811653 25822 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:37.824268 25200 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:37.834049 30319 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:37.834621 30319 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:37.835507 30319 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.836328 30531 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:37.837038 30319 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:37.838384 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:37.833855 25009 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1f471cfad2348a09c4b699f01f9dfa9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2e30bdd4cd1b45299f50b9bcfc9c1667 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:37.856750 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:37.861624 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:37.823351 30684 consensus_meta.cc:287] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.781s	user 0.013s	sys 0.003s
I20260709 12:21:37.862500 25194 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:37.837742 30508 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:37.864357 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:37.840893 30705 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:37.853296 30711 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:37.852646 30244 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:37.873798 25126 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:37.881263 25119 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:37.885345 30697 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:37.885946 30697 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.887113 30543 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:37.888371 30697 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:37.888886 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:37.901681 25122 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:21:37.906450 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:37.908278 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:37.909029 25123 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:37.911609 30712 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.912168 30712 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:37.913337 30713 log.cc:927] Time spent T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.234s	user 0.003s	sys 0.000s
I20260709 12:21:37.882572 30703 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.916057 30703 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.874150 30125 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:37.918345 30125 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.883380 25273 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:37.921344 30662 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:37.921983 30662 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.922531 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:37.918725 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:37.909720 30622 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:37.934679 30673 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:37.935441 30673 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:37.937650 30673 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:37.941167 25090 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:37.943676 30125 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:37.946455 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:37.947353 25852 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 15: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:37.949465 30712 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:37.950492 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:37.951073 30508 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:37.951716 25273 raft_consensus.cc:2410] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:21:37.952391 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:37.954417 30662 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:37.954928 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:37.955701 25125 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:37.955746 30703 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:37.958902 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:37.959472 25126 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:37.959523 30323 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:37.959841 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:37.961949 30719 log.cc:927] Time spent T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:37.963186 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:37.963955 25119 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 15: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:37.877442 30711 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.970422 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:37.971673 25122 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 15: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:37.980446 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:37.981415 25273 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:37.983711 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:37.985172 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:37.986482 25021 catalog_manager.cc:5697] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 8 to 10, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 10 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:37.987104 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:37.987893 25275 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:21:37.988116 25021 catalog_manager.cc:5697] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 3 to 9, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 9 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:37.990849 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.996737 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.996411 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:37.998483 25021 catalog_manager.cc:5697] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 12 to 15, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 15 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.999017 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:38.000023 25274 raft_consensus.cc:2393] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:38.001226 25021 catalog_manager.cc:5697] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:38.002415 25093 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:38.003439 30323 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:38.003562 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:38.003978 30323 raft_consensus.cc:697] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:38.004897 30323 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.006321 30310 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:38.006707 30310 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.006795 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:38.007076 30310 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:38.008163 25855 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:21:38.008518 25855 pending_rounds.cc:85] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 6
I20260709 12:21:38.008761 25855 pending_rounds.cc:107] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:21:38.009008 25855 raft_consensus.cc:2889] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:37.982941 25119 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 12:21:38.017012 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:38.018489 25123 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:38.002874 25021 catalog_manager.cc:5697] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 9 to 13, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 13 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:38.025080 25167 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:38.012746 25125 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
W20260709 12:21:38.043033 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 269522us
I20260709 12:21:37.970436 30711 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:38.046013 30244 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:37.953672 30612 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:38.056097 25273 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:38.046008 25021 catalog_manager.cc:5697] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 9 to 11, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 11 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.019447 30543 raft_consensus.cc:2764] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:21:38.064249 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.074199 25200 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:38.066857 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:38.077836 25275 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:38.081146 25090 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:38.081223 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.082259 25118 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:38.044509 30703 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:38.099315 25196 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 14: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:38.100623 25021 catalog_manager.cc:5697] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:38.106703 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 344097us
I20260709 12:21:38.108003 25165 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:38.095348 30214 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:38.103440 25122 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:38.083536 30712 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:38.101055 30703 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.125429 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.125121 25021 catalog_manager.cc:5697] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 6 to 13, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 13 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:38.131134 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:38.127063 25118 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
W20260709 12:21:38.146961 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.155325 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.130339 30703 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:38.137391 30626 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:38.153554 25021 catalog_manager.cc:5697] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 12 to 14, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 14 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:38.126605 30214 raft_consensus.cc:697] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:38.139935 30712 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:38.179265 25193 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:38.180065 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.179908 25021 catalog_manager.cc:5697] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:38.180846 25119 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:38.153988 30673 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.180428 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:38.183570 25193 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:38.193838 25126 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:38.197988 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:38.199051 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:38.204154 25196 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:21:38.210539 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.210235 25021 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 10 to 13, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 13 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:38.211970 25021 catalog_manager.cc:5697] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 8 to 11, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 11 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.214354 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.214627 30214 consensus_queue.cc:237] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:38.217017 25200 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
W20260709 12:21:38.218987 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.219059 30700 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:38.226861 30700 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:38.229761 30700 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:38.230844 30700 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:38.233222 30474 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.234427 25199 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:38.234737 30474 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.236580 25197 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 15: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:38.236665 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.237468 25199 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:38.237607 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.174157 30508 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:38.213500 25021 catalog_manager.cc:5697] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 7 to 11, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 11 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.240653 25193 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:38.244508 25119 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:38.245560 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.242247 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:38.246516 25199 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 18: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:38.250815 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.248924 25854 raft_consensus.cc:2410] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:21:38.252801 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.255481 25093 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:38.247507 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.257210 30712 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:38.262480 30474 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:38.266256 25023 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41756 (request call id 376) took 28887 ms (client timeout 15000 ms). Trace:
I20260709 12:21:38.213876 30711 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.268985 30711 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:38.270366 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.270932 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:38.202481 30673 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.271484 25118 raft_consensus.cc:2376] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12. Re-sending same reply.
I20260709 12:21:38.271886 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:38.272444 25268 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:38.272521 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.273257 30673 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:38.273888 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:38.274561 25121 raft_consensus.cc:1240] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:38.245069 30543 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:21:38.275049 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:38.275825 25121 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:21:38.276902 25123 raft_consensus.cc:1240] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: []
W20260709 12:21:38.266793 25023 rpcz_store.cc:269] 0709 12:21:09.355132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.356759 (+  1627us) service_pool.cc:224] Handling call
0709 12:21:38.235858 (+28879099us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:31.656202 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:31.656818 (+   616us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:31.656852 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:21:31.656870 (+    18us) tablet.cc:662] Decoding operations
0709 12:21:31.657955 (+  1085us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:31.665824 (+  7869us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:31.671441 (+  5617us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:21:31.712217 (+ 40776us) tablet.cc:701] Row locks acquired
0709 12:21:31.712237 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:21:31.712396 (+   159us) write_op.cc:270] Start()
0709 12:21:31.712521 (+   125us) write_op.cc:276] Timestamp: P: 1783599691712349 usec, L: 0
0709 12:21:31.712543 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:31.747735 (+ 35192us) log.cc:844] Serialized 4398 byte log entry
0709 12:21:32.610304 (+862569us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b180025ee20. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:33.077500 (+467196us) op_driver.cc:464] REPLICATION: finished
0709 12:21:33.173026 (+ 95526us) write_op.cc:301] APPLY: starting
0709 12:21:33.174421 (+  1395us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:33.236453 (+ 62032us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:33.236486 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:33.246382 (+  9896us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:33.246731 (+   349us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:21:33.246842 (+   111us) write_op.cc:312] APPLY: finished
0709 12:21:33.247341 (+   499us) log.cc:844] Serialized 105 byte log entry
0709 12:21:33.247603 (+   262us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:33.247811 (+   208us) write_op.cc:454] Released schema lock
0709 12:21:33.247886 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:33.248514 (+   628us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:33.248565 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3879175,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":84219,"apply.run_cpu_time_us":16809,"apply.run_wall_time_us":80068,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50195,"num_ops":11,"prepare.queue_time_us":85959,"prepare.run_cpu_time_us":18452,"prepare.run_wall_time_us":264153,"raft.queue_time_us":445308,"raft.run_cpu_time_us":5451,"raft.run_wall_time_us":66335,"replication_time_us":1364759,"spinlock_wait_cycles":11337472,"thread_start_us":457164,"threads_started":4,"wal-append.queue_time_us":174628,"wal-append.run_cpu_time_us":17003,"wal-append.run_wall_time_us":1649076}]]}
I20260709 12:21:38.277904 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.278513 25124 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:38.247490 30508 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.279112 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.280429 30508 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:38.281056 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:38.281056 30576 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:38.282473 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.282681 25267 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:21:38.283069 25267 pending_rounds.cc:85] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 7
I20260709 12:21:38.283267 25267 pending_rounds.cc:107] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:21:38.283484 25267 raft_consensus.cc:2889] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:38.284166 25119 raft_consensus.cc:2410] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:21:38.247887 25021 catalog_manager.cc:5697] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 11, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 11 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:38.249312 25193 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:21:38.254784 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.287001 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:38.288473 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 296710us
I20260709 12:21:38.287582 25197 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:38.292280 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:38.292393 25168 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:38.296358 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.299422 25275 raft_consensus.cc:3055] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:38.299918 25275 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:38.302539 25125 raft_consensus.cc:2468] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:38.303519 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.304136 25125 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:38.300127 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:38.296998 25199 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:38.305476 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:38.306277 25271 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:38.307355 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:38.309163 25168 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:38.305889 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:38.317760 25274 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:38.305507 25852 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
I20260709 12:21:38.305054 25021 catalog_manager.cc:5697] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 8 to 13, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 13 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.323628 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:38.323764 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:38.327255 25273 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:38.329998 25272 raft_consensus.cc:2393] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 14: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:38.329528 25021 catalog_manager.cc:5697] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 8 to 11, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 11 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:38.331316 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.332284 25242 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:38.335457 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:38.335191 25241 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:38.319060 30617 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:38.336037 25126 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:38.317313 30612 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:38.347074 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.347946 30638 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:38.295746 30703 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.353729 30502 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:38.325162 30508 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:38.354310 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.354949 25195 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
I20260709 12:21:38.354765 30508 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.358297 25202 raft_consensus.cc:2368] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14.
W20260709 12:21:38.359525 30319 consensus_meta.cc:287] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
I20260709 12:21:38.360298 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:38.360472 25122 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:38.361111 25271 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 14: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:38.361884 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.362711 30703 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:38.350593 25199 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:38.364416 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:38.365036 25857 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:21:38.330968 30727 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:38.331316 30673 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.318189 30503 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:38.369086 25021 catalog_manager.cc:5697] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:38.368448 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:38.341041 30658 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:38.340812 30310 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:38.373903 30623 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:38.379967 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:38.339152 30591 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:38.323351 30622 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:21:38.339197 30705 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:38.336467 30711 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.391410 25268 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:38.392622 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.333191 30576 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:21:38.364091 30653 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:38.408782 25275 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:38.416304 25275 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:38.417351 25124 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:38.417691 25125 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:38.418720 25021 catalog_manager.cc:5697] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.428370 25822 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:38.432767 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:38.433748 25860 raft_consensus.cc:2368] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13.
I20260709 12:21:38.435083 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:38.398772 30502 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:38.437032 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.442507 30711 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.443571 30697 raft_consensus.cc:2804] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:38.390674 30658 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.430912 25165 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:38.398438 30684 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:38.449097 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:38.451661 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:38.452385 25271 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:38.444324 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:38.446477 25825 leader_election.cc:400] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14.
I20260709 12:21:38.454434 25825 leader_election.cc:403] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:38.456646 25857 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:38.466012 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:38.466120 25122 raft_consensus.cc:1275] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:38.468209 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:38.426759 30474 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:38.476629 25021 catalog_manager.cc:5697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:38.401170 30612 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:21:38.436000 30705 raft_consensus.cc:697] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:38.454218 30658 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:38.399588 30673 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.399778 30503 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:38.502900 25167 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:38.511793 25275 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:21:38.512380 25275 pending_rounds.cc:85] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 7
I20260709 12:21:38.512718 25275 pending_rounds.cc:107] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:21:38.513070 25275 raft_consensus.cc:2889] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:38.529417 25859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.014s	sys 0.018s
W20260709 12:21:38.530050 25859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.014s	sys 0.018s
I20260709 12:21:38.490525 30653 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:38.444185 30662 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:21:38.541386 25021 catalog_manager.cc:5697] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 5 to 8, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 8 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:38.374526 30620 consensus_queue.cc:1059] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:21:38.491523 30474 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.403761 30617 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:21:38.569279 25858 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:38.497049 30508 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:38.574954 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:38.591920 25119 raft_consensus.cc:3060] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:38.579763 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:38.583128 30705 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.585902 30503 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:38.588274 30673 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:38.598402 25021 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 8 to 11, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 11 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.589748 30711 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:38.602644 25856 raft_consensus.cc:2393] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:38.576377 30474 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:38.605264 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 213045us
I20260709 12:21:38.610231 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:38.601944 30623 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:38.600801 30503 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.603713 30673 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.651589 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:38.605300 30502 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.606750 30638 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14.
I20260709 12:21:38.629742 30711 raft_consensus.cc:476] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 12:21:38.628811 30591 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:21:38.695547 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.703642 25275 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 17. Current term is 18. Ops: []
W20260709 12:21:38.705684 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 214852us
I20260709 12:21:38.696511 30697 raft_consensus.cc:697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:38.716986 30697 consensus_queue.cc:237] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.654603 30623 raft_consensus.cc:697] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:38.729207 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:38.730621 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 79065.8us
I20260709 12:21:38.734687 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:38.742872 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 311417us
I20260709 12:21:38.699944 30310 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:38.712028 30724 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.712551 30244 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.655527 30503 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:38.679625 30673 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.687475 30502 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.735795 30638 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:38.743503 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:38.783078 25202 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:38.793746 25199 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:38.736083 30712 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.739691 25127 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:38.797780 30638 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:38.794518 30734 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:21:38.739091 30703 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:21:38.763880 30756 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:38.792995 30711 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.791236 30576 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:38.834333 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 51881.3us
I20260709 12:21:38.841027 25268 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:21:38.846083 25118 consensus_meta.cc:287] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
I20260709 12:21:38.846743 25118 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
W20260709 12:21:38.851428 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.777817 30617 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:21:38.856865 25119 raft_consensus.cc:2468] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:38.787500 30724 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:38.790809 30244 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.835029 30726 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:38.874799 30732 log.cc:927] Time spent T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.279s	user 0.001s	sys 0.001s
I20260709 12:21:38.901278 30754 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.902127 30754 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.851662 30756 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.825574 30712 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.870174 30653 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:38.914606 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:38.915376 25268 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:38.855933 30711 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.855482 30576 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:38.926157 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 183065us
I20260709 12:21:38.920617 25822 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:38.851086 30591 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.956436 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.958839 25168 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:38.851864 30623 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:38.961758 25202 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:38.892596 30726 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:38.960634 30735 log.cc:927] Time spent T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
W20260709 12:21:38.977227 30738 log.cc:927] Time spent T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:21:38.979800 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:38.981616 30747 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:21:38.984112 30704 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:38.984506 30704 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.984846 30704 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:38.986781 30712 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:38.989444 30756 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:38.990983 30727 raft_consensus.cc:3055] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:38.991437 30727 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:38.992437 30727 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:38.991027 30724 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:38.997370 30727 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:39.004280 30739 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
W20260709 12:21:39.005908 30737 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:21:38.919976 30754 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.008855 25193 raft_consensus.cc:1240] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:38.963703 30751 log.cc:927] Time spent T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 12:21:39.007629 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1866) took 1001 ms. Trace:
I20260709 12:21:39.015120 30460 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:39.016476 30502 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.017725 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.065572 25852 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:39.017771 30244 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.018399 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.019145 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:38.946587 30653 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.025923 25199 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
W20260709 12:21:39.063511 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 99313.7us
W20260709 12:21:39.062386 30658 consensus_meta.cc:287] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.006s
W20260709 12:21:39.030220 25271 consensus_meta.cc:287] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.005s
I20260709 12:21:38.972204 30757 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:39.077507 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:39.072039 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.080976 25271 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:39.082154 25241 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:39.035723 25859 rpcz_store.cc:276] 0709 12:21:38.006115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.011090 (+  4975us) service_pool.cc:224] Handling call
0709 12:21:38.011411 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:38.011870 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:38.011898 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:38.012521 (+   623us) log.cc:844] Serialized 52 byte log entry
0709 12:21:38.530656 (+518135us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:38.530717 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.530809 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.007376 (+476567us) raft_consensus.cc:1685] finished
0709 12:21:39.007395 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.007549 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7980,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":14199,"thread_start_us":517647,"threads_started":1,"wal-append.queue_time_us":678579}
I20260709 12:21:39.078922 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:21:39.072062 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 150977us
W20260709 12:21:39.091670 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:39.095631 25270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.010s	sys 0.003s
W20260709 12:21:39.096284 25270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.010s	sys 0.003s
I20260709 12:21:39.059015 30460 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:39.105646 25195 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 16: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:21:39.114670 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.068521 30756 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:39.121102 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 110180us
I20260709 12:21:39.094506 30655 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:39.130374 30775 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:39.130661 30704 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.132997 30704 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.133713 30460 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:39.134975 30460 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:39.109593 30503 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:39.143647 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 64832.8us
I20260709 12:21:39.092005 30658 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.187852 25201 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:21:39.167011 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 44885.7us
I20260709 12:21:39.103029 30757 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:39.195559 30774 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:39.195905 30757 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:39.199350 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:39.204514 30703 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.205225 30703 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.211462 30703 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:39.177691 30474 consensus_meta.cc:287] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 12:21:39.212811 30474 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.216711 30474 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:39.131356 30773 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:21:39.222222 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 97374us
I20260709 12:21:39.229826 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.127240 30244 consensus_queue.cc:1048] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 12:21:39.231746 25242 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:39.124495 30756 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.188858 30626 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:39.258510 30711 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.259194 30576 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.260334 30756 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.260471 30726 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.261123 30749 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:39.294840 30780 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:39.262444 30752 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.306883 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.263592 30653 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.263993 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:39.231360 30638 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.307614 25276 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:39.221454 30697 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:39.258680 30788 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:39.231355 30502 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:39.237851 30773 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:39.261261 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:39.270826 30626 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.292623 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1420) took 1553 ms. Trace:
I20260709 12:21:39.311260 30780 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:39.315615 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:39.316568 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 55405.4us
I20260709 12:21:39.301036 30673 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:39.317682 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 53795.3us
I20260709 12:21:39.318004 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:39.296659 30658 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.312563 25270 rpcz_store.cc:276] 0709 12:21:37.725364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.725517 (+   153us) service_pool.cc:224] Handling call
0709 12:21:37.749158 (+ 23641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.754993 (+  5835us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:21:38.117482 (+362489us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.096670 (+979188us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:39.097295 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:21:39.097552 (+   257us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:39.097605 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.097706 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.278384 (+180678us) raft_consensus.cc:1685] finished
0709 12:21:39.278408 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.278575 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36307,"prepare.queue_time_us":152151,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":27,"raft.queue_time_us":384533,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":24317,"thread_start_us":1212388,"threads_started":3,"wal-append.queue_time_us":426982}
I20260709 12:21:39.311343 30502 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.330976 25825 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:39.311280 30788 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:39.337873 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.312253 30749 raft_consensus.cc:697] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:39.338280 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.338824 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.339614 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:39.339854 25273 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:39.342445 25124 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:39.312292 30773 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:39.343683 25118 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:21:39.340570 25197 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:39.315953 30704 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:39.322219 30653 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:39.348834 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:39.326988 30748 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:39.354926 25090 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:39.329228 30712 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.330235 30700 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:39.334177 30638 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:39.358680 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:39.339133 30502 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:39.335857 30576 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:39.316402 30697 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.362112 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2826) took 1085 ms. Trace:
W20260709 12:21:39.362707 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 44779.5us
I20260709 12:21:39.356324 30310 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:21:39.359557 30748 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:39.340793 30788 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:39.355850 30658 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:39.356344 30704 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.371380 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:39.348333 30711 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:39.347976 30319 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:39.357267 30653 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.311635 30752 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:39.339125 30753 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:21:39.370929 25120 rpcz_store.cc:276] 0709 12:21:38.272561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.279182 (+  6621us) service_pool.cc:224] Handling call
0709 12:21:38.279506 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:38.279894 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:38.279924 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:38.280467 (+   543us) log.cc:844] Serialized 52 byte log entry
0709 12:21:38.605937 (+325470us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:38.785005 (+179068us) log.cc:844] Serialized 14 byte log entry
0709 12:21:38.788298 (+  3293us) log.cc:844] Serialized 14 byte log entry
0709 12:21:38.979349 (+191051us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b1800474460. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e21522 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:39.309429 (+330080us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b1800474460. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287 00007f2103f29208
0709 12:21:39.357202 (+ 47773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.357301 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.357354 (+    53us) raft_consensus.cc:1685] finished
0709 12:21:39.357372 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.357522 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":388884,"prepare.queue_time_us":137274,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":7588,"raft.queue_time_us":530556,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":13549,"spinlock_wait_cycles":41697280,"thread_start_us":505396,"threads_started":3,"wal-append.queue_time_us":1019114}
I20260709 12:21:39.386126 30638 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:39.403116 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:39.419411 25852 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:39.357401 30508 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:21:39.406555 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:39.388243 30673 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:39.409582 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.439388 25858 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:39.385846 30748 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:39.425238 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.407631 30310 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:39.443351 30762 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:21:39.395736 30711 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:39.373517 30724 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:21:39.362586 30700 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:39.363394 30712 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:39.442102 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.373652 30576 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:39.443742 30794 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:21:39.411870 30653 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:39.453626 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 94983.3us
I20260709 12:21:39.451575 25274 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:39.454767 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.457660 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:39.423766 30638 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:39.443849 30697 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:39.459515 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 104707us
I20260709 12:21:39.458411 25858 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:39.447183 30310 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:39.447678 30711 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:39.411680 30319 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.461738 30638 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:39.471269 30797 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:39.482383 30797 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.483142 30797 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:39.490255 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.493325 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:39.493727 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:39.402298 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.494887 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:39.494958 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:39.495675 25199 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:39.503002 25852 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 18.
I20260709 12:21:39.504803 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.505455 25124 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:39.509366 25825 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:39.511250 25198 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:21:39.511281 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.483863 30653 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.523017 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:39.523162 25860 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:39.543628 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:39.543982 25199 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 18.
I20260709 12:21:39.524593 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:39.522699 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:39.547083 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:39.547497 25195 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:39.550935 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.523317 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:39.554129 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:39.490363 30780 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:39.562440 25197 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 14: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:39.544447 30753 raft_consensus.cc:2804] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:39.555893 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:39.446587 30749 consensus_queue.cc:237] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.565482 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.566228 25851 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:39.550361 30697 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:39.585916 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.522768 30757 consensus_queue.cc:1059] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:21:39.570600 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:39.558856 30319 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.584154 30778 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:39.562922 30673 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:39.565876 30782 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:39.569551 30662 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:39.566039 30753 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:39.549003 30310 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:39.584453 30724 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:39.592991 30707 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:39.584908 30697 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:39.557956 30801 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:21:39.625207 25194 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:21:39.625943 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 68555.2us
I20260709 12:21:39.595956 30783 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:39.627707 25852 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:39.611248 30704 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:39.615677 30753 raft_consensus.cc:3060] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:39.634069 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 63534.7us
I20260709 12:21:39.642808 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:39.626451 30697 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:39.623554 30662 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:39.621701 30782 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:39.633100 30778 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:39.616381 30805 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:21:39.643250 30707 raft_consensus.cc:697] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:39.665937 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.673054 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:39.667543 25092 leader_election.cc:400] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13.
I20260709 12:21:39.660208 30712 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.651623 30724 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:39.680476 30724 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:39.683313 30653 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.642295 30762 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:39.675596 25092 leader_election.cc:403] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:21:39.642871 30502 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.674041 30777 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:39.666671 30576 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.661247 30319 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:39.677800 30787 consensus_queue.cc:1059] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:21:39.674537 30704 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:39.693092 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.696175 30319 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.700467 30319 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.675019 30778 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:39.638713 30783 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.704113 30748 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:39.669196 30727 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:21:39.686579 30777 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.720832 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.716557 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.688333 30712 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:39.727442 25271 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:39.728302 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.662652 30782 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.714918 30508 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13.
I20260709 12:21:39.737399 25856 raft_consensus.cc:2393] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:39.743271 30803 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:21:39.743705 30782 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.744997 30808 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:39.745656 30808 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.746390 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:39.747211 25858 raft_consensus.cc:2393] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 15: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:39.748106 30808 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.748169 30778 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.750494 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.752308 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.753175 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.728598 30777 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:39.688010 30762 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.757134 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:39.758682 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 91239.2us
I20260709 12:21:39.760062 25851 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:39.759047 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:39.715610 30662 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.677824 30707 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.743279 30502 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.736133 30712 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.778568 30776 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:39.782087 25858 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:39.794703 25851 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:39.804574 30697 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:39.806325 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 46145.2us
I20260709 12:21:39.806958 30697 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.807163 25092 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:39.808565 30638 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.811029 30638 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.811764 25859 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:39.811944 30508 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:39.812573 30508 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.814280 30775 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:39.814785 30775 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:39.814874 30508 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.815426 30508 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:39.815903 30508 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.821784 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.832542 25856 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:39.837311 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.840423 25856 raft_consensus.cc:2368] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 14. Current term is 15.
I20260709 12:21:39.853478 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.836843 30819 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:39.822569 30776 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.865502 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:39.871488 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 64427us
I20260709 12:21:39.872342 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:39.875744 25092 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:39.877358 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:39.849677 30711 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.880427 25127 raft_consensus.cc:2376] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12. Re-sending same reply.
I20260709 12:21:39.883504 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.884357 25127 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:39.885494 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.886607 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.887251 25122 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:39.890563 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.874643 30508 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.912919 30626 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.873413 30819 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:39.900341 25854 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:39.900419 25856 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:39.906257 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.943922 25858 raft_consensus.cc:2410] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:21:39.881596 30753 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.913956 30712 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.935849 30775 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.950135 30775 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.950384 30748 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:39.950965 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.951248 30797 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:39.952404 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.890772 30576 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:39.914844 30783 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.879741 30805 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:39.913074 30773 consensus_meta.cc:287] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.002s
W20260709 12:21:39.919028 30788 consensus_meta.cc:287] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 12:21:39.966207 30788 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:39.922562 30814 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:21:39.922989 30762 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.923672 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.924319 30776 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.899748 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.926306 30711 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.930718 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.953413 30750 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:39.933882 30816 log.cc:927] Time spent T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:21:39.980623 30777 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.981277 30753 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.936288 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:39.982298 25860 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:39.983062 30788 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.983088 30777 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.983757 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:39.984283 25123 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:39.986819 30797 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.969192 30773 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.988154 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.989383 30773 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.989981 25273 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:39.990255 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:39.991096 25123 raft_consensus.cc:2468] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:39.989377 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:39.993024 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:39.954412 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:39.993468 25241 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:39.958307 30819 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:39.994747 25271 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:39.955015 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:39.955523 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.996142 30819 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:39.992988 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:39.914430 30700 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:39.997291 25123 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:39.997465 30775 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:39.958638 25270 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:39.998157 30750 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:39.958669 25127 raft_consensus.cc:2368] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:40.000221 30750 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:40.001155 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:39.974175 30460 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:40.002480 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.001159 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:40.004565 25267 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:40.004796 25123 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:39.971083 25125 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:39.944758 30612 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.007594 30612 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.015043 25273 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:40.018065 30780 raft_consensus.cc:3055] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:40.018512 30780 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:40.019342 30780 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:40.020305 30780 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:40.013679 25242 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:40.003628 30781 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:39.972656 25122 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:40.022655 30781 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:40.023792 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:40.024292 25119 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:40.024408 25122 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:40.024832 30781 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:40.025350 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.973953 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.026309 25202 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:39.975069 25851 raft_consensus.cc:2393] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 13: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:39.932111 25857 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:39.976929 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:39.977780 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:39.978571 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:39.978819 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:39.979240 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:39.993126 25121 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:39.969751 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:39.938859 25822 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:40.006552 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:40.001756 25127 raft_consensus.cc:2376] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13. Re-sending same reply.
I20260709 12:21:39.994686 25241 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:40.032642 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:40.034914 25854 raft_consensus.cc:2368] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 15. Current term is 16.
I20260709 12:21:40.030216 25193 raft_consensus.cc:2468] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:40.035185 25241 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:40.035269 25860 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
W20260709 12:21:40.036023 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 97245.3us
I20260709 12:21:40.037966 25165 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:40.038786 30626 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:40.039777 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:40.009825 30612 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:40.043929 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.040349 25241 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:40.033957 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.051447 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.051954 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.047272 25120 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:39.968560 30748 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:40.046377 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.053272 25271 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:21:40.053323 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.053627 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:40.055193 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.055692 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.054705 25267 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:40.057328 25269 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:40.059073 25241 leader_election.cc:400] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 15. Current term is 16.
I20260709 12:21:40.059526 25241 leader_election.cc:403] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:21:40.061544 25857 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 14: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:40.034307 30750 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.035348 30781 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:40.043038 30705 raft_consensus.cc:2764] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:21:40.061977 30756 raft_consensus.cc:2764] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:21:40.002504 30460 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.147631 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.051152 30775 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:40.149426 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.149991 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:40.164845 25126 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:21:40.042969 30823 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:40.152017 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:40.060920 30762 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:40.040539 30673 raft_consensus.cc:2804] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:40.159639 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.162495 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 1044) took 1778 ms. Trace:
I20260709 12:21:40.165179 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:40.056780 30788 consensus_queue.cc:1059] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 12:21:40.064150 30748 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.178686 25122 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:40.180603 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.181020 25194 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:21:40.184157 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:40.184360 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.184732 25201 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:40.185500 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.182121 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:40.194357 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.194410 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.196458 25202 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:21:40.196869 25202 pending_rounds.cc:85] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 8
I20260709 12:21:40.197077 25202 pending_rounds.cc:107] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:21:40.197299 25202 raft_consensus.cc:2889] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:40.168802 25196 rpcz_store.cc:276] 0709 12:21:38.384440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.384591 (+   151us) service_pool.cc:224] Handling call
0709 12:21:38.407508 (+ 22917us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:38.718153 (+310645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:38.718202 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:38.719004 (+   802us) log.cc:844] Serialized 52 byte log entry
0709 12:21:38.918540 (+199536us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:38.968958 (+ 50418us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.999032 (+1030074us) spinlock_profiling.cc:243] Waited 6.62 ms on lock 0x7b18003acba0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287 00007f2103f29208
0709 12:21:40.154311 (+155279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.154435 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:40.154499 (+    64us) raft_consensus.cc:1685] finished
0709 12:21:40.162204 (+  7705us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.162414 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9867,"prepare.queue_time_us":47573,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":211299,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":54369,"spinlock_wait_cycles":15253248,"thread_start_us":620316,"threads_started":3,"wal-append.queue_time_us":539400}
I20260709 12:21:40.167429 30823 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.200883 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:40.202636 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.179107 30626 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:40.177983 30705 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.178313 30612 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:40.155611 30750 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.207355 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.167037 30781 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.180342 30832 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:40.205636 30823 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:40.212779 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.186403 30478 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:21:40.228163 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.208771 30626 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.212952 30711 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:40.214164 30832 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.214782 30612 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:40.235072 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.233364 30626 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:40.231647 25825 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:40.243175 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.244160 25202 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:40.211175 30705 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.249686 25121 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:40.222595 30715 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:40.232899 30711 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.257766 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:40.258541 25121 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:40.259418 30697 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:40.257372 30715 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.267306 30697 raft_consensus.cc:697] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:40.268401 30697 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.270514 30748 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:40.274365 30460 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:40.255820 30711 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:40.276793 30799 log.cc:927] Time spent T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.719s	user 0.004s	sys 0.001s
I20260709 12:21:40.279263 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2837) took 1574 ms. Trace:
I20260709 12:21:40.279615 25275 rpcz_store.cc:276] 0709 12:21:38.704987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.705104 (+   117us) service_pool.cc:224] Handling call
0709 12:21:38.729645 (+ 24541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.123888 (+394243us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:39.318902 (+195014us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.424461 (+105559us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.424665 (+   204us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:39.425270 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 12:21:39.444589 (+ 19319us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:39.444625 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.921521 (+476896us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b1800439d80. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100def2a6 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1
0709 12:21:39.922119 (+   598us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b1800439d80. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:40.008881 (+ 86762us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b1800439d80. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e21522 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:40.016839 (+  7958us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x7b540005ffd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:40.016889 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:40.240250 (+223361us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:40.279024 (+ 38774us) raft_consensus.cc:1685] finished
0709 12:21:40.279049 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.279200 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30550,"prepare.queue_time_us":243192,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":338623,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":40121,"spinlock_wait_cycles":261609472,"thread_start_us":489369,"threads_started":3,"wal-append.queue_time_us":136595}
I20260709 12:21:40.282123 30750 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:40.281661 30612 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.283260 25197 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:40.284842 30783 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:40.285470 30783 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.287513 30832 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:40.288584 30781 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:40.290679 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:40.296126 25201 raft_consensus.cc:2410] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:21:40.293835 25127 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:40.304369 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.310483 30705 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:40.315658 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.316562 25201 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:40.293488 30783 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:40.327260 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 104451us
I20260709 12:21:40.325387 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:40.346724 25167 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:40.350858 30750 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:40.352236 30770 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:40.355839 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.356977 30802 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:40.357244 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:40.358565 30765 log.cc:927] Time spent T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 1.232s	user 0.005s	sys 0.000s
I20260709 12:21:40.358630 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.359095 30802 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:40.359531 25851 raft_consensus.cc:2393] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 16: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:40.361342 25093 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:40.362210 30802 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:40.362726 30802 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.363080 30802 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:40.370538 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.371757 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.373214 25167 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:40.389171 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.393013 25167 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:40.397173 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.375700 30755 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.412356 30840 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:40.422171 30715 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:40.431763 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.446336 25200 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:40.448514 30752 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:40.429950 30612 raft_consensus.cc:3060] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:40.421833 30755 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:40.457618 30802 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:40.465150 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 102002us
I20260709 12:21:40.434101 30839 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:40.475684 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.478905 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.490779 30700 consensus_queue.cc:1059] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:40.491729 30700 raft_consensus.cc:3055] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:40.492084 30700 raft_consensus.cc:740] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:40.492820 30700 consensus_queue.cc:260] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.494978 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2505) took 1142 ms. Trace:
I20260709 12:21:40.495644 25118 rpcz_store.cc:276] 0709 12:21:39.352909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.353302 (+   393us) service_pool.cc:224] Handling call
0709 12:21:39.362523 (+  9221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.465677 (+103154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.465730 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.465797 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:39.465860 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.494745 (+1028885us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001b76d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:40.494790 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.494924 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236587904}
I20260709 12:21:40.493952 30700 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:40.501358 30310 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:40.503000 30802 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:40.483937 30797 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:40.507424 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:40.508096 25123 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:40.482764 30711 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.510249 30711 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:40.464459 30244 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:40.484813 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.511773 30244 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.513258 30797 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:40.513773 30797 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:40.481032 30839 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:40.514650 30797 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.516238 30839 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:40.518172 30626 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:40.519693 25090 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.520239 30626 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:40.520135 30801 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:40.521034 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.521525 30801 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:40.522209 30819 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:40.526820 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.508117 30823 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.529584 30638 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:40.530393 30638 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:40.533430 30823 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:40.514014 30244 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:40.542526 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 57824.9us
I20260709 12:21:40.543435 25092 leader_election.cc:400] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 14. Current term is 15.
I20260709 12:21:40.543740 25092 leader_election.cc:403] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:40.544281 25168 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:40.544680 30798 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 14. Current term is 15.
I20260709 12:21:40.546376 30830 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:40.546150 30460 consensus_queue.cc:1059] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:40.548764 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.550060 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:40.550176 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 497482us
I20260709 12:21:40.551220 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.551944 25271 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 16: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:40.552273 30755 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:40.529961 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:40.548152 30830 raft_consensus.cc:3055] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:40.554258 30783 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:40.554328 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.554843 30783 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.554971 30705 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:40.554000 30830 raft_consensus.cc:740] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:40.556346 30782 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:40.556602 30788 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:40.556743 30782 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:40.556849 30697 consensus_queue.cc:1059] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 14.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:21:40.557207 30788 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:40.555294 30783 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:40.557755 25822 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.557760 30697 consensus_queue.cc:1059] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:21:40.569139 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.558121 30711 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:40.558557 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:40.570520 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:40.559751 30775 raft_consensus.cc:697] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:40.572567 30775 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.570655 30711 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:40.562125 30748 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.574499 30748 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:40.574723 30711 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 14.15, Last appended by leader: 15, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.575954 30711 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:40.576705 30748 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:40.562652 30787 raft_consensus.cc:3055] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:40.577622 30787 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:40.578155 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:40.578570 30787 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.580068 30787 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:40.562983 30830 consensus_queue.cc:260] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:40.581255 30830 raft_consensus.cc:3060] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:40.564846 25276 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:40.556346 30773 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.583622 30773 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.585749 30773 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:40.586705 30707 raft_consensus.cc:3055] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:40.628109 30707 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:40.629261 30707 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.630637 30707 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:40.587572 25822 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:40.634795 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 47311.4us
I20260709 12:21:40.637198 30705 raft_consensus.cc:2804] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:40.637722 30705 raft_consensus.cc:697] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:40.561897 30762 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 15. Current term is 16.
I20260709 12:21:40.557634 30782 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.641108 30782 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:40.638880 30705 consensus_queue.cc:237] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.569896 30612 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:40.594256 30623 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:40.646860 30623 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:40.647717 30623 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:40.596911 30827 log.cc:927] Time spent T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.546s	user 0.000s	sys 0.002s
I20260709 12:21:40.649880 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.650353 30830 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.650851 30830 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:40.652009 25268 raft_consensus.cc:1240] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:40.652803 30830 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:40.601079 25168 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:40.653795 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 52811.2us
I20260709 12:21:40.655118 25168 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:40.655164 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.656705 30715 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:40.657923 30715 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.607568 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:40.567598 30756 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:40.658886 30715 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:40.659121 30756 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:40.659734 30756 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:40.662518 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:40.559559 30788 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:40.666590 25197 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:40.544641 25092 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:40.670565 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 125976us
I20260709 12:21:40.671344 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:40.567271 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 513667us
I20260709 12:21:40.619181 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:40.675298 25273 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:40.619568 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.678444 25271 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:40.623888 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.625499 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.671986 30797 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:40.593708 30783 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:40.680071 25272 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:40.682622 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:40.683267 25197 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:40.683612 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:40.691139 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:40.692749 25273 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:21:40.699882 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.701598 25165 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:40.683676 25242 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:40.602722 25167 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:40.706101 25092 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:40.707337 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 104695us
I20260709 12:21:40.718657 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:40.725229 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:40.726140 25271 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 17
W20260709 12:21:40.731135 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 47538.7us
I20260709 12:21:40.732451 25193 raft_consensus.cc:1240] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:40.732594 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:40.732493 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.733479 25121 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:40.732721 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.744398 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:40.745922 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 44443.4us
I20260709 12:21:40.748240 25242 leader_election.cc:400] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:40.748746 25242 leader_election.cc:403] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:40.746238 25276 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:40.764925 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.770300 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:40.771777 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.773597 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:40.775110 25165 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:40.777930 25267 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:21:40.779273 25267 pending_rounds.cc:85] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 7
I20260709 12:21:40.779489 25267 pending_rounds.cc:107] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:21:40.779781 25267 raft_consensus.cc:2889] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:40.704849 30802 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:40.773191 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60567.1us
I20260709 12:21:40.732887 30798 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:40.794677 25119 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:21:40.732692 30612 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:40.733003 30777 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:40.799808 25860 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:40.777871 30776 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:40.796124 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:40.766050 30769 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:40.807665 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.728742 30801 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:21:40.804095 25852 raft_consensus.cc:1240] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:40.779336 30797 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:40.768702 30658 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:40.773758 30780 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:21:40.800812 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.804642 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:40.728180 30788 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:21:40.835139 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.797928 30755 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:40.830653 30460 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:40.840636 30700 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:40.845563 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.842170 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:40.845747 30700 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:40.843539 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 47506.9us
I20260709 12:21:40.835486 30748 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:40.847937 30700 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:40.850962 25021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33480 (request call id 272) took 12909 ms (client timeout 15000 ms). Trace:
I20260709 12:21:40.854094 30591 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:40.854465 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:40.854712 30591 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:40.855271 30591 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:40.856215 25273 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:40.799882 30777 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:40.807315 30684 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:40.858507 25276 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:40.858693 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:40.807596 30769 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:40.864683 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:40.851432 25021 rpcz_store.cc:269] 0709 12:21:27.941460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.941654 (+   194us) service_pool.cc:224] Handling call
0709 12:21:40.850882 (+12909228us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:39.385443 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:39.473617 (+ 88174us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:39.473683 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:21:39.473707 (+    24us) tablet.cc:662] Decoding operations
0709 12:21:39.730791 (+257084us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:39.754093 (+ 23302us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:39.755939 (+  1846us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:21:39.916140 (+160201us) tablet.cc:701] Row locks acquired
0709 12:21:39.916188 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:21:39.916371 (+   183us) write_op.cc:270] Start()
0709 12:21:39.916522 (+   151us) write_op.cc:276] Timestamp: P: 1783599699916300 usec, L: 0
0709 12:21:39.916560 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:21:39.917334 (+   774us) log.cc:844] Serialized 8643 byte log entry
0709 12:21:40.190258 (+272924us) op_driver.cc:464] REPLICATION: finished
0709 12:21:40.262819 (+ 72561us) write_op.cc:301] APPLY: starting
0709 12:21:40.262947 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:40.282789 (+ 19842us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:40.282890 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:40.348872 (+ 65982us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:40.349285 (+   413us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 12:21:40.349353 (+    68us) write_op.cc:312] APPLY: finished
0709 12:21:40.349897 (+   544us) log.cc:844] Serialized 196 byte log entry
0709 12:21:40.350251 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:40.350473 (+   222us) write_op.cc:454] Released schema lock
0709 12:21:40.350564 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:40.351012 (+   448us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:40.351043 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1318825,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":72165,"apply.run_cpu_time_us":28612,"apply.run_wall_time_us":88182,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96263,"num_ops":22,"prepare.queue_time_us":118087,"prepare.run_cpu_time_us":30210,"prepare.run_wall_time_us":587022,"raft.queue_time_us":173879,"raft.run_cpu_time_us":22872,"raft.run_wall_time_us":32081,"replication_time_us":273450,"spinlock_wait_cycles":43392,"thread_start_us":241266,"threads_started":4,"wal-append.queue_time_us":43210}]]}
I20260709 12:21:40.825397 30673 raft_consensus.cc:697] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:40.863198 25271 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
I20260709 12:21:40.785337 30757 consensus_queue.cc:1059] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
W20260709 12:21:40.862365 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 122177us
I20260709 12:21:40.876449 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:40.892294 25202 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:40.858045 30478 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:40.900368 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 194252us
I20260709 12:21:40.862903 30777 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:40.890187 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:40.859323 30814 log.cc:927] Time spent T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:21:40.908783 25090 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:40.886037 30787 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:40.885360 25025 catalog_manager.cc:5697] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:40.915517 25193 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:21:40.919657 25202 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
I20260709 12:21:40.902416 25092 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.868599 30769 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:40.861910 30684 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:40.907081 25195 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:40.868127 30748 raft_consensus.cc:697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:40.894893 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:40.899456 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.931216 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:40.932252 25093 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:40.930775 25275 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:40.906733 30785 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:40.935281 25090 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:40.936352 25093 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:40.950661 30852 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:21:40.907775 30310 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:21:40.923478 30784 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:40.908011 30715 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:40.954746 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.930124 30801 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:40.929880 30684 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:40.940335 30700 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:40.940026 30785 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.908972 30756 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:40.965881 30673 consensus_queue.cc:237] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:40.982169 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.934424 30802 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:40.961898 25025 catalog_manager.cc:5697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 6 to 12, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 12 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:41.007570 30785 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:41.008035 30868 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:41.009223 30862 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:21:41.011096 30856 consensus_queue.cc:1059] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:40.958634 30783 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:41.026072 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 89782.9us
I20260709 12:21:41.028988 25272 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:41.020982 30700 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:41.021046 30801 raft_consensus.cc:697] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:41.040263 25025 catalog_manager.cc:5697] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:41.041882 25025 catalog_manager.cc:5697] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 11 to 12, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 12 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:21:41.047422 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.031590 30697 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:41.047420 25025 catalog_manager.cc:5697] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
W20260709 12:21:41.053423 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 261590us
I20260709 12:21:41.053802 25025 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 11 to 16, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 16 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:41.054771 30879 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:41.033524 30700 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.055032 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:41.055267 25025 catalog_manager.cc:5697] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 13 to 14, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 14 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.087301 30876 consensus_queue.cc:1059] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:21:41.089010 30854 log.cc:927] Time spent T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:21:41.055613 30700 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:41.090180 30801 consensus_queue.cc:237] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:41.095963 30756 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:41.093933 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:41.106212 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 171846us
I20260709 12:21:41.085255 30684 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:41.107975 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 175386us
I20260709 12:21:41.108673 30684 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:41.108780 25092 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:41.109706 30478 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:41.113116 25195 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
W20260709 12:21:41.114900 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 171521us
I20260709 12:21:41.118273 25165 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:41.116079 30775 raft_consensus.cc:3055] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:41.118952 25025 catalog_manager.cc:5697] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 8 to 13, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 13 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:41.056428 30864 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:41.126245 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:41.165405 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:41.165593 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.166936 25119 raft_consensus.cc:2410] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:21:41.167847 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:41.169427 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 215114us
I20260709 12:21:41.170512 25124 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 14. Current term is 15. Ops: [14.15-14.15]
I20260709 12:21:41.170535 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:41.171157 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 140528us
I20260709 12:21:41.176669 25860 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:21:41.177838 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.179601 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.180346 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:41.180678 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:41.122346 30775 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:41.176347 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.182374 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:41.182843 25118 raft_consensus.cc:2368] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 14. Current term is 15.
I20260709 12:21:41.183476 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:41.184175 25127 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:41.184526 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.134707 30662 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:41.185263 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:41.138141 30798 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:41.191185 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.191401 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:41.129258 30876 raft_consensus.cc:3055] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:41.188688 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:41.189635 25025 catalog_manager.cc:5697] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 8 to 13, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 13 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:41.149056 30715 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:41.199465 30612 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:41.178721 30762 consensus_queue.cc:1059] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:21:41.200570 30762 consensus_queue.cc:1243] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:21:41.133558 30638 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:41.201509 30866 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:41.195839 25118 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:41.173174 30830 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.203892 30830 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:41.205078 25122 raft_consensus.cc:1275] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:21:41.198529 30711 consensus_meta.cc:287] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.622s	user 0.013s	sys 0.000s
I20260709 12:21:41.186489 30662 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:41.199321 25268 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:41.206301 30655 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:41.206720 30655 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:41.200111 30612 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:41.207120 30655 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:41.206810 30662 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:41.208241 30860 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:21:41.209300 30876 raft_consensus.cc:740] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:41.201179 30638 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:41.210260 30871 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.200s	user 0.002s	sys 0.000s
I20260709 12:21:41.210322 30876 consensus_queue.cc:260] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.211694 30876 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:41.211766 30638 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:41.199618 30879 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:41.208176 30662 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:41.216688 30769 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:41.195874 30872 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:21:41.050915 30748 consensus_queue.cc:237] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:41.195233 25125 raft_consensus.cc:2393] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:21:41.192512 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 74314.3us
I20260709 12:21:41.193480 25025 catalog_manager.cc:5697] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 10 to 11, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 11 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:41.221241 25118 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:41.125067 30877 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:41.209939 30870 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:21:41.227064 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.223978 25165 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:41.229362 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 104298us
I20260709 12:21:41.230856 25121 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:41.232009 25122 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:41.233914 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:41.234246 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.234824 25118 raft_consensus.cc:3060] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:41.235034 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:41.236124 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.238616 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:41.240770 25127 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:41.242542 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:41.237108 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.243060 25118 raft_consensus.cc:2468] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:41.247241 30884 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:41.251652 25123 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:41.144801 30785 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:41.146346 30700 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:41.264330 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 86429.8us
I20260709 12:21:41.255467 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:41.265069 25090 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:41.266168 25126 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:41.253249 30707 consensus_meta.cc:287] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.004s
I20260709 12:21:41.255894 25093 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:41.205808 30830 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:41.270869 25270 raft_consensus.cc:1240] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: []
W20260709 12:21:41.267379 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 76069.1us
I20260709 12:21:41.268591 25857 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:41.268941 25025 catalog_manager.cc:5697] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:41.263931 30310 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.271663 25242 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:41.287452 25126 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:41.275810 25121 raft_consensus.cc:2393] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 13: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:41.286464 25025 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:41.279639 25122 raft_consensus.cc:2468] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:41.265997 30864 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:21:41.300709 30769 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:41.304198 30777 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.271719 30798 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:41.307029 30798 raft_consensus.cc:697] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:41.307981 30798 consensus_queue.cc:237] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:41.271763 30866 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:41.310796 30866 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:41.311174 30866 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:41.311352 30700 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:41.307725 25025 catalog_manager.cc:5697] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 7 to 9, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 9 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.313491 30612 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.315658 30612 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:41.316107 30658 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:41.317222 30785 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:41.317453 30769 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:41.272862 30775 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.290786 30310 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.319216 30591 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:41.321166 30310 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:41.270467 30819 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:21:41.322630 30819 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:41.322960 30819 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:41.323823 30819 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:41.325155 30819 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:41.327368 25194 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: []
W20260709 12:21:41.327731 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.330184 30883 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:41.320873 25242 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:41.335139 30883 raft_consensus.cc:2804] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:41.335676 30883 raft_consensus.cc:697] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:41.336861 30757 raft_consensus.cc:3055] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:21:41.337877 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 68683.6us
W20260709 12:21:41.338442 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 114534us
I20260709 12:21:41.336560 30883 consensus_queue.cc:237] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.339174 25165 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:41.343961 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2368) took 1339 ms. Trace:
I20260709 12:21:41.344579 25270 rpcz_store.cc:276] 0709 12:21:40.004922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.005177 (+   255us) service_pool.cc:224] Handling call
0709 12:21:40.043344 (+ 38167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.272165 (+1228821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.343757 (+ 71592us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540034e9d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:41.343910 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2822626560}
I20260709 12:21:41.344120 25852 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:21:41.345541 25852 pending_rounds.cc:85] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 13
I20260709 12:21:41.345772 25852 pending_rounds.cc:107] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:21:41.346017 25852 raft_consensus.cc:2889] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:41.346356 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:41.343802 25025 catalog_manager.cc:5697] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 10 to 12, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 12 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:41.337267 30757 raft_consensus.cc:740] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:41.360917 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:41.362900 25825 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:41.292570 30787 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:41.385984 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:41.389973 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:41.394503 25857 raft_consensus.cc:1275] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:41.394639 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:41.395193 25242 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:41.395218 25276 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:41.398175 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.398922 25122 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:41.399267 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.398243 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:41.399819 25121 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:41.402318 25825 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:41.317901 30780 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:41.406363 25119 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:21:41.407217 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:41.356827 30655 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:41.420032 30787 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 14.15, Last appended by leader: 15, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.424021 30715 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:41.410110 25825 leader_election.cc:400] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 14. Current term is 15.
I20260709 12:21:41.435515 25825 leader_election.cc:403] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:21:41.321080 30591 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:41.443578 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 94689us
I20260709 12:21:41.403628 30850 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:41.413118 30823 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:41.409461 30662 consensus_queue.cc:1048] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:21:41.408761 30697 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:41.455392 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.455821 25196 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:41.412150 30884 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:41.462734 25122 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:41.454538 30877 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 14. Current term is 15.
W20260709 12:21:41.474355 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 87594.6us
I20260709 12:21:41.474890 25270 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:21:41.417071 30840 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:21:41.456246 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 46280us
W20260709 12:21:41.489176 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.496919 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:41.503863 25121 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:41.412567 30769 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.078s
W20260709 12:21:41.493225 30870 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:21:41.525753 25825 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:41.536144 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:41.546041 25118 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:41.524524 30877 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:41.490244 30757 consensus_queue.cc:260] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.526410 30840 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:41.560073 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:41.561473 25276 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:41.532408 30884 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:41.521149 30830 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:21:41.569646 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:41.570372 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:41.570317 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:41.571254 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.572628 25123 raft_consensus.cc:1240] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:41.528472 30778 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:21:41.599525 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:41.600204 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:41.600690 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:41.631464 25194 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:21:41.631762 25196 raft_consensus.cc:2368] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:41.634646 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:41.635324 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:41.636221 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:41.636922 25202 raft_consensus.cc:2368] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:41.540364 30697 consensus_queue.cc:1048] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:21:41.637480 25201 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:21:41.680099 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:41.683738 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 83192.7us
I20260709 12:21:41.684125 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:41.682262 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 235051us
I20260709 12:21:41.571929 30880 raft_consensus.cc:2764] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 12:21:41.686167 30769 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:41.602058 30758 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:41.692344 25168 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:41.699254 30895 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:21:41.707139 30769 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.708030 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:41.629525 30876 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:41.719825 30887 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:41.722272 30864 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.709280 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:41.709527 25202 raft_consensus.cc:1275] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:21:41.683506 30870 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:21:41.690688 30801 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.701215 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:41.739607 25168 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:41.562839 30782 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
W20260709 12:21:41.690366 30892 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:21:41.722820 30864 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.690860 30711 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:41.714735 25092 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:41.771230 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 56050.1us
I20260709 12:21:41.720994 30879 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:41.773146 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.720659 30727 raft_consensus.cc:2804] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:41.777374 25122 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:21:41.742120 30591 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:41.778816 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 64172.8us
I20260709 12:21:41.767844 25202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:41.723752 30655 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:41.782495 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.767323 30626 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:21:41.778981 30897 log.cc:927] Time spent T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:21:41.836915 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:41.767323 30832 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:21:41.806814 30893 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
W20260709 12:21:41.783082 30889 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 12:21:41.783697 30888 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
W20260709 12:21:41.794694 30898 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 12:21:41.841706 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.803535 30823 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:41.848109 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 356195us
I20260709 12:21:41.780629 30700 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:41.795374 30707 consensus_queue.cc:1059] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:21:41.775050 30801 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.868606 30769 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:41.791746 30866 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.828693 30879 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:41.870199 30903 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:41.873399 25856 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:21:41.897223 25856 pending_rounds.cc:85] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 10
I20260709 12:21:41.897574 25856 pending_rounds.cc:107] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:21:41.897876 25856 raft_consensus.cc:2889] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:41.877343 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:41.880470 30868 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:41.854111 30626 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:41.883535 30638 raft_consensus.cc:3055] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:41.861001 30832 raft_consensus.cc:697] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:41.883266 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:41.892259 25860 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:21:41.842741 30727 raft_consensus.cc:697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:41.911713 30727 consensus_queue.cc:237] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:41.778436 30840 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:41.882448 30700 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:21:41.888888 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.925920 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:41.919165 30787 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:21:41.951328 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:41.961202 25196 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 12:21:41.962704 25269 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
I20260709 12:21:41.966136 25165 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:41.907938 30638 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:41.963302 30711 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:42.022145 30711 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.028321 30906 raft_consensus.cc:3055] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:42.028857 30906 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:42.030215 30626 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:42.031481 25167 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:42.032721 30903 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:42.043020 30832 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.044615 30887 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:42.045228 30887 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.047432 30887 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:42.047120 30638 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.048470 30638 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:42.051796 30801 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:42.061322 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:41.959364 30823 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 12:21:42.037573 30866 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:42.058660 30780 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.019166 30700 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:21:42.095974 25242 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:42.105370 25272 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:42.109110 25242 leader_election.cc:400] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:42.110407 25242 leader_election.cc:400] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:42.110769 25242 leader_election.cc:403] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:42.112128 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:42.113132 30874 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:42.113691 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:42.113993 30874 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:42.115942 30874 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:42.118825 25119 raft_consensus.cc:1275] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:21:42.117774 25122 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
W20260709 12:21:42.122465 25090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.195:44749 timed out after 1.603s (SENT) [suppressed 13 similar messages]
I20260709 12:21:42.029731 30906 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.076655 30864 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:42.109549 30819 consensus_meta.cc:287] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.784s	user 0.011s	sys 0.002s
I20260709 12:21:42.166496 30906 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:42.168587 30865 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:42.169099 30865 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:42.108201 30780 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:42.139376 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 360717us
I20260709 12:21:42.175166 25268 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:42.111267 30591 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:21:42.194793 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.199302 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:42.135762 30748 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:42.223937 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:42.225514 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:42.229214 30877 consensus_queue.cc:1048] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:21:42.230538 30900 log.cc:927] Time spent T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.494s	user 0.002s	sys 0.001s
I20260709 12:21:42.232055 30912 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.232661 30912 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.234328 30726 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:42.234941 30912 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:42.234853 30726 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.237074 30726 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:42.218485 30884 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:42.241648 25272 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 12:21:42.247152 30912 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:21:42.248447 30910 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:21:42.255244 30912 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.255929 30912 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.266492 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:42.267097 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:42.270823 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.274444 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:42.174422 30879 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:42.306855 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:42.176043 30780 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:42.098549 30915 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.127s
I20260709 12:21:42.311662 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:42.312902 25859 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 14: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:42.313138 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:42.317517 25856 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:42.317865 30912 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:42.309314 30905 log.cc:927] Time spent T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:21:42.327157 25092 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:42.324962 30727 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.329365 30819 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:42.329789 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:42.330404 30864 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.330919 30864 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:42.321439 30769 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:42.331957 30769 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.333436 30864 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:42.329618 30727 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:42.330442 25127 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:42.339708 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1470) took 1098 ms. Trace:
I20260709 12:21:42.340713 30798 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:42.340090 25274 rpcz_store.cc:276] 0709 12:21:41.241316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.241423 (+   107us) service_pool.cc:224] Handling call
0709 12:21:41.241687 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.264699 (+ 23012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.264727 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.346998 (+ 82271us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b2c0003d328. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:21:41.361527 (+ 14529us) log.cc:844] Serialized 26 byte log entry
0709 12:21:41.504339 (+142812us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:41.504375 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.504442 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:42.338813 (+834371us) spinlock_profiling.cc:243] Waited 932 us on lock 0x7b24001e2198. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100ca79c4 00007f2100ca5acb 00007f2100e60dc9 00007f2100e60a55 00007f2100e5ffb0 00007f2103ad6488 00007f2103ad6be8 00007f2103aae398 00007f2103aa976a 00007f2103aa8bb6
0709 12:21:42.339485 (+   672us) raft_consensus.cc:1685] finished
0709 12:21:42.339518 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.339650 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14891,"raft.queue_time_us":22161,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3944,"spinlock_wait_cycles":7303296,"thread_start_us":95706,"threads_started":1,"wal-append.queue_time_us":181811}
I20260709 12:21:42.341320 30798 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.343938 30798 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:42.329841 30819 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.351164 30819 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:42.351966 30769 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:42.169992 30865 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:42.355136 30727 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:42.357402 30777 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:42.364065 25271 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:42.366532 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:42.371254 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.386359 25857 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 16: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:42.368054 25825 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:42.396446 30711 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:42.411521 25119 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:42.403198 30711 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:42.426894 25239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.407703 30773 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:42.436352 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 360201us
I20260709 12:21:42.430806 30711 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:42.439755 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:42.448208 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:42.448975 25201 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
W20260709 12:21:42.439154 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 316708us
I20260709 12:21:42.453684 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:42.462823 25090 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:42.440320 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 319896us
I20260709 12:21:42.471082 25123 raft_consensus.cc:1275] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:42.479635 25194 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:42.484611 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:42.436856 30773 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:42.462497 30876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.011s	sys 0.014s
I20260709 12:21:42.489893 30707 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:42.491971 30707 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.492583 30802 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:42.493455 30802 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:42.493827 30802 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:42.494738 30920 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:42.494843 30802 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.463511 30887 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.499842 25090 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:42.504314 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:42.504850 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:42.505601 25090 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:42.498423 30876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.012s	sys 0.014s
I20260709 12:21:42.485289 30906 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:42.514312 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:42.484270 30478 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:42.510960 30915 consensus_queue.cc:1048] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:21:42.519717 25274 raft_consensus.cc:2393] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 16: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:42.524545 25202 raft_consensus.cc:606] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:42.525003 25202 raft_consensus.cc:614] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:42.503163 30673 consensus_queue.cc:1059] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:21:42.526538 25165 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:42.498871 30769 consensus_queue.cc:1048] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:21:42.524894 30707 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:42.521570 30478 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:42.508059 30876 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:42.528724 30850 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:42.510274 30887 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:42.531404 30906 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:42.535284 30886 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:42.537741 30866 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:21:42.604965 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 99435.3us
I20260709 12:21:42.620071 25165 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:42.633648 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:42.634344 25126 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:42.636896 25242 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:42.640704 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:42.691735 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 54900.8us
I20260709 12:21:42.630424 30876 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:42.694747 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.605954 30886 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:21:42.793234 30773 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:42.802686 30921 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 12:21:42.800626 30910 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:21:43.019577 30930 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.035313 30930 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.035710 30880 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:43.036095 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2734) took 1016 ms. Trace:
I20260709 12:21:43.036360 30880 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.036517 25196 rpcz_store.cc:276] 0709 12:21:42.019934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.020087 (+   153us) service_pool.cc:224] Handling call
0709 12:21:42.020505 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.020769 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.020805 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:42.021356 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.319756 (+298400us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:42.319791 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.319855 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:43.035867 (+716012us) raft_consensus.cc:1685] finished
0709 12:21:43.035891 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.036037 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":298005,"threads_started":1,"wal-append.queue_time_us":503186}
I20260709 12:21:43.037582 30930 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:42.932250 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 312289us
I20260709 12:21:42.742432 30775 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:42.786877 30925 log.cc:927] Time spent T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:21:42.705960 30769 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:21:42.811163 30931 log.cc:927] Time spent T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 12:21:42.627156 30832 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
W20260709 12:21:43.031644 30926 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.441s	user 0.009s	sys 0.003s
W20260709 12:21:43.023952 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 305902us
W20260709 12:21:42.764931 30940 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:21:42.633020 30866 raft_consensus.cc:697] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:42.720377 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.630004 30819 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.019608 30673 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:43.032868 30938 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.233s	user 0.004s	sys 0.009s
I20260709 12:21:43.038743 30478 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.040642 30880 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:43.032650 30927 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.501s	user 0.010s	sys 0.004s
I20260709 12:21:43.043195 30887 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:43.027788 30877 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.033696 30884 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.049639 25193 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:43.048795 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:43.082891 25194 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 14: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:43.083977 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:43.084134 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:43.085034 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:43.055837 30899 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 1.336s	user 0.009s	sys 0.015s
I20260709 12:21:43.058307 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:42.637233 30726 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:43.027278 30864 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.067477 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:43.047808 30773 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:43.057188 30769 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.087994 25198 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:43.110206 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:43.088685 25193 raft_consensus.cc:1240] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:43.073261 30866 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.075915 30951 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:43.096063 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.096611 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2871) took 1690 ms. Trace:
I20260709 12:21:43.121121 25120 rpcz_store.cc:276] 0709 12:21:41.405894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.406004 (+   110us) service_pool.cc:224] Handling call
0709 12:21:41.426471 (+ 20467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.426907 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.426940 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.427447 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.044542 (+617095us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180027b4a0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae0d1 00007f2103ec9a0f
0709 12:21:42.399535 (+354993us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:42.399595 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.399668 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:43.082558 (+682890us) raft_consensus.cc:1685] finished
0709 12:21:43.082577 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.096516 (+ 13939us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1462,"raft.queue_time_us":124,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":9478,"spinlock_wait_cycles":23734656,"thread_start_us":354596,"threads_started":1,"wal-append.queue_time_us":1124395}
I20260709 12:21:43.096545 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:43.100378 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2720) took 1498 ms. Trace:
I20260709 12:21:43.119639 25242 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:43.124166 25195 rpcz_store.cc:276] 0709 12:21:41.601657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.601764 (+   107us) service_pool.cc:224] Handling call
0709 12:21:41.602135 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.683599 (+ 81464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.683631 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.699143 (+ 15512us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.359739 (+660596us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b180041cbc0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae0d1 00007f2103ec9a0f
0709 12:21:42.583317 (+223578us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:42.583360 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.583429 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:43.081318 (+497889us) raft_consensus.cc:1685] finished
0709 12:21:43.081340 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.100288 (+ 18948us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83969,"raft.queue_time_us":81575,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":12604,"spinlock_wait_cycles":2538880,"thread_start_us":203728,"threads_started":1,"wal-append.queue_time_us":899117}
I20260709 12:21:43.075625 30673 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.139432 25273 raft_consensus.cc:3055] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:43.139907 25273 raft_consensus.cc:740] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:43.141553 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:43.142445 25274 raft_consensus.cc:2393] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 15: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:43.145016 25200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2727) took 1805 ms. Trace:
I20260709 12:21:43.114957 30769 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:43.152225 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 1285) took 1575 ms. Trace:
I20260709 12:21:43.153978 25860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1916) took 1220 ms. Trace:
I20260709 12:21:43.145371 25200 rpcz_store.cc:276] 0709 12:21:41.339939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.342976 (+  3037us) service_pool.cc:224] Handling call
0709 12:21:41.343298 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.428892 (+ 85594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.428924 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.916047 (+487123us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b4800061ed8. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2108e37aa1 00007f2108e2eb37 00007f2108e2e9ca 00007f2108f2626f 00007f2108f25f37 00007f2108f3a55c 00007f2108f3a508 00007f2108f3a488 00007f2108f3a443 00007f2108f396ec 00007f2107e63a96
0709 12:21:42.342833 (+426786us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b18002b6840. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100def2a6 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a
0709 12:21:42.344158 (+  1325us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b2c0000e5c8. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:21:42.344557 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.524387 (+179830us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:42.524428 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.526404 (+  1976us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:43.144838 (+618434us) raft_consensus.cc:1685] finished
0709 12:21:43.144853 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.144969 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85198,"raft.queue_time_us":100499,"raft.run_cpu_time_us":8669,"raft.run_wall_time_us":468673,"spinlock_wait_cycles":86512256,"thread_start_us":179436,"threads_started":1,"wal-append.queue_time_us":266771}
I20260709 12:21:43.140676 25273 consensus_queue.cc:260] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.156709 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1488) took 1762 ms. Trace:
I20260709 12:21:43.156852 25273 raft_consensus.cc:3060] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:43.154460 25860 rpcz_store.cc:276] 0709 12:21:41.924138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.924298 (+   160us) service_pool.cc:224] Handling call
0709 12:21:41.924632 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.924944 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.924969 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.925415 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.423864 (+498449us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:42.423905 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.425292 (+  1387us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:43.143788 (+718496us) raft_consensus.cc:1685] finished
0709 12:21:43.143807 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.143938 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":642,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":363977,"threads_started":1,"wal-append.queue_time_us":478849}
I20260709 12:21:43.167941 30943 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.168557 30943 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.146347 30887 consensus_queue.cc:1059] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:21:43.087150 30877 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.157378 25852 rpcz_store.cc:276] 0709 12:21:41.389300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.391143 (+  1843us) service_pool.cc:224] Handling call
0709 12:21:41.410453 (+ 19310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.410893 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.410929 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.437292 (+ 26363us) log.cc:844] Serialized 26 byte log entry
0709 12:21:41.508879 (+ 71587us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:21:41.509372 (+   493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.509449 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:43.047149 (+1537700us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:43.134138 (+ 86989us) raft_consensus.cc:1685] finished
0709 12:21:43.134170 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.151669 (+ 17499us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1060,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9980,"spinlock_wait_cycles":107426688,"thread_start_us":34707,"threads_started":1,"wal-append.queue_time_us":90063}
I20260709 12:21:43.174516 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:43.095566 30884 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.152716 25855 rpcz_store.cc:276] 0709 12:21:41.568357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.568519 (+   162us) service_pool.cc:224] Handling call
0709 12:21:41.568987 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.575522 (+  6535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.575550 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.598381 (+ 22831us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.052226 (+453845us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b1800493c60. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae0d1 00007f2103ec9a0f
0709 12:21:42.361951 (+309725us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:42.361994 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.362088 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:43.132835 (+770747us) raft_consensus.cc:1685] finished
0709 12:21:43.132868 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.143099 (+ 10231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6691,"raft.queue_time_us":8554,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":34778,"spinlock_wait_cycles":4703104,"thread_start_us":309544,"threads_started":1,"wal-append.queue_time_us":837570}
I20260709 12:21:43.144670 30748 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:43.157017 30880 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:43.108961 30864 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.115569 30773 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.142045 30883 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:43.171113 30943 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.131573 30951 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.217926 30951 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.222898 30673 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:43.224198 30819 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:43.158012 30932 consensus_queue.cc:1175] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b83c12959b9848b3b7bbc680f5ee6225" responder_term: 14 status { last_received { term: 14 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:21:43.227757 30948 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:21:43.228382 25272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2868) took 1088 ms. Trace:
I20260709 12:21:43.228921 25272 rpcz_store.cc:276] 0709 12:21:42.139563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.139720 (+   157us) service_pool.cc:224] Handling call
0709 12:21:42.140311 (+   591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.242045 (+101734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.228036 (+985991us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400418f54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:43.228299 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232204672}
W20260709 12:21:43.208356 30711 consensus_meta.cc:287] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.761s	user 0.012s	sys 0.007s
I20260709 12:21:43.214646 30883 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.234091 30711 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.237098 30711 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.245270 25202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55488 (request call id 25) took 1477 ms. Trace:
I20260709 12:21:43.211669 30748 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:43.248365 30896 log.cc:927] Time spent T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 1.696s	user 0.010s	sys 0.019s
I20260709 12:21:43.249104 30748 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:43.251709 30773 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:43.252686 30924 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.720s	user 0.001s	sys 0.000s
W20260709 12:21:43.252925 30942 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.198s	user 0.001s	sys 0.001s
I20260709 12:21:43.245743 25202 rpcz_store.cc:276] 0709 12:21:41.767552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.767698 (+   146us) service_pool.cc:224] Handling call
0709 12:21:43.245044 (+1477346us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b5400440a54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f08853 00007f2108ed660a 00007f210245c7d4 00007f210245c762 00007f210245c691 00007f210245c60c 00007f210245b8c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:43.245165 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610296064}
I20260709 12:21:43.254616 30864 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:43.259030 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:43.259577 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:43.236871 30883 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:43.211477 30922 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Append to log took a long time: real 0.528s	user 0.007s	sys 0.007s
I20260709 12:21:43.276988 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:43.292894 30958 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.293526 30958 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.295879 30958 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:43.299535 30757 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:43.313872 30711 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:43.315169 30884 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:43.314755 30711 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.316756 30877 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.326599 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48492 (request call id 1044) took 1052 ms. Trace:
I20260709 12:21:43.327178 25119 rpcz_store.cc:276] 0709 12:21:42.266110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.266231 (+   121us) service_pool.cc:224] Handling call
0709 12:21:43.318446 (+1052215us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54003237d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:43.318557 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331762944}
W20260709 12:21:43.324010 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 182850us
I20260709 12:21:43.319164 30787 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.336419 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:43.340399 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:43.319358 30957 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.347136 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:43.348623 25119 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:21:43.347895 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.340948 30877 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:43.319808 30887 consensus_queue.cc:1243] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer b83c12959b9848b3b7bbc680f5ee6225 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:21:43.340111 30884 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:43.337047 30787 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.382418 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:43.345786 30908 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:43.384966 25123 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:43.388737 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 182675us
I20260709 12:21:43.395253 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:43.396432 25272 raft_consensus.cc:2393] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 19: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:43.387367 30908 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.399113 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.403399 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.406201 25123 raft_consensus.cc:2468] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:43.392127 30962 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.391566 30887 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:43.392470 30782 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:43.387060 30884 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.420545 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.444306 25267 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:43.414100 30866 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.426514 30876 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:43.433811 30937 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 12:21:43.436203 25271 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:43.437971 25273 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:21:43.402608 30874 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.438442 30726 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:43.405140 30460 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:43.438709 30887 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.411868 30964 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:21:43.445662 25272 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:21:43.464102 30787 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:43.465145 30887 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.465505 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 1042) took 1215 ms. Trace:
I20260709 12:21:43.465909 25122 rpcz_store.cc:276] 0709 12:21:42.249864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.250038 (+   174us) service_pool.cc:224] Handling call
0709 12:21:42.250393 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.250765 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.250799 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:42.251286 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.487918 (+236632us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:42.487957 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.488029 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:43.433064 (+945035us) spinlock_profiling.cc:243] Waited 6.63 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:43.465230 (+ 32166us) raft_consensus.cc:1685] finished
0709 12:21:43.465250 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.465446 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54250,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7420,"spinlock_wait_cycles":15243136,"thread_start_us":236247,"threads_started":1,"wal-append.queue_time_us":376470}
I20260709 12:21:43.467705 30658 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.350637 30957 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.403401 30908 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:43.455687 25273 pending_rounds.cc:85] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 7
I20260709 12:21:43.470366 25273 pending_rounds.cc:107] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:21:43.470695 25273 raft_consensus.cc:2889] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:43.441967 30949 log.cc:927] Time spent T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.355s	user 0.002s	sys 0.001s
I20260709 12:21:43.477952 25196 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: []
W20260709 12:21:43.461238 25825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.447669 30877 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.455747 30756 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.443032 30782 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.468206 30658 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.497018 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.480087 30964 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.479804 30310 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.485592 30915 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.418879 30962 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.456732 30876 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.508002 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.519255 25122 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 18.
W20260709 12:21:43.514165 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 69609.8us
I20260709 12:21:43.515082 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:43.455189 30866 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.516389 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:43.479223 30460 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.492771 30884 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.462740 30874 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.517253 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:43.523902 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.522572 30943 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.542348 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.542300 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.489548 30715 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:21:43.544827 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:43.542932 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.490329 30877 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.491839 30756 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.541422 30673 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:43.522325 30880 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:43.611894 30757 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:21:43.601233 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.617105 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2881) took 1086 ms. Trace:
I20260709 12:21:43.512431 30711 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.547950 25201 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:43.621588 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.624020 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.636262 25120 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:43.527016 30832 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:43.631137 25127 rpcz_store.cc:276] 0709 12:21:42.530423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.530579 (+   156us) service_pool.cc:224] Handling call
0709 12:21:42.530995 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.531370 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.531410 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:42.538257 (+  6847us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.626623 (+ 88366us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:42.626667 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.626734 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:43.441162 (+814428us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:43.542254 (+101092us) raft_consensus.cc:1685] finished
0709 12:21:43.542285 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.617007 (+ 74722us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71858,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":8681,"spinlock_wait_cycles":127139712,"thread_start_us":19868,"threads_started":1,"wal-append.queue_time_us":480656}
I20260709 12:21:43.559207 30887 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.517073 30310 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.535959 30958 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.516405 30930 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.122s
I20260709 12:21:43.609903 30782 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:43.658957 25269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2851) took 2947 ms (client timeout 1603 ms). Trace:
I20260709 12:21:43.611297 30874 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:43.610968 30876 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.526916 30830 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 12:21:43.624845 30960 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.625643 30951 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:43.630324 30757 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.523135 30915 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.535228 30700 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.670881 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.672271 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.673074 25122 raft_consensus.cc:1275] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:21:43.690488 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.691134 25122 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
W20260709 12:21:43.693454 30662 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:21:43.687620 30715 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:43.694449 30715 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.696698 30715 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:43.674057 25123 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:43.698402 30955 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.698959 30955 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.701037 30955 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:43.702696 30950 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.703253 30950 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.705327 30950 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.705863 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:43.616681 30943 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.708464 25855 raft_consensus.cc:3055] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:43.709055 25855 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:43.710144 30943 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.711727 30310 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.659588 30832 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:43.713223 30769 consensus_meta.cc:287] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.001s
I20260709 12:21:43.713985 30832 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:43.634591 30880 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.716042 30880 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:43.682858 30970 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.716817 30970 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.718959 30970 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.683239 30972 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.719310 30866 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:43.719833 30972 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:43.677919 25269 rpcz_store.cc:269] 0709 12:21:40.698060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.710667 (+ 12607us) service_pool.cc:224] Handling call
0709 12:21:43.645006 (+2934339us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002bedd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:43.645135 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2712752512}
I20260709 12:21:43.681394 30782 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.731433 25122 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:43.512238 30964 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:43.733378 25201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:43.736621 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:43.738536 25859 raft_consensus.cc:2393] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 15: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:43.731473 30876 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.740307 30876 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.665014 30887 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.742547 30876 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:43.743391 30887 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:43.744262 30957 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:43.745585 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.721045 30951 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.749905 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.751230 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:43.710147 25855 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.789076 25201 raft_consensus.cc:606] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:43.789553 25201 raft_consensus.cc:614] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:43.688485 30757 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:43.667078 30958 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.713661 30769 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.791280 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.793131 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.727087 30658 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:43.731544 30877 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:43.826123 25859 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:43.823719 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:43.829186 25125 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
W20260709 12:21:43.992837 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.835135 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:43.797405 30727 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.836208 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:43.749552 30782 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.737666 30700 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:43.809895 30880 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:43.829906 30819 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:44.011474 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.009444 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:44.004276 30927 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 12:21:44.007588 30959 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:21:44.016748 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:43.987756 30658 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:44.024834 30990 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:44.025595 30990 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:43.749169 30960 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.029564 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.014600 30981 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.038975 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.033949 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:44.046680 30984 log.cc:927] Time spent T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:21:44.054868 30915 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.008200 30727 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:44.054920 30985 log.cc:927] Time spent T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:21:44.017462 30880 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.038579 30658 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.084700 30865 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:44.098369 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.037896 30990 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:44.018316 30819 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.113107 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.115388 25168 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:44.120162 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.064543 30962 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:44.146005 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:44.147899 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.122572 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.127107 25852 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:44.110545 30957 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.127426 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.128543 30964 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:44.130002 30958 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.132230 30658 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.134351 30880 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.134876 30850 consensus_queue.cc:1048] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:44.135939 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:44.141459 30727 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.150233 30957 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.063946 30981 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.158258 30769 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:44.181802 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 193214us
I20260709 12:21:44.184700 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:44.174948 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 339852us
I20260709 12:21:44.175644 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.175819 25198 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:44.179208 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.182650 25242 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.186729 25859 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:44.187016 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.188674 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.188875 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.189944 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:44.192924 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 77685.7us
I20260709 12:21:44.193096 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.195736 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.199620 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.200783 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.200937 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.201407 25269 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
I20260709 12:21:44.202558 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.203261 30700 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.204152 30930 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:44.204494 30658 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:44.204770 30930 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.205042 30658 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.207118 30658 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.210944 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.211710 25197 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:44.161473 30972 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:44.219370 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.220286 25199 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:44.222370 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.211342 30787 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:44.232126 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 49596.8us
I20260709 12:21:44.232041 30787 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.232759 30802 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:44.233672 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.233840 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.234225 30993 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:44.234762 30993 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.235210 30993 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:44.236491 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.234457 25270 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:44.244139 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.246249 25272 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:44.252112 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.253095 25273 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:44.254317 25825 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.208063 30784 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:44.245604 30991 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:44.256960 30991 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:44.257354 30991 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:44.258747 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.259940 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.260530 25267 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:44.261394 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.261255 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:44.262804 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.209144 30901 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:44.262609 30787 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.266487 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.267362 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.208516 30880 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.207121 30930 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.272714 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.265518 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.277000 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.282480 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.286939 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.287240 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:44.294198 25852 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:44.294639 25198 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:44.296748 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.296654 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.300544 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.301290 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.302356 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.303251 25269 raft_consensus.cc:1240] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:44.305845 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.308064 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.309891 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.311959 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.313592 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.245689 30244 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:44.208664 30962 consensus_queue.cc:1059] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:21:44.315223 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.319658 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.331816 25124 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:21:44.272082 30707 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:44.337138 25125 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:44.337728 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.315627 25860 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:44.331854 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.318284 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.320498 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.317479 25093 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.247071 30999 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:44.279654 30662 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.319129 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.289788 30658 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:44.318739 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.308923 25853 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:44.370507 25852 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:44.356305 25124 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:44.358068 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.247282 30951 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.360188 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.386216 25269 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:44.386720 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.315316 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.389307 25858 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 9.
I20260709 12:21:44.363895 30958 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:44.336043 30782 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:44.335041 30700 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.394490 30700 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.397480 30700 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.398556 30981 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:44.339068 30244 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:44.362895 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 45488.2us
I20260709 12:21:44.401810 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.403438 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.333992 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.289572 30901 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:44.406504 30901 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:44.406155 30658 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.287979 30877 raft_consensus.cc:2804] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:21:44.359297 30997 log.cc:927] Time spent T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:44.369469 30662 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.413775 25241 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.419075 30883 consensus_queue.cc:1059] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:44.419669 30662 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.420200 30662 raft_consensus.cc:3055] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:44.420531 30662 raft_consensus.cc:740] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:44.314811 30880 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.421295 30662 consensus_queue.cc:260] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.16, Last appended by leader: 16, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.422211 25267 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:44.424499 25241 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.389599 30991 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:44.425765 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 207466us
I20260709 12:21:44.426595 25093 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:44.468946 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 100852us
I20260709 12:21:44.426999 25241 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.408684 30960 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.415678 31002 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:44.411779 30951 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:44.443858 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 235992us
I20260709 12:21:44.474139 25168 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:44.422888 30877 raft_consensus.cc:697] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:44.475411 30877 consensus_queue.cc:237] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 14.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.477186 30787 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:44.444518 30780 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:44.455812 30662 raft_consensus.cc:3060] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:44.478190 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 51264.4us
I20260709 12:21:44.480563 25196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 1076) took 1432 ms. Trace:
I20260709 12:21:44.481015 25196 rpcz_store.cc:276] 0709 12:21:43.048007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.048136 (+   129us) service_pool.cc:224] Handling call
0709 12:21:43.048442 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.484987 (+436545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.480242 (+995255us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400220e54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:44.480487 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987298176}
I20260709 12:21:44.482105 25241 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:44.467891 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 292582us
W20260709 12:21:44.470121 31006 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:21:44.464453 30957 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.467936 30819 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:44.472591 30943 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:44.484999 25241 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:44.489151 30990 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.493577 30957 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:44.493667 30658 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.495498 25859 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:44.495797 30990 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.486759 30787 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:44.497344 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.500062 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.500933 25241 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.502267 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.502866 25090 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.503793 30787 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:44.503969 30460 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:44.504788 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.506410 25241 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:44.507174 30662 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:44.507541 30662 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.507851 30662 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:44.515524 25271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2876) took 2062 ms (client timeout 1723 ms). Trace:
W20260709 12:21:44.515995 25271 rpcz_store.cc:269] 0709 12:21:42.453137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.453360 (+   223us) service_pool.cc:224] Handling call
0709 12:21:44.515311 (+2061951us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b540002bf54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:44.515416 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2258030464}
I20260709 12:21:44.516078 30662 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.517189 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.518507 25241 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:44.518972 30911 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:44.519497 30911 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.520419 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:44.521399 25267 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:44.521586 30911 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:44.523837 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.524508 25857 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:44.528774 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:44.528978 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.529361 25124 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:44.532235 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.532812 25825 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.534297 25856 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:44.534922 30951 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:44.535760 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.535614 30951 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.536430 25122 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:44.538286 30884 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:44.539362 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.539697 30884 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:44.540086 30884 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.540138 31001 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:44.540530 30884 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:44.541189 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.538434 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.542069 30990 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:44.542484 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.543236 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.544613 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.545315 30990 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:44.545717 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.546531 30990 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:44.546896 30990 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:44.547241 30990 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:44.547446 30880 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.548285 30700 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:44.548517 31003 log.cc:927] Time spent T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:21:44.550098 31008 log.cc:927] Time spent T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:21:44.551807 25090 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.552484 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.525422 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2420) took 1078 ms. Trace:
I20260709 12:21:44.554234 25124 raft_consensus.cc:2468] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:44.555440 25119 raft_consensus.cc:1240] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:44.529747 25118 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
I20260709 12:21:44.556349 25090 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.556869 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:44.554121 25274 rpcz_store.cc:276] 0709 12:21:43.447103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.447982 (+   879us) service_pool.cc:224] Handling call
0709 12:21:43.448273 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.490220 (+ 41947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.490254 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:43.490298 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:43.490328 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.525220 (+1034892us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b54002a8d54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:44.525268 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.525373 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96029440}
I20260709 12:21:44.561998 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.517773 25271 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:44.563755 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.558419 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.567000 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.567049 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.568984 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.552212 30884 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.571228 25092 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.583631 25123 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:44.575428 25241 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:44.572652 25822 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:44.586499 25090 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.587005 25092 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.587767 25090 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:44.527281 30957 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:44.523857 30943 raft_consensus.cc:697] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:44.588816 25092 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.557171 30986 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:44.591965 25822 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:44.594704 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:44.595283 25857 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:44.556967 30819 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.596099 25822 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:44.558588 30700 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:44.601876 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.578570 30798 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:44.585245 30958 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:44.606493 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.589977 30953 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:44.603498 25822 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.585172 30866 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:44.592806 30711 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:44.591238 30797 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:44.605384 30780 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:44.596493 30951 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.623886 30964 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:44.642894 31011 consensus_queue.cc:1059] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:44.643306 30911 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:44.618470 30864 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:44.618153 30707 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:44.634948 30958 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:44.604209 30981 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:44.651293 25857 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:44.592062 30865 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:21:44.643709 30991 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.633772 30957 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:44.634572 30700 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:44.631816 30953 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:44.638047 30797 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:44.618419 30990 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.650333 30780 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.671747 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2567) took 1002 ms. Trace:
I20260709 12:21:44.672298 25127 rpcz_store.cc:276] 0709 12:21:43.669732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.669904 (+   172us) service_pool.cc:224] Handling call
0709 12:21:43.670365 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.679041 (+  8676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.679094 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:43.679163 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:43.679212 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.671451 (+992239us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b540021edd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:44.671516 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.671674 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19296512}
I20260709 12:21:44.650756 30673 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.604703 30819 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.654280 30864 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:44.662384 30958 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:44.670189 30953 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:44.669242 30797 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:44.686678 25118 raft_consensus.cc:1240] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: [15.15-15.15]
I20260709 12:21:44.677394 30780 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:44.688632 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 47991.3us
I20260709 12:21:44.689914 25822 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:44.691645 30711 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:44.693351 25822 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:44.695101 30707 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:44.696465 25822 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:44.698470 30707 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:44.700539 30707 consensus_queue.cc:1059] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:44.701467 30972 raft_consensus.cc:3055] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:44.701826 30972 raft_consensus.cc:740] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:44.702780 30972 consensus_queue.cc:260] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.704174 30972 raft_consensus.cc:3060] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:44.681103 30864 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:44.680168 30673 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:44.736864 31009 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:21:44.737646 30244 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:44.742053 31013 log.cc:927] Time spent T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:21:44.744032 30915 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:44.744575 30915 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.748378 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:44.749344 30802 consensus_meta.cc:287] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.006s
I20260709 12:21:44.750165 25121 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:21:44.750522 25121 pending_rounds.cc:85] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 11
I20260709 12:21:44.750738 25121 pending_rounds.cc:107] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:21:44.750936 30884 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:44.759141 30908 consensus_meta.cc:287] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 1.273s	user 0.010s	sys 0.002s
W20260709 12:21:44.761255 30993 consensus_meta.cc:287] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.003s
I20260709 12:21:44.669727 30943 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.749691 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.767827 25822 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:44.750952 25121 raft_consensus.cc:2889] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:44.776034 25241 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:44.782323 30989 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:44.755055 30901 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.799590 30901 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:44.759686 30908 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.782898 30989 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.802711 30908 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:44.804394 30989 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.761729 30993 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:44.806988 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 218214us
I20260709 12:21:44.808068 25822 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:44.810060 31022 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:44.790830 30880 raft_consensus.cc:2804] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:44.808902 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:44.811398 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 223681us
I20260709 12:21:44.792793 30999 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:44.812861 25090 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:44.815402 31026 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:21:44.813263 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.816954 31026 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:44.817134 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.817340 30960 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:44.818153 30960 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:44.818413 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.819013 25122 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:44.819075 30960 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.819638 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.821014 30993 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.822199 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:44.822724 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.814821 25242 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:44.824174 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:44.834443 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.836284 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.837155 25270 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:44.821973 30787 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:21:44.854899 31014 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:44.831552 30880 raft_consensus.cc:697] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:44.859385 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.855042 30990 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.843961 30989 raft_consensus.cc:2804] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:44.862746 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:44.863468 25126 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:44.852958 30993 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:44.879992 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:44.880194 30993 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:44.880731 30993 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:44.881042 25276 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:44.881402 30958 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.883930 31002 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:44.883607 30958 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:44.866428 30880 consensus_queue.cc:237] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.868247 30797 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.856675 30787 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:44.886232 30787 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:44.869328 30989 raft_consensus.cc:697] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:44.859004 30915 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.873236 30864 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.874889 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.895807 25276 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:21:44.879022 30673 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.897332 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:44.897835 25270 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:21:44.898753 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 62629.3us
I20260709 12:21:44.900151 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.901978 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:44.903867 25276 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:44.891794 30958 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:44.923024 25090 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:44.921804 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:44.921804 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:44.923863 25120 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:44.899607 30955 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:44.925650 31002 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:44.918918 30915 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:44.926935 30915 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.927371 30915 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:21:44.904182 30757 consensus_meta.cc:287] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 1.075s	user 0.011s	sys 0.002s
I20260709 12:21:44.924181 25122 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:44.931591 30953 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.933683 30953 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.935693 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:44.936290 25857 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:44.937518 31016 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:21:44.941392 31026 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:44.941531 30776 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:44.942523 30776 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:44.942552 30989 consensus_queue.cc:237] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.943801 30986 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.944270 30986 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:44.945019 25123 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:44.931048 25126 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:44.943440 30776 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.948282 25120 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:44.947867 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.951376 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2871) took 2762 ms. Trace:
I20260709 12:21:44.952126 30864 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:44.953138 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.951788 25275 rpcz_store.cc:276] 0709 12:21:42.189355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.196534 (+  7179us) service_pool.cc:224] Handling call
0709 12:21:43.645336 (+1448802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.823593 (+178257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.823628 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:43.823679 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:43.823723 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.823794 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.951189 (+1127395us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54002bedd0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:44.951294 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23062,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":2747,"spinlock_wait_cycles":3330835840,"thread_start_us":157537,"threads_started":1}
I20260709 12:21:44.959499 30850 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.960142 30776 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:44.960041 30850 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.960587 30797 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:44.929872 30958 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:44.964005 30958 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.965193 30662 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:44.967451 30787 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.969614 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:44.969890 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:44.970227 25859 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:44.970578 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 672644us
W20260709 12:21:44.972862 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.973100 30993 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:44.974351 31011 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:44.974850 31011 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:44.976790 25857 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:44.977411 25858 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:44.978394 25276 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
I20260709 12:21:44.978746 25859 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:44.979096 25271 raft_consensus.cc:1240] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:44.979380 25120 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 12:21:44.979451 25123 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:21:44.955127 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.979789 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:44.981046 25276 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:44.982105 25853 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:44.983068 25092 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.981956 25242 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.984546 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.986270 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:44.986845 25198 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:44.983954 25092 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:44.990101 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:44.985255 30787 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:44.992436 30797 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:44.951473 30962 raft_consensus.cc:3055] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:44.949775 30773 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:44.997206 30797 raft_consensus.cc:697] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:44.992223 30673 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:44.935942 30757 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:45.005676 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 531596us
I20260709 12:21:45.006687 25168 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:45.007368 30673 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:45.009626 25270 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:21:44.987764 30662 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:45.011505 25118 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:44.995123 30958 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:45.011229 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:44.998308 25276 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:44.993938 30957 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:44.998462 30962 raft_consensus.cc:740] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:45.016175 25276 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:45.017911 25269 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:21:45.020242 30957 raft_consensus.cc:697] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:45.007946 30830 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:45.013173 30662 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.021921 25167 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:44.984501 30780 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.019523 30958 raft_consensus.cc:697] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:45.010459 31001 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:21:45.035274 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:45.035653 25093 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:45.005861 30773 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.039503 30840 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:45.040855 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.043191 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.040206 31002 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:44.981040 31011 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.032042 30662 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:45.023339 30957 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.044975 30850 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:45.053175 25267 raft_consensus.cc:2393] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 15: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:45.054462 30757 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:45.056285 30773 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.040431 30930 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:45.058105 30797 consensus_queue.cc:237] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.063166 30673 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:45.090965 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.091944 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.092147 25197 raft_consensus.cc:2410] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:21:45.092890 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.063872 30851 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:45.064352 30784 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:45.075630 25122 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:45.095352 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:45.076570 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:45.044502 30901 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:45.095994 25120 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:45.050901 31002 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.090250 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.093894 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.103195 25199 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:45.094630 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.088301 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:45.097990 25202 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 16: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:45.100538 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:45.108193 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.100824 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.109544 25194 raft_consensus.cc:3060] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:21:45.115463 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.101714 30901 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.061288 30915 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:45.120282 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.120329 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:45.119877 30901 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:45.127359 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:45.120997 31035 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:21:45.104709 31002 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:45.147166 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.150874 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:45.155014 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.156215 25201 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 16: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:45.140717 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.086799 30962 consensus_queue.cc:260] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.154160 25202 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:45.161149 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.120038 30655 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:45.154234 31032 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:21:45.176538 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:45.123600 30830 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:45.143648 30993 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:45.143321 30850 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.207674 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.177273 25126 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:45.174331 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.176736 30655 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.187288 30915 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:45.187798 30780 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.195247 25196 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
I20260709 12:21:45.199708 30964 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:45.201975 30970 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:45.169173 30962 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:45.106273 30851 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.181035 25120 raft_consensus.cc:2468] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 20.
I20260709 12:21:45.237782 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:45.225705 31001 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:45.169319 30877 consensus_queue.cc:1175] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b83c12959b9848b3b7bbc680f5ee6225" responder_term: 16 status { last_received { term: 15 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:45.244910 25202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:45.242513 25855 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:45.246330 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:45.258961 25202 raft_consensus.cc:606] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:45.259429 25272 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:45.139614 30958 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.240309 30960 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:45.260346 25194 raft_consensus.cc:2468] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:45.249570 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.230726 25122 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:45.244711 30953 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.223256 30830 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.235833 30850 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.280668 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.245244 30964 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.292359 25121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 1049) took 2692 ms. Trace:
I20260709 12:21:45.303073 25121 rpcz_store.cc:276] 0709 12:21:42.585039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.585184 (+   145us) service_pool.cc:224] Handling call
0709 12:21:42.585480 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:44.768784 (+2183304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.277561 (+508777us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54001b71d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:45.277724 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4977371904}
I20260709 12:21:45.304515 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:45.297269 30830 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.248255 30970 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.260856 31001 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.271034 30960 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.311918 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.309659 30964 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.316586 25194 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:45.322566 25125 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:45.273501 30953 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.337039 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:45.339917 30830 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:45.341346 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.342267 30851 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.344188 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:45.345695 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.346585 25200 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:45.346486 25165 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:45.350185 25855 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:45.350910 25855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1934) took 1647 ms. Trace:
I20260709 12:21:45.351280 25855 rpcz_store.cc:276] 0709 12:21:43.703118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.707942 (+  4824us) service_pool.cc:224] Handling call
0709 12:21:43.708307 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.241827 (+1533520us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b58002dddd0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e6a0aa 00007f2103eec447 00007f2103f04fe7 00007f2103f067de 00007f2103f10b49 00007f2103f11416 00007f2103f0dd8f 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4
0709 12:21:45.350621 (+108794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.350857 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2504544000}
I20260709 12:21:45.352772 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.354868 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.356068 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.354174 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.371495 25200 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:21:45.372617 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.372877 25121 raft_consensus.cc:1240] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:45.375972 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:45.366366 30638 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:21:45.370949 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:45.361649 30851 raft_consensus.cc:2764] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:21:45.381176 30934 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:45.381523 30850 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.382968 30756 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.372083 30726 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:21:45.387234 25273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1477) took 1130 ms. Trace:
I20260709 12:21:45.389451 30819 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.391024 25274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1498) took 1001 ms. Trace:
I20260709 12:21:45.393421 31011 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:45.394687 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:45.395982 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:45.396064 25090 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:45.402140 30934 consensus_queue.cc:1059] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:45.403703 25165 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:45.416334 25273 rpcz_store.cc:276] 0709 12:21:44.256893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.287229 (+ 30336us) service_pool.cc:224] Handling call
0709 12:21:44.287597 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:44.427819 (+140222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:44.427868 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:44.443400 (+ 15532us) log.cc:844] Serialized 26 byte log entry
0709 12:21:44.632682 (+189282us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:44.632720 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.386838 (+754118us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400123ed4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:45.386887 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:45.386942 (+    55us) raft_consensus.cc:1685] finished
0709 12:21:45.386957 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.387173 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":394,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":4266,"spinlock_wait_cycles":309354240,"thread_start_us":168754,"threads_started":1,"wal-append.queue_time_us":229508}
I20260709 12:21:45.417726 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:45.423060 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:45.424904 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:45.417729 25274 rpcz_store.cc:276] 0709 12:21:44.407436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.580298 (+172862us) service_pool.cc:224] Handling call
0709 12:21:44.580608 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:44.604875 (+ 24267us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:21:44.632731 (+ 27856us) log.cc:844] Serialized 14 byte log entry
0709 12:21:44.729054 (+ 96323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:44.729115 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:44.729169 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.390801 (+661632us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b5400299854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:45.390844 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.390965 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31126,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":260,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5756,"spinlock_wait_cycles":55326464,"thread_start_us":95675,"threads_started":1,"wal-append.queue_time_us":167382}
I20260709 12:21:45.425338 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:45.426697 25274 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18. Ops: []
W20260709 12:21:45.427067 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.424942 25090 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:45.394016 30887 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:45.431687 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.429430 25090 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:45.432449 25268 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 17: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:45.450840 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 47200.4us
I20260709 12:21:45.430998 30819 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:45.440377 30797 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:45.430914 31027 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:45.455322 25165 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:45.462604 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:45.448726 30964 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:45.475905 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.443552 30887 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.455520 30851 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:45.463560 30797 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 16 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:45.476389 30776 consensus_queue.cc:1059] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:21:45.489106 31001 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:45.471521 30755 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:45.491348 30662 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:45.468804 31027 raft_consensus.cc:697] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:45.495563 30756 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:45.496114 30756 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:45.462826 30819 raft_consensus.cc:697] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:45.497417 30819 consensus_queue.cc:237] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:45.498220 30756 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:45.467509 30934 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:45.502117 30851 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.502707 30851 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:45.506503 30960 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:45.514386 31039 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:21:45.517921 25270 raft_consensus.cc:2368] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 15. Current term is 16.
I20260709 12:21:45.495164 31027 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.520699 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:45.528136 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 81931.3us
W20260709 12:21:45.538630 31043 log.cc:927] Time spent T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:21:45.542434 30970 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.545876 30830 consensus_queue.cc:1059] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:21:45.548363 30830 raft_consensus.cc:3055] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:21:45.548755 31041 log.cc:927] Time spent T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260709 12:21:45.478113 31002 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.550048 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:45.550755 31002 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:45.552102 31046 log.cc:927] Time spent T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:21:45.548779 30830 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:45.554549 25119 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 15: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:45.554127 30830 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.555215 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2428) took 1189 ms. Trace:
I20260709 12:21:45.555711 30830 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:45.555568 25269 rpcz_store.cc:276] 0709 12:21:44.366178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.388250 (+ 22072us) service_pool.cc:224] Handling call
0709 12:21:44.388718 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.018371 (+629653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.554968 (+536597us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b540034dad4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:45.555153 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446237568}
I20260709 12:21:45.558701 25271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2430) took 1147 ms. Trace:
I20260709 12:21:45.559154 25271 rpcz_store.cc:276] 0709 12:21:44.411174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.930605 (+519431us) service_pool.cc:224] Handling call
0709 12:21:44.978943 (+ 48338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:44.979453 (+   510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.558527 (+579074us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b5400298950. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:45.558647 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56934784}
I20260709 12:21:45.561182 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:45.561803 25859 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:45.563098 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:45.568848 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:45.570511 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:45.577041 30887 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:45.561204 30662 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:45.578563 25127 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:45.558631 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:45.581436 25855 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:45.588750 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:45.577085 25241 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:45.591329 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:45.593061 25855 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:45.591954 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:45.594561 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:45.594792 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:45.595242 25122 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:45.595474 25857 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 17: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:45.587970 25825 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:45.597219 25118 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 17: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:45.601999 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:45.602473 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:45.602825 25860 raft_consensus.cc:2410] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 17 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 12:21:45.603749 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:45.604739 25859 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:45.606422 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:45.614148 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:45.618322 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:45.628324 25092 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:45.630990 30970 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:45.632797 31040 log.cc:927] Time spent T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:21:45.634949 31002 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:45.635627 25275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40096 (request call id 2431) took 1212 ms. Trace:
I20260709 12:21:45.636080 25275 rpcz_store.cc:276] 0709 12:21:44.423614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.964445 (+540831us) service_pool.cc:224] Handling call
0709 12:21:44.964766 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.055224 (+ 90458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.055262 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.055310 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:45.055357 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.635301 (+579944us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b5400123754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:45.635367 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.635552 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207466880}
I20260709 12:21:45.641204 25122 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:45.481882 30797 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:45.608165 30960 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:45.609773 31033 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:45.647135 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:45.649088 25242 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:45.598803 30877 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:21:45.626797 30876 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:45.650663 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:45.655849 31023 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:45.659130 25851 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 15. (term mismatch)
I20260709 12:21:45.659464 25851 pending_rounds.cc:85] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 14
I20260709 12:21:45.659744 25851 pending_rounds.cc:107] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 15.15
I20260709 12:21:45.659974 25851 raft_consensus.cc:2889] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:45.645810 31033 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:45.651762 30915 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:45.651651 30993 raft_consensus.cc:2804] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:21:45.669277 30748 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:45.653182 30960 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:45.682186 30886 raft_consensus.cc:3055] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:45.682643 30886 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:45.683421 30886 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:45.645946 31048 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:21:45.687678 30886 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:45.693019 25267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1501) took 1126 ms. Trace:
I20260709 12:21:45.693447 25267 rpcz_store.cc:276] 0709 12:21:44.566610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.580906 (+ 14296us) service_pool.cc:224] Handling call
0709 12:21:45.692789 (+1111883us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54002a9254. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:45.692952 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026267008}
I20260709 12:21:45.663542 31033 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:45.694648 25276 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:21:45.685293 30993 raft_consensus.cc:697] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:45.703697 30993 consensus_queue.cc:237] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:45.705420 30986 consensus_meta.cc:287] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.761s	user 0.011s	sys 0.000s
W20260709 12:21:45.711552 31036 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.691s	user 0.003s	sys 0.009s
I20260709 12:21:45.715732 30953 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.716761 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:45.717919 31037 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 12:21:45.705871 30986 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:45.719782 25124 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:21:45.721696 30903 consensus_queue.cc:1059] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:45.722725 30903 raft_consensus.cc:3055] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:45.723042 30903 raft_consensus.cc:740] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:45.723774 30903 consensus_queue.cc:260] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.724859 30903 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:45.678994 30915 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:45.727843 30915 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:45.730104 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.731201 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.720853 30986 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:45.654655 30876 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.742972 25270 raft_consensus.cc:1275] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 16. Preceding OpId from leader: term: 16 index: 16. (term mismatch)
I20260709 12:21:45.743501 25270 pending_rounds.cc:85] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 15
I20260709 12:21:45.743777 25270 pending_rounds.cc:107] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 15.16
I20260709 12:21:45.744050 25270 raft_consensus.cc:2889] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:45.747360 25193 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:45.747759 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.748437 25201 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
W20260709 12:21:45.752959 30901 consensus_meta.cc:287] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.000s
I20260709 12:21:45.753425 30901 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.756803 25822 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:45.759950 30655 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.760492 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:45.760664 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:45.762748 25202 raft_consensus.cc:2368] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 14. Current term is 15.
I20260709 12:21:45.764700 25199 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:45.771991 25093 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:45.771140 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:45.786274 25167 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:45.787916 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:45.794003 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.734799 30851 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:45.794220 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:45.778594 30782 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:45.798267 25167 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:45.790201 31029 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:45.706467 30960 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.807672 25822 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:21:45.805325 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 150336us
I20260709 12:21:45.791277 31005 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:45.822918 25093 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:45.798485 31033 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.826081 30970 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:21:45.838383 31033 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.838603 30755 consensus_queue.cc:1059] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:45.834601 30782 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:45.830811 31002 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:45.839643 31002 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:45.840047 31002 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:45.842916 25093 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:45.845053 25093 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:45.846099 30950 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:45.846385 30851 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:45.848024 30950 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:45.859017 30830 consensus_queue.cc:1059] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:45.860836 30934 raft_consensus.cc:3055] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:45.861472 30934 raft_consensus.cc:740] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:45.862726 30934 consensus_queue.cc:260] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:45.864106 30755 raft_consensus.cc:3055] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:45.865029 30755 raft_consensus.cc:740] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:45.866144 30755 consensus_queue.cc:260] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:45.867452 30755 raft_consensus.cc:3060] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:45.810750 30990 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:45.874874 25165 leader_election.cc:400] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 15. Current term is 16.
I20260709 12:21:45.877934 25165 leader_election.cc:403] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:21:45.879127 25853 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:45.882699 25193 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:21:45.885321 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.875759 25242 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:45.886665 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:45.892230 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.832855 30655 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:45.894207 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:45.898768 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:45.899454 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.901862 25200 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:45.874076 30962 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:45.906340 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:45.894728 30886 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:45.912220 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:45.896155 30991 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:45.923300 25200 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 18.
I20260709 12:21:45.878809 30990 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.927522 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:45.918089 30780 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:45.935421 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:45.939370 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40086 (request call id 2898) took 1104 ms. Trace:
W20260709 12:21:45.940425 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.939759 25276 rpcz_store.cc:276] 0709 12:21:44.834829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.067266 (+232437us) service_pool.cc:224] Handling call
0709 12:21:45.694404 (+627138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.695109 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.937623 (+242514us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b54002a9250. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:45.939318 (+  1695us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1440502528}
W20260709 12:21:45.941167 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.932605 25242 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:45.907450 31005 consensus_queue.cc:1059] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:21:45.949505 25242 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:45.910413 30962 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:45.938400 31026 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:45.936254 30901 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:45.938926 30957 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:45.955030 30991 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:45.977995 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:45.953162 30780 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:45.996438 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:45.977391 30883 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:45.996575 31052 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:21:46.000429 30748 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:45.978487 31005 consensus_queue.cc:1243] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:21:46.056432 31055 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:21:46.071233 31058 log.cc:927] Time spent T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:21:46.073510 31026 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:46.085778 30962 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:45.994345 30991 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:46.144410 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.162135 31026 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:46.163322 31053 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:46.153616 30957 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:46.171437 30991 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:46.179458 30962 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.191896 31029 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:46.174355 31053 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.230906 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:46.226173 31029 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.262087 31029 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.266263 30877 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:46.270533 31053 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.232285 30990 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:46.274844 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.313913 30877 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:46.277871 31056 log.cc:927] Time spent T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 12:21:46.316996 30877 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:46.219725 30962 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.317703 30877 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:46.318384 30877 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.319909 30962 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:46.320945 30877 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:46.217099 30957 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.323189 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:46.325438 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:46.321895 30957 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.325647 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:46.327692 30957 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.332883 30991 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.335888 30782 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:46.231805 25267 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:46.352815 25270 raft_consensus.cc:2393] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 17: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:21:46.357329 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.358960 31001 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:46.359731 31001 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.362329 31001 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:46.369774 30991 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.373248 31049 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:46.373931 31049 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:46.382853 31049 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:46.394868 25124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2596) took 1150 ms. Trace:
I20260709 12:21:46.297127 31002 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:46.303041 30780 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:46.284077 30970 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:46.296535 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 300182us
I20260709 12:21:46.396903 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2755) took 1263 ms. Trace:
I20260709 12:21:46.395267 25124 rpcz_store.cc:276] 0709 12:21:45.244083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.343006 (+ 98923us) service_pool.cc:224] Handling call
0709 12:21:45.343275 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.720136 (+376861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.394610 (+674474us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b540026c854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:46.394811 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865396608}
I20260709 12:21:46.397392 31033 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:46.403298 25125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2585) took 1327 ms. Trace:
I20260709 12:21:46.400830 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:46.399271 30970 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.400637 25198 rpcz_store.cc:276] 0709 12:21:45.133077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.133602 (+   525us) service_pool.cc:224] Handling call
0709 12:21:45.159174 (+ 25572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.297914 (+138740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.297959 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.298010 (+    51us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:21:45.298070 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.396636 (+1098566us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54000a7654. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:46.396691 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.396842 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318538624}
I20260709 12:21:46.417492 30991 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:46.397572 30782 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:46.431056 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:46.432835 30989 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:46.433442 30970 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.401868 30886 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 15. Current term is 16.
I20260709 12:21:46.454869 31002 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:46.455510 31026 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.403834 25125 rpcz_store.cc:276] 0709 12:21:45.075731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.075991 (+   260us) service_pool.cc:224] Handling call
0709 12:21:45.076264 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.323022 (+246758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.403013 (+1079991us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400105c54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:46.403237 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566012288}
I20260709 12:21:46.436300 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:46.494347 25201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.021s	sys 0.049s
W20260709 12:21:46.495126 25201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.021s	sys 0.049s
W20260709 12:21:46.497225 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 60855.4us
I20260709 12:21:46.501958 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:46.506719 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:46.525883 30756 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:46.527658 25125 raft_consensus.cc:1275] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:21:46.529556 30662 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:46.529095 30756 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:21:46.530856 30662 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:46.531972 30662 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:46.532780 30781 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.011s	sys 0.016s
W20260709 12:21:46.533433 30781 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.011s	sys 0.016s
I20260709 12:21:46.529172 30727 raft_consensus.cc:3055] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:46.534624 30727 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:46.536409 30727 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.541940 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:46.437364 30782 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.543325 30727 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:46.544373 31026 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.547983 30970 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:46.549101 30970 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:46.550482 31002 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:46.551398 31002 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.559908 31001 consensus_queue.cc:1048] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:21:46.560592 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.569393 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 1111) took 1232 ms. Trace:
I20260709 12:21:46.569198 31053 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:46.570662 31053 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.554363 30970 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:46.575814 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:46.577307 25858 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:46.580897 25851 raft_consensus.cc:1275] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:21:46.584450 25198 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:46.569888 25199 rpcz_store.cc:276] 0709 12:21:45.336410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.338141 (+  1731us) service_pool.cc:224] Handling call
0709 12:21:45.764387 (+426246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.765163 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.568917 (+803754us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400220950. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:46.569193 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979496192}
I20260709 12:21:46.586858 30781 raft_consensus.cc:3055] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:46.587188 31002 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.588376 30782 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:46.602654 31026 consensus_queue.cc:1059] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:21:46.594641 30781 raft_consensus.cc:740] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:46.605986 31026 raft_consensus.cc:3055] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:46.606597 31026 raft_consensus.cc:740] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:46.607218 30781 consensus_queue.cc:260] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:46.608093 31026 consensus_queue.cc:260] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.610674 31026 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:46.619004 25127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 1081) took 1351 ms. Trace:
I20260709 12:21:46.619570 25127 rpcz_store.cc:276] 0709 12:21:45.267804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.347813 (+ 80009us) service_pool.cc:224] Handling call
0709 12:21:45.578391 (+230578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.578965 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.618530 (+1039565us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54003237d0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0d8ad 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:46.618781 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529672448}
I20260709 12:21:46.634848 30876 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:46.634742 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:46.635591 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:46.638844 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:46.640051 25855 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:46.621169 25822 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:46.652187 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:46.655839 30991 consensus_queue.cc:1048] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:46.656579 30991 consensus_queue.cc:1243] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer 4456c1069d1541fab5b7cb29df9b6167 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:21:46.669898 31054 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.676s	user 0.003s	sys 0.008s
I20260709 12:21:46.670331 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:46.676493 25194 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:46.680159 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:46.681205 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.683918 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:46.685024 25202 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:46.688354 30662 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.696045 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:46.693766 30934 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:46.708040 30658 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.709162 30658 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:46.709828 30936 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:46.710484 30936 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:46.711014 30936 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:46.716131 31030 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:46.717247 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:46.717020 31030 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.718168 25275 raft_consensus.cc:2393] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 12: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:46.719591 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:46.721236 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:46.645416 31053 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.722198 25276 raft_consensus.cc:2368] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 17. Current term is 18.
W20260709 12:21:46.723439 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 102551us
W20260709 12:21:46.724287 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 72547.4us
I20260709 12:21:46.728811 30658 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:46.725646 31030 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.727187 25270 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:21:46.734748 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:46.735930 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:46.737215 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.737658 30876 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:46.738412 30876 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.745048 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:46.746568 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 64642us
I20260709 12:21:46.745064 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:46.755930 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:46.757532 25855 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
I20260709 12:21:46.759419 25858 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:46.743238 30876 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:46.766847 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:46.752918 30658 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:46.782205 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:46.787709 30953 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:46.788440 30953 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:46.788827 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 53142.9us
I20260709 12:21:46.791219 30953 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.793478 31053 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:46.794237 31053 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.796789 31053 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.798115 30876 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:46.798942 30876 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.803375 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:46.804522 25268 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:46.802918 30876 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:46.805591 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:46.807096 25274 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:21:46.807942 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:46.789702 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:46.808970 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:46.814692 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:46.771674 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:46.833498 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:46.835057 25273 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:21:46.833384 25270 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:46.841950 25194 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:46.849092 25196 raft_consensus.cc:2368] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 17. Current term is 18.
I20260709 12:21:46.849084 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:46.849969 25851 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
W20260709 12:21:46.853183 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.852982 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:46.857043 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:46.854481 25858 pending_rounds.cc:85] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 11
I20260709 12:21:46.859786 25854 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:46.860280 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:46.860842 30658 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:46.861850 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:46.863435 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.861452 30658 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:46.858951 25858 pending_rounds.cc:107] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:21:46.868918 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:46.867450 25858 raft_consensus.cc:2889] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:46.875504 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:46.881510 25201 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:21:46.883250 25276 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:46.883836 30781 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:46.888065 25124 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:21:46.889076 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:46.889994 25127 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:21:46.891032 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:46.866479 30658 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:46.892998 25241 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:46.894117 30957 raft_consensus.cc:2804] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:46.894771 25272 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:21:46.894667 30957 raft_consensus.cc:697] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:46.901746 25241 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:46.899531 30957 consensus_queue.cc:237] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.902864 25125 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:46.906706 31049 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:46.907133 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:46.907498 31049 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.908047 25126 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:46.908972 25275 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:46.909883 31049 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:46.913272 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.917479 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 127923us
I20260709 12:21:46.919761 31029 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:46.920558 31029 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.926522 30955 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:46.927407 30955 raft_consensus.cc:697] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:46.929844 30819 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:46.930785 30819 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.933346 25168 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:46.935597 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:46.933701 30819 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.946429 25090 leader_election.cc:400] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 17. Current term is 18.
W20260709 12:21:46.946579 25227 heartbeater.cc:646] Failed to heartbeat to 127.23.81.254:44087 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.23.81.254:44087 timed out after 15.000s (SENT)
I20260709 12:21:46.946918 25090 leader_election.cc:403] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:21:46.949682 30953 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.950397 30953 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.952723 30953 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:46.953833 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:46.954830 30782 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:46.955528 25825 leader_election.cc:400] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for earlier term 14. Current term is 15.
I20260709 12:21:46.966173 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:46.967097 25855 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:46.981073 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:46.982663 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 49469.9us
I20260709 12:21:46.986212 31005 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.987059 31005 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.990294 30727 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:46.990540 30954 consensus_queue.cc:1059] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:46.991309 30782 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:46.992187 30954 raft_consensus.cc:3055] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:46.992714 30954 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:21:46.994473 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.995186 30819 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:46.996946 30954 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:46.998850 30954 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:46.998993 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 60190.7us
I20260709 12:21:47.001646 30662 consensus_queue.cc:1048] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:47.006181 25242 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:47.007948 25242 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:47.008262 30915 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:47.010385 31029 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:47.012868 31049 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:47.022683 25198 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:47.025177 30955 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.030495 31049 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:21:47.031104 31072 log.cc:927] Time spent T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.294s	user 0.000s	sys 0.002s
I20260709 12:21:47.031153 25090 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:47.033179 31049 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:47.033588 31049 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:47.033990 31049 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:47.035271 30798 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:47.038118 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:47.038586 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:47.039034 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:47.039721 25269 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
W20260709 12:21:47.039786 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 81292.2us
I20260709 12:21:47.040706 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:47.040776 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:47.043627 30782 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:47.047751 25090 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:47.043463 31001 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:47.043102 25022 catalog_manager.cc:5697] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 10 to 11, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 11 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:47.099617 30902 raft_consensus.cc:993] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:21:47.099436 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:47.100253 30902 raft_consensus.cc:1081] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
W20260709 12:21:47.102489 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 61929.5us
I20260709 12:21:47.103770 31029 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:47.103978 25093 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:47.104280 30798 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:47.104430 31029 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.104951 30798 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:47.106853 25093 leader_election.cc:400] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 17. Current term is 18.
I20260709 12:21:47.107034 30798 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:47.107402 30970 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:47.109404 30797 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:47.110277 31029 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:47.116266 30960 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 12:21:47.118248 30960 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:47.129171 25241 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:47.124487 30957 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:47.134123 30658 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:47.134248 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:47.134666 30658 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:47.135088 30658 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:47.138351 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:47.138952 25198 raft_consensus.cc:3060] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:47.141119 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:47.150156 30964 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:47.150763 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:47.149586 25025 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41756 (request call id 377) took 15587 ms (client timeout 15000 ms). Trace:
I20260709 12:21:47.151880 25859 raft_consensus.cc:2393] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 17: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:47.090095 31005 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:47.179714 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.177983 30658 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.183140 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:47.183728 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:47.183956 25197 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:47.185842 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:47.187786 30658 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:47.191874 25198 raft_consensus.cc:2468] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
I20260709 12:21:47.150739 30964 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.194018 30797 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:47.206513 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:47.207221 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.210911 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:47.119628 30936 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.204028 30964 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:47.213806 30797 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:47.223654 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:47.213634 30934 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:47.221277 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:47.223717 25270 raft_consensus.cc:1240] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18. Ops: []
W20260709 12:21:47.221359 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 213500us
I20260709 12:21:47.228164 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:47.220633 25125 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 16 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:47.234246 25201 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:21:47.236817 25242 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:47.233183 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:47.239637 25851 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:47.243498 25855 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:47.247166 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:47.248811 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:47.246320 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:47.270212 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 166351us
I20260709 12:21:47.244074 30957 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:47.262498 30991 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:47.307299 25125 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:47.319785 30850 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.320585 30850 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.327078 30936 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:47.331748 30797 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:47.307899 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:47.339294 25198 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:47.342324 25853 raft_consensus.cc:1240] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:47.308494 30798 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.367615 25851 raft_consensus.cc:2468] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:47.374698 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:47.382700 25119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:21:47.383401 25856 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:47.383508 25119 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:47.384016 25119 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:47.384560 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:47.385221 25856 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:47.386546 30727 raft_consensus.cc:493] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:47.387410 30727 raft_consensus.cc:515] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:47.389185 30986 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:21:47.390386 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:47.390656 30839 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:47.391456 30839 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.392364 25119 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.395526 30727 leader_election.cc:290] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:47.397688 30839 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:47.398190 30798 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.402527 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:47.403436 25200 raft_consensus.cc:606] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:47.403861 25200 raft_consensus.cc:614] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:47.152683 25025 rpcz_store.cc:269] 0709 12:21:31.560941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.563415 (+  2474us) service_pool.cc:224] Handling call
0709 12:21:31.826381 (+262966us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b5400002210. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9b71 00007f2100dea0b2 00007f2109d63759 00007f2109cfba76 00007f2109cccd58 00007f2109dcb04e 00007f210828c2a4 00007f210828c232 00007f210828c161 00007f210828c0dc
0709 12:21:31.988805 (+162424us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x7b54002ef754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e78090 00007f2103f16f3a 00007f2109ccce9c 00007f2109dcb04e 00007f210828c2a4 00007f210828c232 00007f210828c161 00007f210828c0dc 00007f210828b392 00007f210224948c 00007f21022488c6
0709 12:21:47.147797 (+15158992us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:41.792168 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:41.792817 (+   649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:41.792860 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:21:41.792882 (+    22us) tablet.cc:662] Decoding operations
0709 12:21:41.800968 (+  8086us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:41.801038 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:41.801072 (+    34us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:21:41.881820 (+ 80748us) tablet.cc:701] Row locks acquired
0709 12:21:41.881841 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:21:41.881986 (+   145us) write_op.cc:270] Start()
0709 12:21:41.882136 (+   150us) write_op.cc:276] Timestamp: P: 1783599701881934 usec, L: 0
0709 12:21:41.882158 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:41.893298 (+ 11140us) log.cc:844] Serialized 5547 byte log entry
0709 12:21:43.308737 (+1415439us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54002ef754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f09e28 00007f2107944581 00007f2107943d58 00007f21079489f1 00007f21079489a9 00007f2107948939 00007f2107948901 00007f2107947b2d 0000000000388634 0000000000388479
0709 12:21:43.521908 (+213171us) op_driver.cc:464] REPLICATION: finished
0709 12:21:44.123288 (+601380us) write_op.cc:301] APPLY: starting
0709 12:21:44.145154 (+ 21866us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:44.869714 (+724560us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b18000a8400. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2103c4d0ec 00007f2103c4faf7 00007f2103c50fb0 00007f21079651bb 00007f2107965532 00007f21079acb93 00007f2107859de3 00007f21078596ab 00007f210785ae77
0709 12:21:44.871643 (+  1929us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:44.871669 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:45.296675 (+425006us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:45.296927 (+   252us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 12:21:45.296970 (+    43us) write_op.cc:312] APPLY: finished
0709 12:21:45.297281 (+   311us) log.cc:844] Serialized 129 byte log entry
0709 12:21:45.446315 (+149034us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:45.456251 (+  9936us) write_op.cc:454] Released schema lock
0709 12:21:45.461428 (+  5177us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:45.487608 (+ 26180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:45.487658 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1769499,"reported_tablets":46,"spinlock_wait_cycles":216873472,"child_traces":[["op",{"apply.queue_time_us":544094,"apply.run_cpu_time_us":45542,"apply.run_wall_time_us":1372211,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62759,"num_ops":14,"prepare.queue_time_us":264343,"prepare.run_cpu_time_us":40831,"prepare.run_wall_time_us":1516786,"raft.queue_time_us":168606,"raft.run_cpu_time_us":27351,"raft.run_wall_time_us":347267,"replication_time_us":1615688,"spinlock_wait_cycles":28717184,"thread_start_us":999721,"threads_started":5,"wal-append.queue_time_us":840878,"wal-append.run_cpu_time_us":34482,"wal-append.run_wall_time_us":2969070}]]}
I20260709 12:21:47.416832 30819 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for earlier term 17. Current term is 18.
I20260709 12:21:47.417732 25857 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:47.419013 25200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:47.419870 25200 raft_consensus.cc:606] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:47.420361 25200 raft_consensus.cc:614] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:47.424228 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:47.427922 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:47.435674 25126 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:47.437183 25125 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:47.437840 25851 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:47.312768 30934 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.428797 25856 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 10.
I20260709 12:21:47.443497 25022 catalog_manager.cc:5697] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 13 to 14, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 14 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:47.506865 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:47.508102 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:47.512590 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:47.524780 25093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.380856 31049 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:47.443068 30797 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.528965 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:47.532506 25124 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 15: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:47.532861 25200 raft_consensus.cc:3055] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:47.533135 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:47.536935 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:47.446273 31026 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:47.533216 25200 raft_consensus.cc:740] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:47.537619 25202 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:47.543447 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:47.541419 25022 catalog_manager.cc:5697] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 9 to 13, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 13 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:47.545588 25856 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:47.629390 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:47.629528 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:47.635524 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:47.576129 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 275162us
I20260709 12:21:47.536074 30915 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:47.544652 30986 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.550310 31001 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:47.640851 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 204790us
I20260709 12:21:47.651487 25127 raft_consensus.cc:2393] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 16: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:47.630378 25022 catalog_manager.cc:5697] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 7 to 9, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 9 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:47.676465 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 377336us
I20260709 12:21:47.636361 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:47.575147 31090 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:47.650111 25200 consensus_queue.cc:260] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.733347 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:47.646570 30797 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:47.649765 31026 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.745661 30850 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:47.789772 25855 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:47.712355 31001 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.794019 25241 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:47.730245 30915 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:47.801303 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 88393.2us
I20260709 12:21:47.815032 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:47.818109 31080 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.578s	user 0.002s	sys 0.000s
W20260709 12:21:47.818300 31083 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
I20260709 12:21:47.820369 30797 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:47.820680 25852 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:47.814206 30934 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:47.823592 30915 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:47.823897 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:47.825129 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:47.826692 30798 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:47.827280 25856 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 13. Current term is 14. Ops: []
W20260709 12:21:47.828404 30964 consensus_meta.cc:287] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
I20260709 12:21:47.828907 30964 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.829569 25858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1549) took 1026 ms. Trace:
I20260709 12:21:47.829968 25858 rpcz_store.cc:276] 0709 12:21:46.803236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.836284 (+ 33048us) service_pool.cc:224] Handling call
0709 12:21:46.847065 (+ 10781us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:46.913168 (+ 66103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.913191 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:46.916280 (+  3089us) log.cc:844] Serialized 52 byte log entry
0709 12:21:47.089507 (+173227us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:47.089557 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.089623 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:47.817333 (+727710us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:47.829290 (+ 11957us) raft_consensus.cc:1685] finished
0709 12:21:47.829311 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.829514 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7419,"raft.queue_time_us":14765,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":9048448,"thread_start_us":115290,"threads_started":1,"wal-append.queue_time_us":258077}
I20260709 12:21:47.766779 30986 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:47.750921 31090 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.831682 31107 raft_consensus.cc:2804] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:21:47.850256 31099 log.cc:927] Time spent T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:21:47.850703 31091 log.cc:927] Time spent T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:21:47.860004 31090 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:47.840296 30798 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:47.852833 31087 log.cc:927] Time spent T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
W20260709 12:21:47.855237 31086 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
W20260709 12:21:47.855577 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:47.871111 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:47.857264 30970 consensus_meta.cc:287] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.749s	user 0.008s	sys 0.004s
W20260709 12:21:47.841015 30960 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.013s	sys 0.017s
W20260709 12:21:47.873158 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 155586us
I20260709 12:21:47.850760 25022 catalog_manager.cc:5697] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
W20260709 12:21:47.837946 30782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.002s	sys 0.009s
I20260709 12:21:47.857872 31107 raft_consensus.cc:697] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:21:47.877700 30782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.002s	sys 0.009s
I20260709 12:21:47.885576 31001 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:47.888177 30964 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:47.847981 31049 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:47.875221 30960 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.013s	sys 0.018s
I20260709 12:21:47.898330 31107 consensus_queue.cc:237] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:47.874639 30970 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:47.899991 25123 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:47.876896 30798 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:47.902509 31085 log.cc:927] Time spent T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.253s	user 0.000s	sys 0.002s
W20260709 12:21:47.924031 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 211962us
W20260709 12:21:47.955404 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 160355us
I20260709 12:21:47.936854 31005 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:47.960489 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:47.969250 25165 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:47.973094 31093 consensus_queue.cc:1059] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:21:47.964015 25825 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:47.970173 25022 catalog_manager.cc:5697] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:47.954164 31089 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:21:47.965560 31005 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:47.982388 30839 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:47.989362 25121 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:47.976732 30798 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:47.974752 30986 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:47.987950 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:47.998973 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.023007 31026 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:47.998821 31074 consensus_queue.cc:1059] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:21:48.004125 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:48.025637 31110 raft_consensus.cc:3055] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:48.017746 25125 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:21:48.026084 31110 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:21:48.026469 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 67569.8us
I20260709 12:21:47.991266 31116 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.988523 31117 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:48.027374 31110 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.027694 31116 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.027937 31117 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.017196 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.028941 31110 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:48.027091 31113 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:48.028039 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.029829 25856 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:48.001893 25120 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:21:48.007629 25022 catalog_manager.cc:5697] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 6 to 8, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 8 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:48.001888 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.004043 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:48.032054 30819 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.027349 25825 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:48.032763 30819 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.045104 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.032153 25022 catalog_manager.cc:5697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 7 to 13, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 13 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.044847 31113 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:48.060600 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:48.061087 31113 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:48.062839 30819 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:48.045691 31117 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.065605 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:48.068157 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 90316.4us
I20260709 12:21:48.071007 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:48.072860 31116 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.070365 31074 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.073745 31074 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.075102 30955 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:48.075929 31074 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:48.076859 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:48.078269 30955 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:48.078918 30955 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:48.079334 30955 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:48.080052 31095 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:48.080536 31095 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:48.080932 31095 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:48.078235 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.085441 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.085704 31116 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:48.106307 25093 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.113960 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:48.115752 30986 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:48.121570 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.122536 25852 raft_consensus.cc:2410] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:21:48.116422 25093 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.123998 30953 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:48.124040 25093 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:48.126230 31113 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:48.126669 31113 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:48.127043 31113 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:48.127260 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.129221 31118 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:48.130605 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.113279 31001 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:48.125460 25195 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:21:48.131723 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.134272 30797 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:21:48.134682 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 47383.5us
I20260709 12:21:48.135690 30970 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:48.134685 30797 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.137036 30797 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:48.111454 31074 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.137887 31074 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.146680 25195 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:21:48.148900 25168 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:48.154191 25194 raft_consensus.cc:1275] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:48.155325 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:48.158109 25825 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.159719 25193 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:48.153652 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:48.176707 25198 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:48.179150 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.180547 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.181171 25198 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:48.182512 25168 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:48.182693 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:48.184007 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:48.185479 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.189451 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.189800 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.190625 25198 raft_consensus.cc:2410] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:21:48.191346 31097 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:48.194185 30819 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:48.194635 30819 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.195042 30819 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:48.194765 31095 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.197217 31095 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:48.198251 31124 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:48.188402 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.199999 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:48.180264 31110 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:48.202052 31110 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:48.202683 25856 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:48.203027 31110 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.182108 30782 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:21:48.187556 31105 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:21:48.207646 31074 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:48.212267 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.218045 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.219969 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.224244 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.225616 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.226361 25202 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:48.227777 25202 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:48.233705 30936 raft_consensus.cc:3055] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:48.233790 30797 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.234398 30936 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:48.234853 30819 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.235450 30936 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.229768 31130 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:48.233716 25825 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:48.244401 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46474 (request call id 1987) took 1074 ms. Trace:
I20260709 12:21:48.244792 25859 rpcz_store.cc:276] 0709 12:21:47.168176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.170196 (+  2020us) service_pool.cc:224] Handling call
0709 12:21:47.194004 (+ 23808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.533788 (+339784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.533835 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:47.533894 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:47.533940 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.241946 (+708006us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400470ed4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:48.242004 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.242137 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780240256}
I20260709 12:21:48.245623 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:48.246227 25201 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:48.249202 31108 raft_consensus.cc:2764] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:21:48.233826 31113 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.250247 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.244786 30936 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:48.252099 31113 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:48.236320 30797 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.230413 31102 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:48.267699 25201 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:48.230262 31074 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:48.269850 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:48.284931 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:48.286405 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:48.287110 25201 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:48.288815 31134 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:48.289489 31134 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.291795 31134 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.294731 25201 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
I20260709 12:21:48.294804 31005 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:48.296511 30850 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:48.297107 30850 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.299350 30850 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.305068 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:48.310573 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.310904 25200 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.311408 25859 raft_consensus.cc:2410] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:21:48.312917 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:48.315536 31117 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:48.316800 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.317011 31107 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:48.317507 31107 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:48.317938 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:48.277868 31074 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.279155 30955 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.324911 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:48.325959 25120 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:21:48.332836 25119 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.322609 30658 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:21:48.337407 30955 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:48.326215 31117 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 12:21:48.338845 25092 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.196:45401 timed out after 1.512s (SENT) [suppressed 3 similar messages]
I20260709 12:21:48.342729 25197 pending_rounds.cc:85] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Aborting all ops after (but not including) 12
I20260709 12:21:48.343350 25197 pending_rounds.cc:107] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:21:48.343660 25197 raft_consensus.cc:2889] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:48.346629 30953 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:48.349813 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:48.350754 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:48.352226 25120 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:21:48.366705 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:48.371919 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:48.372382 30986 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:48.373150 25168 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:48.373091 30986 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.374691 30850 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:48.375240 30850 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.375708 30850 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:48.358449 30797 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:48.350684 31074 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.380316 30781 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:48.347909 30953 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.377517 30797 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.382316 30781 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.397975 30986 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:48.411525 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 95529.6us
I20260709 12:21:48.411547 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:48.418506 30953 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.421972 30797 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.407466 30781 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:48.407526 31005 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:48.427424 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:48.422842 31133 log.cc:927] Time spent T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:21:48.425720 30727 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:48.437434 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.434195 31005 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.441056 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2942) took 1176 ms. Trace:
I20260709 12:21:48.441646 31090 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.441864 31005 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.442180 31090 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.442629 30727 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.444713 25200 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:48.445143 30727 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.446376 25202 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:21:48.441464 25118 rpcz_store.cc:276] 0709 12:21:47.264735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.264850 (+   115us) service_pool.cc:224] Handling call
0709 12:21:47.297513 (+ 32663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:48.123784 (+826271us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b180003df00. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e03e07 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e1e455 00007f2103f06060 00007f2103f06bfb 00007f2103f1164b 00007f2103f0dd8f
0709 12:21:48.166072 (+ 42288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:48.166118 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:48.184734 (+ 18616us) log.cc:844] Serialized 26 byte log entry
0709 12:21:48.267161 (+ 82427us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:21:48.267603 (+   442us) log.cc:844] Serialized 14 byte log entry
0709 12:21:48.275231 (+  7628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.275308 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:48.440739 (+165431us) raft_consensus.cc:1685] finished
0709 12:21:48.440843 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.440996 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":913,"prepare.queue_time_us":9374,"prepare.run_wall_time_us":35,"raft.queue_time_us":66337,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":58018,"spinlock_wait_cycles":11612672,"thread_start_us":117710,"threads_started":2,"wal-append.queue_time_us":140456}
I20260709 12:21:48.445307 31090 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:48.448009 25202 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:21:48.451066 31117 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.451706 31117 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.454811 31117 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:48.456516 30727 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:48.457281 30727 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.438730 25195 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
W20260709 12:21:48.462852 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.465342 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.466082 25195 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:48.464427 31117 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:48.467402 31117 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.471594 25123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41048 (request call id 2599) took 1277 ms. Trace:
I20260709 12:21:48.472007 25123 rpcz_store.cc:276] 0709 12:21:47.193875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.194186 (+   311us) service_pool.cc:224] Handling call
0709 12:21:47.214308 (+ 20122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.900382 (+686074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.471349 (+570967us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54001b76d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:48.471538 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576482176}
I20260709 12:21:48.474349 31105 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:48.474973 31105 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.478195 25092 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:48.482754 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:48.483053 30781 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.484968 31106 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:48.485324 30781 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:48.485663 31106 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.488265 31106 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.489219 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.489316 25167 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:48.489826 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.490738 25825 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.491452 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.491822 25825 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.492094 31134 consensus_queue.cc:1059] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:48.492755 25092 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.493135 31134 raft_consensus.cc:3055] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:48.493207 31026 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:48.493659 31134 raft_consensus.cc:740] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:48.494799 31026 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:48.494517 31134 consensus_queue.cc:260] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.495208 31026 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:48.495604 31026 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:48.495771 31134 raft_consensus.cc:3060] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:48.497915 30782 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:48.498596 31130 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:48.500068 31130 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:48.500437 31130 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:48.500612 25270 raft_consensus.cc:2410] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:21:48.500833 31130 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.502925 25122 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:48.498601 30782 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:48.504643 30782 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:48.477423 31105 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:48.507254 25859 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:21:48.494237 31107 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.505062 25167 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:48.527511 30819 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:48.516693 25268 raft_consensus.cc:1240] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:48.519898 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.521215 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.518728 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.530843 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.531483 25267 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:48.522639 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:48.524583 25092 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.532665 25122 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:48.533138 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.534219 25859 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 15: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:48.535372 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:48.537915 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:48.540061 31100 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:48.539868 30658 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:48.541755 25092 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.548113 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.529799 30970 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:48.545879 30797 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:48.549053 31102 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:48.546876 30915 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:48.540683 30986 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:48.541929 31107 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:48.566056 30727 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.550880 31088 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:48.569128 31088 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.569576 25093 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.549851 30776 consensus_queue.cc:1059] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:48.527871 31106 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:21:48.543318 30960 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:21:48.547355 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 1331) took 1135 ms. Trace:
I20260709 12:21:48.543727 30819 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:48.553361 25822 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:48.553932 31124 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:48.540480 31100 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:48.554770 31116 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:48.556037 31030 consensus_queue.cc:1048] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:48.558238 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.560051 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.561297 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.578186 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:48.591984 25093 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:48.546377 30781 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:48.563186 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.565814 30915 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:48.602113 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 48837.5us
I20260709 12:21:48.567129 31117 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:48.568038 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.546882 30936 consensus_queue.cc:1059] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:21:48.597350 31102 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:48.597831 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.625283 25269 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:21:48.625394 30986 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:48.600140 25270 raft_consensus.cc:1240] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:48.600900 30955 consensus_queue.cc:1059] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:48.601370 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.627202 30955 raft_consensus.cc:3055] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:48.627795 30955 raft_consensus.cc:740] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
W20260709 12:21:48.607026 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 58388us
I20260709 12:21:48.615139 31150 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:48.591610 30819 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:48.611174 30658 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:21:48.657549 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.658255 25195 raft_consensus.cc:1275] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:21:48.592305 25857 rpcz_store.cc:276] 0709 12:21:47.411923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.712968 (+301045us) service_pool.cc:224] Handling call
0709 12:21:47.737430 (+ 24462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.754951 (+ 17521us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:21:47.929965 (+175014us) log.cc:844] Serialized 14 byte log entry
0709 12:21:48.532253 (+602288us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b18003a2ee0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2103ab64bc 00007f2100e0448b 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b 00007f2103aadd23 00007f2103aae23a
0709 12:21:48.537449 (+  5196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:48.537498 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:48.547084 (+  9586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.547169 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.547287 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6395,"prepare.queue_time_us":227068,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":11115,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":1797,"spinlock_wait_cycles":3391360,"thread_start_us":197081,"threads_started":2,"wal-append.queue_time_us":122691}
I20260709 12:21:48.618134 31113 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:48.619146 30850 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.621196 30915 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:48.625837 30986 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.607048 25093 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:48.666855 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 59932.4us
I20260709 12:21:48.667207 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.667488 25093 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:48.663235 30936 raft_consensus.cc:3055] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:48.667829 25276 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 10.
I20260709 12:21:48.629467 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.668125 30936 raft_consensus.cc:740] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:48.669708 30953 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:48.670358 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:48.669093 30936 consensus_queue.cc:260] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.671597 30936 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:48.627281 30776 raft_consensus.cc:3055] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:48.652140 31124 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:48.606324 30781 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.673434 31124 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:48.673569 30781 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.653744 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:48.654577 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.667136 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:48.661669 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.662457 25167 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:48.659298 25090 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.676326 25122 raft_consensus.cc:2468] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:21:48.575338 31088 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:48.629025 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d606e00420654b22bb1000c1b0aacbbc" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.655474 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:48.680080 30850 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:48.676600 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:48.680940 31104 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.013s	sys 0.015s
I20260709 12:21:48.681344 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.680974 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:48.630651 31150 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.664660 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:48.684357 25093 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:48.662137 30819 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:48.673291 30776 raft_consensus.cc:740] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:48.662688 31113 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.668174 30797 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:48.673746 31101 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:21:48.704480 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 45304.9us
I20260709 12:21:48.675235 30986 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:48.663398 31093 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:48.665114 31116 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:48.681381 31104 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.013s	sys 0.015s
I20260709 12:21:48.713471 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:48.611948 31130 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.713856 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:48.713405 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 135360us
I20260709 12:21:48.939505 25125 raft_consensus.cc:1240] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:21:48.738956 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:48.690656 31150 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:48.688814 31100 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.686165 30970 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:21:48.891772 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 185780us
W20260709 12:21:48.892572 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.675163 30955 consensus_queue.cc:260] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.708367 30662 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:48.690238 31074 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:48.736884 31112 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:48.714928 31113 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:48.742360 31124 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.893821 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:48.974694 30955 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:48.975093 25268 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:48.894480 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:48.897344 25123 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:48.901997 30776 consensus_queue.cc:260] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:48.903491 31090 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.904017 31049 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:21:48.893339 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 335784us
I20260709 12:21:48.983311 31049 raft_consensus.cc:697] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:48.984539 25241 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.908731 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:48.987484 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.906948 31005 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.932524 31116 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.988227 31005 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.988600 31105 raft_consensus.cc:2749] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:48.990381 31116 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.957307 25859 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:48.991143 31005 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:48.985793 25241 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:48.958392 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:48.966964 30662 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.992161 25122 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:48.957177 30781 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.992777 25270 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:48.982494 30776 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:48.984328 31049 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:48.937034 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 46196.7us
I20260709 12:21:48.991814 30819 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.953269 25165 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:49.026453 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 73260.1us
I20260709 12:21:48.978434 31090 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.002516 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:49.035238 31088 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:49.050616 25197 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:21:49.042999 25268 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:21:48.963979 30970 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:48.992935 30797 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:48.946692 31026 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:48.996902 30658 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:49.066134 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:49.049592 30934 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:49.074352 25168 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:49.074648 25165 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:49.078075 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:49.079284 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:49.080082 25126 raft_consensus.cc:3060] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:21:49.073218 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 115277us
I20260709 12:21:49.093380 30819 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:49.052968 31030 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:21:49.098693 25124 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:49.088873 31005 raft_consensus.cc:2804] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:49.089253 31110 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:49.100224 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:49.100485 31150 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:49.101725 30797 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.102527 30970 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:49.101754 25126 raft_consensus.cc:2468] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:21:49.104382 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:49.108613 31113 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.109292 31130 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:49.057273 31088 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.111202 31093 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:49.111150 30986 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.111825 31088 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:49.113982 25125 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:49.114770 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:49.115336 25125 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:21:49.115597 25126 raft_consensus.cc:2410] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:21:49.116325 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:49.116420 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:49.117065 25126 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:49.117537 30934 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:49.117944 30934 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:49.118135 25240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.118381 30934 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:49.119035 25126 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:21:49.119172 30781 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:49.104516 31090 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:49.123987 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 216410us
I20260709 12:21:49.131666 25123 raft_consensus.cc:1275] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:21:49.133224 25118 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:49.132915 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:49.165300 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:49.165711 25269 raft_consensus.cc:2410] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:21:49.167500 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:49.135251 30986 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:49.170495 31150 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:49.126087 31030 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:49.125819 31005 raft_consensus.cc:697] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:49.176908 31030 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.139763 31090 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:49.176318 30776 consensus_queue.cc:1059] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:21:49.190286 31130 consensus_queue.cc:1059] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:49.192555 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:49.202208 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:49.228551 30934 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:49.232547 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 154553us
I20260709 12:21:49.233948 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:49.237216 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:49.230221 30776 raft_consensus.cc:3055] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:49.240056 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:49.240170 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:49.255293 25165 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:49.257745 25165 leader_election.cc:304] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:49.259769 25165 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:49.235236 31088 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:49.309393 31026 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:49.254324 31097 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:49.313244 31110 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:49.314325 31110 raft_consensus.cc:2749] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:49.315153 31110 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:49.281378 31158 raft_consensus.cc:3055] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:49.318264 31158 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:49.318938 31030 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:49.319409 31158 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:49.321020 31158 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:49.233085 31090 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.282809 30955 consensus_queue.cc:1059] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:49.274544 30936 consensus_queue.cc:1059] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:21:49.321873 31097 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:49.322487 31097 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.323484 31090 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:49.283721 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:49.324424 30658 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:49.325228 31097 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:49.290015 31150 consensus_queue.cc:1059] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:49.281620 31005 consensus_queue.cc:237] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:49.251046 30776 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:49.293448 30960 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:49.295550 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:49.301262 30727 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:49.306607 31113 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:49.262633 25118 raft_consensus.cc:2393] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 13: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:49.322716 31107 raft_consensus.cc:3055] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:49.291656 30934 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:49.350872 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:49.351022 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 147588us
I20260709 12:21:49.355840 25267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3552726c022345b394b69265b8f3b566"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35504
I20260709 12:21:49.359444 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:49.359494 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 197253us
I20260709 12:21:49.322503 30936 raft_consensus.cc:3055] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:49.362980 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:49.367869 25118 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:49.361832 25267 raft_consensus.cc:606] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Received request to transfer leadership
I20260709 12:21:49.371727 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:49.371847 30776 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.355549 31152 consensus_queue.cc:1048] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:21:49.367743 30936 raft_consensus.cc:740] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:49.375509 30936 consensus_queue.cc:260] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.376726 30936 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:49.372349 25121 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:49.356766 31107 raft_consensus.cc:740] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:49.381919 31107 consensus_queue.cc:260] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:49.383576 31107 raft_consensus.cc:3060] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:49.388111 31161 raft_consensus.cc:3055] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:49.388630 30915 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:49.388633 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:49.392560 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:49.403908 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 242213us
I20260709 12:21:49.404281 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:49.404889 25855 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:49.409377 25267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3552726c022345b394b69265b8f3b566"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35504
I20260709 12:21:49.410153 25267 raft_consensus.cc:606] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Received request to transfer leadership
I20260709 12:21:49.388710 31161 raft_consensus.cc:740] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:49.420192 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:49.420394 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 180324us
I20260709 12:21:49.422489 25121 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:49.412437 25168 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:49.424041 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:49.406563 31160 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:49.430104 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 127008us
I20260709 12:21:49.433892 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:49.435056 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 175372us
I20260709 12:21:49.409291 31148 consensus_queue.cc:1059] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:21:49.442684 31168 raft_consensus.cc:2804] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:21:49.451702 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.442586 25855 raft_consensus.cc:2468] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:49.444814 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:49.448657 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:49.453508 25195 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:49.453794 25852 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:49.450138 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.455500 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:49.457314 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:49.457599 25855 raft_consensus.cc:1240] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:21:49.458142 25272 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:49.427896 31104 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:49.454312 25167 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:49.466526 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:49.466748 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:49.420897 30902 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:21:49.468242 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:49.444554 30934 consensus_queue.cc:1059] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:49.480222 25198 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:49.273572 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:49.481247 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:49.483582 25198 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:49.484738 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:49.485759 25198 raft_consensus.cc:2393] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:49.428180 31113 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:21:49.495359 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:49.559247 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:49.559931 25858 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:49.562361 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:49.562986 25854 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:49.564960 30662 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:49.566792 31164 log.cc:927] Time spent T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:21:49.571488 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:49.572129 25857 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:49.572062 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:49.574813 25851 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:49.575941 25092 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:49.581386 25858 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:49.584681 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:49.584954 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 130761us
W20260709 12:21:49.582695 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 130137us
I20260709 12:21:49.587811 25272 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:49.590019 30902 raft_consensus.cc:2804] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:49.590730 30902 raft_consensus.cc:697] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:49.591858 30902 consensus_queue.cc:237] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.601903 25092 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:49.649119 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 62407.1us
I20260709 12:21:49.657898 25851 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 12.
I20260709 12:21:49.663808 31005 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.666395 31005 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.675231 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:49.599072 31102 consensus_queue.cc:1059] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:21:49.678077 31005 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:49.678867 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:49.679950 31172 log.cc:927] Time spent T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:21:49.685649 25854 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:49.598910 30953 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:49.694700 31165 log.cc:927] Time spent T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 12:21:49.587453 31153 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.732357 25195 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:49.719950 25852 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
W20260709 12:21:49.723839 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 73916.5us
W20260709 12:21:49.651335 31049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.009s	sys 0.008s
I20260709 12:21:49.706521 31171 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:49.720271 31173 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:49.737942 31168 raft_consensus.cc:697] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:49.735255 31163 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:49.766602 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:49.754980 31049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.009s	sys 0.009s
I20260709 12:21:49.752967 31113 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:49.781054 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 179218us
I20260709 12:21:49.760169 31112 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:49.783097 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:49.784570 25200 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:49.786137 25193 raft_consensus.cc:1240] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:21:49.787155 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:49.748567 31153 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:49.775779 30953 raft_consensus.cc:3055] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:49.806182 30953 raft_consensus.cc:740] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:49.807688 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:49.809083 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:49.789837 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:49.794183 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:49.800197 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:49.810982 25121 raft_consensus.cc:3060] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:49.807291 30953 consensus_queue.cc:260] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.792352 31168 consensus_queue.cc:237] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:49.812130 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:49.814356 25202 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:49.810117 31178 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.817003 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:49.817332 31178 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.818328 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:49.821604 31158 consensus_meta.cc:287] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
I20260709 12:21:49.823210 25127 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 11: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:21:49.843039 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 78827.9us
I20260709 12:21:49.785427 31113 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.778985 31173 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.781584 31163 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:49.862740 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 216427us
I20260709 12:21:49.865957 25093 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:49.856142 30953 raft_consensus.cc:3060] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:49.850509 31130 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:49.872372 25857 raft_consensus.cc:2410] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:21:49.868628 25121 raft_consensus.cc:2468] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
W20260709 12:21:49.878114 31181 log.cc:927] Time spent T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:21:49.879267 31113 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:49.880249 30936 consensus_meta.cc:287] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: Time spent flushing consensus metadata: real 0.503s	user 0.013s	sys 0.000s
I20260709 12:21:49.880785 31130 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.889472 31163 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:49.889837 31187 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:49.891660 31171 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:49.892234 31171 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.896628 31090 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:49.897051 31090 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:49.897276 31171 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:49.898775 25202 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
W20260709 12:21:49.928575 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:49.933324 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.876390 31179 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.905721 31187 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 16 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:49.905465 31173 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:49.932307 31153 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:49.897984 31090 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.944164 31179 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.982128 31193 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:49.982941 31193 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.985337 31193 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:49.991853 31090 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:49.992252 30781 raft_consensus.cc:3055] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:49.992847 30781 raft_consensus.cc:740] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:49.966955 31187 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.993892 30781 consensus_queue.cc:260] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:49.999861 31179 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:50.004136 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.011983 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:50.015626 25168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.011675 31193 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:50.017833 31193 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.021163 30957 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:50.021708 30957 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.021939 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.022575 25270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40096 (request call id 2474) took 1317 ms. Trace:
I20260709 12:21:50.022938 25270 rpcz_store.cc:276] 0709 12:21:48.704655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.705604 (+   949us) service_pool.cc:224] Handling call
0709 12:21:50.022291 (+1316687us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b54003147d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:50.022435 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118896512}
I20260709 12:21:50.012024 31093 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:50.023772 30957 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:50.024318 31093 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.027266 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.029794 31193 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:50.032197 31160 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.035971 25269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 2956) took 1371 ms. Trace:
I20260709 12:21:50.036490 25269 rpcz_store.cc:276] 0709 12:21:48.664300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.664425 (+   125us) service_pool.cc:224] Handling call
0709 12:21:50.033222 (+1368797us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540005ffd4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:50.035907 (+  2685us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1042659584}
I20260709 12:21:50.032856 31160 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.045208 25120 raft_consensus.cc:1240] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 12:21:50.048413 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.048867 31160 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:50.049072 25118 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:21:50.049916 31155 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:50.050513 31155 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.053679 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2828) took 1467 ms. Trace:
I20260709 12:21:50.056965 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.054062 25197 rpcz_store.cc:276] 0709 12:21:48.586119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.613525 (+ 27406us) service_pool.cc:224] Handling call
0709 12:21:48.613978 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.051052 (+437074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.053438 (+1002386us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54002da354. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:50.053617 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003602304}
I20260709 12:21:50.058188 31155 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:50.058427 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.058967 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.063889 31124 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:50.072371 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.074079 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:50.076989 30727 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:50.077513 30727 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:50.077951 30727 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:50.078410 30776 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:50.079689 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.081869 31130 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:50.082337 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.082962 25268 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:50.083359 25272 raft_consensus.cc:1275] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:21:50.083671 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.084057 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:50.084342 25273 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:50.085425 31155 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:50.085783 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.084062 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.088858 30915 raft_consensus.cc:3055] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:50.089066 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.089277 30915 raft_consensus.cc:740] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:50.090127 30915 consensus_queue.cc:260] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.083698 25272 pending_rounds.cc:85] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 10
I20260709 12:21:50.091507 30915 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:50.094425 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.099213 25165 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.091629 25272 pending_rounds.cc:107] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:21:50.102133 25272 raft_consensus.cc:2889] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:50.105551 30970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.009s	sys 0.007s
I20260709 12:21:50.105912 30957 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:50.106527 30957 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.108196 31170 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:50.108717 30957 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:50.108978 31170 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:50.110705 25273 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:21:50.111218 25273 pending_rounds.cc:85] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 9
I20260709 12:21:50.111508 25273 pending_rounds.cc:107] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:21:50.111799 25273 raft_consensus.cc:2889] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:50.106189 30970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.009s	sys 0.007s
I20260709 12:21:50.114368 25200 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 18.
I20260709 12:21:50.127599 25165 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:50.133571 25165 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:50.134985 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.136830 25122 raft_consensus.cc:1240] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:21:50.137791 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:50.143137 25202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:50.156774 31005 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:50.157411 30902 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:50.139389 31155 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:50.166891 31155 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:50.167431 31155 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:50.139225 31184 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:50.170274 31184 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:50.170747 31184 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:50.163545 31179 consensus_queue.cc:1048] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:21:50.177913 31124 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:50.177781 30839 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:50.178298 31178 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:50.178567 31124 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.180706 31124 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:50.181005 31130 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.188608 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.189154 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.190415 31093 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:50.189393 25272 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
I20260709 12:21:50.197664 25090 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.198956 25120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48492 (request call id 1102) took 1493 ms. Trace:
I20260709 12:21:50.200305 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.199342 25120 rpcz_store.cc:276] 0709 12:21:48.705277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.705740 (+   463us) service_pool.cc:224] Handling call
0709 12:21:48.890717 (+184977us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.045696 (+1154979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.198771 (+153075us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540005b9d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:50.198909 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2651305216}
I20260709 12:21:50.181591 31130 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.216655 25123 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:21:50.217221 25123 pending_rounds.cc:85] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 7
I20260709 12:21:50.217597 25123 pending_rounds.cc:107] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:21:50.217878 25123 raft_consensus.cc:2889] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:50.219236 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.218756 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:50.221534 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 370587us
I20260709 12:21:50.205524 30970 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:50.237020 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:50.246204 31049 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:50.246793 31049 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:50.247236 31049 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:50.248839 30727 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.249239 31155 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.253000 31184 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.257478 30781 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:50.260026 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:50.260509 31155 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:50.262106 25202 raft_consensus.cc:606] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:50.274428 25202 raft_consensus.cc:614] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:50.266357 30727 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:50.267134 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:50.278450 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.280602 31088 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:50.281057 31088 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:50.281411 31088 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:50.288120 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.289916 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.309199 25197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:50.310331 31184 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:50.310652 31104 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.311676 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:50.315479 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:50.318550 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.319382 25202 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
W20260709 12:21:50.344564 25165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.348260 25197 raft_consensus.cc:606] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:50.348907 25197 raft_consensus.cc:614] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:50.294688 31090 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:50.351576 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:50.304898 31097 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:50.352748 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 62889.9us
W20260709 12:21:50.355180 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.290668 30960 consensus_queue.cc:1059] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:21:50.370090 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:50.371723 25822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.354601 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:50.373371 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.349968 31101 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.357445 25193 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: []
W20260709 12:21:50.358857 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.358801 31173 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:50.359148 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.315048 30781 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:21:50.379796 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.380581 31101 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.363668 25201 raft_consensus.cc:1240] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:50.376011 30782 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.384008 30782 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.386157 30782 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:50.387552 31173 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.366303 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.356848 25092 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.359815 31219 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:50.393208 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.394004 25267 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:21:50.356076 31163 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:50.396649 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:50.389855 31173 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:50.398958 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.377687 30776 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:50.311221 31104 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.400332 25269 pending_rounds.cc:85] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 8
I20260709 12:21:50.400681 25269 pending_rounds.cc:107] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:21:50.396607 25092 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.400923 25269 raft_consensus.cc:2889] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:50.401650 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.402726 25242 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.401823 25092 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:50.403167 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.405663 25242 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.406126 31160 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:50.406415 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.406297 31182 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:50.406870 30798 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:50.403056 25271 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:50.408247 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:50.419008 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:50.419821 25852 raft_consensus.cc:2410] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:21:50.404712 30915 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:50.410454 31153 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:50.415722 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:50.395465 30986 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:50.405275 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.426383 31163 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:50.410888 30960 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:50.432242 31153 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.433139 30960 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.401660 31030 consensus_queue.cc:1048] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:21:50.409984 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:50.402594 30955 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:50.404474 30797 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:50.404079 31088 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.460104 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:50.461009 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 56890.9us
I20260709 12:21:50.464291 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.465448 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.455657 30960 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:50.456393 25822 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:50.457218 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:50.460467 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 50532.7us
I20260709 12:21:50.458416 31161 consensus_queue.cc:260] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.419026 31117 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:50.396844 31219 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:50.467088 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 100913us
I20260709 12:21:50.519882 25855 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:50.530144 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.523522 25854 raft_consensus.cc:1275] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:21:50.524135 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 51116.9us
W20260709 12:21:50.527344 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 55130.5us
I20260709 12:21:50.545835 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.550489 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.552841 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.564215 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:50.459867 30955 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:50.565214 25854 raft_consensus.cc:2393] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 18: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:50.566004 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:50.465485 30915 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:50.569762 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.574894 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.468351 30986 raft_consensus.cc:697] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:50.571604 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a38bc05c84ba69ac42605a0f627ca" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:50.552773 25822 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.581503 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.596019 25092 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.472019 30798 raft_consensus.cc:697] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:50.598482 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.549695 30960 raft_consensus.cc:2804] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:50.601395 25822 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:50.573251 30955 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:50.611464 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 84560.4us
I20260709 12:21:50.612056 25856 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
W20260709 12:21:50.612838 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 73329us
I20260709 12:21:50.611856 25167 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.609699 25822 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:50.619799 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.608129 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:50.621600 25859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1573) took 1573 ms. Trace:
I20260709 12:21:50.622008 25167 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:50.595345 31169 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:50.598829 30915 raft_consensus.cc:697] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:50.602372 30776 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:50.622370 25859 rpcz_store.cc:276] 0709 12:21:49.047764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.049250 (+  1486us) service_pool.cc:224] Handling call
0709 12:21:49.812675 (+763425us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b5800093398. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9b71 00007f2100de9a22 00007f2109d028d9 00007f2108e5cee0 00007f2108f260ab 00007f2108f26131 00007f2108ee7fc0 00007f2108ed2929 00007f2108ed23d2 00007f2102449bd4
0709 12:21:49.812857 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:49.875091 (+ 62234us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:21:49.956190 (+ 81099us) log.cc:844] Serialized 14 byte log entry
0709 12:21:49.969683 (+ 13493us) log.cc:844] Serialized 14 byte log entry
0709 12:21:50.230770 (+261087us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:50.230827 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:50.230879 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.621377 (+390498us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b54005802d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:50.621427 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.621542 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":260833,"prepare.queue_time_us":137524,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":261066,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":144824320,"thread_start_us":90887,"threads_started":2,"wal-append.queue_time_us":82011}
I20260709 12:21:50.610258 30960 raft_consensus.cc:697] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:50.633833 25167 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:50.609043 31222 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:50.640763 25857 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 12:21:50.638713 25009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 135537us
I20260709 12:21:50.642725 31163 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:50.618187 31104 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:50.649438 25167 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.641999 25859 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:50.625573 31184 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:50.675276 25859 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:21:50.675660 25859 pending_rounds.cc:85] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 10
I20260709 12:21:50.675879 25859 pending_rounds.cc:107] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:21:50.676101 25859 raft_consensus.cc:2889] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:50.645197 25822 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:50.664480 25856 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:21:50.679150 25856 pending_rounds.cc:85] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 9
I20260709 12:21:50.679418 25856 pending_rounds.cc:107] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:21:50.679666 25856 raft_consensus.cc:2889] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:50.614286 30782 consensus_queue.cc:1059] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 12:21:50.665263 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 44642.9us
I20260709 12:21:50.673805 25167 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.633313 31124 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:50.627141 31226 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:50.626149 31191 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:50.671481 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 47000.2us
I20260709 12:21:50.641572 31158 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:50.693168 25241 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.685266 31223 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:50.665570 30986 consensus_queue.cc:237] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.645351 30776 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.693833 30915 consensus_queue.cc:237] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.684569 31179 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:50.695367 31088 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:50.696796 31176 raft_consensus.cc:3055] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:50.710259 31176 raft_consensus.cc:740] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:50.711176 31176 consensus_queue.cc:260] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.712661 31234 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:50.640081 31049 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.697010 30960 consensus_queue.cc:237] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.699456 25242 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:50.666731 31182 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:50.666955 31074 consensus_queue.cc:1048] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:21:50.712489 31176 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:50.698064 30798 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.702201 31158 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.736370 31158 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:50.702284 31223 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.717685 31049 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:50.719971 31219 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:50.702080 31155 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:50.722374 31161 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:50.725206 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.726119 25198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 1148) took 1253 ms. Trace:
I20260709 12:21:50.746235 25198 rpcz_store.cc:276] 0709 12:21:49.472304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.544742 (+ 72438us) service_pool.cc:224] Handling call
0709 12:21:50.725216 (+1180474us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b5800211b98. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9b71 00007f2100de9a22 00007f2109d028d9 00007f2108e5cee0 00007f2108f260ab 00007f2108f26131 00007f2108ee7fc0 00007f2108ed2929 00007f2108ed23d2 00007f2102449bd4
0709 12:21:50.725452 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:50.725664 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:50.725701 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:50.725756 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:21:50.725810 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.725882 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.726047 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50988800}
I20260709 12:21:50.743049 31223 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:50.749636 30953 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:50.729041 31233 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:50.750243 30953 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.752414 31153 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:50.752974 30953 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:50.755302 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:50.753772 31101 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:50.760095 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:50.762537 25853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1580) took 1462 ms. Trace:
I20260709 12:21:50.760744 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:50.762701 25860 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 13: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:50.765965 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:50.766902 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:50.768121 25269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3552726c022345b394b69265b8f3b566"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35504
I20260709 12:21:50.768678 25269 raft_consensus.cc:606] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Received request to transfer leadership
I20260709 12:21:50.769282 25269 raft_consensus.cc:614] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:50.770304 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:50.770920 25856 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:50.757802 31155 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.763013 25853 rpcz_store.cc:276] 0709 12:21:49.300518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.300682 (+   164us) service_pool.cc:224] Handling call
0709 12:21:49.300973 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:49.327651 (+ 26678us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:21:49.587000 (+259349us) log.cc:844] Serialized 14 byte log entry
0709 12:21:49.762391 (+175391us) log.cc:844] Serialized 14 byte log entry
0709 12:21:50.075721 (+313330us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b1800301660. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100def2a6 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1
0709 12:21:50.077200 (+  1479us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b1800301660. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e213f3 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:50.189305 (+112105us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b1800301660. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100d9bc0a 00007f210a4db219 00007f2100e23a40 00007f2100e1e4e4 00007f2100e1e455 00007f2103f06060 00007f2103f18716 00007f2103f29287 00007f2103f29208
0709 12:21:50.215760 (+ 26455us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:50.215801 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:21:50.215835 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.762288 (+546453us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b54004f6354. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:50.762342 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.762478 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":470825,"prepare.queue_time_us":748689,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":482326,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":16218,"spinlock_wait_cycles":94246528,"thread_start_us":404999,"threads_started":3,"wal-append.queue_time_us":211066}
I20260709 12:21:50.773393 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.759897 31233 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:50.769047 31177 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:50.767791 30957 consensus_queue.cc:1059] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:21:50.781188 31236 raft_consensus.cc:3055] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:50.772337 31155 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.781630 31236 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:50.782693 31236 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.783695 31235 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:50.785158 31236 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:50.786676 31097 raft_consensus.cc:3055] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:50.787114 31097 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:50.788091 31097 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.788882 31235 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:50.789511 31235 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.792289 31235 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:50.794193 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:50.794831 25854 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:50.795884 25167 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:50.796677 30850 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:50.797036 30850 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.797406 30850 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:50.789678 31097 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:50.783277 31155 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:50.816694 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.819224 30776 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:50.825650 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:50.826490 25854 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 18.
W20260709 12:21:50.828586 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.837040 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:50.838429 25200 raft_consensus.cc:1240] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:50.838454 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:50.839074 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.839751 25198 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:50.840301 25200 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:50.841014 25241 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:50.842551 25118 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:50.844233 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:50.845302 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.842643 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.850607 25202 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:21:50.851339 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.852264 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.857497 25276 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 17: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:50.861047 31184 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:50.866734 31100 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:50.871371 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.875119 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:50.804230 30955 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.882366 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.883483 31219 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:50.881131 25093 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.885766 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.890815 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:50.891595 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:50.892838 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 112686us
I20260709 12:21:50.853308 31233 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:50.896338 25122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41032 (request call id 2956) took 1782 ms. Trace:
W20260709 12:21:50.897169 25242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.900046 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:50.900673 25200 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:50.903452 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:50.896718 25122 rpcz_store.cc:276] 0709 12:21:49.113783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.131509 (+ 17726us) service_pool.cc:224] Handling call
0709 12:21:49.131850 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.137408 (+1005558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.896070 (+758662us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400452c54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:50.896278 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310433664}
I20260709 12:21:50.908353 31219 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:50.908900 31219 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.909579 31219 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:50.908860 31231 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:50.893989 31090 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:50.911520 31231 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:50.912521 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:50.887351 31102 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:21:50.924605 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 43557.4us
I20260709 12:21:50.925252 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.896220 31233 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:50.939852 25197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:50.934218 25092 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.885363 31223 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.933146 30798 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:50.926684 31102 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.954457 31188 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:50.927152 31227 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:21:50.958452 25093 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:50.959182 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:50.957042 30798 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:50.926448 31198 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:21:50.967437 31223 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:50.933892 31153 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:21:50.967775 25196 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:50.968480 31102 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:50.968741 30955 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:50.969251 31049 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:50.970521 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:50.992048 25276 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:21:50.971119 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:50.950685 31233 raft_consensus.cc:3060] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:50.990137 25093 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:50.986112 30798 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:50.986217 31158 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:51.010453 30819 consensus_queue.cc:1059] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:21:51.032516 30850 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.033433 31186 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.032364 31130 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:51.046629 30850 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:51.047415 31186 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:50.976475 30986 consensus_queue.cc:1059] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 17.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:21:50.995311 30797 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:51.051609 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:51.053777 25857 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:51.052449 25201 raft_consensus.cc:2393] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 17: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:51.077144 25123 raft_consensus.cc:1240] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:51.082383 31153 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.082535 31130 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.083021 31153 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:51.085170 31153 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:51.056604 30797 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.086062 30797 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:51.086185 31251 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:51.038731 31158 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:51.089454 31158 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:51.083137 31186 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:51.092020 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:51.092635 25267 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:51.049292 31231 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:51.094602 25197 raft_consensus.cc:606] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:51.094882 25197 raft_consensus.cc:614] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:51.096237 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:51.096834 30986 raft_consensus.cc:3055] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:51.097229 30986 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:51.098171 30986 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.7, Last appended by leader: 7, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:51.101330 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:51.101658 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:51.102653 25854 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 16: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:51.099789 25276 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:51.083107 31130 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:51.104154 25822 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:51.109110 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:51.109649 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:51.102154 25267 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
W20260709 12:21:51.114562 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 48655.8us
I20260709 12:21:51.117637 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:51.113667 25090 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:51.126587 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:51.127040 25199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51270 (request call id 1144) took 1655 ms. Trace:
I20260709 12:21:51.110481 31074 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:51.127563 31097 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:51.127609 25199 rpcz_store.cc:276] 0709 12:21:49.471351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.479798 (+  8447us) service_pool.cc:224] Handling call
0709 12:21:50.731280 (+1251482us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b5800211b98. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100de9b71 00007f2100de9a22 00007f2109d028d9 00007f2108e5cee0 00007f2108f260ab 00007f2108f26131 00007f2108ee7fc0 00007f2108ed2929 00007f2108ed23d2 00007f2102449bd4
0709 12:21:50.731459 (+   179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.865583 (+134124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:50.865617 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:50.866138 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.950902 (+ 84764us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:21:50.990606 (+ 39704us) log.cc:844] Serialized 14 byte log entry
0709 12:21:50.991096 (+   490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.097742 (+106646us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b1800087100. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100e21522 00007f2100e237c1 00007f2100e23779 00007f2100e23709 00007f2100e236d1 00007f2100e229cd 0000000000388634 0000000000388479 00007f2100e0483a
0709 12:21:51.126758 (+ 29016us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54000a7154. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f0ee01 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2 00007f210224948c 00007f21022488c6
0709 12:21:51.126803 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:51.126847 (+    44us) raft_consensus.cc:1685] finished
0709 12:21:51.126859 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:51.126982 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18430,"prepare.queue_time_us":34432,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1269,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":13553,"spinlock_wait_cycles":362968064,"thread_start_us":84082,"threads_started":1,"wal-append.queue_time_us":164063}
I20260709 12:21:51.156898 31130 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:51.135967 30798 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.159066 30798 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:51.161077 31219 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.163965 30797 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:51.144739 25196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2794) took 2453 ms (client timeout 1576 ms). Trace:
W20260709 12:21:51.174817 25196 rpcz_store.cc:269] 0709 12:21:48.675957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.676355 (+   398us) service_pool.cc:224] Handling call
0709 12:21:51.129660 (+2453305us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b54000a5d54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:51.129751 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5259366656}
I20260709 12:21:51.176952 30797 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:51.138120 31101 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:51.165571 25201 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:51.166988 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:51.140707 31097 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:51.180437 25857 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:51.180955 25196 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:51.145208 30986 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:51.187253 25854 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:21:51.183144 25167 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:51.193832 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:51.194815 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:51.198371 25854 raft_consensus.cc:2393] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 17: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:51.173524 31233 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.200420 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:51.200982 25123 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 18: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:51.193188 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:51.204278 25859 raft_consensus.cc:2393] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 18: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:51.157766 31102 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:51.181353 31101 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.195717 30850 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:51.177879 31158 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.227519 25122 raft_consensus.cc:2368] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14.
W20260709 12:21:51.229190 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 239164us
I20260709 12:21:51.214689 31101 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:51.242173 25242 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:51.242857 31153 raft_consensus.cc:3055] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:51.243466 31153 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:51.244707 31153 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:51.247284 25121 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:51.248833 25119 raft_consensus.cc:1275] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:21:51.249352 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:51.251933 25859 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:51.230547 30850 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:51.222616 30798 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:21:51.250587 31074 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:51.246932 31097 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.262748 30797 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:21:51.269757 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:51.253545 31030 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:51.275061 25120 raft_consensus.cc:2393] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 17: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:51.281862 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:51.261564 31160 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:51.285269 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:51.294229 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:51.295410 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:51.296289 25196 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:51.301501 25121 raft_consensus.cc:2393] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 17: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:51.262084 31161 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:21:51.332301 25242 leader_election.cc:400] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14.
I20260709 12:21:51.373107 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:51.377054 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:51.382112 25196 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:51.386782 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:51.392771 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:51.393216 25122 raft_consensus.cc:2393] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 18: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:51.393646 25199 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:51.397105 25195 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:51.394845 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:51.298830 30819 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 12:21:51.316797 31160 raft_consensus.cc:697] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:51.416402 31233 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:51.416770 31160 consensus_queue.cc:237] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:51.418002 31158 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:51.422837 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:51.406774 25093 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:51.389961 31257 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:51.406848 31130 consensus_queue.cc:1059] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:21:51.403116 30850 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.427750 25859 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:51.427850 25093 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:51.442168 31251 raft_consensus.cc:3055] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:51.463927 31251 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:51.465039 31251 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.466447 31251 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:51.431994 30798 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:51.451598 31049 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:51.468446 31049 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.468933 31049 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:51.472695 30934 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:51.473379 30934 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.474154 31005 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:51.475008 31005 consensus_queue.cc:1048] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:51.475857 31074 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:51.476362 31074 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:51.481808 31153 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:51.430146 31177 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.486382 31177 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.486984 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:51.487846 25859 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 13: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:51.498678 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 59611.8us
I20260709 12:21:51.498471 31102 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:51.510426 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:51.511116 25195 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:51.512691 30819 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:51.518249 25197 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 18.
I20260709 12:21:51.488914 31177 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:51.526237 25093 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:51.528215 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:51.540037 25195 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:51.544917 25093 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:51.560648 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.560462 25851 raft_consensus.cc:2468] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 18.
I20260709 12:21:51.594306 25241 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:51.574586 25199 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:51.562067 31102 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:51.638703 31102 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 18 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:51.639919 31102 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.625782 31074 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:51.641631 31074 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:51.581336 30957 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.642344 30957 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.644913 30957 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:51.596278 31101 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:51.649219 25120 raft_consensus.cc:2368] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18.
I20260709 12:21:51.622751 31049 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:51.627556 31236 raft_consensus.cc:2804] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:51.650159 31101 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:51.650560 31236 raft_consensus.cc:697] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:51.597867 25093 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:21:51.651880 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 54131.7us
I20260709 12:21:51.651814 31236 consensus_queue.cc:237] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.636082 25025 catalog_manager.cc:5697] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 7 to 12, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 12 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.655278 25025 catalog_manager.cc:5697] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 10 to 15, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 15 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:21:51.656730 25073 auto_rebalancer.cc:893] Removing replace marker failed: Replica 2e30bdd4cd1b45299f50b9bcfc9c1667 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:21:51.657327 25073 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:21:51.657732 25073 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:21:51.580090 31130 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:51.658408 31130 raft_consensus.cc:697] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:51.659493 31130 consensus_queue.cc:237] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:51.660910 31235 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.663996 31153 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:51.664693 31153 raft_consensus.cc:697] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:51.665823 31153 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.570515 30934 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:51.671505 25121 raft_consensus.cc:1240] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:51.674407 31049 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:51.657128 25025 catalog_manager.cc:5697] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:51.676509 25025 catalog_manager.cc:5697] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.679152 25025 catalog_manager.cc:5697] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 13 to 17, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 17 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:51.685914 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:51.686812 25859 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:51.687575 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:51.661612 31235 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.688706 31219 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:51.692806 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:51.694972 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:51.695581 25197 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 18.
I20260709 12:21:51.697172 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:51.698555 30782 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:51.699023 30819 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:51.699041 30782 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.700832 30782 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:51.703500 31161 consensus_queue.cc:1059] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:51.709210 31159 raft_consensus.cc:3055] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:51.708676 30782 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.709654 31159 raft_consensus.cc:740] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:51.710628 31159 consensus_queue.cc:260] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:51.713207 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:51.716976 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:51.718473 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:51.716060 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:51.721364 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:51.717607 25124 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
I20260709 12:21:51.721923 25199 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:21:51.725343 30782 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:51.726776 25241 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:51.733734 31233 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:51.733932 25120 raft_consensus.cc:2410] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:21:51.734220 31233 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.734688 31233 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:51.742946 31235 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:51.745164 31233 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.746003 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:51.746876 25202 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:51.748929 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:51.760427 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.749785 25851 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 12.
W20260709 12:21:51.761478 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 44172.3us
I20260709 12:21:51.766364 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:51.758461 25025 catalog_manager.cc:5697] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.767604 25120 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:21:51.768603 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 49130.6us
I20260709 12:21:51.769064 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:51.711897 31159 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:51.775568 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:51.786895 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:51.787602 25201 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:51.759302 25199 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 18.
I20260709 12:21:51.771468 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:51.768234 25025 catalog_manager.cc:5697] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 10 to 11, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 11 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:51.802057 25025 catalog_manager.cc:5697] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 10 to 13, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 13 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.803714 25025 catalog_manager.cc:5697] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 11 to 12, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 12 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:51.801256 25093 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:51.834785 31257 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:51.856261 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 55094.6us
I20260709 12:21:51.810789 31177 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:51.845242 25201 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 19.
I20260709 12:21:51.850739 25025 catalog_manager.cc:5697] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:51.854423 25240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.017s	sys 0.009s
I20260709 12:21:51.834887 31233 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:51.923708 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.816033 31235 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:51.929484 25240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.018s	sys 0.009s
I20260709 12:21:51.860272 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:51.813261 31191 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.111s
W20260709 12:21:51.932977 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.923058 31187 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:51.941838 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 81640.4us
I20260709 12:21:51.923837 31219 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:51.943547 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 470325us
I20260709 12:21:51.927199 30797 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:21:51.951073 25022 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41770 (request call id 329) took 32334 ms (client timeout 15000 ms). Trace:
I20260709 12:21:51.943620 25025 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:51.935595 30819 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.952684 25025 catalog_manager.cc:5697] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 14 to 16, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 16 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.978283 25025 catalog_manager.cc:5697] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 12 to 15, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 15 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:51.981112 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.991592 25823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.048s	sys 0.094s
W20260709 12:21:51.992046 25823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.048s	sys 0.094s
W20260709 12:21:51.992203 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 218462us
W20260709 12:21:51.954967 31160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.034s	sys 0.069s
I20260709 12:21:51.942777 31235 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.945621 31090 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:51.923166 31257 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.996136 25168 leader_election.cc:400] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18.
I20260709 12:21:52.018107 25168 leader_election.cc:403] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:51.987560 25025 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 13 to 17, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 17 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:51.951467 25022 rpcz_store.cc:269] 0709 12:21:19.611897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.614619 (+  2722us) service_pool.cc:224] Handling call
0709 12:21:51.946110 (+32331491us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:48.284169 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:48.284939 (+   770us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:48.284995 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:21:48.285019 (+    24us) tablet.cc:662] Decoding operations
0709 12:21:48.286438 (+  1419us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:48.286550 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:48.286584 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:21:48.288061 (+  1477us) tablet.cc:701] Row locks acquired
0709 12:21:48.288114 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:21:48.288290 (+   176us) write_op.cc:270] Start()
0709 12:21:48.293954 (+  5664us) write_op.cc:276] Timestamp: P: 1783599708288229 usec, L: 0
0709 12:21:48.293996 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:21:48.347596 (+ 53600us) log.cc:844] Serialized 3364 byte log entry
0709 12:21:48.615059 (+267463us) op_driver.cc:464] REPLICATION: finished
0709 12:21:48.897195 (+282136us) write_op.cc:301] APPLY: starting
0709 12:21:48.897291 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:48.968017 (+ 70726us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:48.968153 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:48.985770 (+ 17617us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:48.986125 (+   355us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:21:48.986191 (+    66us) write_op.cc:312] APPLY: finished
0709 12:21:48.986532 (+   341us) log.cc:844] Serialized 81 byte log entry
0709 12:21:49.054592 (+ 68060us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:49.068733 (+ 14141us) write_op.cc:454] Released schema lock
0709 12:21:49.072960 (+  4227us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:49.106931 (+ 33971us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:49.106962 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4601818,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":281839,"apply.run_cpu_time_us":14869,"apply.run_wall_time_us":209673,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37631,"num_ops":8,"prepare.queue_time_us":96130,"prepare.run_cpu_time_us":24572,"prepare.run_wall_time_us":149371,"raft.queue_time_us":62412,"raft.run_cpu_time_us":24496,"raft.run_wall_time_us":330120,"replication_time_us":320886,"thread_start_us":505835,"threads_started":4,"wal-append.queue_time_us":157651,"wal-append.run_cpu_time_us":9901,"wal-append.run_wall_time_us":1479507}]]}
I20260709 12:21:52.021093 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:52.023264 25120 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:52.024595 25122 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:52.026415 25201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:52.027225 25201 raft_consensus.cc:606] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:52.027676 25201 raft_consensus.cc:614] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:52.020431 31235 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:51.981796 30797 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 18 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:52.018255 31160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.034s	sys 0.070s
I20260709 12:21:52.031447 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:52.036077 31100 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18.
I20260709 12:21:52.046252 25858 raft_consensus.cc:2393] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 12: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:52.046710 25025 catalog_manager.cc:5697] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:51.952347 31219 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:51.949276 31187 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:52.051389 25025 catalog_manager.cc:5697] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 11 to 12, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 12 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:51.988994 30819 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.024623 31097 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.068876 25025 catalog_manager.cc:5697] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:21:52.085356 25200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.025s	sys 0.025s
W20260709 12:21:52.085886 25200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.025s	sys 0.025s
I20260709 12:21:52.086974 25025 catalog_manager.cc:5697] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:52.094472 25201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:52.095535 25201 raft_consensus.cc:606] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:52.050521 31090 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 19 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:52.091091 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:52.117771 31262 log.cc:927] Time spent T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:21:52.130292 31269 log.cc:927] Time spent T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.194s	user 0.000s	sys 0.004s
I20260709 12:21:52.088573 25025 catalog_manager.cc:5697] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 8 to 13, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 13 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:52.088999 31160 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:52.137881 25241 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:52.089532 31097 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.158176 31030 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:52.142175 30960 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.138533 30957 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:52.165004 25273 raft_consensus.cc:1275] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:21:52.188231 25269 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:21:52.160566 25025 catalog_manager.cc:5697] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:52.227118 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:52.229167 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:52.233206 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:52.145403 30797 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:52.155385 31160 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:52.237471 25025 catalog_manager.cc:5697] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 8 to 10, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 10 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:52.224968 31153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.003s	sys 0.027s
I20260709 12:21:52.185317 30957 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:52.245326 25197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.011s	sys 0.031s
W20260709 12:21:52.266206 25197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.011s	sys 0.031s
I20260709 12:21:52.213686 31257 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:52.224503 31187 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:52.262946 31153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.005s	sys 0.027s
I20260709 12:21:52.301661 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.303016 25201 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:52.304482 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:52.245890 31176 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:21:52.185467 30960 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:52.224771 31236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.009s	sys 0.016s
W20260709 12:21:52.313635 31236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.010s	sys 0.016s
I20260709 12:21:52.222126 31261 consensus_queue.cc:1048] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 12:21:52.315618 31274 log.cc:927] Time spent T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:21:52.264562 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:52.264948 31130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.006s	sys 0.028s
I20260709 12:21:52.237326 31090 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.325459 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.326164 25200 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:52.335712 30957 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:52.336252 31264 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:52.336580 30957 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.336882 31264 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.339248 31264 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:52.349364 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:52.350396 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.352568 25825 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:52.358609 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.359419 25201 raft_consensus.cc:2393] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 11: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:52.362519 25202 raft_consensus.cc:2393] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 13: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:52.307703 31219 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:52.309814 31177 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:52.309636 31276 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.368076 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:52.370510 25274 raft_consensus.cc:1240] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:52.371217 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:52.337332 30957 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.385778 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:52.386433 25858 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 11.
I20260709 12:21:52.389534 25200 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:52.242669 25025 catalog_manager.cc:5697] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 8 to 10, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 10 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:21:52.400120 25090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.401044 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:21:52.363413 31130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.006s	sys 0.028s
I20260709 12:21:52.401988 31160 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:52.406602 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:52.408882 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:52.371685 31267 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:52.412196 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:52.412712 31267 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.413232 31267 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:52.415681 31130 consensus_queue.cc:1059] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:52.416746 31158 raft_consensus.cc:3055] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:52.417114 31158 raft_consensus.cc:740] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:52.381743 31177 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.417898 31158 consensus_queue.cc:260] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.418232 31097 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:52.361382 30819 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:52.418905 31158 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:52.419318 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:52.394209 31276 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:52.320257 31235 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.418327 31177 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:52.425901 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:52.438928 25274 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:52.428797 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:52.429999 25119 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:52.413439 25025 catalog_manager.cc:5697] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 10 to 15, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 15 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:52.445906 25124 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:21:52.441931 25241 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:52.449055 31229 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:52.423568 31186 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:52.429170 31159 consensus_meta.cc:287] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.000s
I20260709 12:21:52.447899 25025 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:52.454332 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:52.453236 25168 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:52.471154 25275 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 12.
I20260709 12:21:52.472844 25276 raft_consensus.cc:2368] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13.
W20260709 12:21:52.473354 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 448423us
I20260709 12:21:52.475996 25272 raft_consensus.cc:2410] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:21:52.476301 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.477141 25201 raft_consensus.cc:2393] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 16: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:52.449529 31229 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:52.466981 31265 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:52.439405 31233 consensus_queue.cc:1059] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:21:52.514662 25092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.013s	sys 0.004s
W20260709 12:21:52.516636 25092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.013s	sys 0.005s
I20260709 12:21:52.477051 31074 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:21:52.523198 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 49215.5us
I20260709 12:21:52.466543 31186 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.517117 30960 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:52.480263 31229 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.534627 25167 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:52.476070 31273 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:21:52.469504 25025 catalog_manager.cc:5697] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 7 to 14, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 14 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:52.520865 31074 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.539785 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:52.550289 25025 catalog_manager.cc:5697] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:52.545691 31102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.009s	sys 0.012s
I20260709 12:21:52.530741 31265 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:52.567597 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:52.548452 30934 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:52.547478 31074 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:52.641696 25090 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:52.629612 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:52.631844 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:52.671466 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:52.665556 25025 catalog_manager.cc:5697] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:52.681118 25025 catalog_manager.cc:5697] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 7 to 16. New cstate: current_term: 16 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:52.681257 25272 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:52.683437 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.687917 31265 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:52.688521 31281 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 12:21:52.672216 31223 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.689814 31223 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.690793 25853 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:52.691406 31186 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:52.691896 31223 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:52.698464 31280 log.cc:927] Time spent T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 12:21:52.700645 31278 log.cc:927] Time spent T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:21:52.701210 25274 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 18.
I20260709 12:21:52.703032 31074 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:52.705513 31191 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:52.705169 25025 catalog_manager.cc:5697] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 11 to 14, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 14 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:52.627350 30957 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:52.707218 25197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 2824) took 1001 ms. Trace:
I20260709 12:21:52.711357 25197 rpcz_store.cc:276] 0709 12:21:51.705360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.705498 (+   138us) service_pool.cc:224] Handling call
0709 12:21:51.705846 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.706202 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.706230 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:51.706681 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:21:52.266654 (+559973us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:52.266697 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.266762 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.707003 (+440241us) raft_consensus.cc:1685] finished
0709 12:21:52.707026 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.707160 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1032,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":559574,"threads_started":1,"wal-append.queue_time_us":759960}
I20260709 12:21:52.707701 25092 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:52.708021 25241 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:21:52.706084 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:52.676456 31102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.010s	sys 0.022s
I20260709 12:21:52.675324 31005 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:52.719204 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 243899us
I20260709 12:21:52.720175 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:52.720921 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 79313.3us
I20260709 12:21:52.734529 25272 raft_consensus.cc:3055] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:52.734920 25272 raft_consensus.cc:740] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:52.735455 25165 leader_election.cc:400] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13.
I20260709 12:21:52.747623 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.731745 31049 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:52.731578 31226 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:52.745673 25272 consensus_queue.cc:260] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:52.749929 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.750674 25201 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:52.750694 25272 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:52.717156 31223 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:52.729514 31030 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:52.757567 25274 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:52.735072 31005 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.764127 31005 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:52.758234 31223 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.768842 31223 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:52.754714 31251 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:52.770629 31235 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:52.770843 31251 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.771246 30798 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:52.771770 30798 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:52.772876 31251 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:52.773382 31251 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:52.775396 25197 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:52.751382 31177 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.783844 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:52.783676 25271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:52.784792 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:52.785370 25854 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:52.786321 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:52.795135 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:52.795487 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:52.706149 31191 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.796032 25272 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:21:52.798729 25272 pending_rounds.cc:85] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting all ops after (but not including) 7
I20260709 12:21:52.799045 25272 pending_rounds.cc:107] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:21:52.799319 25272 raft_consensus.cc:2889] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:52.758822 31030 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.773904 30798 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:52.773809 31251 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:52.806807 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:52.807576 25124 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:21:52.808871 31291 log.cc:927] Time spent T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:52.809002 31251 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:52.816399 31282 log.cc:927] Time spent T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.415s	user 0.001s	sys 0.004s
I20260709 12:21:52.817664 31276 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:52.818329 25195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36434 (request call id 2887) took 1246 ms. Trace:
I20260709 12:21:52.818706 31177 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:52.806777 30797 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:21:52.822371 25852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46498 (request call id 1381) took 1104 ms. Trace:
I20260709 12:21:52.822775 25852 rpcz_store.cc:276] 0709 12:21:51.718043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.722399 (+  4356us) service_pool.cc:224] Handling call
0709 12:21:51.754473 (+ 32074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.754877 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.754908 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:51.755447 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:21:52.237977 (+482530us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:52.238020 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.238159 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.803455 (+565296us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2103aa986e 00007f2103aa8bb6 00007f2103aa87d8 00007f2103ab2221 00007f2103ab21d9 00007f2103ab2169
0709 12:21:52.822104 (+ 18649us) raft_consensus.cc:1685] finished
0709 12:21:52.822124 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.822312 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7419,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8605,"spinlock_wait_cycles":52241280,"thread_start_us":482096,"threads_started":1,"wal-append.queue_time_us":645172}
I20260709 12:21:52.824077 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.824388 25858 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:52.826463 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.827742 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:52.829347 25854 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:52.818719 25195 rpcz_store.cc:276] 0709 12:21:51.572376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.572527 (+   151us) service_pool.cc:224] Handling call
0709 12:21:51.572852 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:52.048262 (+475410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:52.048311 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:52.048810 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:21:52.531653 (+482843us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:52.531697 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.531776 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.818095 (+286319us) raft_consensus.cc:1685] finished
0709 12:21:52.818142 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.818273 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38424,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":915526,"threads_started":2,"wal-append.queue_time_us":641243}
I20260709 12:21:52.835690 25124 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:21:52.803514 31074 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:52.802093 31284 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:52.804430 31030 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:52.804602 31266 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:52.851934 25200 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 18. Current term is 19. Ops: []
I20260709 12:21:52.854351 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:52.855201 25852 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:52.853844 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:52.862012 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 129594us
I20260709 12:21:52.862798 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:52.866163 25167 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:52.870057 31285 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:52.872069 30850 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:52.872447 30850 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.872794 30850 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:52.874452 31191 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:52.885195 30850 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.889837 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:52.890936 25859 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:52.862960 31284 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:52.895649 31117 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:21:52.896220 31284 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:52.898418 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 71564.6us
I20260709 12:21:52.899415 25093 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:52.899624 31229 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.901731 31229 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:52.858734 31266 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.904399 25276 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 11.
I20260709 12:21:52.868068 31267 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:52.911111 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.916554 25200 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
W20260709 12:21:52.910001 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 47291.5us
W20260709 12:21:52.922344 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.913497 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.922997 25202 raft_consensus.cc:2368] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 18. Current term is 19.
I20260709 12:21:52.922065 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:52.912786 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:52.910547 31251 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:52.930420 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:52.931439 31293 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:21:52.931651 31074 raft_consensus.cc:993] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:52.916673 31266 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:52.933954 31267 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:52.935184 25857 raft_consensus.cc:2368] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14.
I20260709 12:21:52.925293 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:52.939164 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 84563.1us
I20260709 12:21:52.942438 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.943712 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:52.945354 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:52.945611 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:52.946111 25202 raft_consensus.cc:2368] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12.
I20260709 12:21:52.946277 25199 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:52.947021 25825 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:52.945598 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:52.949812 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:52.953423 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:52.953955 25241 leader_election.cc:400] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14.
I20260709 12:21:52.954324 25241 leader_election.cc:403] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:52.955557 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:52.958282 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:52.958847 25269 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:21:52.963747 25242 leader_election.cc:400] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 18. Current term is 19.
I20260709 12:21:52.964103 25242 leader_election.cc:403] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:53.006963 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 53167.7us
I20260709 12:21:53.008387 25199 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:53.010669 25125 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:53.011200 25125 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:53.013969 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 57034.9us
I20260709 12:21:52.965749 30850 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:53.015974 25825 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:53.017099 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:53.017344 31223 raft_consensus.cc:2804] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:53.019122 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:53.021158 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 64510.3us
I20260709 12:21:53.012109 25125 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:53.022215 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 58609.2us
W20260709 12:21:53.020764 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 75844.3us
I20260709 12:21:52.949852 31285 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.022624 31302 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:53.026630 31302 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:53.022848 25125 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:53.023885 25242 leader_election.cc:400] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12.
I20260709 12:21:53.024453 25121 raft_consensus.cc:1275] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:21:53.029485 25242 leader_election.cc:403] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:21:53.017976 31223 raft_consensus.cc:697] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:52.957805 31158 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:52.997725 31300 raft_consensus.cc:1081] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:53.047744 31303 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.052762 31303 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:53.055099 31303 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:53.019747 31235 raft_consensus.cc:3060] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:21:53.049942 31273 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:53.064401 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:53.069550 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 44736.2us
I20260709 12:21:53.070349 25093 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:53.069669 25269 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:21:52.997313 31265 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:53.062361 31273 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:53.073475 31223 consensus_queue.cc:237] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:53.075222 31273 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:53.072526 25165 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:53.028108 30934 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:53.063961 30957 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:53.089067 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:53.096611 25859 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
W20260709 12:21:53.099238 25241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.106078 25121 raft_consensus.cc:1240] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:53.077400 31233 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 18. Current term is 19.
I20260709 12:21:53.112744 25125 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 12:21:53.113193 25125 pending_rounds.cc:85] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 14
I20260709 12:21:53.115510 25125 pending_rounds.cc:107] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:21:53.115849 25125 raft_consensus.cc:2889] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:53.091362 31153 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.129873 25201 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:53.090175 31273 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:53.025283 31285 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:53.137228 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:53.140130 25125 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 16.
I20260709 12:21:53.103930 30819 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:53.113900 31261 raft_consensus.cc:2764] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:21:53.081287 31265 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:53.094206 31304 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:53.096807 31030 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:53.148165 25859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46474
I20260709 12:21:53.166293 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:53.194675 25857 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:53.214308 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:53.185707 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:53.150563 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:53.156582 25201 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:53.274365 25124 raft_consensus.cc:3060] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:53.275203 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60984.5us
I20260709 12:21:53.192198 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:53.277130 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:53.212145 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:53.277912 25197 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 18.
I20260709 12:21:53.147779 25167 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:53.271226 25859 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:53.280143 25859 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:53.283285 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:53.271898 25125 raft_consensus.cc:2368] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 18. Current term is 19.
I20260709 12:21:53.185325 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:53.285686 25269 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
W20260709 12:21:53.288056 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 45777us
W20260709 12:21:53.288829 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 141131us
I20260709 12:21:53.289561 25853 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 17: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:53.291870 25165 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:53.144826 31273 raft_consensus.cc:697] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:53.307212 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:53.307639 31267 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:53.308465 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:53.308971 31322 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:53.309480 31322 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:53.309544 31223 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:53.205456 31265 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:53.139508 31153 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:53.323642 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:53.191087 31302 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:53.307228 25124 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:53.189401 31235 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 13. Current term is 14.
I20260709 12:21:53.210887 31229 consensus_queue.cc:1048] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.112s
I20260709 12:21:53.184010 31285 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:53.214308 31286 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.151386 31148 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.289283 31090 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:53.208153 31311 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:53.299180 31100 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:53.329557 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afd466aa7a2455fa2f85263e303ec0f" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:53.334354 25123 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 18: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:53.329850 25859 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:53.340704 31273 consensus_queue.cc:237] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.7, Last appended by leader: 7, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:53.189795 31266 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:53.347186 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 284529us
I20260709 12:21:53.310123 31267 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:21:53.349053 25859 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:53.353432 25269 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:21:53.327895 31322 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:53.355834 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:53.361969 25124 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:53.344242 31285 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:21:53.369055 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 61936.9us
I20260709 12:21:53.367368 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:53.369967 25858 raft_consensus.cc:2368] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 16. Current term is 17.
I20260709 12:21:53.389087 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:53.370321 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:53.348413 31100 raft_consensus.cc:697] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:53.336509 31311 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:53.393525 25242 leader_election.cc:400] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 18. Current term is 19.
I20260709 12:21:53.402340 25242 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:53.402403 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 110607us
I20260709 12:21:53.332770 31148 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:53.409191 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:53.410308 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:53.369434 31285 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:53.409291 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 48975.9us
I20260709 12:21:53.336078 31286 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:53.416318 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 49027.6us
I20260709 12:21:53.423295 25195 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:21:53.418829 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:53.423110 25092 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:53.428462 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:53.416630 31285 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:53.389910 31318 consensus_queue.cc:1059] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:21:53.415906 31235 raft_consensus.cc:2804] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:53.421448 31321 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:53.421280 31130 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:53.435923 25124 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:53.435837 25125 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:53.416354 31304 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:21:53.480741 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:53.481980 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:53.482929 25269 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 17: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:21:53.483266 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:53.469782 25853 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 19 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 18. Current term is 19. Ops: []
I20260709 12:21:53.427498 31284 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:53.481823 25123 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 14.
I20260709 12:21:53.492257 31303 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:53.492741 31303 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.463063 31148 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:53.493067 31303 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:53.490592 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:53.495255 31286 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:53.476245 31153 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:53.449632 31321 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:53.464509 31266 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:53.587672 25092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.495978 30957 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 11. Current term is 12.
I20260709 12:21:53.505367 31265 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:53.593597 31265 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.594002 31265 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:53.587566 31321 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:53.605444 25125 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:21:53.476872 31100 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:53.619915 31313 log.cc:927] Time spent T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.413s	user 0.004s	sys 0.000s
I20260709 12:21:53.637310 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:53.637881 25196 raft_consensus.cc:3055] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:53.638161 25196 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:53.642148 25199 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:21:53.642373 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:53.643302 25193 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:53.638898 25196 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:53.650909 25196 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:53.655223 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 236486us
I20260709 12:21:53.627487 31273 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:53.658918 25858 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:53.660362 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:53.668735 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:53.670359 25202 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:21:53.673296 25273 raft_consensus.cc:2468] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:53.669823 25857 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
I20260709 12:21:53.677919 25167 leader_election.cc:400] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 16. Current term is 17.
I20260709 12:21:53.679191 25167 leader_election.cc:403] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:53.659492 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:53.719341 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:53.670733 31101 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:53.777120 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.682353 31219 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:21:53.782733 31337 log.cc:927] Time spent T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:21:53.728020 31328 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:53.909350 25202 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:21:53.814316 31219 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:53.684912 31273 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:53.806990 31101 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:53.930601 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 267087us
W20260709 12:21:53.947517 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 445766us
I20260709 12:21:53.942796 31330 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 16. Current term is 17.
I20260709 12:21:53.938560 31235 raft_consensus.cc:697] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:53.959096 31117 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:53.970757 31303 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:53.974139 31332 log.cc:927] Time spent T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:21:53.975404 31101 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:53.976791 31339 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
W20260709 12:21:53.978909 31334 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:21:53.949002 31219 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:53.980052 31322 consensus_meta.cc:287] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.000s
I20260709 12:21:53.980792 31251 raft_consensus.cc:3055] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:53.982865 31273 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:53.984622 31265 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:53.985723 31321 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:54.037289 31251 raft_consensus.cc:740] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:54.067888 25276 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 18.
I20260709 12:21:54.057478 31219 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:53.996251 31117 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:54.069633 31285 consensus_meta.cc:287] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.002s
I20260709 12:21:54.077363 25196 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
W20260709 12:21:54.076543 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 405479us
W20260709 12:21:54.080469 25269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.007s	sys 0.007s
W20260709 12:21:54.080893 25269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.007s	sys 0.007s
I20260709 12:21:53.990013 31235 consensus_queue.cc:237] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.076783 31330 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.070736 31328 raft_consensus.cc:697] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:54.088029 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.057796 31322 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:54.086870 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 154162us
I20260709 12:21:54.076553 31219 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.080565 31285 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:54.092105 31285 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:54.096526 31117 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.097867 31265 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:54.098572 31321 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:54.100063 31303 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:54.101792 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.087353 31251 consensus_queue.cc:260] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.102837 31251 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:54.110463 25197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:54.111207 25197 raft_consensus.cc:606] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:54.114158 31350 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.114701 25273 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 17 index: 7. Preceding OpId from leader: term: 19 index: 8. (index mismatch)
I20260709 12:21:54.115840 31311 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:54.092074 31219 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:54.114735 31350 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.120507 31350 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.089715 31330 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:54.121567 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.122401 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:54.122537 31330 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:54.127839 31328 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.130337 31330 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.130963 31330 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:54.131851 31310 log.cc:927] Time spent T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 12:21:54.133220 31330 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.142118 25120 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:54.143085 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:54.150388 25124 raft_consensus.cc:2393] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 14: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:54.150184 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:54.151039 25196 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 16.
I20260709 12:21:54.144295 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:54.152146 25121 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:54.141692 25201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 2842) took 1202 ms. Trace:
I20260709 12:21:54.145807 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:54.152782 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:54.152954 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:54.153487 25274 raft_consensus.cc:2368] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15.
I20260709 12:21:54.154592 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:54.154866 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:54.155428 25273 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:54.147679 25168 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:54.155085 25197 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 19: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:54.149358 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:54.155318 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:54.152923 25201 rpcz_store.cc:276] 0709 12:21:52.939582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.943799 (+  4217us) service_pool.cc:224] Handling call
0709 12:21:54.141422 (+1197623us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54003615d4. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:54.141569 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253130496}
I20260709 12:21:54.162236 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.167245 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:54.169593 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:54.170915 25165 leader_election.cc:400] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15.
I20260709 12:21:54.171255 25165 leader_election.cc:403] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:54.171545 25242 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:54.171653 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:54.171896 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:54.172248 25120 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:54.172459 25196 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:21:54.177241 25273 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:54.211601 25124 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 17 index: 7. Preceding OpId from leader: term: 19 index: 8. (index mismatch)
I20260709 12:21:54.218927 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:54.224220 25196 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:54.177728 31353 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:54.175736 31330 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:54.235364 25201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:54.236233 25201 raft_consensus.cc:606] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:54.236727 25201 raft_consensus.cc:614] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:54.221040 31311 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:54.238751 31311 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.241541 31322 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:54.241490 31311 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.247231 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.227016 30850 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15.
I20260709 12:21:54.180850 30957 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:54.226227 25242 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:54.159789 31277 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:21:54.265674 25120 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:54.262771 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:54.268236 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:54.268896 25121 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:21:54.272084 31357 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:54.279752 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:54.287396 31284 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:54.290787 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:54.291702 25201 raft_consensus.cc:2368] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:54.258122 31353 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:54.304028 31353 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:54.304601 25201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:54.305459 25201 raft_consensus.cc:606] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:54.271368 31322 raft_consensus.cc:2804] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:54.281424 31316 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:54.314754 25242 leader_election.cc:400] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:54.315203 25242 leader_election.cc:403] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:21:54.296209 31101 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:54.323431 25201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:54.324280 25201 raft_consensus.cc:606] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:54.325884 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:54.326535 25125 raft_consensus.cc:3060] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:54.331032 25166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.331923 31322 raft_consensus.cc:697] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:54.332507 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:54.333272 25124 raft_consensus.cc:2368] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 18. Current term is 19.
I20260709 12:21:54.334203 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:54.335079 25121 raft_consensus.cc:2410] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:21:54.316704 31233 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) with higher term. Message: Invalid argument: T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:54.341452 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:54.343294 25121 raft_consensus.cc:2368] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:54.332957 31322 consensus_queue.cc:237] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:54.362150 25201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:54.312167 25093 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:54.368808 25242 leader_election.cc:400] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 18. Current term is 19.
I20260709 12:21:54.369406 25242 leader_election.cc:403] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:21:54.370412 25270 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:54.360702 25125 raft_consensus.cc:2468] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 15.
I20260709 12:21:54.373860 31327 raft_consensus.cc:993] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:54.374424 31327 raft_consensus.cc:1081] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:54.371742 31101 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:54.375248 31101 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.375499 31350 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:54.375620 31101 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:54.379151 25242 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:54.358249 31295 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:54.371620 25165 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:54.281136 31357 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.387292 25858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46474
I20260709 12:21:54.388094 25858 raft_consensus.cc:493] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:54.388549 25858 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:54.401839 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:54.367575 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 55620.4us
I20260709 12:21:54.420462 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e59abaef5845e2bb8f466331bb98c3" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:54.396795 31357 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.426115 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:54.384979 31160 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:54.385725 31297 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:54.314868 31316 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.386178 31295 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:54.450222 25242 leader_election.cc:400] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:21:54.430424 30957 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:54.460944 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 46102.1us
I20260709 12:21:54.449648 31297 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:54.467195 25858 raft_consensus.cc:515] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.477119 25168 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:54.466313 30957 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.491123 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:54.491667 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:54.492295 25200 raft_consensus.cc:3055] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:54.492650 25200 raft_consensus.cc:740] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:54.493386 25200 consensus_queue.cc:260] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.467299 31235 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:54.497344 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:54.499891 25168 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:54.500823 25858 leader_election.cc:290] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:54.502166 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:54.502800 25120 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:54.503641 25193 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:54.505455 31297 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:54.506294 30957 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.507965 31303 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:54.472808 31236 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:54.513893 25858 raft_consensus.cc:1240] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:21:54.521163 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:54.492159 31366 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.526139 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:54.482139 31338 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:21:54.528054 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.531239 25858 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:54.528712 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:54.535833 31295 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:54.511663 31235 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.536604 31219 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:21:54.532051 31191 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:54.538146 31235 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.538700 31235 raft_consensus.cc:493] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:54.539182 31235 raft_consensus.cc:515] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.541244 31235 leader_election.cc:290] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.545719 31353 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.547842 31353 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.551249 25276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40086 (request call id 3021) took 1069 ms. Trace:
I20260709 12:21:54.551643 25276 rpcz_store.cc:276] 0709 12:21:53.482288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.483006 (+   718us) service_pool.cc:224] Handling call
0709 12:21:54.551076 (+1068070us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54002fec54. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:54.551187 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342693120}
I20260709 12:21:54.563097 31350 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 18. Current term is 19.
I20260709 12:21:54.531117 31367 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:54.564646 31367 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.531478 31311 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:54.528941 31251 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:54.567101 31251 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.529266 31366 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:54.571929 31366 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:54.519462 31236 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:54.575922 31236 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:54.577301 31101 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.588089 25853 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:54.597153 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:54.597859 25268 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 14.
I20260709 12:21:54.598057 31327 raft_consensus.cc:993] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:21:54.598635 31327 raft_consensus.cc:1081] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:21:54.601421 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:54.602085 25267 raft_consensus.cc:2468] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:54.527519 31357 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:54.603152 31357 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
W20260709 12:21:54.603412 31362 log.cc:927] Time spent T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.230s	user 0.003s	sys 0.000s
I20260709 12:21:54.604053 31357 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:54.605377 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:54.607477 31191 raft_consensus.cc:697] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:54.610747 25200 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:54.623016 25859 raft_consensus.cc:2393] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 17: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:54.634057 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:54.636584 25201 raft_consensus.cc:606] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:54.637298 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 108706us
W20260709 12:21:54.638960 25091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.667618 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:54.668637 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 45920.4us
I20260709 12:21:54.669528 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:54.681185 25200 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:54.686203 31101 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.690896 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.692504 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.694357 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.693706 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:54.695590 25853 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:54.698535 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:54.667740 31005 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:54.664906 31317 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:54.667889 31286 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:54.711184 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:54.702543 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 197651us
I20260709 12:21:54.712638 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:54.712725 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:54.713210 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
W20260709 12:21:54.714131 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 193036us
I20260709 12:21:54.709122 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:54.709796 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:54.706341 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:54.715260 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb58fb89c744c58d9494a99f2adda8" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.707335 25090 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:54.717633 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:54.705837 25825 leader_election.cc:304] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:54.710350 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:54.635782 31346 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:21:54.714620 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.723237 31350 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:54.731180 31373 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:54.718680 30797 raft_consensus.cc:2764] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:21:54.731743 31350 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.731843 31373 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.733680 31251 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.735030 31329 raft_consensus.cc:2804] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:54.735173 31316 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.735261 31373 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.700982 31369 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:54.739751 31367 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.780215 31030 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.780201 31369 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.726853 31286 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.720932 31191 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.723206 30819 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:54.785171 30819 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.785640 30819 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:54.721354 25200 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:54.748732 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:21:54.789556 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 67519.3us
I20260709 12:21:54.792142 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:54.689267 31090 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:21:54.755115 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:54.756620 25270 raft_consensus.cc:1275] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:54.757400 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbf7458baff481588dabf347ec2112d" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:54.794821 25276 raft_consensus.cc:3060] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:54.797435 31329 raft_consensus.cc:697] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 14 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:54.798256 31350 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.798741 31329 consensus_queue.cc:237] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.762595 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:54.765000 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:54.806648 25121 raft_consensus.cc:2368] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18.
I20260709 12:21:54.766250 25122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:21:54.807897 25122 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:54.808382 25122 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:54.814284 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 94109.2us
W20260709 12:21:54.823315 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 65204.1us
I20260709 12:21:54.824697 25200 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 18.
I20260709 12:21:54.815430 25165 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:54.827087 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.834798 31286 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.838127 30850 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:54.840831 25853 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 18.
W20260709 12:21:54.850522 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 130840us
I20260709 12:21:54.847302 25276 raft_consensus.cc:2468] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:21:54.852193 25122 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.857092 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:54.862812 25092 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:54.863521 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 91306.3us
I20260709 12:21:54.864955 25122 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:54.867619 31369 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:21:54.871623 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 44571us
I20260709 12:21:54.877736 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:54.884773 25853 consensus_queue.cc:237] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.885258 25092 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:54.886066 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.886624 25092 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:54.898859 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 83550.7us
I20260709 12:21:54.900902 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.902489 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.906092 25822 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:54.907886 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 55863.3us
I20260709 12:21:54.909204 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:54.914332 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:54.918176 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:54.920641 25118 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:21:54.921576 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 54617.7us
I20260709 12:21:54.923453 25168 leader_election.cc:400] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18.
I20260709 12:21:54.923771 25168 leader_election.cc:403] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:21:54.886512 31378 raft_consensus.cc:993] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:54.897729 31316 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:54.932646 25168 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:54.926970 25242 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:54.927918 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:54.929996 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 212491us
I20260709 12:21:54.935703 25856 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.909121 31130 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:54.942247 25242 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:54.916146 30782 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:54.921165 31005 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:54.943179 31265 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:54.953534 30819 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:54.955837 31351 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409) with higher term. Message: Invalid argument: T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18.
W20260709 12:21:54.956403 31387 log.cc:927] Time spent T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:21:54.969455 25852 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:21:54.970156 25123 raft_consensus.cc:1240] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:54.974500 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:54.975268 25200 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 17: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:54.924212 31090 consensus_queue.cc:1048] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:21:54.949399 31353 raft_consensus.cc:1081] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:54.946070 31325 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:55.010321 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 47915.9us
I20260709 12:21:55.012490 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:55.026978 25200 raft_consensus.cc:3055] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:55.027382 25200 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:55.028208 25200 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.029424 25200 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:55.030692 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 67552.9us
I20260709 12:21:55.030165 31300 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:55.058404 31375 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:55.017300 30797 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:55.051499 31191 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.053150 31130 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 18 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:55.074303 30819 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:55.076994 25200 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:54.977815 31229 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:55.089622 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:55.103490 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 167062us
I20260709 12:21:55.097576 25121 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:21:55.101166 25853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46474
I20260709 12:21:55.106600 25853 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:55.107049 25853 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:55.103780 25856 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 11.
I20260709 12:21:55.091584 25242 leader_election.cc:304] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:54.996439 31343 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
W20260709 12:21:55.111703 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 80596.2us
I20260709 12:21:55.114984 25202 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:21:55.104271 25852 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:21:55.101102 31191 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.117686 25093 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:55.132903 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:55.121296 31219 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:21:55.184475 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 59431.9us
I20260709 12:21:55.138279 25853 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.186437 25856 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:55.186918 25852 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
W20260709 12:21:55.188751 31392 log.cc:927] Time spent T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:21:55.191234 31191 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:55.097011 31375 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:55.195415 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 77808.9us
I20260709 12:21:55.196379 31375 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:55.188449 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 68994.8us
W20260709 12:21:55.203655 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 176459us
I20260709 12:21:55.098917 31300 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.211805 31300 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:55.212405 31300 raft_consensus.cc:993] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:55.212833 31300 raft_consensus.cc:1081] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:21:55.218097 31267 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:55.223417 25090 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:55.224728 31284 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:21:55.221251 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 68260.4us
I20260709 12:21:55.224736 25090 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:55.229326 30986 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:55.230063 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba87711b0ab4e3394481dfecfeb886e" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:55.232180 25200 raft_consensus.cc:1275] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:21:55.234724 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:55.236277 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:55.196810 31302 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:55.237260 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:55.198912 25853 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:55.241497 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 104618us
I20260709 12:21:55.143361 31159 raft_consensus.cc:2749] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:55.241892 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:55.242681 25269 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:55.243995 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:55.246345 25856 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46474
I20260709 12:21:55.247380 25856 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:55.248148 25856 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:55.249182 25121 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:55.250965 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:55.252466 25090 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:55.258441 25853 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 14: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:21:55.255355 31302 raft_consensus.cc:697] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:55.259585 31368 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:55.261145 31302 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.258172 25090 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:55.244088 31283 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:55.268359 25269 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:55.269799 25090 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:55.268834 25856 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.277343 31368 raft_consensus.cc:2749] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:55.278401 30797 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:55.279345 25856 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:55.253829 31300 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:21:55.291821 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:55.242578 31130 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.299917 25090 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
W20260709 12:21:55.314373 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 58828.4us
I20260709 12:21:55.322659 25242 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:55.297928 30797 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.315778 30819 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:55.313825 31161 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:55.334666 31375 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:55.337292 30797 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.342562 30797 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:55.344656 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:55.347138 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:55.347832 25200 raft_consensus.cc:2468] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:21:55.360069 25200 raft_consensus.cc:1275] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:21:55.361280 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 238548us
I20260709 12:21:55.374605 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:55.375761 25127 raft_consensus.cc:2410] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:21:55.377136 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:55.378036 25200 raft_consensus.cc:2410] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:21:55.379518 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:55.380199 25201 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:55.380523 25201 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:55.385406 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:55.386103 25123 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:55.386312 25125 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:21:55.388249 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 264295us
I20260709 12:21:55.367183 30819 raft_consensus.cc:697] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:55.381253 25201 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.362046 31324 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:21:55.423797 25201 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:55.427220 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:55.429008 30819 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.455067 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:55.435374 31312 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:55.456053 25121 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:55.500784 25201 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 18.
I20260709 12:21:55.522975 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:55.532974 25092 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:55.536656 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 200580us
I20260709 12:21:55.474110 31312 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:55.544413 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 229223us
I20260709 12:21:55.556826 25270 raft_consensus.cc:1275] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:55.543677 31324 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:55.559067 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:55.561594 25269 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:55.563426 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:55.560256 31251 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:55.568866 31329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.024s	sys 0.017s
W20260709 12:21:55.569293 31329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.024s	sys 0.017s
I20260709 12:21:55.550534 31317 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:21:55.543409 31148 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:21:55.559787 31374 consensus_queue.cc:1048] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:21:55.564797 31324 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.577663 31324 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:55.553277 31343 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:55.568783 31401 log.cc:927] Time spent T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:21:55.592208 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:55.600952 31343 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.605194 25269 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
I20260709 12:21:55.608893 25123 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 18.
I20260709 12:21:55.606119 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:55.603821 31375 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:55.627146 25854 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
W20260709 12:21:55.637986 30850 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 12:21:55.608060 31412 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:55.641976 31326 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:55.666955 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:55.617000 31324 consensus_queue.cc:1048] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:21:55.665035 31277 consensus_queue.cc:1059] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 12:21:55.682404 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 115272us
I20260709 12:21:55.711314 25822 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:55.712194 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:55.679080 31326 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:55.715693 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:55.716483 31317 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:55.719358 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:55.719440 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:55.735010 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:55.723480 25168 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:55.741662 25274 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:55.721745 31312 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:55.763859 25267 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 12. Current term is 13. Ops: []
W20260709 12:21:55.766489 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 48936.4us
I20260709 12:21:55.743024 31416 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:55.767560 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:55.768522 25241 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:55.774328 31326 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.722115 31399 consensus_queue.cc:1048] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:21:55.778296 31277 consensus_queue.cc:1059] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:21:55.780342 31415 log.cc:927] Time spent T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:21:55.785409 25241 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:55.805756 31265 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:55.770764 31416 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:55.823482 31416 raft_consensus.cc:3060] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:55.785106 31266 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:55.841915 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 56593.8us
I20260709 12:21:55.843382 31350 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:55.862082 25122 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:21:55.878063 31317 raft_consensus.cc:697] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:55.893318 31317 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.894346 25196 raft_consensus.cc:3055] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:55.904206 25196 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:55.906490 25196 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:55.907850 25196 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:55.924206 25201 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:55.925386 31327 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:56.003626 31416 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:56.013134 25853 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:21:56.046986 31074 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.979523 31424 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 12:21:56.088927 31416 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:56.091225 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:56.102435 25859 raft_consensus.cc:2393] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 14: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
W20260709 12:21:56.108187 25167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.167179 25196 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 13.
W20260709 12:21:55.979561 31338 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.030s	sys 0.023s
I20260709 12:21:56.078857 31074 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:56.190614 31338 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.030s	sys 0.023s
W20260709 12:21:56.211201 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 50339us
I20260709 12:21:56.191367 31429 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:21:56.242717 31074 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:56.244823 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:56.248804 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:56.249356 25269 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:56.250480 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:56.255378 31343 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:56.263407 25269 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:21:56.250207 31426 log.cc:927] Time spent T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:21:56.263543 31323 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:21:56.269235 31430 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:21:56.271888 31442 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
W20260709 12:21:56.287920 31436 log.cc:927] Time spent T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:21:56.276450 31323 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.288604 31323 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:56.298861 31324 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.315801 31324 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:56.319238 31323 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:56.317936 31324 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:56.322345 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:56.322975 25274 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:56.340004 25274 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:21:56.341715 25165 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:56.345479 31418 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:56.346292 31418 raft_consensus.cc:697] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:56.347371 31418 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:56.352859 31447 log.cc:927] Time spent T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:56.355115 25857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46484 (request call id 1681) took 1236 ms. Trace:
I20260709 12:21:56.355628 25857 rpcz_store.cc:276] 0709 12:21:55.118710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.123165 (+  4455us) service_pool.cc:224] Handling call
0709 12:21:55.123493 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:55.447076 (+323583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:55.447122 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:56.231343 (+784221us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b2c00047098. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2102807a11 00007f2102817372 00007f2103f49a01 00007f2103f0e43a 00007f2103f0d83e 00007f2108ed2419 00007f2102449bd4 00007f2102449b62 00007f2102449a91 00007f2102449a0c 00007f2102448cc2
0709 12:21:56.246603 (+ 15260us) log.cc:844] Serialized 26 byte log entry
0709 12:21:56.261540 (+ 14937us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:56.261571 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.261632 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:56.354800 (+ 93168us) raft_consensus.cc:1685] finished
0709 12:21:56.354832 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.355056 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9746,"raft.queue_time_us":19488,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":52078,"spinlock_wait_cycles":18260864,"thread_start_us":337713,"threads_started":2,"wal-append.queue_time_us":14963}
W20260709 12:21:56.361049 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 455936us
I20260709 12:21:56.370465 31328 raft_consensus.cc:2955] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 3 to 8, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:56.397958 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:56.399362 31323 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:56.525079 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:21:56.510923 31326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.010s	sys 0.022s
I20260709 12:21:56.526196 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:56.506975 31350 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:56.533012 31350 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:56.525390 31441 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:56.534121 31441 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:56.535962 31350 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:56.536504 31441 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:56.537003 31350 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.525574 30797 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:56.537693 30797 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:56.538587 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:56.539681 30797 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:56.521281 31368 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.510844 31302 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:56.541088 31368 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:56.529212 31326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.010s	sys 0.022s
I20260709 12:21:56.542217 31440 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:56.542816 31440 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:56.543430 31368 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:56.522727 31300 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:56.544747 25120 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
I20260709 12:21:56.523511 25274 raft_consensus.cc:2955] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 3 to 8, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:56.545018 31440 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:56.541684 31302 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:56.549510 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:56.551980 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:56.559615 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:56.564039 25276 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:21:56.557283 31302 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:56.544958 31300 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:56.557785 31323 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:56.558115 31350 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:56.724983 31357 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
W20260709 12:21:56.735354 31437 log.cc:927] Time spent T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:21:56.694199 31404 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:21:56.749136 30782 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
W20260709 12:21:56.749900 31450 log.cc:927] Time spent T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
W20260709 12:21:56.749595 31451 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:21:56.761047 31297 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:56.765412 30782 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:56.767688 31300 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:56.771651 31350 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:56.738536 31323 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:56.843256 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:56.846231 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:56.848424 25274 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 17.
W20260709 12:21:56.849488 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 282086us
I20260709 12:21:56.851692 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:56.855671 25090 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:56.752157 31357 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:56.863174 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:56.864535 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:56.845984 31326 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.861169 31187 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:56.860908 31328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44120 (request call id 0) took 1992 ms. Trace:
I20260709 12:21:56.865583 31300 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:56.845652 31297 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:56.869220 31326 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:56.876318 31328 rpcz_store.cc:276] 0709 12:21:54.855251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.855419 (+   168us) service_pool.cc:224] Handling call
0709 12:21:54.898122 (+ 42703us) log.cc:844] Serialized 501 byte log entry
0709 12:21:55.192648 (+294526us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b18003240a0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f2100def2a6 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e8eb26 00007f2103e8849a 00007f2103e87714
0709 12:21:55.193392 (+   744us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b540008d520. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e8eb26 00007f2103e8849a 00007f2103e87714 00007f2103e67eaa 00007f2103e6ed53 00007f2103e6ecd9 00007f2103e6ec69 00007f2103e6ec31 00007f2103e6ddfd 0000000000388634
0709 12:21:55.223062 (+ 29670us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b540008d520. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103e87142 00007f2103e67eaa 00007f2103e6ed53 00007f2103e6ecd9 00007f2103e6ec69 00007f2103e6ec31 00007f2103e6ddfd 0000000000388634 0000000000388479 00007f2100e21475
0709 12:21:56.847893 (+1624831us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":208,"mutex_wait_us":39179,"raft.queue_time_us":23990,"raft.run_cpu_time_us":5698,"raft.run_wall_time_us":212182,"spinlock_wait_cycles":42549888,"thread_start_us":142749,"threads_started":1,"wal-append.queue_time_us":149886,"wal-append.run_cpu_time_us":1838,"wal-append.run_wall_time_us":1004095}
I20260709 12:21:56.875419 31187 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.886335 31326 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:56.894951 31357 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:56.896757 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:56.898964 31297 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:56.902592 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:56.910919 31187 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:56.923305 31323 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:56.907866 31300 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.013600 30782 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:21:57.014019 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 141892us
I20260709 12:21:57.016871 31159 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:57.018231 31159 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:57.033460 30782 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:57.035137 30782 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.043280 31159 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:57.043769 31324 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:57.044734 31324 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:57.045691 25196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51270 (request call id 1218) took 1619 ms (client timeout 2146 ms). Trace:
I20260709 12:21:57.047756 31324 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:57.047971 25196 rpcz_store.cc:269] 0709 12:21:55.426454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.426583 (+   129us) service_pool.cc:224] Handling call
0709 12:21:57.045206 (+1618623us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b5400221854. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e77571 00007f2103f122fa 00007f2108ed3b17 00007f210244e6d4 00007f210244e662 00007f210244e591 00007f210244e50c 00007f210244d7c2 00007f210224948c 00007f21022488c6 00007f210224826f
0709 12:21:57.045446 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066646272}
I20260709 12:21:57.048851 31438 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:57.049952 31438 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:57.053386 31438 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:57.064600 30782 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:57.064999 31459 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.065827 31459 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.024914 31300 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.076752 31357 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:57.088048 31357 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.081506 31346 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.099929 31346 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.102296 31329 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:57.102620 25011 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f1f471cfad2348a09c4b699f01f9dfa9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 12:21:57.102845 31459 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.103343 31329 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:57.105536 31453 log.cc:927] Time spent T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.355s	user 0.004s	sys 0.004s
I20260709 12:21:57.111886 31297 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.112903 31297 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.110430 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.125248 31357 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.133594 31297 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.156442 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.161023 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.165197 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.165891 25272 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:21:57.169418 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:57.171933 25199 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:21:57.172798 30850 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.173393 25274 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:21:57.173632 30850 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.175426 25276 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:21:57.175580 31311 raft_consensus.cc:493] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.176417 31311 raft_consensus.cc:515] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.180140 31398 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:57.181231 31398 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.181784 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.190840 25853 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:57.191244 31429 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.192129 31429 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.183265 25269 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:21:57.184348 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.196856 25859 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:21:57.185197 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:57.198413 31429 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:57.185395 25270 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:57.186204 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.187037 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.200852 25856 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:57.208455 31369 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.209512 31369 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.212627 31369 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.215031 31368 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:57.215905 31368 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.219578 25025 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33480 (request call id 273) took 8480 ms. Trace:
I20260709 12:21:57.155493 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:57.228395 31329 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:57.222684 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.187876 31311 leader_election.cc:290] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.224730 31398 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.227298 30850 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.126724 31346 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.252507 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.255936 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.256949 25120 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
I20260709 12:21:57.259274 25272 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:57.231985 25025 rpcz_store.cc:276] 0709 12:21:48.738839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.893456 (+154617us) service_pool.cc:224] Handling call
0709 12:21:48.950236 (+ 56780us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b54002ef754. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e78090 00007f2103f16f3a 00007f2109ccce9c 00007f2109dcb04e 00007f210828c2a4 00007f210828c232 00007f210828c161 00007f210828c0dc 00007f210828b392 00007f210224948c 00007f21022488c6
0709 12:21:57.219330 (+8269094us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:53.015194 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:53.015740 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:53.015768 (+    28us) write_op.cc:435] Acquired schema lock
0709 12:21:53.015785 (+    17us) tablet.cc:662] Decoding operations
0709 12:21:53.017906 (+  2121us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:53.017982 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:53.018039 (+    57us) tablet.cc:685] Acquiring locks for 29 operations
0709 12:21:53.170491 (+152452us) tablet.cc:701] Row locks acquired
0709 12:21:53.170518 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:21:53.170662 (+   144us) write_op.cc:270] Start()
0709 12:21:53.170783 (+   121us) write_op.cc:276] Timestamp: P: 1783599713170616 usec, L: 0
0709 12:21:53.170804 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:21:53.205856 (+ 35052us) log.cc:844] Serialized 11450 byte log entry
0709 12:21:53.478114 (+272258us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4400022b4c. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2100ca9db1 00007f2100d47c85 00007f2100d486a2 00007f2103aba1db 00007f2103ab5aaf 00007f2100e040ac 00007f2109c5e9a9 00007f2100e2069b 00007f2100e1e93f 00007f2100e20c02 00007f2103aa820b
0709 12:21:54.106518 (+628404us) op_driver.cc:464] REPLICATION: finished
0709 12:21:54.305038 (+198520us) write_op.cc:301] APPLY: starting
0709 12:21:54.305123 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:54.480229 (+175106us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:54.480254 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:54.871296 (+391042us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:55.019723 (+148427us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 12:21:55.050163 (+ 30440us) write_op.cc:312] APPLY: finished
0709 12:21:55.055166 (+  5003us) log.cc:844] Serialized 252 byte log entry
0709 12:21:55.055366 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:55.055671 (+   305us) write_op.cc:454] Released schema lock
0709 12:21:55.055750 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:55.056225 (+   475us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:55.056263 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":304861,"reported_tablets":40,"spinlock_wait_cycles":103402368,"child_traces":[["op",{"apply.queue_time_us":198223,"apply.run_cpu_time_us":40245,"apply.run_wall_time_us":751167,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125579,"num_ops":29,"prepare.queue_time_us":149034,"prepare.run_cpu_time_us":25030,"prepare.run_wall_time_us":629720,"raft.queue_time_us":91437,"raft.run_cpu_time_us":53318,"raft.run_wall_time_us":131722,"replication_time_us":935520,"spinlock_wait_cycles":38857984,"thread_start_us":737388,"threads_started":4,"wal-append.queue_time_us":705613,"wal-append.run_cpu_time_us":31211,"wal-append.run_wall_time_us":2150722}]]}
W20260709 12:21:57.265587 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 58421.5us
I20260709 12:21:57.271304 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.274561 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.287457 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.299250 25274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.302315 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.304500 25167 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:57.300655 31366 raft_consensus.cc:493] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.307570 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.307879 31366 raft_consensus.cc:515] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.308631 25090 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:57.315255 25167 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:57.316483 25167 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:57.323782 31357 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.324151 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.324849 31357 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.328253 31357 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.322232 30850 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:57.330302 31100 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:57.330442 30850 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:57.330868 31100 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.331048 30850 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:57.331339 31100 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:57.333134 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.335861 30819 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:57.336477 30819 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.336930 30819 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:57.320874 31311 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:57.339682 31311 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:57.340134 31311 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.350041 30986 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:57.350380 30797 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.350911 31130 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:57.351154 30797 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.351752 31130 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:57.350927 30986 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:57.353729 30797 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.356832 31130 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:57.362269 31441 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.363014 31441 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.369724 31432 consensus_queue.cc:1059] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:57.371117 31328 raft_consensus.cc:3055] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:57.371539 31328 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
W20260709 12:21:57.355161 31470 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:21:57.371899 31432 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:57.372624 31328 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.374327 31357 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.375057 31357 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.376176 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.377110 31418 raft_consensus.cc:493] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.377588 31357 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.377780 31418 raft_consensus.cc:515] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.379084 31328 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:57.380148 31418 leader_election.cc:290] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.381078 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:57.381843 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:57.339262 31187 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:57.397429 31347 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.398231 31321 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.391021 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:57.405251 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:57.382959 31368 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.408025 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:57.405326 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:57.408957 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 107200us
I20260709 12:21:57.412005 25202 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
I20260709 12:21:57.413019 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.415896 31160 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:57.416855 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.406720 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.422490 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.398411 31347 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.400947 31321 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:57.425483 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 46474.7us
I20260709 12:21:57.426375 31321 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.426544 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.392094 31366 leader_election.cc:290] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.432612 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d246e87571b4365a1d11d98c7455fb9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.432796 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.442783 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.443634 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:57.446314 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.435702 31347 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.452865 25269 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:21:57.449765 31375 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:57.459836 31300 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:57.438827 30986 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:57.469151 31300 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:57.462080 31375 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:57.483098 25165 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:57.470382 31441 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.484004 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.481025 31346 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:57.476181 31375 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:57.485419 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.481930 30797 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:57.479238 31409 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:57.490309 25011 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet f1f471cfad2348a09c4b699f01f9dfa9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 8
I20260709 12:21:57.491508 31409 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.494590 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:21:57.495409 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 55606.6us
I20260709 12:21:57.478473 30986 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:57.488364 31346 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.503463 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.514389 31409 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.516350 31329 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:57.518062 31329 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.518730 31300 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:57.520154 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.520339 31329 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:57.499894 30797 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:57.526054 31303 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:57.528769 31346 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.501176 31187 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:57.496119 31311 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:57.539556 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.541572 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.549751 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.550448 25856 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
I20260709 12:21:57.544412 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:57.551280 31090 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:57.555639 31090 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.557754 31090 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:57.524080 31100 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:21:57.564009 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 106487us
I20260709 12:21:57.565804 25167 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:57.568426 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:57.575350 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:57.554522 30850 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.578526 31300 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:57.573328 31396 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:21:57.581272 31300 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:57.581758 31300 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.581679 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f698d5eb641d4490aaa13e25382450db" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.581008 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.572000 31187 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:57.563714 30986 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:57.597023 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.590122 25021 catalog_manager.cc:5697] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 7 to 15. New cstate: current_term: 15 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
W20260709 12:21:57.609023 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 69209.9us
I20260709 12:21:57.606617 31297 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:57.647960 25853 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:57.653048 25851 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:57.659492 31311 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.661332 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:57.662007 25851 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.642995 31297 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.665153 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:57.666785 31297 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:57.684913 31090 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.685603 31090 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.686614 31375 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:57.687942 31090 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:57.689249 31375 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:21:57.677456 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 104967us
I20260709 12:21:57.694284 31418 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:57.711576 25021 catalog_manager.cc:5697] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:57.718129 31343 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:21:57.726498 25168 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.81.193:46409 timed out after 1.627s (SENT) [suppressed 2 similar messages]
I20260709 12:21:57.730173 31396 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:57.730921 30986 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:57.730867 31396 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:57.732484 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.733091 31396 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:57.733166 25272 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 19.
I20260709 12:21:57.735010 25090 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:57.736027 30797 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:57.736073 31366 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:57.736786 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.736956 31366 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:57.738279 31366 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:57.714463 31418 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:21:57.753337 25851 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:57.764362 25021 catalog_manager.cc:5697] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
W20260709 12:21:57.778119 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 75774us
I20260709 12:21:57.778890 25165 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:57.783629 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:57.785523 25167 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:57.786226 31418 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:57.787206 25021 catalog_manager.cc:5697] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 13 to 16, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 16 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:57.788829 25021 catalog_manager.cc:5697] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 7 to 15. New cstate: current_term: 15 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:57.790338 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.792883 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:57.802196 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:57.802850 25851 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:57.802215 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:57.803871 25858 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:57.793953 30797 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.779072 31100 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.805227 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.797782 31300 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.807695 25165 leader_election.cc:304] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:57.782197 30850 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.810520 25125 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:57.812659 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:57.813879 31303 raft_consensus.cc:2749] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:57.818985 30797 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.822518 30797 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.780668 31187 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.801477 31418 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:21:57.828748 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 51595.9us
I20260709 12:21:57.830520 25122 raft_consensus.cc:2468] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:21:57.830801 31346 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:57.838452 31346 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:57.838876 31346 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:57.842226 31418 raft_consensus.cc:697] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:57.843369 31418 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.829753 31396 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 12:21:57.853279 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 54735.5us
W20260709 12:21:57.854982 31473 log.cc:927] Time spent T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:21:57.856353 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.856562 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.857039 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb65a99b5c44038087d76d815e3abf" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.857784 25857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.859259 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.852926 31187 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.807020 31375 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:57.851325 31297 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.870069 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.872987 25854 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:21:57.873333 25854 pending_rounds.cc:85] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Aborting all ops after (but not including) 12
I20260709 12:21:57.873603 25854 pending_rounds.cc:107] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:21:57.873855 25854 raft_consensus.cc:2889] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:57.866307 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.882038 25124 raft_consensus.cc:1813] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Handling vote request from an unknown peer b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:21:57.882339 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 155974us
I20260709 12:21:57.882723 25853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.888513 25124 raft_consensus.cc:2410] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:21:57.879307 31100 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.895996 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.898486 25196 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:57.890614 31160 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.901248 31160 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.903471 31160 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.908087 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.917214 25127 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:21:57.917264 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.917695 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.917995 25855 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 18.
I20260709 12:21:57.918406 25125 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
W20260709 12:21:57.918704 30819 consensus_meta.cc:287] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: Time spent flushing consensus metadata: real 0.581s	user 0.003s	sys 0.011s
I20260709 12:21:57.919307 30819 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.921365 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.921965 25121 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:21:57.927642 25851 raft_consensus.cc:2468] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:21:57.929334 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.932109 31297 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.929426 25021 catalog_manager.cc:5697] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 14 to 15, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 15 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:57.934755 25092 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:57.935582 31441 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:57.936892 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:57.938184 30797 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:57.933544 30819 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.940256 31100 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:57.942572 31100 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.940078 25021 catalog_manager.cc:5697] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:57.946676 25021 catalog_manager.cc:5697] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 9 to 10, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 10 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:57.951929 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:57.952224 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:57.959014 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:57.958678 25021 catalog_manager.cc:5697] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: term changed from 10 to 14, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 14 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:21:57.959570 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:57.960314 25125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e78737bee66450b9a076cc9676331b9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:57.951368 31100 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:57.965430 31187 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:57.968299 25196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:57.969141 25196 raft_consensus.cc:606] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:57.969484 25196 raft_consensus.cc:614] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:57.954689 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:57.955118 25241 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
W20260709 12:21:57.971433 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 44064.9us
I20260709 12:21:57.975543 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.984081 25858 raft_consensus.cc:2468] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
I20260709 12:21:57.986956 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:57.991796 25092 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.001459 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.003917 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.004324 31440 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:58.004799 31440 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.004859 25198 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:21:58.005242 31440 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:58.006763 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258fe130eb914f5b858baf4782663574" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.007997 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8512157f7e4dcc8a59428a2ccbd2a8" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.008430 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:57.997044 30986 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:21:58.012183 25856 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:58.012670 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:58.014690 25092 leader_election.cc:304] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.025079 25092 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.030704 25195 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:21:58.036217 31130 raft_consensus.cc:2749] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:58.040833 25193 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:58.042002 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.042102 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.026981 30986 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:58.059006 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.060896 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:57.997308 31396 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 12:21:58.070133 25823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.072499 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:58.076092 25124 raft_consensus.cc:1240] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:58.049515 31130 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:58.073140 25121 raft_consensus.cc:2376] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14. Re-sending same reply.
I20260709 12:21:58.078855 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:58.049077 31357 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:58.053427 31368 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:58.096635 31300 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.139729 25168 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:58.148933 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:58.155081 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.155467 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:58.158743 25195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.161343 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:58.163393 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:58.113323 31357 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:58.170773 25123 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:21:58.175319 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:58.175891 25196 raft_consensus.cc:1240] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:58.185181 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552726c022345b394b69265b8f3b566" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.169234 31366 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:58.198899 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
W20260709 12:21:58.199205 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 59587.3us
I20260709 12:21:58.190821 31418 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:58.209151 31396 raft_consensus.cc:493] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:58.209981 31396 raft_consensus.cc:515] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.213006 31396 leader_election.cc:290] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.215689 25194 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:58.216099 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.217281 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.218312 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.218500 31375 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:58.219036 31343 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:58.219352 25196 raft_consensus.cc:2410] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:21:58.218379 25242 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.220599 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.221181 31160 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:58.221253 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:58.222596 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb0b452100949b58ad2bf4a4aed36fa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:58.222971 31160 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:58.221769 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:58.223465 31160 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:58.223552 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cdcb70b0d4499b94b2f51672f6895" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:58.223804 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.226316 31321 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:58.226938 25268 raft_consensus.cc:1240] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:58.223466 25124 raft_consensus.cc:2410] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:21:58.246491 31357 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:58.250725 31312 consensus_queue.cc:1059] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:58.249786 25118 raft_consensus.cc:2955] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 3 to 8, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:58.253285 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.254419 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.255205 25201 raft_consensus.cc:2393] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 12: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:58.259721 25122 raft_consensus.cc:1240] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:58.270198 25856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:58.277590 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.283478 25201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.286298 25168 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:58.287681 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:58.288170 25858 raft_consensus.cc:1240] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 18. Current term is 19. Ops: [16.11-18.12]
I20260709 12:21:58.288723 25202 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:58.289307 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:58.260874 31090 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:58.292137 25855 raft_consensus.cc:1240] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:21:58.256330 31346 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.296344 25093 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.302413 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.284601 31300 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:58.284750 31311 raft_consensus.cc:493] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:21:58.254406 31160 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.309384 25165 leader_election.cc:304] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.305544 25167 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:58.313513 25093 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.315486 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:58.318815 30850 raft_consensus.cc:2804] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:58.319375 30850 raft_consensus.cc:697] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:58.319832 31328 raft_consensus.cc:3055] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:58.320259 31328 raft_consensus.cc:740] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:58.320358 30850 consensus_queue.cc:237] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.322089 31300 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.323947 25194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.324278 31300 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.267840 31440 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.326937 31440 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.327422 25276 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:21:58.328785 25199 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:58.312516 25167 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:58.309386 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:58.310150 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:58.330708 25093 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.331130 25858 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.310438 30797 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:58.332232 30797 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:58.332597 30797 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:58.314999 31312 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:58.301622 31418 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:58.340147 31297 raft_consensus.cc:2804] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:58.339980 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:58.340643 31311 raft_consensus.cc:515] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.341166 25197 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 13.
I20260709 12:21:58.343143 31311 leader_election.cc:290] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.344645 31311 consensus_queue.cc:1059] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:58.345929 31357 raft_consensus.cc:3055] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:58.346302 31357 raft_consensus.cc:740] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:58.347203 31357 consensus_queue.cc:260] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:58.348805 31357 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:58.355234 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.356205 31418 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:58.357432 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 71224.2us
I20260709 12:21:58.357954 31312 consensus_queue.cc:1059] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:58.359169 31489 raft_consensus.cc:3055] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:58.359364 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:58.359560 31489 raft_consensus.cc:740] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:58.360425 31489 consensus_queue.cc:260] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.363708 31366 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:58.350260 31187 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:58.364629 31160 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.363560 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.366653 31346 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.366830 31100 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:58.367271 31100 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:58.367614 31100 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:58.367877 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:58.371052 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:58.351521 31300 raft_consensus.cc:2749] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:58.372150 25168 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.375263 25168 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.378345 25858 raft_consensus.cc:2468] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:21:58.377552 25825 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:58.381359 30797 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.386746 25168 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:58.395308 25268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:58.397218 30797 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.399221 25242 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.401362 25825 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:21:58.414463 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 100470us
I20260709 12:21:58.380379 31396 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:58.383883 31346 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:58.321116 31328 consensus_queue.cc:260] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.403669 25242 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.433422 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:58.392876 31297 raft_consensus.cc:697] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:58.397984 31312 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:58.444689 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 114061us
I20260709 12:21:58.453814 25199 raft_consensus.cc:2393] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 18: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:21:58.454252 25200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
W20260709 12:21:58.454588 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 50993.5us
W20260709 12:21:58.459836 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 73183.3us
W20260709 12:21:58.454082 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 70078.4us
I20260709 12:21:58.461560 25168 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.461004 25167 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:58.468189 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.453588 31148 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:58.445298 31346 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:58.459578 31409 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:58.462559 31300 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:58.439611 31329 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:21:58.494254 25267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:58.464690 31311 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:58.522411 31311 raft_consensus.cc:2804] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:58.504863 31297 consensus_queue.cc:237] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.505708 31328 raft_consensus.cc:3060] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:58.479236 31366 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:21:58.482208 30986 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:58.476357 31266 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:58.482352 31346 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:58.508405 25276 raft_consensus.cc:1240] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:58.508589 31300 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:58.508463 31496 raft_consensus.cc:2804] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:58.514309 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:58.497336 25093 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.518198 31441 consensus_queue.cc:1059] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:21:58.499271 25012 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer b83c12959b9848b3b7bbc680f5ee6225 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 17 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:21:58.497143 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 53406.5us
I20260709 12:21:58.487604 31409 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:21:58.553546 25825 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:21:58.542578 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 79666.9us
I20260709 12:21:58.545495 25858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:58.553913 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:58.546265 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bde194ca9e544f1befacd3ad39463a2" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:58.551398 25198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:58.555255 25198 raft_consensus.cc:606] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:58.555640 25198 raft_consensus.cc:614] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:58.560573 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 63347.8us
W20260709 12:21:58.563761 25012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 108216us
I20260709 12:21:58.543452 31311 raft_consensus.cc:697] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:58.567711 25093 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.552578 31300 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:21:58.614431 31484 log.cc:927] Time spent T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:21:58.564280 31441 consensus_queue.cc:1243] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Peer b83c12959b9848b3b7bbc680f5ee6225 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:21:58.556757 31409 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:58.618171 31497 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:58.566951 31494 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:58.648442 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
W20260709 12:21:58.649755 31486 log.cc:927] Time spent T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 12:21:58.650640 31499 log.cc:927] Time spent T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:21:58.652290 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 84653.8us
I20260709 12:21:58.682333 25122 raft_consensus.cc:2393] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 18: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
W20260709 12:21:58.656787 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 90130.3us
I20260709 12:21:58.666663 31311 consensus_queue.cc:237] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.667611 31489 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:58.668709 31346 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.693059 31187 raft_consensus.cc:3055] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:58.693470 31187 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:58.694264 31187 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.695441 31187 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.651929 30986 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:58.698297 31300 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.700212 31130 raft_consensus.cc:3055] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:58.677621 25092 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.708686 25198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:58.683224 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.709306 25198 raft_consensus.cc:606] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:21:58.709724 25198 raft_consensus.cc:614] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:58.710618 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.681304 25093 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.712893 25092 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:58.683921 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 249603us
I20260709 12:21:58.688300 31496 raft_consensus.cc:697] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:58.713178 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.718170 30986 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:58.718634 31266 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:58.718221 25824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.719429 31329 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:58.704350 31346 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.720700 31496 consensus_queue.cc:237] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.721907 31329 consensus_queue.cc:1059] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:58.722600 30986 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:58.689235 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 135932us
I20260709 12:21:58.690896 31100 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.700515 31300 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.727826 25165 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.733778 25198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:21:58.735050 25198 raft_consensus.cc:606] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:21:58.732314 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:58.700642 31130 raft_consensus.cc:740] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:58.733379 30986 consensus_queue.cc:1059] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:21:58.740123 31502 consensus_queue.cc:1059] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:21:58.728983 31497 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:58.741387 31100 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 20 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.742419 25860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
W20260709 12:21:58.771865 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 44319.2us
I20260709 12:21:58.742576 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff71ed0aef74f1f963b143876c9b3d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:58.681221 31396 consensus_queue.cc:1059] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:21:58.743244 31498 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:58.676855 31432 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:21:58.745069 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960cba74c5c0438f9a3d8e25d8dec7ad" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:58.716747 31503 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:58.795890 31508 log.cc:927] Time spent T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:21:58.751380 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f120f7a3d32426ab1243e87fe0194ac" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:58.796721 25120 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:58.751439 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:58.755543 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:58.756170 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7e49fd52d74821a66c7dbbc770a988" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:58.758008 25121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:58.776367 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:58.798015 25127 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:58.779341 25860 raft_consensus.cc:1240] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:58.769750 31497 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:58.729184 31494 consensus_queue.cc:1059] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:21:58.780558 31495 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:58.821897 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:58.824399 25202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:58.826401 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:58.736804 31346 consensus_queue.cc:1059] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:21:58.827515 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.833992 25092 leader_election.cc:304] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.841714 25201 raft_consensus.cc:1240] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Rejecting Update request from peer 897be935c42e41b995f177155b042be0 for earlier term 12. Current term is 13. Ops: []
W20260709 12:21:58.829205 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 64178.8us
I20260709 12:21:58.849337 25167 leader_election.cc:304] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.850570 25167 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:21:58.853271 25202 raft_consensus.cc:1240] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:58.828429 31300 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:21:58.856305 25196 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: []
W20260709 12:21:58.861223 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 116912us
I20260709 12:21:58.865906 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.869825 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:58.871064 31506 raft_consensus.cc:3055] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:58.871547 31506 raft_consensus.cc:740] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:58.872510 31506 consensus_queue.cc:260] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:58.855785 31366 raft_consensus.cc:2749] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:58.862727 31496 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:58.859223 30850 raft_consensus.cc:2749] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:58.856011 31418 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:58.880426 25859 raft_consensus.cc:2468] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 18.
I20260709 12:21:58.867571 31300 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.884487 31300 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.885937 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:21:58.891819 31514 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:58.893011 31492 raft_consensus.cc:3055] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:58.876173 31506 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:58.904747 25093 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.931324 31368 raft_consensus.cc:2749] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:21:58.933271 31187 consensus_queue.cc:1059] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:58.934055 31187 consensus_queue.cc:1243] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [LEADER]: Peer b83c12959b9848b3b7bbc680f5ee6225 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:21:58.905743 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 58845us
I20260709 12:21:58.906253 25127 raft_consensus.cc:2468] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
W20260709 12:21:58.906741 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 70100.5us
W20260709 12:21:58.893764 31357 consensus_meta.cc:287] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: Time spent flushing consensus metadata: real 0.544s	user 0.015s	sys 0.001s
I20260709 12:21:58.910835 25855 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:58.915117 31409 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.946363 25123 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
W20260709 12:21:58.957046 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 134266us
I20260709 12:21:58.960552 25092 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:58.960815 25241 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:21:58.964236 30819 consensus_queue.cc:1059] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:58.965266 31409 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:21:58.965938 25272 raft_consensus.cc:1240] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:58.967065 31514 raft_consensus.cc:2804] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:58.967613 31514 raft_consensus.cc:697] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:58.968525 31514 consensus_queue.cc:237] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.895318 31492 raft_consensus.cc:740] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:58.971282 31492 consensus_queue.cc:260] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:58.972632 31492 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:58.976042 31369 raft_consensus.cc:3055] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:58.976485 31369 raft_consensus.cc:740] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:21:58.976999 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:21:58.977461 30986 raft_consensus.cc:3055] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:58.978175 25275 raft_consensus.cc:1240] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Rejecting Update request from peer b83c12959b9848b3b7bbc680f5ee6225 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:21:58.981909 30819 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:21:58.984472 25090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 145230us
I20260709 12:21:58.992092 25852 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:21:58.980100 30986 raft_consensus.cc:740] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
W20260709 12:21:59.002249 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 105914us
I20260709 12:21:59.003705 31495 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:59.006100 30986 consensus_queue.cc:260] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:59.007738 30986 raft_consensus.cc:3060] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:58.987895 31502 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:21:59.012607 31130 consensus_queue.cc:260] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:59.021837 31369 consensus_queue.cc:260] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:59.023592 31369 raft_consensus.cc:3060] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.024727 31130 raft_consensus.cc:3060] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:59.040169 31497 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:59.048484 31497 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:59.072739 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:59.076247 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:59.078290 31500 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:21:59.079593 25168 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:59.080960 25168 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:21:59.081522 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 78551us
I20260709 12:21:59.089425 25168 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:21:59.090255 31357 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:21:59.090693 31346 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:21:59.134255 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 44922.3us
I20260709 12:21:59.136612 25855 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:21:59.137799 25168 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:21:59.136443 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 53000.5us
I20260709 12:21:59.140329 25242 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:21:59.145668 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:21:59.145516 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:59.147941 25118 raft_consensus.cc:1275] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:21:59.148324 25118 pending_rounds.cc:85] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Aborting all ops after (but not including) 11
I20260709 12:21:59.148538 25118 pending_rounds.cc:107] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:21:59.148795 25118 raft_consensus.cc:2889] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:59.147578 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:59.150969 31518 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:59.153316 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:59.153924 31406 consensus_queue.cc:1059] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:59.154794 31406 raft_consensus.cc:3055] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:59.155114 31406 raft_consensus.cc:740] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:59.155405 31495 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:59.155900 31406 consensus_queue.cc:260] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:59.157255 31406 raft_consensus.cc:3060] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:59.146772 31357 raft_consensus.cc:2804] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:59.139644 31519 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:59.159070 31357 raft_consensus.cc:697] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:21:59.160045 31357 consensus_queue.cc:237] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:59.160569 31516 consensus_queue.cc:1059] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:59.161713 31090 raft_consensus.cc:3055] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:59.141801 31346 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:21:59.164057 25854 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:59.162106 31090 raft_consensus.cc:740] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:59.182790 31516 consensus_queue.cc:1059] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:59.177826 31090 consensus_queue.cc:260] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:59.200335 31489 consensus_queue.cc:1059] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:59.200829 31329 raft_consensus.cc:3055] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:59.201359 31329 raft_consensus.cc:740] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:59.208210 25127 raft_consensus.cc:1240] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:59.200889 31090 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:59.210421 31329 consensus_queue.cc:260] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:59.211941 31329 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:59.213482 31266 raft_consensus.cc:3055] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:59.213897 31266 raft_consensus.cc:740] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:21:59.214672 31266 consensus_queue.cc:260] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:59.215819 31266 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:59.216589 31522 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:21:59.224152 25023 catalog_manager.cc:5697] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 13 to 15, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 15 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:59.227507 25023 catalog_manager.cc:5697] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 8 to 14, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 14 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:59.237311 25021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41770 (request call id 330) took 18250 ms (client timeout 15000 ms). Trace:
I20260709 12:21:59.244964 25199 raft_consensus.cc:1240] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Rejecting Update request from peer 4456c1069d1541fab5b7cb29df9b6167 for earlier term 18. Current term is 19. Ops: []
W20260709 12:21:59.246204 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 49115.1us
I20260709 12:21:59.250144 25859 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:59.257349 25123 raft_consensus.cc:1275] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:59.268283 25120 raft_consensus.cc:1275] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:59.269381 25118 raft_consensus.cc:1275] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:21:59.271737 25168 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:21:59.273940 31522 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:59.263262 25021 rpcz_store.cc:269] 0709 12:21:40.949549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.959584 (+ 10035us) service_pool.cc:224] Handling call
0709 12:21:59.199382 (+18239798us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:58.294940 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:58.346874 (+ 51934us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:58.346925 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:21:58.346951 (+    26us) tablet.cc:662] Decoding operations
0709 12:21:58.347998 (+  1047us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:58.348100 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:58.348137 (+    37us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:21:58.349025 (+   888us) tablet.cc:701] Row locks acquired
0709 12:21:58.349078 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:21:58.349274 (+   196us) write_op.cc:270] Start()
0709 12:21:58.349427 (+   153us) write_op.cc:276] Timestamp: P: 1783599718349206 usec, L: 0
0709 12:21:58.349465 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:21:58.370363 (+ 20898us) log.cc:844] Serialized 3632 byte log entry
0709 12:21:58.670264 (+299901us) op_driver.cc:464] REPLICATION: finished
0709 12:21:58.787172 (+116908us) write_op.cc:301] APPLY: starting
0709 12:21:58.787274 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:58.888444 (+101170us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:58.888566 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:59.020284 (+131718us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:59.020613 (+   329us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:21:59.021215 (+   602us) write_op.cc:312] APPLY: finished
0709 12:21:59.021571 (+   356us) log.cc:844] Serialized 89 byte log entry
0709 12:21:59.021772 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:59.021904 (+   132us) write_op.cc:454] Released schema lock
0709 12:21:59.021963 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:59.147943 (+125980us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:59.151442 (+  3499us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5954,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":116621,"apply.run_cpu_time_us":15495,"apply.run_wall_time_us":304528,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41819,"num_ops":9,"prepare.queue_time_us":192820,"prepare.run_cpu_time_us":10239,"prepare.run_wall_time_us":126820,"raft.queue_time_us":152911,"raft.run_cpu_time_us":45438,"raft.run_wall_time_us":109108,"replication_time_us":320629,"thread_start_us":361693,"threads_started":4,"wal-append.queue_time_us":74893}]]}
I20260709 12:21:59.284668 25023 catalog_manager.cc:5697] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:21:59.286954 25023 catalog_manager.cc:5697] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 14 to 17, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 17 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:59.323055 31522 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:21:59.324316 31506 consensus_queue.cc:1048] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:21:59.367367 31346 consensus_queue.cc:1048] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:59.374089 31520 consensus_queue.cc:1048] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:59.358079 31492 consensus_queue.cc:1048] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:21:59.395912 25023 catalog_manager.cc:5697] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 12 to 13, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 13 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:59.434584 25199 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:21:59.444834 31514 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:59.576182 25859 raft_consensus.cc:1275] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:21:59.579314 31375 consensus_queue.cc:1048] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:59.580178 25124 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:21:59.587224 31346 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:59.718593 25859 raft_consensus.cc:1275] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:21:59.723713 31357 consensus_queue.cc:1048] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:59.728953 31375 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:59.729575 31375 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:59.731762 31375 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:59.740867 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:59.741977 25124 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 20: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:59.742695 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:21:59.746690 25199 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 20.
I20260709 12:21:59.750694 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:59.752113 31513 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:59.756785 31513 raft_consensus.cc:493] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:21:59.759541 31513 raft_consensus.cc:3060] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:21:59.802263 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 46531.4us
W20260709 12:21:59.805104 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 49036us
W20260709 12:21:59.881325 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 72570.7us
I20260709 12:21:59.857888 31513 raft_consensus.cc:515] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:21:59.897332 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 86828.3us
I20260709 12:21:59.900014 31513 leader_election.cc:290] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:21:59.904727 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:21:59.903973 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bae455c93a497ca28011bd9cd473ec" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:59.905805 25124 raft_consensus.cc:2393] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 20: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:21:59.912201 31522 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.912889 31522 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:59.916292 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:59.917042 25124 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:21:59.918572 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:21:59.920511 31492 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:59.920955 31492 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.921317 31492 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:59.935276 25193 raft_consensus.cc:2468] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 20.
I20260709 12:21:59.936990 25242 leader_election.cc:304] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:21:59.939406 31375 raft_consensus.cc:2804] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:21:59.939522 31522 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:59.939957 31375 raft_consensus.cc:697] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:21:59.940881 31375 consensus_queue.cc:237] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:59.941336 31329 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.941923 31329 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:21:59.945050 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:59.945469 31329 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:59.945765 25275 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:21:59.949422 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:21:59.950198 25127 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:21:59.951380 25825 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:21:59.952428 31329 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:59.952982 31329 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.953411 31329 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:59.959625 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:21:59.969611 31492 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:21:59.976423 31492 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:21:59.978389 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:21:59.979099 25275 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:59.980413 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504eece31eb848cc80169ecf5ab51b9a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:21:59.981038 25124 raft_consensus.cc:3060] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:59.997109 31554 raft_consensus.cc:493] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:00.011118 31160 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:00.027657 31160 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.002686 31554 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.029845 31160 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:22:00.000923 25023 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41752 (request call id 366) took 19151 ms (client timeout 15000 ms). Trace:
I20260709 12:22:00.031351 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:00.032296 25859 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
I20260709 12:22:00.033985 25241 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:22:00.022696 25124 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:22:00.036150 31160 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:00.036660 31160 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:00.036623 25168 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:00.037449 31160 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:00.037784 31554 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:00.038225 31492 raft_consensus.cc:2804] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:00.038812 31492 raft_consensus.cc:697] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:00.039763 31492 consensus_queue.cc:237] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:00.043658 25019 catalog_manager.cc:5697] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.044975 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:00.046463 31160 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:00.031023 25023 rpcz_store.cc:269] 0709 12:21:40.849366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.883346 (+ 33980us) service_pool.cc:224] Handling call
0709 12:22:00.000852 (+19117506us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:59.592574 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:59.593123 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:59.593155 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:21:59.593174 (+    19us) tablet.cc:662] Decoding operations
0709 12:21:59.593829 (+   655us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:59.593910 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:59.593937 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:21:59.654700 (+ 60763us) tablet.cc:701] Row locks acquired
0709 12:21:59.654731 (+    31us) write_op.cc:260] PREPARE: finished
0709 12:21:59.654933 (+   202us) write_op.cc:270] Start()
0709 12:21:59.655103 (+   170us) write_op.cc:276] Timestamp: P: 1783599719654865 usec, L: 0
0709 12:21:59.655138 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:21:59.656022 (+   884us) log.cc:844] Serialized 2084 byte log entry
0709 12:21:59.774057 (+118035us) op_driver.cc:464] REPLICATION: finished
0709 12:21:59.869836 (+ 95779us) write_op.cc:301] APPLY: starting
0709 12:21:59.869925 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:59.874427 (+  4502us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:59.874538 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:59.882907 (+  8369us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:59.883134 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:21:59.883185 (+    51us) write_op.cc:312] APPLY: finished
0709 12:21:59.910099 (+ 26914us) log.cc:844] Serialized 57 byte log entry
0709 12:21:59.910926 (+   827us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:59.911050 (+   124us) write_op.cc:454] Released schema lock
0709 12:21:59.911096 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:59.954195 (+ 43099us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:59.954228 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":95536,"apply.run_cpu_time_us":8037,"apply.run_wall_time_us":67735,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25067,"num_ops":5,"prepare.queue_time_us":140598,"prepare.run_cpu_time_us":4002,"prepare.run_wall_time_us":73666,"replication_time_us":118707,"thread_start_us":239243,"threads_started":2}]]}
I20260709 12:22:00.048418 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:22:00.052563 25123 raft_consensus.cc:2393] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 16: Already voted for candidate 897be935c42e41b995f177155b042be0 in this term.
I20260709 12:22:00.056393 31160 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:00.057428 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:00.035300 25275 raft_consensus.cc:2468] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:22:00.065431 25859 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
I20260709 12:22:00.067351 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:00.068221 25241 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:22:00.068620 25199 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 17: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:22:00.069192 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:22:00.066452 25019 catalog_manager.cc:5697] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:00.077778 31375 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:00.075510 25019 catalog_manager.cc:5697] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: config changed from index 3 to 8, VOTER b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) evicted. New cstate: current_term: 11 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.080170 31375 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:22:00.081179 31375 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.086972 25019 catalog_manager.cc:5697] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 13 to 14, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 14 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:00.093010 25019 catalog_manager.cc:5697] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 13 to 14, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 14 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.096805 25019 catalog_manager.cc:5697] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.085862 31329 raft_consensus.cc:515] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.104219 25852 raft_consensus.cc:2368] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:22:00.107090 25241 leader_election.cc:400] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:22:00.107440 25241 leader_election.cc:403] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:00.108069 31160 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:22:00.101184 25019 catalog_manager.cc:5697] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 17 to 18, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 18 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:00.115061 25019 catalog_manager.cc:5697] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:00.116671 31160 raft_consensus.cc:2749] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 16. Current term is 17.
I20260709 12:22:00.116888 25019 catalog_manager.cc:5697] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 15 to 17, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 17 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:00.125870 25019 catalog_manager.cc:5697] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 13 to 16, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 16 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.126935 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:22:00.127668 25124 raft_consensus.cc:3060] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:00.127871 25019 catalog_manager.cc:5697] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 13 to 19, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 19 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.128690 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b13f2e891f348229e95286682b88911" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:00.130538 31329 leader_election.cc:290] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:00.129801 25019 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.139854 25019 catalog_manager.cc:5697] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:00.141366 25124 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:22:00.141456 25019 catalog_manager.cc:5697] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.142781 25825 leader_election.cc:304] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:22:00.143728 31555 raft_consensus.cc:2804] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:00.144423 31555 raft_consensus.cc:697] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:22:00.143669 25019 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 14 to 15, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 15 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.145342 31555 consensus_queue.cc:237] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.150604 25269 raft_consensus.cc:2468] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:22:00.156023 31495 raft_consensus.cc:493] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:00.156665 31495 raft_consensus.cc:515] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.153157 25019 catalog_manager.cc:5697] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 10 to 11, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 11 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:00.160676 25019 catalog_manager.cc:5697] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 13 to 14, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 14 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:00.162638 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:00.164022 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:22:00.163337 31495 leader_election.cc:290] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:00.166507 25168 leader_election.cc:304] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:22:00.166826 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f471cfad2348a09c4b699f01f9dfa9" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:00.167719 31495 raft_consensus.cc:2749] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:00.278924 31555 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:00.279606 31555 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.280673 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:00.282999 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:00.283672 25193 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 19.
I20260709 12:22:00.283778 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:00.284654 25269 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 19: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:22:00.285902 31555 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:00.289688 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:22:00.291087 31555 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:00.291535 31555 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:00.291972 31555 raft_consensus.cc:3060] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:00.307400 31555 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.311619 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:22:00.320137 31555 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:00.324029 31555 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.324666 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:00.324641 31555 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.325695 25269 raft_consensus.cc:2393] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 19: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:22:00.336745 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:00.341836 25124 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:22:00.354292 25193 raft_consensus.cc:2468] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 19.
I20260709 12:22:00.356686 25825 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:22:00.357216 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:00.357923 25269 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:22:00.363219 25822 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:00.356489 31513 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:22:00.377099 31556 raft_consensus.cc:2804] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:00.377753 31556 raft_consensus.cc:697] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:22:00.368741 30797 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:00.378345 30797 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.378705 31556 consensus_queue.cc:237] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.383157 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:00.384074 25193 raft_consensus.cc:2393] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 20: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:22:00.384117 30797 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:00.387383 31329 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:00.362191 31555 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:00.387866 31329 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.388284 31329 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:00.416314 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 53215.9us
I20260709 12:22:00.425287 31329 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.415674 31492 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:00.431424 31329 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:00.431157 31492 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:00.438560 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 81963.3us
I20260709 12:22:00.440698 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:00.441352 25275 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:00.446888 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:22:00.447611 25196 raft_consensus.cc:3060] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:22:00.456120 25275 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:22:00.458503 25822 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:22:00.460763 31492 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:00.461645 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:00.462452 25852 raft_consensus.cc:2368] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15.
I20260709 12:22:00.464177 25167 leader_election.cc:400] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15.
I20260709 12:22:00.464457 25167 leader_election.cc:403] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:00.454860 31520 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.467664 25196 raft_consensus.cc:2468] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:22:00.471278 31329 raft_consensus.cc:2804] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:00.471916 31329 raft_consensus.cc:697] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:22:00.472954 31329 consensus_queue.cc:237] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.468288 31492 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401) with higher term. Message: Invalid argument: T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15.
I20260709 12:22:00.479382 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:00.480314 25852 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 20.
I20260709 12:22:00.488826 25092 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:00.491421 30797 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:00.491520 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:00.491976 30797 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:00.492412 25275 raft_consensus.cc:2368] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15.
I20260709 12:22:00.492482 30797 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:00.504179 25165 leader_election.cc:400] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749) with higher term. Message: Invalid argument: T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for earlier term 14. Current term is 15.
I20260709 12:22:00.507660 25275 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:22:00.513252 25859 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:22:00.466355 31520 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.524598 31495 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:00.532527 30797 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.546006 30797 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:00.551473 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:00.563735 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:22:00.564581 25196 raft_consensus.cc:2393] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 897be935c42e41b995f177155b042be0 in current term 20: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:22:00.530357 31160 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:22:00.592836 31520 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:00.593930 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:00.603094 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:00.603787 25852 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:22:00.608006 25193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:22:00.608618 25193 raft_consensus.cc:606] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:22:00.609768 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:22:00.611035 31495 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:00.611429 31495 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.611802 31495 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:00.624218 25124 raft_consensus.cc:1275] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:22:00.627507 25193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:22:00.628203 25193 raft_consensus.cc:606] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:22:00.628618 25193 raft_consensus.cc:614] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:00.589278 25859 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 20.
I20260709 12:22:00.639413 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet f1f471cfad2348a09c4b699f01f9dfa9 with delete_type TABLET_DATA_TOMBSTONED (TS b83c12959b9848b3b7bbc680f5ee6225 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:36418
I20260709 12:22:00.643042 31492 consensus_queue.cc:1048] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:00.645200 25193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:22:00.645893 25193 raft_consensus.cc:606] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:22:00.646325 25193 raft_consensus.cc:614] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:00.629693 25019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33480 (request call id 274) took 1647 ms. Trace:
I20260709 12:22:00.646286 25092 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:00.655542 25124 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:00.654469 30986 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:00.682291 30986 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 20 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:22:00.687948 25196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0821374625d4793801ab3b3f502714e"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:22:00.688591 25196 raft_consensus.cc:606] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Received request to transfer leadership to TS 2e30bdd4cd1b45299f50b9bcfc9c1667
I20260709 12:22:00.688946 25196 raft_consensus.cc:614] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:00.678685 25022 catalog_manager.cc:5697] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 16 to 17, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 17 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:22:00.661329 31563 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:22:00.699047 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:00.697409 25022 catalog_manager.cc:5697] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 17 to 20, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 20 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:22:00.700412 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:00.705148 30986 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.711233 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:00.717962 25022 catalog_manager.cc:5697] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:00.720248 25022 catalog_manager.cc:5697] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 12 to 14, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 14 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.722267 25022 catalog_manager.cc:5697] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 11 to 12, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 12 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:00.724004 25022 catalog_manager.cc:5697] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.726606 25022 catalog_manager.cc:5697] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 15 to 19, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 19 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.729063 25022 catalog_manager.cc:5697] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 15 to 17, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 17 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:00.730820 31576 tablet_replica.cc:333] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:00.731190 25022 catalog_manager.cc:5697] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 15 to 16, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 16 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:22:00.732110 31576 raft_consensus.cc:2243] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:00.733224 31576 raft_consensus.cc:2272] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:00.732712 25022 catalog_manager.cc:5697] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:22:00.738842 25022 catalog_manager.cc:5697] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:22:00.711092 31495 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.757700 31576 ts_tablet_manager.cc:1916] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:22:00.771428 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 83197.4us
I20260709 12:22:00.775835 25196 raft_consensus.cc:1240] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Rejecting Update request from peer 2e30bdd4cd1b45299f50b9bcfc9c1667 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:00.781497 25193 raft_consensus.cc:1275] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:22:00.782524 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:00.741101 25022 catalog_manager.cc:5697] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 10 to 11, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 11 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
W20260709 12:22:00.792490 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 102713us
I20260709 12:22:00.813287 25022 catalog_manager.cc:5697] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:22:00.827283 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:00.791549 31569 consensus_queue.cc:1059] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:22:00.826982 31495 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:00.829476 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:22:00.843706 31160 raft_consensus.cc:493] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.847640 25274 raft_consensus.cc:1275] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:00.854458 25022 catalog_manager.cc:5697] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
W20260709 12:22:00.853060 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 60280.1us
I20260709 12:22:00.857880 31583 consensus_queue.cc:1048] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:22:00.863693 31569 raft_consensus.cc:3055] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:00.864135 31569 raft_consensus.cc:740] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:22:00.865428 25022 catalog_manager.cc:5697] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 14 to 15, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 15 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
W20260709 12:22:00.872607 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 43781.5us
I20260709 12:22:00.649911 25019 rpcz_store.cc:276] 0709 12:21:58.981786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.982008 (+   222us) service_pool.cc:224] Handling call
0709 12:22:00.629606 (+1647598us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:00.219511 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:00.220109 (+   598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:00.220148 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:22:00.220171 (+    23us) tablet.cc:662] Decoding operations
0709 12:22:00.227973 (+  7802us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:00.228060 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:00.228102 (+    42us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:22:00.229549 (+  1447us) tablet.cc:701] Row locks acquired
0709 12:22:00.229572 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:22:00.229741 (+   169us) write_op.cc:270] Start()
0709 12:22:00.229867 (+   126us) write_op.cc:276] Timestamp: P: 1783599720229684 usec, L: 0
0709 12:22:00.229892 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:22:00.230643 (+   751us) log.cc:844] Serialized 6728 byte log entry
0709 12:22:00.248737 (+ 18094us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b18004aa4c0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2109ce9ab1 00007f2109cf6281 00007f210794541d 00007f210794771a 00007f21079476a8 00007f2107947628 00007f21079475e3 00007f21079467fc 00007f2109d792f6 00007f2109d73aa8 00007f2103f1a310
0709 12:22:00.248804 (+    67us) op_driver.cc:464] REPLICATION: finished
0709 12:22:00.250242 (+  1438us) write_op.cc:301] APPLY: starting
0709 12:22:00.250340 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:00.316112 (+ 65772us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:00.316142 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:00.557116 (+240974us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:00.589095 (+ 31979us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:22:00.589141 (+    46us) write_op.cc:312] APPLY: finished
0709 12:22:00.589486 (+   345us) log.cc:844] Serialized 156 byte log entry
0709 12:22:00.589745 (+   259us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:00.589974 (+   229us) write_op.cc:454] Released schema lock
0709 12:22:00.590078 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:00.590536 (+   458us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:00.590592 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8915,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":131,"apply.run_cpu_time_us":28651,"apply.run_wall_time_us":340259,"cfile_cache_hit":68,"cfile_cache_hit_bytes":71196,"num_ops":17,"prepare.queue_time_us":12130,"prepare.run_cpu_time_us":5288,"prepare.run_wall_time_us":22825,"replication_time_us":13194,"spinlock_wait_cycles":6610304,"thread_start_us":20067,"threads_started":1}]]}
I20260709 12:22:00.870476 31160 raft_consensus.cc:515] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:00.874399 31569 consensus_queue.cc:260] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:00.923523 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 94117.9us
W20260709 12:22:00.925134 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 49425.9us
I20260709 12:22:00.923902 31329 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.922300 31588 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:00.934508 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:00.929028 31569 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:00.928692 31160 leader_election.cc:290] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:22:00.952517 31579 log.cc:927] Time spent T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 12:22:00.958094 31594 consensus_queue.cc:1048] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:22:00.933799 31329 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:01.007781 25120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:22:01.008682 25120 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:22:01.011742 31329 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:01.041438 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:22:01.049436 31563 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:01.068354 31563 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:01.068790 31563 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:01.084117 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 157327us
I20260709 12:22:01.087139 25199 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:22:01.089072 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:01.090777 31568 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.087447 25196 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:01.084498 31576 ts_tablet_manager.cc:1929] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.7
I20260709 12:22:01.102710 31576 log.cc:1199] T f1f471cfad2348a09c4b699f01f9dfa9 P b83c12959b9848b3b7bbc680f5ee6225: Deleting WAL directory at /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/wals/f1f471cfad2348a09c4b699f01f9dfa9
I20260709 12:22:01.091404 31568 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:01.114702 31568 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:01.115845 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0" is_pre_election: true
I20260709 12:22:01.115962 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff47c111f89a444a9c5a1794454f0789" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:01.116299 25193 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:22:01.116525 25124 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:22:01.116811 25199 raft_consensus.cc:2410] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:22:01.119401 25168 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:01.123376 31587 raft_consensus.cc:993] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:22:01.123875 31492 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:01.124329 31492 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:01.124672 31492 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:01.124693 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:01.125063 31587 raft_consensus.cc:1081] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Signalling peer 2e30bdd4cd1b45299f50b9bcfc9c1667 to start an election
I20260709 12:22:01.127552 25274 raft_consensus.cc:1275] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:22:01.130208 25274 raft_consensus.cc:1275] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:01.138717 31562 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:01.141069 31594 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:22:01.145089 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet f1f471cfad2348a09c4b699f01f9dfa9 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:22:01.146449 31591 consensus_queue.cc:1048] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:01.147931 31555 consensus_queue.cc:1048] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:01.149363 25272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
 from {username='slave'} at 127.0.0.1:40096
I20260709 12:22:01.150090 25272 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:01.150485 25272 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:01.137496 31492 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:01.164032 25242 leader_election.cc:304] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:01.174881 31554 raft_consensus.cc:2749] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:01.179481 25272 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:01.192281 25272 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:01.196424 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:22:01.205603 25124 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:01.209400 25193 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:22:01.212126 25124 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 20.
I20260709 12:22:01.213201 25242 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:22:01.216236 31571 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:22:01.219632 31563 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:01.221596 25859 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 17: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:22:01.225384 25855 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:22:01.226513 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:22:01.227351 25124 raft_consensus.cc:3060] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:01.233285 31513 raft_consensus.cc:2804] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:01.251760 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:22:01.252388 25199 raft_consensus.cc:3055] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:01.252689 25199 raft_consensus.cc:740] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:01.254324 25124 raft_consensus.cc:2468] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:22:01.256778 25825 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:22:01.258153 31594 raft_consensus.cc:2804] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:01.258642 31594 raft_consensus.cc:697] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:22:01.259524 31594 consensus_queue.cc:237] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:01.253540 25199 consensus_queue.cc:260] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:01.270339 25199 raft_consensus.cc:3060] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:01.278699 25199 raft_consensus.cc:2468] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 20.
I20260709 12:22:01.293457 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:22:01.247321 31574 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 12:22:01.294431 25196 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 17: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:22:01.290239 31563 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:01.311170 31492 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:01.294975 31513 raft_consensus.cc:697] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 LEADER]: Becoming Leader. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:22:01.316170 31513 consensus_queue.cc:237] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:01.322131 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:22:01.323204 25124 raft_consensus.cc:2393] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 17: Already voted for candidate 4456c1069d1541fab5b7cb29df9b6167 in this term.
I20260709 12:22:01.325697 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:01.333105 25167 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:22:01.339818 31608 log.cc:927] Time spent T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:22:01.349221 31605 log.cc:927] Time spent T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:22:01.334782 31592 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:22:01.560055 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 48785.8us
I20260709 12:22:01.594141 25019 catalog_manager.cc:5697] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 18 to 19, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 19 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:01.596319 25019 catalog_manager.cc:5697] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 12 to 15, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 15 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:01.598529 25019 catalog_manager.cc:5697] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 16 to 19, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 19 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:01.632259 25019 catalog_manager.cc:5697] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:01.678905 25019 catalog_manager.cc:5697] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 17 to 18, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 18 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:01.680962 25019 catalog_manager.cc:5697] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 18 to 19, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 19 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:01.682854 25019 catalog_manager.cc:5697] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:01.684598 25019 catalog_manager.cc:5697] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:01.699378 25019 catalog_manager.cc:5697] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:01.701258 25019 catalog_manager.cc:5697] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 12 to 13, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 13 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:01.703367 25019 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 16 to 17, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 17 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:01.705085 25019 catalog_manager.cc:5697] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:01.722702 25191 tablet_service.cc:1558] Processing DeleteTablet for tablet f1f471cfad2348a09c4b699f01f9dfa9 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:36418
I20260709 12:22:01.729573 25022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41756 (request call id 378) took 9388 ms. Trace:
I20260709 12:22:01.737300 25123 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:22:01.739027 31513 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:01.740832 25012 catalog_manager.cc:5028] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): tablet f1f471cfad2348a09c4b699f01f9dfa9 (table test-workload [id=4687ac69adb14a54936903f246a05431]) successfully deleted
I20260709 12:22:01.736757 25022 rpcz_store.cc:276] 0709 12:21:52.340883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.341076 (+   193us) service_pool.cc:224] Handling call
0709 12:22:01.729446 (+9388370us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:01.050844 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:01.051405 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:01.051444 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:22:01.051463 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:01.052741 (+  1278us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:01.052802 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:01.052835 (+    33us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:22:01.053914 (+  1079us) tablet.cc:701] Row locks acquired
0709 12:22:01.053933 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:22:01.061393 (+  7460us) write_op.cc:270] Start()
0709 12:22:01.063722 (+  2329us) write_op.cc:276] Timestamp: P: 1783599721061043 usec, L: 0
0709 12:22:01.064586 (+   864us) op_driver.cc:348] REPLICATION: starting
0709 12:22:01.080686 (+ 16100us) log.cc:844] Serialized 5956 byte log entry
0709 12:22:01.235591 (+154905us) op_driver.cc:464] REPLICATION: finished
0709 12:22:01.337781 (+102190us) write_op.cc:301] APPLY: starting
0709 12:22:01.354816 (+ 17035us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:01.456205 (+101389us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:01.456353 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:01.568614 (+112261us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:01.568944 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:22:01.569005 (+    61us) write_op.cc:312] APPLY: finished
0709 12:22:01.569439 (+   434us) log.cc:844] Serialized 139 byte log entry
0709 12:22:01.569651 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:01.569858 (+   207us) write_op.cc:454] Released schema lock
0709 12:22:01.569925 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:01.572101 (+  2176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:01.572133 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":382,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":101910,"apply.run_cpu_time_us":22683,"apply.run_wall_time_us":234289,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66947,"num_ops":15,"prepare.queue_time_us":106701,"prepare.run_cpu_time_us":4826,"prepare.run_wall_time_us":30164,"replication_time_us":170807,"thread_start_us":199143,"threads_started":2}]]}
I20260709 12:22:01.771212 25198 raft_consensus.cc:1275] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Refusing update from remote peer 2e30bdd4cd1b45299f50b9bcfc9c1667: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:22:01.772838 31575 consensus_queue.cc:1048] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:01.776278 25193 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:01.777841 31562 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:01.816854 25127 raft_consensus.cc:1275] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:01.818535 31562 consensus_queue.cc:1048] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:01.824095 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:01.890321 25020 catalog_manager.cc:5697] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 12 to 14, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 14 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:01.893455 25020 catalog_manager.cc:5697] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:22:01.906625 25020 catalog_manager.cc:5697] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 11 to 15, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 15 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:22:01.942397 25020 catalog_manager.cc:5697] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:02.002293 25019 catalog_manager.cc:5697] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:02.009846 25276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:22:02.010594 25276 raft_consensus.cc:606] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:22:02.014854 25193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
mode: GRACEFUL
new_leader_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:55488
I20260709 12:22:02.015532 25193 raft_consensus.cc:606] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Received request to transfer leadership to TS 897be935c42e41b995f177155b042be0
I20260709 12:22:02.018604 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:02.025240 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:02.004590 25019 catalog_manager.cc:5697] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 19 to 20, leader changed from 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 20 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:02.026175 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:02.061275 25020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41752 (request call id 367) took 3305 ms. Trace:
W20260709 12:22:02.122256 25073 auto_rebalancer.cc:629] Failed to schedule move for tablet 1081a743e5e04f24a0aebd684da3a15d: Illegal state: Replica b83c12959b9848b3b7bbc680f5ee6225 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:22:02.061705 25020 rpcz_store.cc:276] 0709 12:21:58.755699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.761071 (+  5372us) service_pool.cc:224] Handling call
0709 12:22:02.061179 (+3300108us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:01.952904 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:01.953590 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:01.953637 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:22:01.953658 (+    21us) tablet.cc:662] Decoding operations
0709 12:22:01.954424 (+   766us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:01.954492 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:01.954530 (+    38us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:22:01.954990 (+   460us) tablet.cc:701] Row locks acquired
0709 12:22:01.955013 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:22:01.955182 (+   169us) write_op.cc:270] Start()
0709 12:22:01.955318 (+   136us) write_op.cc:276] Timestamp: P: 1783599721955128 usec, L: 0
0709 12:22:01.955345 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:22:01.956084 (+   739us) log.cc:844] Serialized 1702 byte log entry
0709 12:22:01.960749 (+  4665us) op_driver.cc:464] REPLICATION: finished
0709 12:22:01.962306 (+  1557us) write_op.cc:301] APPLY: starting
0709 12:22:01.962392 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:01.964595 (+  2203us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:01.964686 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:01.974486 (+  9800us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:01.974672 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:22:01.974716 (+    44us) write_op.cc:312] APPLY: finished
0709 12:22:01.974938 (+   222us) log.cc:844] Serialized 49 byte log entry
0709 12:22:01.975104 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:01.975205 (+   101us) write_op.cc:454] Released schema lock
0709 12:22:01.975249 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:01.975607 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:01.975640 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31374,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":1060,"apply.run_cpu_time_us":6027,"apply.run_wall_time_us":13257,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16752,"num_ops":4,"prepare.queue_time_us":122,"prepare.run_cpu_time_us":3532,"prepare.run_wall_time_us":8084,"replication_time_us":5247}]]}
I20260709 12:22:02.170661 31591 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:02.171316 31591 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:02.174667 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:02.175499 25198 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 18: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:22:02.180521 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:02.181190 25276 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 18.
I20260709 12:22:02.182542 25822 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:22:02.183362 31562 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:02.183764 31562 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:02.184131 31562 raft_consensus.cc:3060] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:02.186378 31591 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:02.193843 31562 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:02.230265 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:22:02.231120 25198 raft_consensus.cc:2393] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4456c1069d1541fab5b7cb29df9b6167 in current term 18: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:22:02.247165 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:02.266175 31562 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:02.284631 25276 raft_consensus.cc:2468] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 18.
I20260709 12:22:02.295491 25822 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:02.296741 31562 raft_consensus.cc:2804] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:02.297595 31562 raft_consensus.cc:697] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 18 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:22:02.298611 31562 consensus_queue.cc:237] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:02.299508 31580 raft_consensus.cc:993] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:22:02.300045 31580 raft_consensus.cc:1081] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:22:02.305352 25127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41032
I20260709 12:22:02.305970 25127 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:02.306365 25127 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:02.340567 25025 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41770 (request call id 331) took 4171 ms. Trace:
I20260709 12:22:02.341009 25025 rpcz_store.cc:276] 0709 12:21:58.168958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.169174 (+   216us) service_pool.cc:224] Handling call
0709 12:22:02.340501 (+4171327us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9045,"reported_tablets":46}
I20260709 12:22:02.346367 25127 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:02.353328 25127 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:02.353978 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:02.354717 25276 raft_consensus.cc:3055] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:02.355005 25276 raft_consensus.cc:740] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:22:02.356947 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:02.357542 25855 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:02.355507 25276 consensus_queue.cc:260] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:02.364992 25276 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:02.378258 25276 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:22:02.380421 25090 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:22:02.381956 31571 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:02.382472 31571 raft_consensus.cc:697] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:22:02.383325 31571 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:02.395925 25855 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 15.
I20260709 12:22:02.413024 25020 catalog_manager.cc:5697] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 17 to 20, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 20 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:22:02.414757 25025 catalog_manager.cc:5697] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 17 to 18, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 18 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:02.435287 25024 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41752 (request call id 365) took 50334 ms (client timeout 15000 ms). Trace:
W20260709 12:22:02.436439 25024 rpcz_store.cc:269] 0709 12:21:12.123124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.156062 (+ 32938us) service_pool.cc:224] Handling call
0709 12:22:02.434782 (+50278720us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1063643,"reported_tablets":44}
I20260709 12:22:02.438285 25020 catalog_manager.cc:5697] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 19 to 20, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195). New cstate: current_term: 20 leader_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:22:02.441254 25020 catalog_manager.cc:5697] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 15 to 19, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 19 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } }
I20260709 12:22:02.487816 31520 raft_consensus.cc:993] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225: : Instructing follower 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:22:02.488320 31520 raft_consensus.cc:1081] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Signalling peer 897be935c42e41b995f177155b042be0 to start an election
I20260709 12:22:02.495069 25123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b"
dest_uuid: "897be935c42e41b995f177155b042be0"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:22:02.495656 25123 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:02.495985 25123 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:02.509473 25123 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:02.515735 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:22:02.516314 25198 raft_consensus.cc:3055] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:02.516625 25198 raft_consensus.cc:740] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:02.518065 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:02.518617 25855 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:02.517855 25020 catalog_manager.cc:5697] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 14 to 15, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 15 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.517346 25198 consensus_queue.cc:260] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:02.529136 25198 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:02.547816 25123 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:02.552901 25855 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:22:02.554368 25092 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0; no voters: 
I20260709 12:22:02.555887 31521 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:02.556432 31521 raft_consensus.cc:697] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Becoming Leader. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:22:02.557327 31521 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:02.582948 25198 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897be935c42e41b995f177155b042be0 in term 13.
I20260709 12:22:02.612562 25020 catalog_manager.cc:5697] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 reported cstate change: term changed from 12 to 13, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 897be935c42e41b995f177155b042be0 (127.23.81.193). New cstate: current_term: 13 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.642514 31492 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.649238 31492 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:02.651474 31492 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:02.653750 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:02.655402 25276 raft_consensus.cc:2410] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:22:02.656682 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:02.658406 25167 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:22:02.660274 31492 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:02.838302 25855 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:02.840031 31629 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:02.845418 25194 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:22:02.846719 31562 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:02.896409 25276 raft_consensus.cc:1275] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:22:02.898154 31562 consensus_queue.cc:1048] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:02.987375 25272 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:02.989792 31627 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:03.138473 25194 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:03.178087 25855 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:03.179565 31571 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:22:03.237035 25093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 99308.3us
I20260709 12:22:03.258291 31571 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:03.347076 25124 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:22:03.350750 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:03.363108 25272 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:22:03.363719 25092 consensus_peers.cc:597] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 -> Peer 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401): Couldn't send request to peer 4456c1069d1541fab5b7cb29df9b6167. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 155471b361b441c095eae34b64eb0bed. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:03.365445 31651 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:03.370500 25193 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:03.372416 31629 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:03.421293 31646 raft_consensus.cc:2955] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:22:03.433101 25276 raft_consensus.cc:2955] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:22:03.470255 25020 catalog_manager.cc:5697] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 reported cstate change: config changed from index -1 to 13, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New cstate: current_term: 18 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:22:03.473690 25194 raft_consensus.cc:2955] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } } }
I20260709 12:22:03.649338 25272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:22:03.649942 25272 raft_consensus.cc:606] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:03.683121 31647 raft_consensus.cc:993] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:22:03.683662 31647 raft_consensus.cc:1081] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:22:03.685611 25193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36436
I20260709 12:22:03.686218 25193 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:03.686756 25193 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:03.693745 25193 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:03.702350 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:03.702879 25272 raft_consensus.cc:3055] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:03.703158 25272 raft_consensus.cc:740] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:22:03.703223 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:03.703925 25851 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:03.703912 25272 consensus_queue.cc:260] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:03.717423 25120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6"
dest_uuid: "897be935c42e41b995f177155b042be0"
mode: GRACEFUL
new_leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:44130
I20260709 12:22:03.718189 25120 raft_consensus.cc:606] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Received request to transfer leadership to TS b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:03.714107 25272 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:03.721721 25276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030"
dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
mode: GRACEFUL
new_leader_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:48124
I20260709 12:22:03.725179 25276 raft_consensus.cc:606] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Received request to transfer leadership to TS 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:22:03.726390 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:03.728113 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:03.728940 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:03.744170 25851 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:22:03.749485 25193 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Requested vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:03.772143 25167 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:03.773098 31492 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:03.773653 31492 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:03.774552 31492 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:03.799091 25019 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 18 to 19, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 19 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.806458 25272 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:22:03.838835 31662 ts_tablet_manager.cc:933] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: Initiating tablet copy from peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409)
I20260709 12:22:03.854012 31627 raft_consensus.cc:993] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: : Instructing follower b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:22:03.854764 31646 raft_consensus.cc:1081] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Signalling peer b83c12959b9848b3b7bbc680f5ee6225 to start an election
I20260709 12:22:03.857801 25198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6"
dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
 from {username='slave'} at 127.0.0.1:36434
I20260709 12:22:03.858454 25198 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:03.858837 25198 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.866459 31662 tablet_copy_client.cc:323] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.81.193:46409
I20260709 12:22:03.868592 25136 tablet_copy_service.cc:140] P 897be935c42e41b995f177155b042be0: Received BeginTabletCopySession request for tablet 155471b361b441c095eae34b64eb0bed from peer 4456c1069d1541fab5b7cb29df9b6167 ({username='slave'} at 127.0.0.1:48492)
I20260709 12:22:03.869172 25136 tablet_copy_service.cc:161] P 897be935c42e41b995f177155b042be0: Beginning new tablet copy session on tablet 155471b361b441c095eae34b64eb0bed from peer 4456c1069d1541fab5b7cb29df9b6167 at {username='slave'} at 127.0.0.1:48492: session id = 4456c1069d1541fab5b7cb29df9b6167-155471b361b441c095eae34b64eb0bed
I20260709 12:22:03.877305 25136 tablet_copy_source_session.cc:215] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:03.883958 31662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155471b361b441c095eae34b64eb0bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:03.883592 25198 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:03.888481 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:22:03.889082 25124 raft_consensus.cc:3055] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:03.889381 25124 raft_consensus.cc:740] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897be935c42e41b995f177155b042be0, State: Running, Role: LEADER
I20260709 12:22:03.889693 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:03.890352 25272 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.890132 25124 consensus_queue.cc:260] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:03.891315 25124 raft_consensus.cc:3060] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.906503 25198 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:03.911585 25272 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:22:03.915318 25165 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:03.916185 31643 raft_consensus.cc:2804] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:03.916713 31643 raft_consensus.cc:697] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:03.917572 31643 consensus_queue.cc:237] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:03.920306 25124 raft_consensus.cc:2468] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
I20260709 12:22:03.928535 25019 catalog_manager.cc:5697] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 11 to 12, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 12 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.975188 31662 tablet_copy_client.cc:806] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:03.980922 31662 tablet_copy_client.cc:670] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:03.987264 31662 tablet_copy_client.cc:538] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:04.029346 31662 tablet_bootstrap.cc:492] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap starting.
I20260709 12:22:04.174117 31580 raft_consensus.cc:993] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: : Instructing follower 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:22:04.174660 31580 raft_consensus.cc:1081] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Signalling peer 4456c1069d1541fab5b7cb29df9b6167 to start an election
I20260709 12:22:04.176426 25855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030"
dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:22:04.176968 25855 raft_consensus.cc:493] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.177309 25855 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:04.186568 25855 raft_consensus.cc:515] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:04.189867 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:04.190547 25272 raft_consensus.cc:3055] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:04.190869 25272 raft_consensus.cc:740] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2e30bdd4cd1b45299f50b9bcfc9c1667, State: Running, Role: LEADER
I20260709 12:22:04.191628 25272 consensus_queue.cc:260] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:04.192785 25272 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:04.196075 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880ab05f6e24c9881bbc8954e0d9030" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "897be935c42e41b995f177155b042be0"
I20260709 12:22:04.196731 25124 raft_consensus.cc:3060] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:04.199674 25275 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:22:04.210076 31492 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:22:04.214473 25272 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:22:04.215358 25855 leader_election.cc:290] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:04.216377 25822 leader_election.cc:304] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:22:04.217222 31594 raft_consensus.cc:2804] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:04.217805 31594 raft_consensus.cc:697] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:22:04.218142 25851 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:22:04.218765 31594 consensus_queue.cc:237] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:04.221144 31666 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:22:04.232543 25124 raft_consensus.cc:2468] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
W20260709 12:22:04.328953 31662 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.064s	user 0.003s	sys 0.000s
I20260709 12:22:04.336306 25019 catalog_manager.cc:5697] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 15 to 16, leader changed from 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 16 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.361311 25124 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:04.362769 31492 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:04.368281 31662 tablet_bootstrap.cc:492] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.369455 31662 tablet_bootstrap.cc:492] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: Bootstrap complete.
I20260709 12:22:04.370396 31662 ts_tablet_manager.cc:1403] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: Time spent bootstrapping tablet: real 0.341s	user 0.037s	sys 0.015s
I20260709 12:22:04.377575 31662 raft_consensus.cc:359] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:22:04.378571 31662 raft_consensus.cc:740] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Initialized, Role: LEARNER
I20260709 12:22:04.379343 31662 consensus_queue.cc:260] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: NON_VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: true } }
I20260709 12:22:04.398964 31662 ts_tablet_manager.cc:1434] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 12:22:04.404850 25275 raft_consensus.cc:1275] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:04.408106 31666 consensus_queue.cc:1048] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:04.411363 25136 tablet_copy_service.cc:342] P 897be935c42e41b995f177155b042be0: Request end of tablet copy session 4456c1069d1541fab5b7cb29df9b6167-155471b361b441c095eae34b64eb0bed received from {username='slave'} at 127.0.0.1:48492
I20260709 12:22:04.411933 25136 tablet_copy_service.cc:434] P 897be935c42e41b995f177155b042be0: ending tablet copy session 4456c1069d1541fab5b7cb29df9b6167-155471b361b441c095eae34b64eb0bed on tablet 155471b361b441c095eae34b64eb0bed with peer 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:22:04.655459 25272 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:22:04.657918 31634 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:04.735103 25124 raft_consensus.cc:1275] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:22:04.739255 31634 consensus_queue.cc:1048] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:04.841256 25855 raft_consensus.cc:1217] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
W20260709 12:22:04.823182 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 94913.8us
I20260709 12:22:04.924769 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:05.110594 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:05.114861 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:05.115625 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:05.364243 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:05.421762 23879 tablet_server.cc:179] TabletServer@127.23.81.193:0 shutting down...
W20260709 12:22:05.460382 25242 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:05.461556 31681 raft_consensus.cc:1064] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: attempting to promote NON_VOTER 4456c1069d1541fab5b7cb29df9b6167 to VOTER
I20260709 12:22:05.464306 31681 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:05.524874 25242 consensus_peers.cc:597] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.539192 25242 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.540683 25242 consensus_peers.cc:597] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.551878 25242 consensus_peers.cc:597] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:05.554533 25855 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 18 LEARNER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:22:05.559029 25193 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:22:05.561586 25242 consensus_peers.cc:597] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:05.562682 25276 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Refusing update from remote peer 897be935c42e41b995f177155b042be0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:22:05.562271 25242 consensus_peers.cc:597] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.564998 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.565810 25825 consensus_peers.cc:597] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:05.565786 31684 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
W20260709 12:22:05.568665 25242 consensus_peers.cc:597] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:05.571321 31685 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
W20260709 12:22:05.582603 25168 consensus_peers.cc:597] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:05.584318 31629 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
W20260709 12:22:05.598287 25168 consensus_peers.cc:597] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.613365 25825 consensus_peers.cc:597] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.614809 25168 consensus_peers.cc:597] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.623765 25168 consensus_peers.cc:597] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.666826 25168 consensus_peers.cc:597] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:05.690761 31629 raft_consensus.cc:2955] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:05.694792 25198 raft_consensus.cc:2955] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:22:05.699925 25168 consensus_peers.cc:597] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.716612 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 56678.8us
I20260709 12:22:05.729431 25019 catalog_manager.cc:5697] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: config changed from index 13 to 14, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "897be935c42e41b995f177155b042be0" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
I20260709 12:22:05.743669 25272 raft_consensus.cc:2955] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:22:05.743338 25825 consensus_peers.cc:597] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.751363 31690 log.cc:927] Time spent T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 12:22:05.757580 25825 consensus_peers.cc:597] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:05.762900 25855 raft_consensus.cc:2955] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } } }
W20260709 12:22:05.791308 25168 consensus_peers.cc:597] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.793332 25168 consensus_peers.cc:597] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.741256 25242 consensus_peers.cc:597] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.796386 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 64594.9us
W20260709 12:22:05.807859 25168 consensus_peers.cc:597] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.825919 25242 consensus_peers.cc:597] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.834185 25242 consensus_peers.cc:597] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.835201 25242 consensus_peers.cc:597] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.860455 25825 consensus_peers.cc:597] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.861672 25168 consensus_peers.cc:597] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.896149 25168 consensus_peers.cc:597] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:05.899845 25825 consensus_peers.cc:597] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:05.962069 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:05.963927 23879 tablet_replica.cc:333] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:05.964980 23879 raft_consensus.cc:2243] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:05.965883 23879 raft_consensus.cc:2272] T f1f471cfad2348a09c4b699f01f9dfa9 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:05.968580 23879 tablet_replica.cc:333] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:05.969383 23879 raft_consensus.cc:2243] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:22:05.970953 23879 raft_consensus.cc:2272] T 242311f4ad5044b2ada00bc49a50afeb P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:05.973645 23879 tablet_replica.cc:333] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:05.974562 23879 raft_consensus.cc:2243] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:05.975167 23879 raft_consensus.cc:2272] T b9bae455c93a497ca28011bd9cd473ec P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:05.977708 23879 tablet_replica.cc:333] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:05.987140 23879 raft_consensus.cc:2243] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:22:05.988381 23879 raft_consensus.cc:2272] T 19982d505db74841b1c47ceaaf269baa P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:05.996784 23879 tablet_replica.cc:333] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:05.997615 23879 raft_consensus.cc:2243] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:05.998232 23879 raft_consensus.cc:2272] T d606e00420654b22bb1000c1b0aacbbc P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.001080 23879 tablet_replica.cc:333] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.001875 23879 raft_consensus.cc:2243] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.018498 23879 raft_consensus.cc:2272] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.021242 23879 tablet_replica.cc:333] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.022130 23879 raft_consensus.cc:2243] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.022749 23879 raft_consensus.cc:2272] T 258fe130eb914f5b858baf4782663574 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.025352 23879 tablet_replica.cc:333] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0: stopping tablet replica
W20260709 12:22:06.045316 25168 consensus_peers.cc:597] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:06.046267 23879 raft_consensus.cc:2243] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.054646 23879 raft_consensus.cc:2272] T 3552726c022345b394b69265b8f3b566 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.057974 23879 tablet_replica.cc:333] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.065958 23879 raft_consensus.cc:2243] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.066823 23879 raft_consensus.cc:2272] T 0ff71ed0aef74f1f963b143876c9b3d6 P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.069960 23879 tablet_replica.cc:333] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.079878 23879 raft_consensus.cc:2243] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.082589 23879 raft_consensus.cc:2272] T 7d3090ce3ca84e6e9649297156feeaef P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.089275 23879 tablet_replica.cc:333] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.119982 23879 raft_consensus.cc:2243] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.120963 23879 raft_consensus.cc:2272] T 6248d848eecd4b799e9233d56f0b5467 P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.130394 23879 tablet_replica.cc:333] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.131335 23879 raft_consensus.cc:2243] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.132033 23879 raft_consensus.cc:2272] T c880ab05f6e24c9881bbc8954e0d9030 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:06.154217 25092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 75382.5us
I20260709 12:22:06.178431 23879 tablet_replica.cc:333] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0: stopping tablet replica
W20260709 12:22:06.181939 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 58210.7us
I20260709 12:22:06.182215 23879 raft_consensus.cc:2243] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.194931 23879 raft_consensus.cc:2272] T 289cd948a1764490bf11226eedd2c4c7 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.197932 23879 tablet_replica.cc:333] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.254123 23879 raft_consensus.cc:2243] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.255298 23879 raft_consensus.cc:2272] T 6b13f2e891f348229e95286682b88911 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.259052 23879 tablet_replica.cc:333] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0: stopping tablet replica
W20260709 12:22:06.258890 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 73966.8us
I20260709 12:22:06.259996 23879 raft_consensus.cc:2243] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.302152 23879 raft_consensus.cc:2272] T 6afd466aa7a2455fa2f85263e303ec0f P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.305009 23879 tablet_replica.cc:333] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.305809 23879 raft_consensus.cc:2243] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.338711 23879 raft_consensus.cc:2272] T f698d5eb641d4490aaa13e25382450db P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.341595 23879 tablet_replica.cc:333] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.342374 23879 raft_consensus.cc:2243] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.343379 23879 raft_consensus.cc:2272] T a2a57280b61f41a6afa7fea941bb108c P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.381043 23879 tablet_replica.cc:333] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.381862 23879 raft_consensus.cc:2243] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.382658 23879 raft_consensus.cc:2272] T fd7e49fd52d74821a66c7dbbc770a988 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.412254 31685 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:06.413005 23879 tablet_replica.cc:333] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.412900 31685 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:06.413892 23879 raft_consensus.cc:2243] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.414475 23879 raft_consensus.cc:2272] T 960cba74c5c0438f9a3d8e25d8dec7ad P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.417418 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:06.418358 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74518b8711d94925993fc2a788e89ccb" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:06.419744 31685 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:06.428411 25093 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:06.430971 31683 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:06.445137 31683 raft_consensus.cc:493] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:06.445771 31683 raft_consensus.cc:515] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:06.448776 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:06.452665 31683 leader_election.cc:290] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:06.453794 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73f31d21bb0468893aa53b0dcaf3e60" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:06.454712 31683 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:06.455463 31683 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:06.455756 25092 leader_election.cc:304] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:22:06.456622 31681 raft_consensus.cc:2749] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:06.465777 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:06.467935 23879 tablet_replica.cc:333] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.468885 23879 raft_consensus.cc:2243] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.469515 23879 raft_consensus.cc:2272] T 504eece31eb848cc80169ecf5ab51b9a P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.470475 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:06.472306 23879 tablet_replica.cc:333] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.472476 25090 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:06.473178 23879 raft_consensus.cc:2243] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.473683 31681 raft_consensus.cc:2749] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:06.474630 31683 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:06.473876 23879 raft_consensus.cc:2272] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.508457 23879 tablet_replica.cc:333] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.509287 23879 raft_consensus.cc:2243] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.516011 23879 raft_consensus.cc:2272] T 6e78737bee66450b9a076cc9676331b9 P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.518677 23879 tablet_replica.cc:333] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.519498 23879 raft_consensus.cc:2243] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.520148 23879 raft_consensus.cc:2272] T dba87711b0ab4e3394481dfecfeb886e P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.525166 31683 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:06.525707 31683 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:06.528107 31683 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:06.529227 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:06.530990 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaeb230a0f814ad1849053d7a19c90d6" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:06.535496 25093 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:06.536902 31681 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:06.536933 31683 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:06.546957 23879 tablet_replica.cc:333] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.538523 31683 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:06.551426 31681 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:06.552007 31681 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:06.554800 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:06.555267 31681 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:06.556013 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:06.547902 23879 raft_consensus.cc:2243] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.550411 31685 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:06.559579 23879 raft_consensus.cc:2272] T c0821374625d4793801ab3b3f502714e P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.560238 31685 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:06.562513 31685 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:06.563657 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:06.559257 25093 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:06.572438 31685 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:06.562446 23879 tablet_replica.cc:333] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.574314 25193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:06.574579 23879 raft_consensus.cc:2243] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.575600 23879 raft_consensus.cc:2272] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.574942 31683 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:06.574316 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:06.578389 23879 tablet_replica.cc:333] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.579515 25093 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:06.579591 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:06.581025 31683 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:06.582641 23879 raft_consensus.cc:2243] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.590556 25093 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:22:06.591256 25093 raft_consensus.cc:2686] T 08989457946a4946811751dc96e31276 P 897be935c42e41b995f177155b042be0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:22:06.606217 23879 raft_consensus.cc:2272] T e72fd84f77df4beba49c7d81e1b26f8e P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.609231 23879 tablet_replica.cc:333] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.614113 23879 raft_consensus.cc:2243] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.614801 23879 raft_consensus.cc:2272] T 74518b8711d94925993fc2a788e89ccb P 897be935c42e41b995f177155b042be0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.635910 23879 tablet_replica.cc:333] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.636744 23879 raft_consensus.cc:2243] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.637624 23879 raft_consensus.cc:2272] T e7e59abaef5845e2bb8f466331bb98c3 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.640759 23879 tablet_replica.cc:333] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.641594 23879 raft_consensus.cc:2243] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.654012 23879 raft_consensus.cc:2272] T b1d4aa6fab2741dda3fcae71491a229a P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.656992 23879 tablet_replica.cc:333] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.657758 23879 raft_consensus.cc:2243] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.658497 23879 raft_consensus.cc:2272] T bddb65a99b5c44038087d76d815e3abf P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.663991 23879 tablet_replica.cc:333] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.664727 23879 raft_consensus.cc:2243] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.671355 23879 raft_consensus.cc:2272] T 4fb0b452100949b58ad2bf4a4aed36fa P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.675489 23879 tablet_replica.cc:333] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.676265 23879 raft_consensus.cc:2243] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.677295 23879 raft_consensus.cc:2272] T b0e4085b9c3e4704891292cf0881ea14 P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.680083 23879 tablet_replica.cc:333] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.680786 23879 raft_consensus.cc:2243] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.718837 23879 raft_consensus.cc:2272] T 1081a743e5e04f24a0aebd684da3a15d P 897be935c42e41b995f177155b042be0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.721066 31685 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:06.722194 31685 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:06.724401 31685 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:06.725592 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:06.726002 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81b9ed959214538853077eddd8dc8ea" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:06.727665 25093 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:06.728855 31685 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:06.732728 31685 raft_consensus.cc:493] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:06.733229 31685 raft_consensus.cc:515] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:06.736438 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:06.738646 31685 leader_election.cc:290] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:06.740159 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6268d5c5e547b0b77e42ede61314e1" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:06.741587 25092 leader_election.cc:304] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:22:06.742636 31685 raft_consensus.cc:2749] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:06.743106 23879 tablet_replica.cc:333] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.755116 23879 raft_consensus.cc:2243] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.756071 23879 raft_consensus.cc:2272] T 392ec479375b41bbb38793a0c207912d P 897be935c42e41b995f177155b042be0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.771723 23879 tablet_replica.cc:333] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.772547 23879 raft_consensus.cc:2243] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.773816 23879 raft_consensus.cc:2272] T 155471b361b441c095eae34b64eb0bed P 897be935c42e41b995f177155b042be0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.776449 23879 tablet_replica.cc:333] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.796802 31685 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:06.797420 31685 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:06.799618 31685 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:06.800750 23879 raft_consensus.cc:2243] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.801393 23879 raft_consensus.cc:2272] T aaeb230a0f814ad1849053d7a19c90d6 P 897be935c42e41b995f177155b042be0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.802215 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:06.806535 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd90d1f02e904a46be6868d71386b83a" candidate_uuid: "897be935c42e41b995f177155b042be0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:06.808768 25090 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897be935c42e41b995f177155b042be0; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:22:06.810014 31685 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:06.813195 23879 tablet_replica.cc:333] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.814262 23879 raft_consensus.cc:2243] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.814950 23879 raft_consensus.cc:2272] T dd90d1f02e904a46be6868d71386b83a P 897be935c42e41b995f177155b042be0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.830155 23879 tablet_replica.cc:333] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.831071 23879 raft_consensus.cc:2243] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.833525 23879 raft_consensus.cc:2272] T b73f31d21bb0468893aa53b0dcaf3e60 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.836354 23879 tablet_replica.cc:333] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.837189 23879 raft_consensus.cc:2243] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.837970 23879 raft_consensus.cc:2272] T 6c6268d5c5e547b0b77e42ede61314e1 P 897be935c42e41b995f177155b042be0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.852274 23879 tablet_replica.cc:333] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.856707 23879 raft_consensus.cc:2243] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.857889 23879 raft_consensus.cc:2272] T 951ec28047e64bb7a386c7d66a082fd0 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.873387 23879 tablet_replica.cc:333] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.874271 23879 raft_consensus.cc:2243] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.874847 23879 raft_consensus.cc:2272] T e81b9ed959214538853077eddd8dc8ea P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.886565 23879 tablet_replica.cc:333] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.887431 23879 raft_consensus.cc:2243] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.888526 23879 raft_consensus.cc:2272] T 78607220ddf2470a80cefc5d012e7625 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.901374 23879 tablet_replica.cc:333] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.902123 23879 raft_consensus.cc:2243] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.903105 23879 raft_consensus.cc:2272] T d683b7b361f44f7cb6076cf5ac95611b P 897be935c42e41b995f177155b042be0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.905623 23879 tablet_replica.cc:333] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.906301 23879 raft_consensus.cc:2243] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.906874 23879 raft_consensus.cc:2272] T 81fec2cd07604cab87091a034eba2f38 P 897be935c42e41b995f177155b042be0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.909694 23879 tablet_replica.cc:333] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0: stopping tablet replica
I20260709 12:22:06.921906 23879 raft_consensus.cc:2243] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.922843 23879 raft_consensus.cc:2272] T b1e3b9e5896c4b539daf785219debb12 P 897be935c42e41b995f177155b042be0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.051282 31704 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.051894 31704 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:07.077029 25242 leader_election.cc:336] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.081624 31704 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:07.083279 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:07.085274 25241 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:22:07.086815 31704 raft_consensus.cc:2749] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:07.169054 31666 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.169628 31666 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.172887 31666 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:07.175073 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:07.176620 25855 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:22:07.177722 25167 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:07.178508 31643 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:07.178894 31643 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.179262 31643 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:07.188448 25168 leader_election.cc:336] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.207377 31634 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.208323 31634 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.212077 31634 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:07.214259 31643 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.215996 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:07.216617 25275 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:22:07.218106 31643 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:22:07.268081 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 83085.8us
I20260709 12:22:07.288270 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242311f4ad5044b2ada00bc49a50afeb" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:07.294648 25855 raft_consensus.cc:3060] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:07.290284 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 70472.9us
I20260709 12:22:07.303997 31647 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.306332 31647 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:22:07.307160 25168 leader_election.cc:336] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.310778 31647 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:07.322757 25825 leader_election.cc:336] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:07.326979 25242 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.371798 25822 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:07.373275 31669 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:07.373791 31669 raft_consensus.cc:493] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.374246 31669 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:07.383008 31714 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.384078 31714 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:07.388588 31714 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:07.394773 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:07.395720 25198 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
I20260709 12:22:07.425300 31704 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.426183 31704 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:07.438987 25168 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.453747 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:07.455070 25855 raft_consensus.cc:2468] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:22:07.454623 25272 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:22:07.456811 25167 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:07.459007 31710 raft_consensus.cc:2804] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:07.459648 31710 raft_consensus.cc:697] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:07.460274 31704 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:07.461010 31710 consensus_queue.cc:237] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.464170 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:07.465056 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:07.466686 31711 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:07.467154 31711 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.469610 31711 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:07.487730 31634 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.488596 31634 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.496596 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:07.497318 25275 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:22:07.499265 25822 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:22:07.499583 31634 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:07.500555 31708 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:07.501008 31708 raft_consensus.cc:493] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.501441 31708 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:07.518783 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:07.535211 31666 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:07.535665 31666 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.536051 31666 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:07.516835 25242 leader_election.cc:336] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.537191 25242 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
W20260709 12:22:07.519088 25825 leader_election.cc:336] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.548167 31703 raft_consensus.cc:2749] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:07.495914 31669 raft_consensus.cc:515] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.561195 31712 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.567723 31712 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.561291 31647 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.570684 31647 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:07.573045 31647 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:07.573848 31712 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:22:07.574741 25242 leader_election.cc:336] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.575044 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:07.576792 25241 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:22:07.579957 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19982d505db74841b1c47ceaaf269baa" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:07.580662 25275 raft_consensus.cc:3060] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:07.581151 31708 raft_consensus.cc:515] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.582247 31712 raft_consensus.cc:2749] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:07.566489 31666 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:22:07.588953 25242 leader_election.cc:336] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.554576 31711 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:22:07.594651 25242 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:07.597988 25168 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.598969 31711 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:07.603725 31666 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:07.583962 31669 leader_election.cc:290] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:07.615108 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:07.616003 25272 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 18: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
I20260709 12:22:07.617702 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:07.625578 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:22:07.626551 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:22:07.626700 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:07.646718 25196 raft_consensus.cc:2393] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 18: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:22:07.631297 25275 raft_consensus.cc:2468] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:22:07.648322 31710 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:07.636256 25022 catalog_manager.cc:5697] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 14 to 15, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 15 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:07.608821 25825 leader_election.cc:336] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.640599 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3090ce3ca84e6e9649297156feeaef" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:07.652402 25272 raft_consensus.cc:3060] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:07.658645 31634 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.659341 31634 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.661350 31634 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:07.647830 31711 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:07.647800 31708 leader_election.cc:290] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:07.667565 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:07.668073 31712 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.668702 31712 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:07.669541 31647 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:07.670989 31712 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:07.661847 25822 leader_election.cc:304] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:07.673767 31708 raft_consensus.cc:2804] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:07.674322 31708 raft_consensus.cc:697] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:22:07.675336 31708 consensus_queue.cc:237] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.677160 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:07.677805 25276 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 14.
I20260709 12:22:07.682726 25822 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:22:07.684500 31634 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:07.684859 31634 raft_consensus.cc:493] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.685225 31634 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:07.691792 25825 leader_election.cc:336] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.692104 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:07.699703 31710 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.703369 25272 raft_consensus.cc:2468] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 16.
I20260709 12:22:07.703864 31710 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:22:07.702363 25825 leader_election.cc:336] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:07.706710 25242 leader_election.cc:336] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.708909 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:07.710749 31634 raft_consensus.cc:515] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.712735 31712 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:07.713347 31634 leader_election.cc:290] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:07.715195 31710 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:22:07.719323 25168 leader_election.cc:336] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.721450 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:07.722255 25272 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:22:07.723084 25822 leader_election.cc:304] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:07.724045 31669 raft_consensus.cc:2804] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:07.724684 31669 raft_consensus.cc:697] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:22:07.724831 25165 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:07.725087 25024 catalog_manager.cc:5697] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 15 to 16, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 16 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.726492 31710 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:07.727113 31710 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.727586 31710 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:07.727934 31669 consensus_queue.cc:237] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.732625 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248d848eecd4b799e9233d56f0b5467" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:07.733253 25272 raft_consensus.cc:3060] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:07.741430 25825 leader_election.cc:336] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:07.743314 25242 consensus_peers.cc:597] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:07.762766 25272 raft_consensus.cc:2468] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 15.
I20260709 12:22:07.766537 31708 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.767570 31708 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.773584 31708 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:07.787212 25822 leader_election.cc:304] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:07.789810 25196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:07.799105 31669 raft_consensus.cc:2804] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:07.800642 31669 raft_consensus.cc:697] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:22:07.799409 31710 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:07.812121 31710 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:07.815440 25272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a57280b61f41a6afa7fea941bb108c" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:07.816066 25272 raft_consensus.cc:3060] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:07.816390 31634 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:22:07.816545 25825 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:07.817144 25168 leader_election.cc:336] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.816991 31634 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.819060 31710 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.819219 31634 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:07.820340 31710 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.802161 31669 consensus_queue.cc:237] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.817015 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:07.827275 31666 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.827883 31666 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.828574 31708 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:22:07.829924 25168 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.831215 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:07.831506 31666 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:07.833571 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:07.834324 25855 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:22:07.837013 25167 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:07.839308 25272 raft_consensus.cc:2468] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
W20260709 12:22:07.838264 25825 leader_election.cc:336] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:07.840197 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:07.843544 31634 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:07.849601 25165 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:07.844193 31666 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:07.850915 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:07.851562 25855 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 20.
I20260709 12:22:07.855218 31714 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.857373 31709 raft_consensus.cc:2804] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:07.857954 31709 raft_consensus.cc:697] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:07.847378 31710 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:22:07.860302 25093 connection.cc:466] server connection from 127.0.0.1:41048 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41048 (request call id 3042) could send its response
I20260709 12:22:07.860450 31709 consensus_queue.cc:237] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:07.857741 31714 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.853963 31666 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.865828 31714 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:07.866458 31666 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:07.866550 31708 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.867251 25167 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:07.867317 31708 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.871627 31714 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:07.873296 31714 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.873773 31714 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:07.876227 31708 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:07.876533 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:07.879935 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:07.880590 25855 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 11.
W20260709 12:22:07.883445 25168 leader_election.cc:336] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: recv got EOF from unknown peer (error 108)
I20260709 12:22:07.888441 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:07.892249 31717 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:07.892890 31717 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.894997 31717 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:07.908201 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:07.919011 25825 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:07.927292 31708 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:07.928467 31717 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.945379 31714 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:07.956756 31708 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.957477 31708 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:07.955583 25825 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:07.959880 31708 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:07.963749 31666 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:07.967096 25242 consensus_peers.cc:597] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:07.967957 25242 consensus_peers.cc:597] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:07.968453 25242 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:07.968888 25242 consensus_peers.cc:597] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:07.973223 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:07.976998 31717 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:22:07.980494 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:07.987381 31714 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:22:07.987777 25242 consensus_peers.cc:597] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:07.989667 31712 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:07.990345 31712 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:07.992717 31712 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:07.995246 31666 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:08.001772 31714 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.002488 31714 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:08.005288 31714 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:22:08.007390 25825 leader_election.cc:336] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:08.007886 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:08.008102 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d4aa6fab2741dda3fcae71491a229a" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:08.008805 25855 raft_consensus.cc:3060] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:08.009089 31708 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:08.010919 25852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e4085b9c3e4704891292cf0881ea14" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:08.011586 25852 raft_consensus.cc:3060] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:08.013736 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:08.017371 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:08.017431 31703 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.018298 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72fd84f77df4beba49c7d81e1b26f8e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:08.018800 31703 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:08.018962 25851 raft_consensus.cc:3060] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:08.023025 31703 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:08.020279 25269 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:22:08.028847 25855 raft_consensus.cc:2468] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 21.
I20260709 12:22:08.034891 25022 catalog_manager.cc:5697] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 14 to 15, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 15 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.038043 25852 raft_consensus.cc:2468] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 12.
W20260709 12:22:08.042577 25168 leader_election.cc:336] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:08.043416 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:08.046133 25167 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:08.047089 31643 raft_consensus.cc:2804] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:08.047124 25167 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:08.047742 31643 raft_consensus.cc:697] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 21 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:08.054625 25851 raft_consensus.cc:2468] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:22:08.054649 31710 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.062891 31710 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:08.048866 31643 consensus_queue.cc:237] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:08.065389 31710 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:08.068831 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:08.069053 31727 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:08.069389 25859 raft_consensus.cc:1275] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:08.069554 31727 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.069610 25269 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:22:08.070101 31727 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:08.074775 31714 raft_consensus.cc:2804] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:08.075448 31714 raft_consensus.cc:697] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:08.076781 31714 consensus_queue.cc:237] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:08.078773 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:08.079903 31717 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:08.080354 31717 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.080789 31717 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:08.082370 31666 consensus_queue.cc:1048] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:22:08.043426 25168 consensus_peers.cc:597] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:08.084420 25168 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.085254 25168 leader_election.cc:336] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.086344 25168 leader_election.cc:336] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.055166 25242 consensus_peers.cc:597] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:08.087175 25168 leader_election.cc:336] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.087317 25242 leader_election.cc:336] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:08.099211 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:08.100163 31712 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:08.103982 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
W20260709 12:22:08.088056 25168 consensus_peers.cc:597] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:08.111680 25168 consensus_peers.cc:597] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:08.120785 31717 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:08.123926 31634 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
W20260709 12:22:08.121344 25168 consensus_peers.cc:597] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:08.124802 25168 leader_election.cc:336] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:08.124647 31634 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:08.126767 25167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 46522.5us
I20260709 12:22:08.127158 31712 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.127904 31712 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:08.131342 31712 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:22:08.132289 25825 consensus_peers.cc:597] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:08.133232 25167 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:08.131502 31727 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:08.135725 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:08.136371 25855 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 18.
I20260709 12:22:08.131911 31710 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.137276 31634 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:08.145483 25242 leader_election.cc:336] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:08.149108 31710 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:08.151613 31717 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:08.143860 31666 raft_consensus.cc:2804] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:08.155097 31666 raft_consensus.cc:697] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:08.156179 31666 consensus_queue.cc:237] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:08.159091 25168 leader_election.cc:336] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.159658 25168 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:08.160418 25022 catalog_manager.cc:5697] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 20 to 21, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 21 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.166774 25197 raft_consensus.cc:2393] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 15: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:22:08.172505 25168 consensus_peers.cc:597] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:08.173120 25825 leader_election.cc:336] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.174047 25242 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.174597 25242 consensus_peers.cc:597] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:08.175297 25825 consensus_peers.cc:597] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:08.179139 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:08.179778 25855 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:22:08.176424 31710 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:08.189260 25269 raft_consensus.cc:1275] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:08.190250 31643 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.190804 31716 consensus_queue.cc:1048] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:08.176877 25022 catalog_manager.cc:5697] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 11 to 12, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 12 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.192366 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:08.192958 25275 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:22:08.191031 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0821374625d4793801ab3b3f502714e" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:08.193758 25269 raft_consensus.cc:3060] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:08.194705 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:08.196297 31711 raft_consensus.cc:3060] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:08.190958 31643 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:08.203240 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:08.205730 25197 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 18.
I20260709 12:22:08.208043 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:08.205034 31727 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:08.212798 25269 raft_consensus.cc:2468] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:22:08.216346 31711 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:08.217442 31643 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:08.219141 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:08.219996 25165 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:08.220643 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392ec479375b41bbb38793a0c207912d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
W20260709 12:22:08.220764 25825 consensus_peers.cc:597] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:08.221210 25168 leader_election.cc:336] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.221782 25825 consensus_peers.cc:597] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.223310 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:08.223960 25276 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 17.
I20260709 12:22:08.230947 25165 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:08.224197 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:08.232947 25165 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:08.230386 31734 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:08.235114 31734 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.235548 31734 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:08.236584 31713 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:08.241118 25168 leader_election.cc:336] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.244644 25168 consensus_peers.cc:597] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:08.248569 25275 raft_consensus.cc:2468] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
I20260709 12:22:08.249547 25165 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:08.254990 31732 raft_consensus.cc:2804] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:08.255524 31732 raft_consensus.cc:697] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:08.233721 31727 raft_consensus.cc:2804] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:08.256534 31727 raft_consensus.cc:697] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 18 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:08.256433 31732 consensus_queue.cc:237] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:08.231664 31711 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:08.263509 25276 raft_consensus.cc:1275] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:22:08.264202 25825 consensus_peers.cc:597] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:08.234576 31643 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:22:08.265306 25242 consensus_peers.cc:597] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:08.274159 31716 consensus_queue.cc:1048] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:08.272336 31643 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.288524 31643 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:08.286849 25022 catalog_manager.cc:5697] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 15 to 16, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 16 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:08.269555 31711 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.266568 25024 catalog_manager.cc:5697] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 14 to 15, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 15 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.311094 31734 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:08.314095 31727 consensus_queue.cc:237] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:08.315078 31734 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:08.315320 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:08.315999 25851 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:08.321357 25022 catalog_manager.cc:5697] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 14 to 15, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 15 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:08.296211 31711 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:08.365214 25851 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:22:08.392936 31710 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.393342 31739 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.393867 31710 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:08.394116 31739 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:08.396656 31710 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:08.419893 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:08.422739 25859 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 13.
W20260709 12:22:08.435290 25168 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.435933 25168 consensus_peers.cc:597] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:08.436347 25168 consensus_peers.cc:597] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:08.439779 31739 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:08.444167 25272 raft_consensus.cc:1275] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:22:08.445673 25825 consensus_peers.cc:597] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:08.459149 25167 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:08.460067 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:08.460819 25859 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 15.
W20260709 12:22:08.461815 25168 leader_election.cc:336] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.462635 25168 consensus_peers.cc:597] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.464504 31643 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:08.471427 31643 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:22:08.467867 25825 consensus_peers.cc:597] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:08.474350 31669 consensus_queue.cc:1048] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:08.471724 31711 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:08.479549 25168 leader_election.cc:336] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.481689 25825 consensus_peers.cc:597] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.481369 31717 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:08.484472 31711 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:08.482524 31717 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.489365 31717 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:08.490530 25167 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
W20260709 12:22:08.487767 25168 consensus_peers.cc:597] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.496470 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:08.500154 25859 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 19: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
I20260709 12:22:08.500304 31732 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:08.507510 31732 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897be935c42e41b995f177155b042be0)
I20260709 12:22:08.511222 31732 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:08.520040 25024 catalog_manager.cc:5697] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 14 to 15, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 15 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.521865 25024 catalog_manager.cc:5697] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 17 to 18, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 18 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:08.530615 25168 leader_election.cc:336] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.549861 25168 consensus_peers.cc:597] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:08.557003 25242 consensus_peers.cc:597] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:08.557859 25242 consensus_peers.cc:597] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:08.558348 25242 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:08.559803 31732 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:08.563226 25859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951ec28047e64bb7a386c7d66a082fd0" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:08.563820 25859 raft_consensus.cc:3060] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:08.563704 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 274139us
W20260709 12:22:08.566421 25168 consensus_peers.cc:597] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:08.558734 25242 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:22:08.575476 31717 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:08.575546 31746 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:08.577649 31717 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:08.587455 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:08.614933 25275 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b83c12959b9848b3b7bbc680f5ee6225 in current term 19: Already voted for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in this term.
W20260709 12:22:08.592051 25168 leader_election.cc:336] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:08.578819 25855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d683b7b361f44f7cb6076cf5ac95611b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167"
I20260709 12:22:08.617079 25855 raft_consensus.cc:3060] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:08.599406 25272 raft_consensus.cc:1275] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:08.619017 25276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78607220ddf2470a80cefc5d012e7625" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:08.619611 25276 raft_consensus.cc:3060] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:08.621591 25168 leader_election.cc:336] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:08.603713 25825 consensus_peers.cc:597] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:08.585057 25859 raft_consensus.cc:2468] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 16.
I20260709 12:22:08.623435 25167 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:08.588944 31732 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:08.624343 31753 raft_consensus.cc:2804] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:08.624890 31753 raft_consensus.cc:697] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:08.625895 31753 consensus_queue.cc:237] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:08.638392 25855 raft_consensus.cc:2468] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 14.
I20260709 12:22:08.639570 25167 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:08.649669 31732 raft_consensus.cc:2804] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:08.650347 25276 raft_consensus.cc:2468] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:22:08.650349 31732 raft_consensus.cc:697] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:08.652558 31732 consensus_queue.cc:237] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:08.659907 25855 raft_consensus.cc:1275] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:22:08.661299 31717 consensus_queue.cc:1048] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:08.672485 25197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:22:08.673579 25197 raft_consensus.cc:2393] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in current term 19: Already voted for candidate b83c12959b9848b3b7bbc680f5ee6225 in this term.
W20260709 12:22:08.693511 25168 consensus_peers.cc:597] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:08.694468 25168 consensus_peers.cc:597] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:08.695114 25168 consensus_peers.cc:597] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:08.701010 25855 raft_consensus.cc:1275] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:08.720553 31732 consensus_queue.cc:1048] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:22:08.757863 25168 consensus_peers.cc:597] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:08.765913 25168 consensus_peers.cc:597] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:08.780829 31758 log.cc:927] Time spent T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:22:08.815122 25165 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:22:08.823357 25024 catalog_manager.cc:5697] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 15 to 16, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 16 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.826980 31727 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:08.827713 31727 consensus_queue.cc:1048] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:08.827822 25165 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:08.838275 31727 raft_consensus.cc:2804] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:08.838819 31727 raft_consensus.cc:697] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:08.839818 31727 consensus_queue.cc:237] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:22:08.879423 25168 consensus_peers.cc:597] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.927783 25024 catalog_manager.cc:5697] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 13 to 14, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 14 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:08.929152 23879 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 25148)
I20260709 12:22:08.932596 25275 raft_consensus.cc:1275] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:22:08.935189 25276 raft_consensus.cc:1275] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:08.940121 25859 raft_consensus.cc:1275] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:22:08.935117 25024 catalog_manager.cc:5697] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 17 to 18, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 18 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.951725 31643 consensus_queue.cc:1048] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:08.947412 31753 consensus_queue.cc:1048] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:22:08.947387 31717 consensus_queue.cc:1048] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.011s
W20260709 12:22:08.980329 25168 consensus_peers.cc:597] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:09.007417 25165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 58770.1us
I20260709 12:22:09.121025 25855 raft_consensus.cc:1275] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:09.123025 31763 consensus_queue.cc:1048] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:09.144138 25859 raft_consensus.cc:1275] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:22:09.145479 25168 consensus_peers.cc:597] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:09.161545 31643 consensus_queue.cc:1048] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:22:09.294925 25168 consensus_peers.cc:597] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:09.323158 31734 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.323729 31734 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:09.326917 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:09.327550 25275 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 18.
I20260709 12:22:09.328774 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
I20260709 12:22:09.329568 31753 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:09.329989 31753 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.330359 31753 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:09.329588 31734 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:09.339211 31753 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:22:09.352669 25168 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:09.353713 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289cd948a1764490bf11226eedd2c4c7" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:09.354357 25275 raft_consensus.cc:3060] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:09.352669 31753 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:22:09.359606 25168 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:09.361855 25275 raft_consensus.cc:2468] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83c12959b9848b3b7bbc680f5ee6225 in term 19.
I20260709 12:22:09.364688 25165 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:09.366897 31753 raft_consensus.cc:2804] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:09.367441 31753 raft_consensus.cc:697] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Becoming Leader. State: Replica: b83c12959b9848b3b7bbc680f5ee6225, State: Running, Role: LEADER
I20260709 12:22:09.368417 31753 consensus_queue.cc:237] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:09.390327 25275 raft_consensus.cc:1275] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:22:09.392575 31727 consensus_queue.cc:1048] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:22:09.447134 25168 consensus_peers.cc:597] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:09.496240 25020 catalog_manager.cc:5697] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 reported cstate change: term changed from 17 to 19, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194). New cstate: current_term: 19 leader_uuid: "b83c12959b9848b3b7bbc680f5ee6225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:09.818230 25275 raft_consensus.cc:1275] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Refusing update from remote peer b83c12959b9848b3b7bbc680f5ee6225: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:22:09.821038 31763 consensus_queue.cc:1048] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:22:09.863097 25168 consensus_peers.cc:597] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:09.930538 23879 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 25148)
I20260709 12:22:10.038829 31708 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.039827 31708 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:10.045487 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:10.048718 25275 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 19.
I20260709 12:22:10.060007 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225" is_pre_election: true
I20260709 12:22:10.060743 25199 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 19.
I20260709 12:22:10.059514 31708 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:10.078997 25825 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 
W20260709 12:22:10.080506 25825 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:10.086762 31774 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:10.087234 31774 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.087589 31774 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:10.146914 31774 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:10.160274 31774 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 election: Requested vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:10.167079 25275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:10.167886 25275 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:10.177376 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b83c12959b9848b3b7bbc680f5ee6225"
I20260709 12:22:10.178093 25199 raft_consensus.cc:3060] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:10.184600 25825 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:10.187390 25199 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 20.
I20260709 12:22:10.192355 25275 raft_consensus.cc:2468] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 20.
I20260709 12:22:10.204463 25822 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225; no voters: 897be935c42e41b995f177155b042be0
I20260709 12:22:10.205376 31774 raft_consensus.cc:2804] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:10.205948 31774 raft_consensus.cc:697] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 20 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:22:10.206946 31774 consensus_queue.cc:237] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:10.302681 25024 catalog_manager.cc:5697] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 18 to 20, leader changed from 897be935c42e41b995f177155b042be0 (127.23.81.193) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 20 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:10.323688 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.367113 25242 consensus_peers.cc:597] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.370455 25168 consensus_peers.cc:597] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.375067 25242 consensus_peers.cc:597] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.385596 25168 consensus_peers.cc:597] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.403812 25242 consensus_peers.cc:597] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.420994 25168 consensus_peers.cc:597] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:10.448148 25168 consensus_peers.cc:597] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.463948 25168 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111) [suppressed 407 similar messages]
W20260709 12:22:10.530853 25242 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.547644 25242 consensus_peers.cc:597] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.561800 25168 consensus_peers.cc:597] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.572804 25825 consensus_peers.cc:597] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.596060 25825 consensus_peers.cc:597] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.639739 25168 consensus_peers.cc:597] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.644142 25825 consensus_peers.cc:597] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:10.679013 25242 consensus_peers.cc:597] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.681051 25825 consensus_peers.cc:597] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.709327 25242 consensus_peers.cc:597] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:10.722419 25197 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:22:10.726934 31779 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:22:10.770155 25825 consensus_peers.cc:597] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:10.777884 25242 consensus_peers.cc:597] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.783716 25168 consensus_peers.cc:597] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.796923 25825 consensus_peers.cc:597] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.799072 25168 consensus_peers.cc:597] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:10.811255 25276 raft_consensus.cc:1275] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:22:10.814953 31708 consensus_queue.cc:1048] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:22:10.852964 25825 consensus_peers.cc:597] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:10.867062 25242 consensus_peers.cc:597] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.901878 25168 consensus_peers.cc:597] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:10.931044 23879 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 25148)
W20260709 12:22:10.994479 25242 consensus_peers.cc:597] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:10.995518 25242 consensus_peers.cc:597] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:11.000898 25168 consensus_peers.cc:597] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:11.006319 25825 consensus_peers.cc:597] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:11.014323 25825 consensus_peers.cc:597] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:11.022545 25168 consensus_peers.cc:597] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:11.046016 25168 consensus_peers.cc:597] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:11.046584 25168 consensus_peers.cc:597] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:11.134954 25825 consensus_peers.cc:597] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:11.181758 25168 consensus_peers.cc:597] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:11.283824 25168 consensus_peers.cc:597] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:11.306018 25168 consensus_peers.cc:597] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:11.328317 25168 consensus_peers.cc:597] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:11.397879 25168 consensus_peers.cc:597] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:11.398413 25168 consensus_peers.cc:597] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:11.836505 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 110267us
W20260709 12:22:11.905702 25168 consensus_peers.cc:597] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:11.931578 23879 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 25148)
W20260709 12:22:11.953565 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 44182.7us
W20260709 12:22:12.043937 25168 consensus_peers.cc:597] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:12.128201 25168 consensus_peers.cc:597] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:12.267588 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 43852.6us
W20260709 12:22:12.626217 25168 consensus_peers.cc:597] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:12.826423 25242 consensus_peers.cc:597] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:12.838536 25825 consensus_peers.cc:597] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:12.844316 25168 consensus_peers.cc:597] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:12.864044 25242 consensus_peers.cc:597] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:12.932126 23879 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 25148)
W20260709 12:22:12.980654 25242 consensus_peers.cc:597] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:12.987646 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:12.983279 25168 consensus_peers.cc:597] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:12.997203 25242 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.003841 25242 consensus_peers.cc:597] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.084256 25242 consensus_peers.cc:597] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.085242 25825 consensus_peers.cc:597] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.097586 25168 consensus_peers.cc:597] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.120791 25168 consensus_peers.cc:597] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.128224 25168 consensus_peers.cc:597] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:13.130457 25242 consensus_peers.cc:597] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.244033 25825 consensus_peers.cc:597] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.249639 25825 consensus_peers.cc:597] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.311942 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 62356.2us
W20260709 12:22:13.283195 25168 consensus_peers.cc:597] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.343746 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 60595.1us
W20260709 12:22:13.310146 25242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 46115.1us
W20260709 12:22:13.369679 25242 consensus_peers.cc:597] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.372944 25825 consensus_peers.cc:597] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:13.420516 25825 consensus_peers.cc:597] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.455981 25825 consensus_peers.cc:597] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:13.521481 25825 consensus_peers.cc:597] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.468832 25168 consensus_peers.cc:597] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.530848 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 62052.7us
W20260709 12:22:13.551680 25242 consensus_peers.cc:597] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.573927 25168 consensus_peers.cc:597] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.597756 25825 consensus_peers.cc:597] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:13.603264 25242 consensus_peers.cc:597] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.611871 25168 consensus_peers.cc:597] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.634975 25168 consensus_peers.cc:597] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:13.635730 25168 consensus_peers.cc:597] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.650874 25168 consensus_peers.cc:597] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.693881 25168 consensus_peers.cc:597] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:13.711274 25242 consensus_peers.cc:597] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.715030 25825 consensus_peers.cc:597] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.726488 25168 consensus_peers.cc:597] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.762493 25168 consensus_peers.cc:597] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:13.796422 25168 consensus_peers.cc:597] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:13.932706 23879 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 25148)
W20260709 12:22:14.010259 25168 consensus_peers.cc:597] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:14.074205 25168 consensus_peers.cc:597] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:14.131940 25168 consensus_peers.cc:597] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:14.276463 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 55186.8us
W20260709 12:22:14.377774 25168 consensus_peers.cc:597] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:14.561486 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 83626us
W20260709 12:22:14.613649 25168 consensus_peers.cc:597] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:14.624318 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 59981.9us
W20260709 12:22:14.807008 25168 consensus_peers.cc:597] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:14.935436 23879 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 25148)
W20260709 12:22:15.104018 25168 consensus_peers.cc:597] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:15.130776 25168 consensus_peers.cc:597] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.214150 25242 consensus_peers.cc:597] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.236626 25242 consensus_peers.cc:597] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.307530 25242 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.312603 25825 consensus_peers.cc:597] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:15.437229 25168 consensus_peers.cc:597] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.468322 25168 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111) [suppressed 434 similar messages]
W20260709 12:22:15.565898 25242 consensus_peers.cc:597] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.569579 25168 consensus_peers.cc:597] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.604573 25242 consensus_peers.cc:597] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.622510 25242 consensus_peers.cc:597] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.638833 25168 consensus_peers.cc:597] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:15.648538 25242 consensus_peers.cc:597] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.653362 25168 consensus_peers.cc:597] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.677445 25825 consensus_peers.cc:597] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.693900 25825 consensus_peers.cc:597] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.730050 25168 consensus_peers.cc:597] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.760887 25825 consensus_peers.cc:597] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.828822 25825 consensus_peers.cc:597] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.839252 25242 consensus_peers.cc:597] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.857087 25168 consensus_peers.cc:597] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.895774 25825 consensus_peers.cc:597] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.907364 25825 consensus_peers.cc:597] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:15.910528 25825 consensus_peers.cc:597] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:15.917186 25168 consensus_peers.cc:597] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.919174 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:15.936561 23879 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 25148)
W20260709 12:22:15.988621 25168 consensus_peers.cc:597] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:16.006585 25168 consensus_peers.cc:597] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:16.094192 25168 consensus_peers.cc:597] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:16.096366 25168 consensus_peers.cc:597] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:16.163264 25242 consensus_peers.cc:597] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:16.163829 25242 consensus_peers.cc:597] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:16.175521 25825 consensus_peers.cc:597] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:16.201296 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 52317.6us
W20260709 12:22:16.224676 25168 consensus_peers.cc:597] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:16.239169 25168 consensus_peers.cc:597] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:16.257727 25242 consensus_peers.cc:597] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:16.274704 25825 consensus_peers.cc:597] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:16.406639 25168 consensus_peers.cc:597] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:16.431599 25168 consensus_peers.cc:597] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:16.725627 25168 consensus_peers.cc:597] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:16.853271 25168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46409, user_credentials={real_user=slave}} blocked reactor thread for 79128.9us
W20260709 12:22:16.976881 25168 consensus_peers.cc:597] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:16.994015 25168 consensus_peers.cc:597] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:16.994731 25168 consensus_peers.cc:597] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:17.043673 25168 consensus_peers.cc:597] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:17.368403 25168 consensus_peers.cc:597] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:17.371997 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 72383.5us
W20260709 12:22:17.649363 25168 consensus_peers.cc:597] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:17.742354 25242 consensus_peers.cc:597] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:17.778589 25825 consensus_peers.cc:597] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:17.823982 25168 consensus_peers.cc:597] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:17.824678 25242 consensus_peers.cc:597] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:17.866526 25242 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:17.903756 25242 consensus_peers.cc:597] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:17.961195 25825 consensus_peers.cc:597] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.038414 25825 consensus_peers.cc:597] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:18.072889 25168 consensus_peers.cc:597] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.081904 25168 consensus_peers.cc:597] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.091975 25242 consensus_peers.cc:597] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.128518 25242 consensus_peers.cc:597] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.217976 25168 consensus_peers.cc:597] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:18.261096 25825 consensus_peers.cc:597] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:22:18.280719 23879 tablet_server.cc:196] TabletServer@127.23.81.193:0 shutdown complete.
W20260709 12:22:18.367379 25168 consensus_peers.cc:597] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.368178 25168 consensus_peers.cc:597] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.363164 25825 consensus_peers.cc:597] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.377249 25825 consensus_peers.cc:597] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.404862 25168 consensus_peers.cc:597] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.487244 25168 consensus_peers.cc:597] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.498016 25242 consensus_peers.cc:597] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.498545 25825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:43905, user_credentials={real_user=slave}} blocked reactor thread for 44297.3us
W20260709 12:22:18.505841 25242 consensus_peers.cc:597] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.503780 25168 consensus_peers.cc:597] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.508266 25168 consensus_peers.cc:597] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:18.522668 25825 consensus_peers.cc:597] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:18.529385 25825 consensus_peers.cc:597] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:18.532348 25825 consensus_peers.cc:597] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:18.540808 25242 consensus_peers.cc:597] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.568383 25168 consensus_peers.cc:597] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.569062 25242 consensus_peers.cc:597] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.610930 25168 consensus_peers.cc:597] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.614270 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.630997 25825 consensus_peers.cc:597] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:18.655911 25168 consensus_peers.cc:597] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:18.752099 25242 consensus_peers.cc:597] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:22:18.794858 23879 tablet_server.cc:179] TabletServer@127.23.81.194:0 shutting down...
W20260709 12:22:18.856048 25242 consensus_peers.cc:597] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:18.865365 25168 consensus_peers.cc:597] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:18.894659 25825 consensus_peers.cc:597] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.350881 25168 consensus_peers.cc:597] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:19.351395 25168 consensus_peers.cc:597] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:19.364063 25822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:44749, user_credentials={real_user=slave}} blocked reactor thread for 297278us
W20260709 12:22:19.374524 25168 consensus_peers.cc:597] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:19.469894 25242 consensus_peers.cc:597] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.479002 25242 consensus_peers.cc:597] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.494626 25242 consensus_peers.cc:597] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.495718 25242 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.496520 25242 consensus_peers.cc:597] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.497087 25242 consensus_peers.cc:597] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.497620 25242 consensus_peers.cc:597] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.498191 25242 consensus_peers.cc:597] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.498750 25242 consensus_peers.cc:597] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.504172 25168 consensus_peers.cc:597] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:19.531857 25168 consensus_peers.cc:597] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:19.619410 25241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:45401, user_credentials={real_user=slave}} blocked reactor thread for 90229.8us
W20260709 12:22:19.654420 25825 consensus_peers.cc:597] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.655537 25825 consensus_peers.cc:597] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.659566 25825 consensus_peers.cc:597] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.660245 25825 consensus_peers.cc:597] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.662514 25825 consensus_peers.cc:597] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.686213 25168 consensus_peers.cc:597] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:22:19.691383 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:22:19.692994 25825 consensus_peers.cc:597] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.703630 25825 consensus_peers.cc:597] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.704818 25825 consensus_peers.cc:597] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:19.705461 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:19.704150 23879 tablet_replica.cc:333] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.707571 23879 raft_consensus.cc:2243] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:22:19.708803 23879 raft_consensus.cc:2272] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.717576 23879 tablet_replica.cc:333] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.718514 23879 raft_consensus.cc:2243] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:19.726661 23879 raft_consensus.cc:2272] T b9bae455c93a497ca28011bd9cd473ec P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.736972 23879 tablet_replica.cc:333] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.737975 23879 raft_consensus.cc:2243] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:22:19.739315 23879 raft_consensus.cc:2272] T 242311f4ad5044b2ada00bc49a50afeb P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.742285 23879 tablet_replica.cc:333] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.753901 23879 raft_consensus.cc:2243] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:19.754727 23879 raft_consensus.cc:2272] T d606e00420654b22bb1000c1b0aacbbc P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.757580 23879 tablet_replica.cc:333] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.758535 23879 raft_consensus.cc:2243] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:22:19.759799 23879 raft_consensus.cc:2272] T 258fe130eb914f5b858baf4782663574 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.776854 23879 tablet_replica.cc:333] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.777838 23879 raft_consensus.cc:2243] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:19.778745 23879 raft_consensus.cc:2272] T ff47c111f89a444a9c5a1794454f0789 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.782949 23879 tablet_replica.cc:333] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.783854 23879 raft_consensus.cc:2243] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:19.784595 23879 raft_consensus.cc:2272] T 3552726c022345b394b69265b8f3b566 P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.794090 23879 tablet_replica.cc:333] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.796231 23879 raft_consensus.cc:2243] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:19.797741 31786 raft_consensus.cc:493] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:19.798300 31786 raft_consensus.cc:515] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:19.800808 31786 leader_election.cc:290] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:19.805260 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08989457946a4946811751dc96e31276" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:22:19.810954 25168 leader_election.cc:336] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:19.811488 25168 leader_election.cc:304] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:22:19.812696 31786 raft_consensus.cc:2749] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:19.815095 23879 raft_consensus.cc:2272] T 783cdcb70b0d4499b94b2f51672f6895 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.818192 23879 tablet_replica.cc:333] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.831521 23879 raft_consensus.cc:2243] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:19.832332 23879 raft_consensus.cc:2272] T fcbf7458baff481588dabf347ec2112d P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.836946 23879 tablet_replica.cc:333] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.843052 23879 raft_consensus.cc:2243] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:19.844343 23879 raft_consensus.cc:2272] T 8dcb58fb89c744c58d9494a99f2adda8 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.852975 23879 tablet_replica.cc:333] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.860937 23879 raft_consensus.cc:2243] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:22:19.862397 23879 raft_consensus.cc:2272] T 2d4c46d8dc974803aa09fb2a6515ca35 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.871297 23879 tablet_replica.cc:333] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.872241 23879 raft_consensus.cc:2243] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:19.881507 23879 raft_consensus.cc:2272] T e42a38bc05c84ba69ac42605a0f627ca P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.884341 23879 tablet_replica.cc:333] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.886193 23879 raft_consensus.cc:2243] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:22:19.887442 23879 raft_consensus.cc:2272] T a2a57280b61f41a6afa7fea941bb108c P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.896377 23879 tablet_replica.cc:333] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.897343 23879 raft_consensus.cc:2243] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:22:19.898977 23879 raft_consensus.cc:2272] T 289cd948a1764490bf11226eedd2c4c7 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.912452 23879 tablet_replica.cc:333] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.914867 23879 raft_consensus.cc:2243] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:19.922637 23879 raft_consensus.cc:2272] T 3bde194ca9e544f1befacd3ad39463a2 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.928757 23879 tablet_replica.cc:333] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.934692 23879 raft_consensus.cc:2243] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:22:19.936038 23879 raft_consensus.cc:2272] T 960cba74c5c0438f9a3d8e25d8dec7ad P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.939154 23879 tablet_replica.cc:333] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.955428 23879 raft_consensus.cc:2243] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Raft consensus shutting down.
W20260709 12:22:19.955857 25168 consensus_peers.cc:597] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:22:19.956812 23879 raft_consensus.cc:2272] T 504eece31eb848cc80169ecf5ab51b9a P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.965690 23879 tablet_replica.cc:333] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:19.966738 23879 raft_consensus.cc:2243] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:22:19.973610 23879 raft_consensus.cc:2272] T 6e78737bee66450b9a076cc9676331b9 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.000065 23879 tablet_replica.cc:333] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.004419 31817 raft_consensus.cc:493] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:20.008145 31817 raft_consensus.cc:515] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:20.012004 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:20.014509 31822 raft_consensus.cc:493] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:20.015084 31822 raft_consensus.cc:515] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:20.015877 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86f3fbaedb441bfa448cef75c5e613f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:20.017267 31817 leader_election.cc:290] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:20.017249 31822 leader_election.cc:290] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:20.018834 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:20.018846 23879 raft_consensus.cc:2243] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.020511 31822 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:20.021013 31822 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:20.023702 31822 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:20.024160 23879 raft_consensus.cc:2272] T 7f120f7a3d32426ab1243e87fe0194ac P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.024808 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:20.027055 23879 tablet_replica.cc:333] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.035132 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c305b34a0c54275af750c832f52691f" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:20.035619 23879 raft_consensus.cc:2243] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.036868 23879 raft_consensus.cc:2272] T fd7e49fd52d74821a66c7dbbc770a988 P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.040720 23879 tablet_replica.cc:333] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.042691 23879 raft_consensus.cc:2243] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.054251 25165 leader_election.cc:304] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:22:20.044088 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f83e7883b540d9907ceefaa443f104" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:20.056016 23879 raft_consensus.cc:2272] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.068814 25165 leader_election.cc:304] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:22:20.068972 31817 raft_consensus.cc:670] T 9d246e87571b4365a1d11d98c7455fb9 P b83c12959b9848b3b7bbc680f5ee6225: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 12:22:20.069454 31822 raft_consensus.cc:2749] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:20.077853 25165 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:22:20.078202 31822 raft_consensus.cc:2749] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:20.078691 31817 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:20.079665 23879 tablet_replica.cc:333] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.080487 23879 raft_consensus.cc:2243] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.083635 23879 raft_consensus.cc:2272] T c0821374625d4793801ab3b3f502714e P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:20.085628 25297 debug-util.cc:398] Leaking SignalData structure 0x7b0800318340 after lost signal to thread 23882
W20260709 12:22:20.087780 25297 debug-util.cc:398] Leaking SignalData structure 0x7b080026eda0 after lost signal to thread 25059
W20260709 12:22:20.088785 25297 debug-util.cc:398] Leaking SignalData structure 0x7b0800247e20 after lost signal to thread 25226
W20260709 12:22:20.089903 25297 debug-util.cc:398] Leaking SignalData structure 0x7b08000ed540 after lost signal to thread 25300
W20260709 12:22:20.091238 25297 debug-util.cc:398] Leaking SignalData structure 0x7b0800160760 after lost signal to thread 25884
I20260709 12:22:20.096271 23879 tablet_replica.cc:333] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.097781 23879 raft_consensus.cc:2243] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.105151 23879 raft_consensus.cc:2272] T 08989457946a4946811751dc96e31276 P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.110198 23879 tablet_replica.cc:333] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
W20260709 12:22:20.113148 25168 consensus_peers.cc:597] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:22:20.115517 31817 raft_consensus.cc:493] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:20.115672 23879 raft_consensus.cc:2243] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.116129 31817 raft_consensus.cc:515] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:20.120764 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e3b9e5896c4b539daf785219debb12" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:20.121804 31817 leader_election.cc:290] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:22:20.137701 25168 leader_election.cc:336] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:20.138156 25168 leader_election.cc:304] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 4456c1069d1541fab5b7cb29df9b6167, 897be935c42e41b995f177155b042be0
I20260709 12:22:20.139338 31817 raft_consensus.cc:2749] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:20.141680 31817 raft_consensus.cc:493] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:20.142222 31817 raft_consensus.cc:515] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:20.145149 23879 raft_consensus.cc:2272] T e72fd84f77df4beba49c7d81e1b26f8e P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.147267 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:20.147931 31817 leader_election.cc:290] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:20.152164 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450e4351142d43ca91af7ff9ee99c74b" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:20.155123 23879 tablet_replica.cc:333] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.156014 23879 raft_consensus.cc:2243] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.157997 25165 leader_election.cc:304] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
I20260709 12:22:20.162711 31817 raft_consensus.cc:2749] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:20.173697 25168 consensus_peers.cc:597] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:20.173656 23879 raft_consensus.cc:2272] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.182992 23879 tablet_replica.cc:333] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.183807 23879 raft_consensus.cc:2243] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.184494 23879 raft_consensus.cc:2272] T b86f3fbaedb441bfa448cef75c5e613f P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.195111 23879 tablet_replica.cc:333] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.202422 23879 raft_consensus.cc:2243] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.203140 23879 raft_consensus.cc:2272] T 450e4351142d43ca91af7ff9ee99c74b P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.211071 23879 tablet_replica.cc:333] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.211966 23879 raft_consensus.cc:2243] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.228453 23879 raft_consensus.cc:2272] T 724a325f5a004fdab6dc4a9bcba2a3e9 P b83c12959b9848b3b7bbc680f5ee6225 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:20.228474 25242 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:20.235312 31817 raft_consensus.cc:493] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4456c1069d1541fab5b7cb29df9b6167)
I20260709 12:22:20.235993 31817 raft_consensus.cc:515] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:20.239831 31817 leader_election.cc:290] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:20.239773 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:20.240510 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155471b361b441c095eae34b64eb0bed" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:20.242233 25167 leader_election.cc:304] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167
W20260709 12:22:20.242838 25168 leader_election.cc:336] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:20.243144 31817 raft_consensus.cc:2749] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:20.250316 31817 raft_consensus.cc:493] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:20.251448 31817 raft_consensus.cc:515] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:20.256950 31817 leader_election.cc:290] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:20.258011 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1081a743e5e04f24a0aebd684da3a15d" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:22:20.259166 25168 leader_election.cc:336] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:20.249496 23879 tablet_replica.cc:333] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.262174 23879 raft_consensus.cc:2243] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.262754 23879 raft_consensus.cc:2272] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.262975 25165 leader_election.cc:304] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
W20260709 12:22:20.263692 25165 raft_consensus.cc:2686] T 1081a743e5e04f24a0aebd684da3a15d P b83c12959b9848b3b7bbc680f5ee6225: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:22:20.274437 23879 tablet_replica.cc:333] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.275267 23879 raft_consensus.cc:2243] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:22:20.275564 25825 consensus_peers.cc:597] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:20.276448 23879 raft_consensus.cc:2272] T b0e4085b9c3e4704891292cf0881ea14 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.294413 23879 tablet_replica.cc:333] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.295471 23879 raft_consensus.cc:2243] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.296399 31817 raft_consensus.cc:493] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:20.296988 31817 raft_consensus.cc:515] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:20.299254 31817 leader_election.cc:290] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:20.300359 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fec2cd07604cab87091a034eba2f38" candidate_uuid: "b83c12959b9848b3b7bbc680f5ee6225" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
W20260709 12:22:20.304070 25168 leader_election.cc:336] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:20.304548 25168 leader_election.cc:304] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b83c12959b9848b3b7bbc680f5ee6225; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:22:20.305680 31817 raft_consensus.cc:2749] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:20.317911 23879 raft_consensus.cc:2272] T 4fb0b452100949b58ad2bf4a4aed36fa P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:20.320214 25242 consensus_peers.cc:597] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:20.326939 23879 tablet_replica.cc:333] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.327795 23879 raft_consensus.cc:2243] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:22:20.345577 25242 consensus_peers.cc:597] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:20.359288 23879 raft_consensus.cc:2272] T 392ec479375b41bbb38793a0c207912d P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.362133 23879 tablet_replica.cc:333] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.367512 23879 raft_consensus.cc:2243] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.373746 23879 raft_consensus.cc:2272] T d683b7b361f44f7cb6076cf5ac95611b P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.380656 23879 tablet_replica.cc:333] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.381634 23879 raft_consensus.cc:2243] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.395521 23879 raft_consensus.cc:2272] T 9c305b34a0c54275af750c832f52691f P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.398545 23879 tablet_replica.cc:333] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.399434 23879 raft_consensus.cc:2243] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.400776 23879 raft_consensus.cc:2272] T 951ec28047e64bb7a386c7d66a082fd0 P b83c12959b9848b3b7bbc680f5ee6225 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.406654 23879 tablet_replica.cc:333] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.415230 23879 raft_consensus.cc:2243] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.417997 23879 raft_consensus.cc:2272] T 74518b8711d94925993fc2a788e89ccb P b83c12959b9848b3b7bbc680f5ee6225 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.421657 23879 tablet_replica.cc:333] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.431615 23879 raft_consensus.cc:2243] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.436668 23879 raft_consensus.cc:2272] T e7e59abaef5845e2bb8f466331bb98c3 P b83c12959b9848b3b7bbc680f5ee6225 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.446524 23879 tablet_replica.cc:333] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.447499 23879 raft_consensus.cc:2243] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.448951 23879 raft_consensus.cc:2272] T b1d4aa6fab2741dda3fcae71491a229a P b83c12959b9848b3b7bbc680f5ee6225 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.457391 23879 tablet_replica.cc:333] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.458348 23879 raft_consensus.cc:2243] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.459263 23879 raft_consensus.cc:2272] T 47f83e7883b540d9907ceefaa443f104 P b83c12959b9848b3b7bbc680f5ee6225 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.466331 23879 tablet_replica.cc:333] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
W20260709 12:22:20.471699 25825 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111) [suppressed 482 similar messages]
I20260709 12:22:20.472508 23879 raft_consensus.cc:2243] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.473237 23879 raft_consensus.cc:2272] T 81fec2cd07604cab87091a034eba2f38 P b83c12959b9848b3b7bbc680f5ee6225 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.475950 23879 tablet_replica.cc:333] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.477851 23879 raft_consensus.cc:2243] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.485247 23879 raft_consensus.cc:2272] T b1e3b9e5896c4b539daf785219debb12 P b83c12959b9848b3b7bbc680f5ee6225 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:20.494812 25242 consensus_peers.cc:597] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:20.495325 25242 consensus_peers.cc:597] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:20.526403 25242 consensus_peers.cc:597] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:20.530387 23879 tablet_replica.cc:333] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.544907 23879 raft_consensus.cc:2243] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.547214 23879 raft_consensus.cc:2272] T 78607220ddf2470a80cefc5d012e7625 P b83c12959b9848b3b7bbc680f5ee6225 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.552615 23879 tablet_replica.cc:333] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.553452 23879 raft_consensus.cc:2243] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.554838 23879 raft_consensus.cc:2272] T 155471b361b441c095eae34b64eb0bed P b83c12959b9848b3b7bbc680f5ee6225 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.557526 23879 tablet_replica.cc:333] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.558285 23879 raft_consensus.cc:2243] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.559515 23879 raft_consensus.cc:2272] T aaeb230a0f814ad1849053d7a19c90d6 P b83c12959b9848b3b7bbc680f5ee6225 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.562579 23879 tablet_replica.cc:333] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225: stopping tablet replica
I20260709 12:22:20.563316 23879 raft_consensus.cc:2243] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.565501 23879 raft_consensus.cc:2272] T e81b9ed959214538853077eddd8dc8ea P b83c12959b9848b3b7bbc680f5ee6225 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:20.734285 25242 consensus_peers.cc:597] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:20.752652 25825 consensus_peers.cc:597] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:20.813700 25242 consensus_peers.cc:597] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:20.866740 31828 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:20.867349 31828 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:20.869421 31828 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:20.887749 25242 leader_election.cc:336] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:20.889241 25242 leader_election.cc:336] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:20.894702 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:20.896818 31828 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:20.921767 25242 consensus_peers.cc:597] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:21.022187 25825 consensus_peers.cc:597] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:21.028328 25825 consensus_peers.cc:597] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:21.049870 31828 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.050458 31828 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:21.052525 31828 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:21.061195 25242 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:21.063292 25242 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.063829 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.065399 31828 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:21.095353 25825 consensus_peers.cc:597] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:21.100716 25825 consensus_peers.cc:597] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:22:21.102721 31828 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.103384 31828 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.106559 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:21.108290 31828 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:22:21.108938 25825 consensus_peers.cc:597] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:21.120949 31830 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.121590 31830 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.123939 31830 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:21.120299 25242 leader_election.cc:336] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.126955 25242 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:22:21.129963 25825 leader_election.cc:336] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:21.130641 31831 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.131608 31828 raft_consensus.cc:2749] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:21.131474 31831 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.132351 31830 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.132916 31830 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.133683 31831 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:21.134613 25825 leader_election.cc:336] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.135056 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.135341 31830 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:21.135903 31830 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:21.136658 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:21.137323 25269 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 19.
I20260709 12:22:21.138541 25822 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:22:21.146478 31830 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:21.148265 31830 raft_consensus.cc:493] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.148810 31830 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:21.150686 25825 leader_election.cc:336] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:21.151415 25825 leader_election.cc:336] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.151895 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.152585 31831 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:21.153815 31828 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.154433 31828 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:22:21.166278 25825 leader_election.cc:336] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.173969 31828 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:21.190141 31830 raft_consensus.cc:515] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:21.200273 25242 leader_election.cc:336] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:21.202061 31812 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.210799 31812 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:21.212944 31812 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:21.202553 31828 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.213683 31828 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:21.215736 31828 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:21.223727 25242 leader_election.cc:336] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.224287 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.226001 31812 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:21.234377 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c46d8dc974803aa09fb2a6515ca35" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:21.234928 25269 raft_consensus.cc:3060] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:21.241154 31830 leader_election.cc:290] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:22:21.244678 25825 leader_election.cc:336] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:21.246464 25242 leader_election.cc:336] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:21.247071 25242 leader_election.cc:336] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:21.248920 25269 raft_consensus.cc:2468] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 20.
W20260709 12:22:21.247998 25242 leader_election.cc:336] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.253633 25822 leader_election.cc:304] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.259829 31828 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.260439 31828 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:21.262706 31828 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:21.263335 31829 raft_consensus.cc:2804] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:21.263964 31829 raft_consensus.cc:697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 20 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:22:21.264882 31829 consensus_queue.cc:237] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.266568 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.272080 31812 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:21.278384 25242 leader_election.cc:336] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.278964 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.279867 31812 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:21.293817 25825 consensus_peers.cc:597] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:22:21.302919 25024 catalog_manager.cc:5697] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 19 to 20, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 20 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:21.306923 25825 consensus_peers.cc:597] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:21.314888 25242 leader_election.cc:336] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:21.316085 25242 leader_election.cc:336] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.316493 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.317163 31828 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:21.341756 31831 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.342428 31831 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:21.343230 25825 consensus_peers.cc:597] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:21.347566 31831 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:21.347777 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:21.357412 31828 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:22:21.357638 25825 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:21.358182 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:22:21.357987 31828 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.358893 31831 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:21.359790 25825 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.361847 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:21.362546 25854 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e30bdd4cd1b45299f50b9bcfc9c1667 in term 17.
I20260709 12:22:21.363965 31828 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
I20260709 12:22:21.371047 31829 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.371809 31831 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.371663 31829 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.372424 31831 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.373842 31829 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:21.374625 31831 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:21.379092 25242 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:21.400508 25242 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.401183 25242 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.401971 31812 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:21.410743 25242 consensus_peers.cc:597] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:21.413599 25825 leader_election.cc:336] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:21.415522 25825 leader_election.cc:336] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:21.418797 25825 leader_election.cc:336] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:21.419981 25242 consensus_peers.cc:597] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:21.419478 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.422144 31831 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:21.423236 25825 leader_election.cc:336] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.423733 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.426818 31831 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:21.430444 25242 consensus_peers.cc:597] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:21.445053 31831 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.445669 31831 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.447976 31831 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:21.464880 31831 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.465631 31831 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.474472 31828 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.475132 31828 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:21.477275 31828 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:21.478737 31831 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:21.489910 31828 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.490672 31828 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.495468 25854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4456c1069d1541fab5b7cb29df9b6167" is_pre_election: true
I20260709 12:22:21.497329 31828 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196:45401)
W20260709 12:22:21.504187 25825 leader_election.cc:336] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:21.509356 25825 leader_election.cc:336] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.512312 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:22:21.511794 25242 consensus_peers.cc:597] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:21.513260 31829 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:21.517364 25242 leader_election.cc:336] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:21.524178 25242 leader_election.cc:336] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:21.532377 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:22:21.533152 25825 leader_election.cc:336] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:21.534348 25825 leader_election.cc:336] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.534852 31828 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:21.536655 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.539755 31829 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:21.557394 31831 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.561337 31831 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.563895 31831 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:21.564945 25242 consensus_peers.cc:597] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:21.568264 25242 leader_election.cc:336] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.568727 25242 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 4456c1069d1541fab5b7cb29df9b6167, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.571573 31828 raft_consensus.cc:2749] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:21.573724 25242 consensus_peers.cc:597] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:21.585458 31831 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.586457 31831 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.591390 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:21.592072 25269 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 8.
I20260709 12:22:21.593423 25822 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:22:21.594344 31829 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:21.594741 31829 raft_consensus.cc:493] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.595139 31829 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:21.596793 31830 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.597375 31830 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.599814 31830 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:21.603582 31831 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:22:21.607344 25223 debug-util.cc:398] Leaking SignalData structure 0x7b08003bf700 after lost signal to thread 23882
W20260709 12:22:21.608477 25223 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6ae0 after lost signal to thread 25059
W20260709 12:22:21.609092 25223 debug-util.cc:398] Leaking SignalData structure 0x7b0800016460 after lost signal to thread 25226
W20260709 12:22:21.610213 25223 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9860 after lost signal to thread 25300
W20260709 12:22:21.611889 25223 debug-util.cc:398] Leaking SignalData structure 0x7b080036ada0 after lost signal to thread 25884
W20260709 12:22:21.613534 25825 consensus_peers.cc:597] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:21.615975 25825 leader_election.cc:336] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:21.610752 31829 raft_consensus.cc:515] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:21.620707 25242 consensus_peers.cc:597] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:21.618283 25825 leader_election.cc:336] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.623495 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724a325f5a004fdab6dc4a9bcba2a3e9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667"
I20260709 12:22:21.624552 25269 raft_consensus.cc:3060] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:21.632535 25269 raft_consensus.cc:2468] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 9.
I20260709 12:22:21.634413 25822 leader_election.cc:304] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 
I20260709 12:22:21.635399 31831 raft_consensus.cc:2804] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:21.635907 31831 raft_consensus.cc:697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Becoming Leader. State: Replica: 4456c1069d1541fab5b7cb29df9b6167, State: Running, Role: LEADER
I20260709 12:22:21.636924 31831 consensus_queue.cc:237] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.633067 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.641630 31830 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:21.644332 31829 leader_election.cc:290] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: Requested vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:21.654850 31830 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.655510 31830 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.657866 31830 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:21.660956 31830 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.661551 31830 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.663848 31830 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:21.696589 25825 leader_election.cc:336] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:21.697576 25825 leader_election.cc:336] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:21.698552 25825 leader_election.cc:336] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:21.702224 25825 leader_election.cc:336] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:21.702800 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.700680 25024 catalog_manager.cc:5697] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 reported cstate change: term changed from 8 to 9, leader changed from b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194) to 4456c1069d1541fab5b7cb29df9b6167 (127.23.81.196). New cstate: current_term: 9 leader_uuid: "4456c1069d1541fab5b7cb29df9b6167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:21.703660 31829 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:21.711117 31829 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.711732 31829 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.714074 31829 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:21.718400 25825 leader_election.cc:336] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:21.719161 25825 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:21.727466 25825 leader_election.cc:336] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:21.728034 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.728881 31831 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:21.730104 25825 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:21.730597 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.731390 31831 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:22:21.738406 25825 leader_election.cc:336] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:21.739280 25825 leader_election.cc:336] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.740005 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.740816 31831 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:21.774662 31831 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.775310 31831 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:21.777491 31831 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:21.788525 23879 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 25223)
W20260709 12:22:21.797327 25825 leader_election.cc:336] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:21.798229 25825 leader_election.cc:336] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.798715 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:22:21.804742 25242 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:21.806288 31831 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:21.831842 31828 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.832453 31828 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:22:21.846549 25242 consensus_peers.cc:597] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:21.849314 31828 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:21.859512 25242 leader_election.cc:336] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:21.860268 25242 leader_election.cc:336] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:21.860690 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.869951 31828 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:21.871786 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:21.872555 25825 consensus_peers.cc:597] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.900532 25269 raft_consensus.cc:1275] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:22:21.903944 31831 consensus_queue.cc:1048] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:22:21.922227 31842 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:21.922830 31842 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:21.925155 31842 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:21.929442 25242 consensus_peers.cc:597] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:21.933545 25242 leader_election.cc:336] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:21.934288 25242 leader_election.cc:336] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:21.934767 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:21.935531 31842 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:21.975268 25825 consensus_peers.cc:597] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:21.994450 25825 consensus_peers.cc:597] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:22.025848 25242 consensus_peers.cc:597] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:22.025936 25825 consensus_peers.cc:597] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:22.030296 31842 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:22.031047 31842 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:22.033527 31842 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:22.040926 25242 consensus_peers.cc:597] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:22.057392 25825 consensus_peers.cc:597] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:22.060593 25242 leader_election.cc:336] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:22.080842 25242 leader_election.cc:336] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:22.083129 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:22.084048 31842 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:22.113385 25825 consensus_peers.cc:597] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:22.120612 25825 consensus_peers.cc:597] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:22.144084 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:22.184725 25270 raft_consensus.cc:1275] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Refusing update from remote peer 4456c1069d1541fab5b7cb29df9b6167: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:22:22.186317 25825 consensus_peers.cc:597] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:22.188715 31831 consensus_queue.cc:1048] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:22:22.234833 25825 consensus_peers.cc:597] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:22.368884 25825 consensus_peers.cc:597] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:22.494542 25242 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:22.672245 25242 consensus_peers.cc:597] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:22.789047 23879 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 25223)
I20260709 12:22:22.847946 31842 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:22.848551 31842 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:22:22.848875 25242 consensus_peers.cc:597] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:22.850742 31842 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:22.860843 25242 leader_election.cc:336] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:22.861795 25242 leader_election.cc:336] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:22.869210 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:22.870080 31842 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:22.965456 31844 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:22.966089 31844 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:22.968686 31844 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:22.969740 25270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:22.970467 25270 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
W20260709 12:22:22.977562 25825 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:22.979664 25825 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:22.980252 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:22.981112 31844 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:23.009779 25242 consensus_peers.cc:597] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:23.011955 25825 consensus_peers.cc:597] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:23.022581 31812 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.023192 31812 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:23.025233 31812 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.048143 25242 leader_election.cc:336] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:23.049032 25242 leader_election.cc:336] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.049731 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.051072 31812 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:23.084375 25242 consensus_peers.cc:597] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:23.090760 25825 consensus_peers.cc:597] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:23.106290 31812 raft_consensus.cc:493] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.106909 31812 raft_consensus.cc:515] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:23.109155 31812 leader_election.cc:290] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:23.116920 31844 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:22:23.117048 25242 leader_election.cc:336] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:23.118616 31844 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:23.121073 31844 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.121899 25242 leader_election.cc:336] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.122385 25242 leader_election.cc:304] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.123842 31812 raft_consensus.cc:2749] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:23.127918 25825 leader_election.cc:336] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:23.128517 31812 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:22:23.128785 25825 leader_election.cc:336] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.129078 31812 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:23.129510 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.131155 31829 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:23.131258 31812 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.150228 25242 leader_election.cc:336] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:23.152076 25242 leader_election.cc:336] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:23.153014 31844 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.153681 31844 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:23.156116 31844 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:23.152609 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.160823 31812 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:23.162470 25825 leader_election.cc:336] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:23.164981 25825 leader_election.cc:336] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:23.165390 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.166002 31844 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:23.173918 31844 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.175068 31844 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:23.177171 31812 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.177780 31812 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:23.179935 31812 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:23.182405 31844 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.185578 25825 leader_election.cc:336] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:23.190059 25825 leader_election.cc:336] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.190623 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.191428 31829 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:23.187852 31844 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.195432 31844 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:23.201531 25825 leader_election.cc:336] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:23.214040 25242 leader_election.cc:336] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:23.214804 25242 leader_election.cc:336] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.215243 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.213320 31844 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:23.216060 31812 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:23.217689 25825 leader_election.cc:336] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.218554 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.221484 31829 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:23.222126 31829 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.222574 31829 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:23.225339 31829 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.237206 25825 leader_election.cc:336] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:23.237929 25825 leader_election.cc:336] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:23.238402 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.242385 31844 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:23.260004 25242 consensus_peers.cc:597] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:23.307667 31812 raft_consensus.cc:493] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.308300 31812 raft_consensus.cc:515] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:23.309689 31844 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.310281 31844 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:23.324600 31812 leader_election.cc:290] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:23.331807 31844 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.345438 25825 leader_election.cc:336] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:23.349750 31829 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:22:23.350798 25242 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:23.351262 25825 consensus_peers.cc:597] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:23.350437 31829 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:23.353477 31829 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.352038 25825 leader_election.cc:336] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.362177 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.363376 31829 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:23.374886 25242 consensus_peers.cc:597] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:23.375473 25242 leader_election.cc:336] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:23.375921 25242 leader_election.cc:304] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.376684 31850 raft_consensus.cc:2749] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:23.377490 25825 leader_election.cc:336] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:23.378106 25825 leader_election.cc:336] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.378682 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.380888 31829 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:23.385777 31829 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.386287 31829 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:23.388391 31829 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.391613 25242 consensus_peers.cc:597] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:23.398553 25825 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:23.399235 25825 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.400501 31829 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.401100 31829 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:23.403101 31829 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:23.403597 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.407855 31829 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:22:23.420423 25825 leader_election.cc:336] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:23.422433 25825 leader_election.cc:336] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.422921 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.423786 31829 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.426323 31829 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:23.428337 31829 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:23.429121 31829 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:23.437395 31853 raft_consensus.cc:493] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.438215 31853 raft_consensus.cc:515] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:23.440845 31853 leader_election.cc:290] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.444238 25242 consensus_peers.cc:597] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:23.448071 25242 leader_election.cc:336] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:23.448855 25242 leader_election.cc:336] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.449306 25242 leader_election.cc:304] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.450150 31853 raft_consensus.cc:2749] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:23.452519 25825 consensus_peers.cc:597] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:23.453015 25825 leader_election.cc:336] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:23.454988 25825 leader_election.cc:336] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.455415 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.461355 31829 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:23.473994 25825 consensus_peers.cc:597] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:23.512602 31852 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.513145 31852 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:23.514559 25825 consensus_peers.cc:597] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:22:23.515336 31852 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.524699 25825 leader_election.cc:336] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:23.530103 31853 raft_consensus.cc:493] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:22:23.530385 25825 leader_election.cc:336] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.530850 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.530814 31853 raft_consensus.cc:515] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:23.531764 31852 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:23.536509 31853 leader_election.cc:290] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.541039 25242 leader_election.cc:336] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:23.549911 25242 leader_election.cc:336] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.551847 25242 leader_election.cc:304] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.553802 31853 raft_consensus.cc:2749] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:23.672930 31829 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:22:23.678900 25242 consensus_peers.cc:597] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:23.673629 31829 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:23.682153 31829 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.689478 25825 leader_election.cc:336] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:23.690279 25825 leader_election.cc:336] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.690737 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.691586 31829 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:23.796555 25825 consensus_peers.cc:597] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:23.832965 25825 consensus_peers.cc:597] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:23.885612 31853 raft_consensus.cc:493] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:23.886188 31853 raft_consensus.cc:515] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:23.888254 31853 leader_election.cc:290] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:23.897993 25242 leader_election.cc:336] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:23.900163 25242 leader_election.cc:336] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:23.900687 25242 leader_election.cc:304] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:23.902426 31853 raft_consensus.cc:2749] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:23.906620 25242 consensus_peers.cc:597] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:23.907140 25242 consensus_peers.cc:597] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:23.958355 25825 consensus_peers.cc:597] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:23.961496 25825 consensus_peers.cc:597] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:24.004273 25242 consensus_peers.cc:597] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.011011 25825 consensus_peers.cc:597] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.076998 25242 consensus_peers.cc:597] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.098013 25242 consensus_peers.cc:597] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:24.140076 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:24.186306 25825 consensus_peers.cc:597] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:24.210069 31812 raft_consensus.cc:493] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:24.210664 31812 raft_consensus.cc:515] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:24.212751 31812 leader_election.cc:290] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:24.221858 25242 leader_election.cc:336] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:24.222658 25242 leader_election.cc:336] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:24.223094 25242 leader_election.cc:304] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:24.223831 31812 raft_consensus.cc:2749] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:24.225719 25242 consensus_peers.cc:597] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.240007 25242 consensus_peers.cc:597] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.287125 25242 consensus_peers.cc:597] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.317080 25242 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.489764 25242 consensus_peers.cc:597] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.513281 25825 consensus_peers.cc:597] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.513753 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.536540 25825 consensus_peers.cc:597] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.542536 25242 consensus_peers.cc:597] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.620286 25825 consensus_peers.cc:597] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.698156 25825 consensus_peers.cc:597] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.719552 25825 consensus_peers.cc:597] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:24.723634 25825 consensus_peers.cc:597] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.724191 25825 consensus_peers.cc:597] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:24.729696 25825 consensus_peers.cc:597] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:24.786686 25825 consensus_peers.cc:597] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:24.828500 31853 raft_consensus.cc:493] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:24.829128 31853 raft_consensus.cc:515] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:24.830770 31812 raft_consensus.cc:493] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:24.831353 31812 raft_consensus.cc:515] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:24.831624 31853 leader_election.cc:290] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:24.833333 31812 leader_election.cc:290] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:24.838735 25242 leader_election.cc:336] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:24.840204 25242 leader_election.cc:336] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:24.841112 25242 leader_election.cc:336] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:24.841629 25242 leader_election.cc:304] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:24.842502 31812 raft_consensus.cc:2749] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:24.842677 25242 leader_election.cc:336] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:24.843206 25242 leader_election.cc:304] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:24.843897 31812 raft_consensus.cc:2749] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:24.897254 25242 consensus_peers.cc:597] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:22:24.907847 23879 tablet_server.cc:196] TabletServer@127.23.81.194:0 shutdown complete.
I20260709 12:22:24.956887 31854 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:24.957650 31854 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:24.964395 31852 raft_consensus.cc:493] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:24.965240 31852 raft_consensus.cc:515] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } attrs { replace: true } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:24.970965 25269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db99f5b516b4f578a44f8ba1bbc3fc9" candidate_uuid: "4456c1069d1541fab5b7cb29df9b6167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" is_pre_election: true
I20260709 12:22:24.971650 25269 raft_consensus.cc:2468] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4456c1069d1541fab5b7cb29df9b6167 in term 17.
I20260709 12:22:24.979668 31854 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:24.972187 31852 leader_election.cc:290] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:22:24.977747 25825 leader_election.cc:336] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:24.993484 25825 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:24.995596 25825 leader_election.cc:336] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:24.996158 25825 leader_election.cc:304] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:25.001209 31852 raft_consensus.cc:2749] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:25.028403 25825 leader_election.cc:336] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:25.030447 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:25.034894 31852 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:25.095625 23879 tablet_server.cc:179] TabletServer@127.23.81.195:0 shutting down...
W20260709 12:22:25.132300 25822 consensus_peers.cc:597] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.134859 25822 consensus_peers.cc:597] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.145937 25822 consensus_peers.cc:597] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:25.149305 31856 raft_consensus.cc:493] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:25.149943 31856 raft_consensus.cc:515] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
W20260709 12:22:25.153597 25822 consensus_peers.cc:597] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.157241 25242 leader_election.cc:336] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:25.158370 31852 raft_consensus.cc:493] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:25.160996 31856 leader_election.cc:290] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:25.161428 31852 raft_consensus.cc:515] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:25.163632 31852 leader_election.cc:290] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:25.165913 25822 consensus_peers.cc:597] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.167352 25242 leader_election.cc:336] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:25.167865 25242 leader_election.cc:304] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:25.169445 31856 raft_consensus.cc:2749] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:25.170985 25825 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:25.171571 25825 leader_election.cc:336] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:25.171886 25825 leader_election.cc:304] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:25.175458 31852 raft_consensus.cc:2749] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:22:25.179247 25822 consensus_peers.cc:597] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.214525 25822 consensus_peers.cc:597] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.216655 25242 consensus_peers.cc:597] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:25.256251 25822 consensus_peers.cc:597] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:25.265038 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:22:25.265300 25822 consensus_peers.cc:597] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.269765 25822 consensus_peers.cc:597] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:25.271027 23879 tablet_replica.cc:333] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.272672 23879 raft_consensus.cc:2243] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.273983 23879 raft_consensus.cc:2272] T b9bae455c93a497ca28011bd9cd473ec P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.279641 23879 tablet_replica.cc:333] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.281441 31856 raft_consensus.cc:493] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:25.294378 31856 raft_consensus.cc:515] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } }
I20260709 12:22:25.296707 31856 leader_election.cc:290] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:25.304031 25242 leader_election.cc:336] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:25.304845 25242 leader_election.cc:336] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:25.305326 25242 leader_election.cc:304] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e30bdd4cd1b45299f50b9bcfc9c1667; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:25.307298 31812 raft_consensus.cc:2749] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:25.309787 23879 raft_consensus.cc:2243] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:25.310304 25822 consensus_peers.cc:597] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:25.310675 23879 raft_consensus.cc:2272] T 19982d505db74841b1c47ceaaf269baa P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.313921 23879 tablet_replica.cc:333] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.319288 23879 raft_consensus.cc:2243] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.320180 23879 raft_consensus.cc:2272] T f1f471cfad2348a09c4b699f01f9dfa9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:25.323873 25822 consensus_peers.cc:597] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:25.324047 23879 tablet_replica.cc:333] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.325050 23879 raft_consensus.cc:2243] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.326202 23879 raft_consensus.cc:2272] T d606e00420654b22bb1000c1b0aacbbc P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.329667 23879 tablet_replica.cc:333] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
W20260709 12:22:25.329860 25822 consensus_peers.cc:597] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.333523 25242 consensus_peers.cc:597] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:22:25.336717 23879 raft_consensus.cc:2243] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.338114 23879 raft_consensus.cc:2272] T 258fe130eb914f5b858baf4782663574 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.341737 23879 tablet_replica.cc:333] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.351517 23879 raft_consensus.cc:2243] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.352629 23879 raft_consensus.cc:2272] T 9f8512157f7e4dcc8a59428a2ccbd2a8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.354988 31852 raft_consensus.cc:493] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:25.355546 31852 raft_consensus.cc:515] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:25.357705 31852 leader_election.cc:290] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:25.357722 23879 tablet_replica.cc:333] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.359201 23879 raft_consensus.cc:2243] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.359952 23879 raft_consensus.cc:2272] T ff47c111f89a444a9c5a1794454f0789 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.370342 23879 tablet_replica.cc:333] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.373682 23879 raft_consensus.cc:2243] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.377723 23879 raft_consensus.cc:2272] T 7d3090ce3ca84e6e9649297156feeaef P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:25.380229 25825 leader_election.cc:336] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:25.381067 25825 leader_election.cc:336] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:25.381556 25825 leader_election.cc:304] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:25.382315 31852 raft_consensus.cc:2749] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:25.380740 23879 tablet_replica.cc:333] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.390974 23879 raft_consensus.cc:2243] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.392447 23879 raft_consensus.cc:2272] T 3552726c022345b394b69265b8f3b566 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.395255 23879 tablet_replica.cc:333] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.397141 23879 raft_consensus.cc:2243] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.397881 23879 raft_consensus.cc:2272] T 0ff71ed0aef74f1f963b143876c9b3d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.410135 23879 tablet_replica.cc:333] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.410888 23879 raft_consensus.cc:2243] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.411475 23879 raft_consensus.cc:2272] T 6248d848eecd4b799e9233d56f0b5467 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.413408 31852 raft_consensus.cc:493] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:25.413981 31852 raft_consensus.cc:515] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:25.413654 23879 tablet_replica.cc:333] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.415529 23879 raft_consensus.cc:2243] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.417281 23879 raft_consensus.cc:2272] T 783cdcb70b0d4499b94b2f51672f6895 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.419684 31852 leader_election.cc:290] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:25.424026 25825 leader_election.cc:336] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:25.420275 23879 tablet_replica.cc:333] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.425943 23879 raft_consensus.cc:2243] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.428762 23879 raft_consensus.cc:2272] T fcbf7458baff481588dabf347ec2112d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.431609 23879 tablet_replica.cc:333] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
W20260709 12:22:25.428000 25825 leader_election.cc:336] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:25.432063 25825 leader_election.cc:304] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:25.432809 31852 raft_consensus.cc:2749] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:25.434865 23879 raft_consensus.cc:2243] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.435663 23879 raft_consensus.cc:2272] T 8dcb58fb89c744c58d9494a99f2adda8 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.438567 23879 tablet_replica.cc:333] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.439415 23879 raft_consensus.cc:2243] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.440030 23879 raft_consensus.cc:2272] T c880ab05f6e24c9881bbc8954e0d9030 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.440610 31852 raft_consensus.cc:493] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:25.441172 31852 raft_consensus.cc:515] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:25.443599 31852 leader_election.cc:290] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:25.446733 31854 raft_consensus.cc:493] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:25.451212 31854 raft_consensus.cc:515] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:25.453215 31854 leader_election.cc:290] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:25.465003 25825 leader_election.cc:336] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:25.466405 25825 leader_election.cc:336] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:25.466874 25825 leader_election.cc:304] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:25.467859 31852 raft_consensus.cc:2749] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:25.480016 25825 consensus_peers.cc:597] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:25.480559 25825 leader_election.cc:336] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:25.481025 25825 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111) [suppressed 570 similar messages]
I20260709 12:22:25.481426 31852 raft_consensus.cc:493] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
W20260709 12:22:25.481809 25825 leader_election.cc:336] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:25.483166 25825 leader_election.cc:304] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:25.483083 31852 raft_consensus.cc:515] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:25.483969 31854 raft_consensus.cc:2749] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:25.489387 25822 consensus_peers.cc:597] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.499259 25822 consensus_peers.cc:597] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:25.508031 31852 leader_election.cc:290] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:25.533756 23879 tablet_replica.cc:333] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
W20260709 12:22:25.536037 25825 leader_election.cc:336] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:25.538347 25825 leader_election.cc:336] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:25.542966 25825 leader_election.cc:304] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:25.543725 31852 raft_consensus.cc:2749] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:25.545835 23879 raft_consensus.cc:2243] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.546562 23879 raft_consensus.cc:2272] T 289cd948a1764490bf11226eedd2c4c7 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.551537 23879 tablet_replica.cc:333] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.552349 23879 raft_consensus.cc:2243] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.553588 23879 raft_consensus.cc:2272] T e42a38bc05c84ba69ac42605a0f627ca P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.556224 23879 tablet_replica.cc:333] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.556994 23879 raft_consensus.cc:2243] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.557593 23879 raft_consensus.cc:2272] T 2d4c46d8dc974803aa09fb2a6515ca35 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.560034 23879 tablet_replica.cc:333] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.560827 23879 raft_consensus.cc:2243] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.561913 23879 raft_consensus.cc:2272] T f698d5eb641d4490aaa13e25382450db P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:25.573024 25822 consensus_peers.cc:597] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.579134 25822 consensus_peers.cc:597] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.587545 25822 consensus_peers.cc:597] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.591202 25822 consensus_peers.cc:597] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:25.590493 25825 consensus_peers.cc:597] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:25.599824 25242 consensus_peers.cc:597] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:25.600425 25242 consensus_peers.cc:597] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:25.603225 25242 consensus_peers.cc:597] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:22:25.606170 23879 tablet_replica.cc:333] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.607290 23879 raft_consensus.cc:2243] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.608050 23879 raft_consensus.cc:2272] T a2a57280b61f41a6afa7fea941bb108c P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.610778 23879 tablet_replica.cc:333] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.611564 23879 raft_consensus.cc:2243] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.612191 23879 raft_consensus.cc:2272] T 6b13f2e891f348229e95286682b88911 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.615059 23879 tablet_replica.cc:333] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.616016 23879 raft_consensus.cc:2243] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.616789 23879 raft_consensus.cc:2272] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.621351 23879 tablet_replica.cc:333] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.622401 23879 raft_consensus.cc:2243] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.637612 23879 raft_consensus.cc:2272] T 6afd466aa7a2455fa2f85263e303ec0f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.640895 23879 tablet_replica.cc:333] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.641752 23879 raft_consensus.cc:2243] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.643219 23879 raft_consensus.cc:2272] T 3bde194ca9e544f1befacd3ad39463a2 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.645738 23879 tablet_replica.cc:333] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.646509 23879 raft_consensus.cc:2243] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.651297 23879 raft_consensus.cc:2272] T 9d246e87571b4365a1d11d98c7455fb9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.655279 23879 tablet_replica.cc:333] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.661686 23879 raft_consensus.cc:2243] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.662895 23879 raft_consensus.cc:2272] T 1081a743e5e04f24a0aebd684da3a15d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:25.674585 25822 consensus_peers.cc:597] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Couldn't send request to peer 2e30bdd4cd1b45299f50b9bcfc9c1667. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:25.681496 23879 tablet_replica.cc:333] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.682722 23879 raft_consensus.cc:2243] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.683867 23879 raft_consensus.cc:2272] T 7f120f7a3d32426ab1243e87fe0194ac P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.694437 23879 tablet_replica.cc:333] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.696079 23879 raft_consensus.cc:2243] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.697175 23879 raft_consensus.cc:2272] T dba87711b0ab4e3394481dfecfeb886e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.700080 23879 tablet_replica.cc:333] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.701172 23879 raft_consensus.cc:2243] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.721681 23879 raft_consensus.cc:2272] T 504eece31eb848cc80169ecf5ab51b9a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.724435 23879 tablet_replica.cc:333] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.725312 23879 raft_consensus.cc:2243] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.725988 23879 raft_consensus.cc:2272] T b86f3fbaedb441bfa448cef75c5e613f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.734579 23879 tablet_replica.cc:333] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.735673 23879 raft_consensus.cc:2243] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.736364 23879 raft_consensus.cc:2272] T 450e4351142d43ca91af7ff9ee99c74b P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.745043 23879 tablet_replica.cc:333] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.752063 23879 raft_consensus.cc:2243] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.752807 23879 raft_consensus.cc:2272] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.755474 23879 tablet_replica.cc:333] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.773762 23879 raft_consensus.cc:2243] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.774791 23879 raft_consensus.cc:2272] T 155471b361b441c095eae34b64eb0bed P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.782387 23879 tablet_replica.cc:333] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.783277 23879 raft_consensus.cc:2243] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.783905 23879 raft_consensus.cc:2272] T aaeb230a0f814ad1849053d7a19c90d6 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.785588 31829 raft_consensus.cc:493] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:25.786372 23879 tablet_replica.cc:333] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.786108 31829 raft_consensus.cc:515] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:25.787318 23879 raft_consensus.cc:2243] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.788182 31829 leader_election.cc:290] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:25.788265 23879 raft_consensus.cc:2272] T 74518b8711d94925993fc2a788e89ccb P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.791471 23879 tablet_replica.cc:333] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.792236 23879 raft_consensus.cc:2243] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.792817 23879 raft_consensus.cc:2272] T 78607220ddf2470a80cefc5d012e7625 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.795564 23879 tablet_replica.cc:333] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.796358 23879 raft_consensus.cc:2243] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.798924 23879 raft_consensus.cc:2272] T 9c305b34a0c54275af750c832f52691f P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.801728 23879 tablet_replica.cc:333] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.802626 23879 raft_consensus.cc:2243] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 LEADER]: Raft consensus shutting down.
W20260709 12:22:25.803364 25825 leader_election.cc:336] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:25.804402 25825 leader_election.cc:336] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:25.804847 25825 leader_election.cc:304] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:25.806188 31829 raft_consensus.cc:2749] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:25.810406 23879 raft_consensus.cc:2272] T 47f83e7883b540d9907ceefaa443f104 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:25.814452 25825 consensus_peers.cc:597] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:25.815068 23879 tablet_replica.cc:333] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.816012 23879 raft_consensus.cc:2243] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.817164 23879 raft_consensus.cc:2272] T 81fec2cd07604cab87091a034eba2f38 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.820091 23879 tablet_replica.cc:333] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.820892 23879 raft_consensus.cc:2243] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.821635 23879 raft_consensus.cc:2272] T bddb65a99b5c44038087d76d815e3abf P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.824236 23879 tablet_replica.cc:333] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.825029 23879 raft_consensus.cc:2243] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.825740 23879 raft_consensus.cc:2272] T 392ec479375b41bbb38793a0c207912d P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.828598 23879 tablet_replica.cc:333] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.829388 23879 raft_consensus.cc:2243] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.830322 23879 raft_consensus.cc:2272] T c0821374625d4793801ab3b3f502714e P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.831482 31829 raft_consensus.cc:493] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:25.832003 31829 raft_consensus.cc:515] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:25.833280 23879 tablet_replica.cc:333] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.833948 31829 leader_election.cc:290] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:25.834211 23879 raft_consensus.cc:2243] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:22:25.839689 25825 leader_election.cc:336] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:25.840579 25825 leader_election.cc:336] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:25.841068 25825 leader_election.cc:304] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:25.841874 31829 raft_consensus.cc:2749] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:25.842767 23879 raft_consensus.cc:2272] T 08989457946a4946811751dc96e31276 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.849020 23879 tablet_replica.cc:333] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.850198 23879 raft_consensus.cc:2243] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.851356 23879 raft_consensus.cc:2272] T dd90d1f02e904a46be6868d71386b83a P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.853942 23879 tablet_replica.cc:333] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.854700 23879 raft_consensus.cc:2243] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.855773 23879 raft_consensus.cc:2272] T b73f31d21bb0468893aa53b0dcaf3e60 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.858489 23879 tablet_replica.cc:333] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667: stopping tablet replica
I20260709 12:22:25.865777 23879 raft_consensus.cc:2243] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.866530 23879 raft_consensus.cc:2272] T 6c6268d5c5e547b0b77e42ede61314e1 P 2e30bdd4cd1b45299f50b9bcfc9c1667 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:25.930799 25825 consensus_peers.cc:597] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:25.964226 25825 consensus_peers.cc:597] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:26.121204 25825 consensus_peers.cc:597] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:26.356457 25825 consensus_peers.cc:597] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:26.442318 25825 consensus_peers.cc:597] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:22:26.443485 31858 raft_consensus.cc:493] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:26.444325 31858 raft_consensus.cc:515] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:26.446478 31858 leader_election.cc:290] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:26.453291 31858 raft_consensus.cc:493] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:26.453895 31858 raft_consensus.cc:515] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:26.456274 31858 leader_election.cc:290] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:26.466177 25825 leader_election.cc:336] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:26.471160 25825 leader_election.cc:336] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:26.471684 25825 leader_election.cc:304] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:26.472481 31858 raft_consensus.cc:2749] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:26.476603 25825 leader_election.cc:336] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:26.483072 25825 leader_election.cc:336] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:26.483578 25825 leader_election.cc:304] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:26.484426 31858 raft_consensus.cc:2749] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:26.522920 25825 consensus_peers.cc:597] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:26.557935 31829 raft_consensus.cc:493] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:26.558457 31829 raft_consensus.cc:515] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:26.560271 31829 leader_election.cc:290] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
W20260709 12:22:26.574249 25825 leader_election.cc:336] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:26.574982 25825 leader_election.cc:336] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:26.575419 25825 leader_election.cc:304] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:26.576251 31858 raft_consensus.cc:2749] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:26.584120 25825 consensus_peers.cc:597] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:22:26.631878 31858 raft_consensus.cc:493] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:26.632453 31858 raft_consensus.cc:515] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } attrs { replace: true } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:26.634943 31858 leader_election.cc:290] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:26.636513 31858 raft_consensus.cc:493] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:26.637079 31858 raft_consensus.cc:515] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:26.639207 31858 leader_election.cc:290] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:22:26.651861 25822 leader_election.cc:336] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Network error: Client connection negotiation failed: client connection to 127.23.81.195:44749: connect: Connection refused (error 111)
W20260709 12:22:26.652931 25822 leader_election.cc:336] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Network error: Client connection negotiation failed: client connection to 127.23.81.195:44749: connect: Connection refused (error 111)
W20260709 12:22:26.680868 25825 leader_election.cc:336] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:26.681734 25825 leader_election.cc:304] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
W20260709 12:22:26.682533 25825 consensus_peers.cc:597] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:22:26.682984 31860 raft_consensus.cc:2749] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:26.684995 25825 leader_election.cc:336] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:26.685804 25825 leader_election.cc:336] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:26.686254 25825 leader_election.cc:304] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:22:26.686993 31860 raft_consensus.cc:2749] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:26.714432 23879 tablet_server.cc:196] TabletServer@127.23.81.195:0 shutdown complete.
I20260709 12:22:26.719434 31860 raft_consensus.cc:493] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:26.720003 31860 raft_consensus.cc:515] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:26.722183 31860 leader_election.cc:290] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:22:26.726804 25822 leader_election.cc:336] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Network error: Client connection negotiation failed: client connection to 127.23.81.195:44749: connect: Connection refused (error 111)
W20260709 12:22:26.727715 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Couldn't send request to peer 897be935c42e41b995f177155b042be0. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:26.732038 25825 leader_election.cc:336] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:26.732585 25825 leader_election.cc:304] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:26.733882 31858 raft_consensus.cc:2749] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:26.804582 31858 raft_consensus.cc:493] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b83c12959b9848b3b7bbc680f5ee6225)
I20260709 12:22:26.806327 31858 raft_consensus.cc:515] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:26.809422 31858 leader_election.cc:290] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905)
I20260709 12:22:26.819598 31858 raft_consensus.cc:493] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:26.820272 31858 raft_consensus.cc:515] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
W20260709 12:22:26.827708 25825 leader_election.cc:336] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
W20260709 12:22:26.838740 25825 leader_election.cc:336] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:26.839265 25825 leader_election.cc:304] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 897be935c42e41b995f177155b042be0, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:26.832427 31858 leader_election.cc:290] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:22:26.837838 25822 leader_election.cc:336] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Network error: Client connection negotiation failed: client connection to 127.23.81.195:44749: connect: Connection refused (error 111)
I20260709 12:22:26.840771 31860 raft_consensus.cc:2749] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:26.859233 25825 leader_election.cc:336] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:26.859823 25825 leader_election.cc:304] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:26.861681 31858 raft_consensus.cc:2749] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:26.865041 31858 raft_consensus.cc:493] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:26.865677 31858 raft_consensus.cc:515] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:26.868093 23879 tablet_server.cc:179] TabletServer@127.23.81.196:0 shutting down...
I20260709 12:22:26.870185 31858 leader_election.cc:290] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
W20260709 12:22:26.873144 25822 leader_election.cc:336] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Network error: Client connection negotiation failed: client connection to 127.23.81.195:44749: connect: Connection refused (error 111)
W20260709 12:22:26.886128 25825 leader_election.cc:336] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:26.892230 25825 leader_election.cc:304] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:22:26.896036 31858 raft_consensus.cc:2749] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:26.901360 25825 consensus_peers.cc:597] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:26.940804 25825 consensus_peers.cc:597] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:22:26.945075 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:26.946120 23879 tablet_replica.cc:333] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:26.947358 23879 raft_consensus.cc:2243] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:22:26.948769 23879 raft_consensus.cc:2272] T 155471b361b441c095eae34b64eb0bed P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:26.951650 23879 tablet_replica.cc:333] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:26.952313 23879 raft_consensus.cc:2243] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:26.953032 23879 raft_consensus.cc:2272] T 5db99f5b516b4f578a44f8ba1bbc3fc9 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:26.955551 23879 tablet_replica.cc:333] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:26.956210 23879 raft_consensus.cc:2243] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:26.956902 23879 raft_consensus.cc:2272] T 3552726c022345b394b69265b8f3b566 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:26.959295 23879 tablet_replica.cc:333] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:26.959236 31858 raft_consensus.cc:493] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:26.959828 31858 raft_consensus.cc:515] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b83c12959b9848b3b7bbc680f5ee6225" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 43905 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:26.960310 23879 raft_consensus.cc:2243] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:26.961335 23879 raft_consensus.cc:2272] T 4fb0b452100949b58ad2bf4a4aed36fa P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:26.964350 23879 tablet_replica.cc:333] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:26.965277 23879 raft_consensus.cc:2243] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:26.965909 23879 raft_consensus.cc:2272] T b0e4085b9c3e4704891292cf0881ea14 P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:26.969053 23879 tablet_replica.cc:333] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:26.969961 23879 raft_consensus.cc:2243] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:26.970767 23879 raft_consensus.cc:2272] T f698d5eb641d4490aaa13e25382450db P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:26.972400 25822 leader_election.cc:336] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Network error: Client connection negotiation failed: client connection to 127.23.81.195:44749: connect: Connection refused (error 111)
I20260709 12:22:26.966013 31858 leader_election.cc:290] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:26.974090 23879 tablet_replica.cc:333] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:26.975039 23879 raft_consensus.cc:2243] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:26.975339 25825 leader_election.cc:336] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:22:26.975822 23879 raft_consensus.cc:2272] T e42a38bc05c84ba69ac42605a0f627ca P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:26.975903 25825 leader_election.cc:304] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, b83c12959b9848b3b7bbc680f5ee6225
I20260709 12:22:26.977279 31858 raft_consensus.cc:2749] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:26.978811 23879 tablet_replica.cc:333] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:26.979645 23879 raft_consensus.cc:2243] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:26.979606 31858 raft_consensus.cc:493] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:26.980508 23879 raft_consensus.cc:2272] T 3bde194ca9e544f1befacd3ad39463a2 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:26.980463 31858 raft_consensus.cc:515] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:26.983723 23879 tablet_replica.cc:333] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:26.984575 23879 raft_consensus.cc:2243] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:26.985265 23879 raft_consensus.cc:2272] T 6afd466aa7a2455fa2f85263e303ec0f P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:26.988246 23879 tablet_replica.cc:333] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:26.989130 23879 raft_consensus.cc:2243] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:26.989910 23879 raft_consensus.cc:2272] T b73f31d21bb0468893aa53b0dcaf3e60 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:26.992240 31858 leader_election.cc:290] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:26.992990 23879 tablet_replica.cc:333] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:26.995787 23879 raft_consensus.cc:2243] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:26.996609 23879 raft_consensus.cc:2272] T 47f83e7883b540d9907ceefaa443f104 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:26.997033 25825 leader_election.cc:336] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
W20260709 12:22:26.997879 25822 leader_election.cc:336] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Network error: Client connection negotiation failed: client connection to 127.23.81.195:44749: connect: Connection refused (error 111)
I20260709 12:22:26.998360 25822 leader_election.cc:304] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:22:26.999541 31858 raft_consensus.cc:2749] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:27.000248 23879 tablet_replica.cc:333] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.000982 23879 raft_consensus.cc:2243] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.001881 23879 raft_consensus.cc:2272] T 6b13f2e891f348229e95286682b88911 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.004356 23879 tablet_replica.cc:333] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.005223 23879 raft_consensus.cc:2243] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.006136 23879 raft_consensus.cc:2272] T 242311f4ad5044b2ada00bc49a50afeb P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.008920 23879 tablet_replica.cc:333] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.009727 23879 raft_consensus.cc:2243] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.010438 23879 raft_consensus.cc:2272] T e72fd84f77df4beba49c7d81e1b26f8e P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.012740 23879 tablet_replica.cc:333] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.013397 23879 raft_consensus.cc:2243] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.014318 23879 raft_consensus.cc:2272] T 8dcb58fb89c744c58d9494a99f2adda8 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.016362 23879 tablet_replica.cc:333] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.016898 23879 raft_consensus.cc:2243] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.017700 23879 raft_consensus.cc:2272] T fcbf7458baff481588dabf347ec2112d P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.020599 23879 tablet_replica.cc:333] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.021445 23879 raft_consensus.cc:2243] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.022565 23879 raft_consensus.cc:2272] T 19982d505db74841b1c47ceaaf269baa P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.024931 23879 tablet_replica.cc:333] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.025593 23879 raft_consensus.cc:2243] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.026459 23879 raft_consensus.cc:2272] T b1e3b9e5896c4b539daf785219debb12 P 4456c1069d1541fab5b7cb29df9b6167 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.029006 23879 tablet_replica.cc:333] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.029842 23879 raft_consensus.cc:2243] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.030505 23879 raft_consensus.cc:2272] T fd7e49fd52d74821a66c7dbbc770a988 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.033107 23879 tablet_replica.cc:333] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.033921 23879 raft_consensus.cc:2243] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.034971 23879 raft_consensus.cc:2272] T 9d246e87571b4365a1d11d98c7455fb9 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.038287 23879 tablet_replica.cc:333] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.039419 23879 raft_consensus.cc:2243] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.040244 23879 raft_consensus.cc:2272] T 7f120f7a3d32426ab1243e87fe0194ac P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.041503 31858 raft_consensus.cc:493] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e30bdd4cd1b45299f50b9bcfc9c1667)
I20260709 12:22:27.042122 31858 raft_consensus.cc:515] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "897be935c42e41b995f177155b042be0" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46409 } } peers { permanent_uuid: "2e30bdd4cd1b45299f50b9bcfc9c1667" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 44749 } } peers { permanent_uuid: "4456c1069d1541fab5b7cb29df9b6167" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 45401 } attrs { promote: false } }
I20260709 12:22:27.044447 31858 leader_election.cc:290] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897be935c42e41b995f177155b042be0 (127.23.81.193:46409), 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749)
I20260709 12:22:27.044976 23879 tablet_replica.cc:333] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.047259 23879 raft_consensus.cc:2243] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.048398 23879 raft_consensus.cc:2272] T ff47c111f89a444a9c5a1794454f0789 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:27.049403 25822 leader_election.cc:336] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e30bdd4cd1b45299f50b9bcfc9c1667 (127.23.81.195:44749): Network error: Client connection negotiation failed: client connection to 127.23.81.195:44749: connect: Connection refused (error 111)
I20260709 12:22:27.051345 23879 tablet_replica.cc:333] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.052336 23879 raft_consensus.cc:2243] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.053467 23879 raft_consensus.cc:2272] T 6c6268d5c5e547b0b77e42ede61314e1 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:27.055470 25825 leader_election.cc:336] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 897be935c42e41b995f177155b042be0 (127.23.81.193:46409): Network error: Client connection negotiation failed: client connection to 127.23.81.193:46409: connect: Connection refused (error 111)
I20260709 12:22:27.055953 25825 leader_election.cc:304] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4456c1069d1541fab5b7cb29df9b6167; no voters: 2e30bdd4cd1b45299f50b9bcfc9c1667, 897be935c42e41b995f177155b042be0
I20260709 12:22:27.056357 23879 tablet_replica.cc:333] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.056716 31858 raft_consensus.cc:2749] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:27.057233 23879 raft_consensus.cc:2243] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.057972 23879 raft_consensus.cc:2272] T b1d4aa6fab2741dda3fcae71491a229a P 4456c1069d1541fab5b7cb29df9b6167 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.060746 23879 tablet_replica.cc:333] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.061614 23879 raft_consensus.cc:2243] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.062645 23879 raft_consensus.cc:2272] T 2d4c46d8dc974803aa09fb2a6515ca35 P 4456c1069d1541fab5b7cb29df9b6167 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.065244 23879 tablet_replica.cc:333] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.065833 23879 raft_consensus.cc:2243] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.066720 23879 raft_consensus.cc:2272] T bddb65a99b5c44038087d76d815e3abf P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.068876 23879 tablet_replica.cc:333] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.069458 23879 raft_consensus.cc:2243] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.070298 23879 raft_consensus.cc:2272] T f1f471cfad2348a09c4b699f01f9dfa9 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.072479 23879 tablet_replica.cc:333] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.073064 23879 raft_consensus.cc:2243] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.073555 23879 raft_consensus.cc:2272] T dd90d1f02e904a46be6868d71386b83a P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.076161 23879 tablet_replica.cc:333] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.076975 23879 raft_consensus.cc:2243] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.077904 23879 raft_consensus.cc:2272] T b86f3fbaedb441bfa448cef75c5e613f P 4456c1069d1541fab5b7cb29df9b6167 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.080753 23879 tablet_replica.cc:333] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.081307 23879 raft_consensus.cc:2243] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.082002 23879 raft_consensus.cc:2272] T e7e59abaef5845e2bb8f466331bb98c3 P 4456c1069d1541fab5b7cb29df9b6167 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.084043 23879 tablet_replica.cc:333] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.084581 23879 raft_consensus.cc:2243] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.085048 23879 raft_consensus.cc:2272] T e81b9ed959214538853077eddd8dc8ea P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.086968 23879 tablet_replica.cc:333] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.087502 23879 raft_consensus.cc:2243] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.088186 23879 raft_consensus.cc:2272] T 960cba74c5c0438f9a3d8e25d8dec7ad P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.090324 23879 tablet_replica.cc:333] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.090866 23879 raft_consensus.cc:2243] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.091957 23879 raft_consensus.cc:2272] T 0ff71ed0aef74f1f963b143876c9b3d6 P 4456c1069d1541fab5b7cb29df9b6167 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.094734 23879 tablet_replica.cc:333] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.095487 23879 raft_consensus.cc:2243] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.096606 23879 raft_consensus.cc:2272] T 7d3090ce3ca84e6e9649297156feeaef P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:27.098145 25825 consensus_peers.cc:597] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 -> Peer b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): Couldn't send request to peer b83c12959b9848b3b7bbc680f5ee6225. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:22:27.099184 23879 tablet_replica.cc:333] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.099781 23879 raft_consensus.cc:2243] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.100589 23879 raft_consensus.cc:2272] T c880ab05f6e24c9881bbc8954e0d9030 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.102825 23879 tablet_replica.cc:333] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.103595 23879 raft_consensus.cc:2243] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.104640 23879 raft_consensus.cc:2272] T 9c305b34a0c54275af750c832f52691f P 4456c1069d1541fab5b7cb29df9b6167 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.107539 23879 tablet_replica.cc:333] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.108321 23879 raft_consensus.cc:2243] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.109578 23879 raft_consensus.cc:2272] T 6248d848eecd4b799e9233d56f0b5467 P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.112453 23879 tablet_replica.cc:333] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.113271 23879 raft_consensus.cc:2243] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.114075 23879 raft_consensus.cc:2272] T d683b7b361f44f7cb6076cf5ac95611b P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.116720 23879 tablet_replica.cc:333] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.117563 23879 raft_consensus.cc:2243] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.118237 23879 raft_consensus.cc:2272] T 951ec28047e64bb7a386c7d66a082fd0 P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.121251 23879 tablet_replica.cc:333] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.122068 23879 raft_consensus.cc:2243] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.123216 23879 raft_consensus.cc:2272] T 783cdcb70b0d4499b94b2f51672f6895 P 4456c1069d1541fab5b7cb29df9b6167 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.125870 23879 tablet_replica.cc:333] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.126623 23879 raft_consensus.cc:2243] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.127466 23879 raft_consensus.cc:2272] T dba87711b0ab4e3394481dfecfeb886e P 4456c1069d1541fab5b7cb29df9b6167 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.130467 23879 tablet_replica.cc:333] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.131237 23879 raft_consensus.cc:2243] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.132017 23879 raft_consensus.cc:2272] T 6e78737bee66450b9a076cc9676331b9 P 4456c1069d1541fab5b7cb29df9b6167 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.134811 23879 tablet_replica.cc:333] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.135552 23879 raft_consensus.cc:2243] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.136654 23879 raft_consensus.cc:2272] T 450e4351142d43ca91af7ff9ee99c74b P 4456c1069d1541fab5b7cb29df9b6167 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.139564 23879 tablet_replica.cc:333] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167: stopping tablet replica
I20260709 12:22:27.140218 23879 raft_consensus.cc:2243] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.141378 23879 raft_consensus.cc:2272] T 724a325f5a004fdab6dc4a9bcba2a3e9 P 4456c1069d1541fab5b7cb29df9b6167 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:27.231261 25056 debug-util.cc:398] Leaking SignalData structure 0x7b080000b620 after lost signal to thread 23882
W20260709 12:22:27.232419 25056 debug-util.cc:398] Leaking SignalData structure 0x7b08003cc9a0 after lost signal to thread 25059
W20260709 12:22:27.233839 25056 debug-util.cc:398] Leaking SignalData structure 0x7b08003922c0 after lost signal to thread 25884
W20260709 12:22:28.238183 23879 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 25881)
I20260709 12:22:28.962380 23879 tablet_server.cc:196] TabletServer@127.23.81.196:0 shutdown complete.
I20260709 12:22:29.095438 23879 master.cc:562] Master@127.23.81.254:44087 shutting down...
W20260709 12:22:29.130008 25073 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:22:29.130389 25073 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:22:29.130637 25073 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:22:58.615182 25012 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111) [suppressed 176 similar messages]
W20260709 12:22:58.619024 25012 catalog_manager.cc:4755] TS b83c12959b9848b3b7bbc680f5ee6225 (127.23.81.194:43905): ChangeConfig:REMOVE_PEER RPC failed for tablet 5db99f5b516b4f578a44f8ba1bbc3fc9: Network error: Client connection negotiation failed: client connection to 127.23.81.194:43905: connect: Connection refused (error 111)
I20260709 12:23:02.313371 23879 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.314630 23879 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.315006 23879 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2d05ccaaf1604ba0be2f6d54385e7ce3: stopping tablet replica
I20260709 12:23:02.526404 23879 master.cc:584] Master@127.23.81.254:44087 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (252681 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:23:02.642616 23879 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.81.254:34289
I20260709 12:23:02.643939 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:02.650363 31868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:02.650413 31869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:02.651650 31871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:02.653359 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:02.656677 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:02.656896 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:02.657107 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599782657070 us; error 0 us; skew 500 ppm
I20260709 12:23:02.657672 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:02.660279 23879 webserver.cc:533] Webserver started at http://127.23.81.254:43737/ using document root <none> and password file <none>
I20260709 12:23:02.660799 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:02.661000 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:02.661288 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:02.662691 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/master-0-root/instance:
uuid: "903760ac998947c288b5e1e75acc13bc"
format_stamp: "Formatted at 2026-07-09 12:23:02 on dist-test-slave-mprf"
I20260709 12:23:02.667505 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:02.671214 31876 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:02.672158 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:23:02.672528 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/master-0-root
uuid: "903760ac998947c288b5e1e75acc13bc"
format_stamp: "Formatted at 2026-07-09 12:23:02 on dist-test-slave-mprf"
I20260709 12:23:02.672969 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:02.699316 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:02.700615 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:02.741590 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.254:34289
I20260709 12:23:02.741768 31927 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.254:34289 every 8 connection(s)
I20260709 12:23:02.746407 31928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.759205 31928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc: Bootstrap starting.
I20260709 12:23:02.764634 31928 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.769464 31928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc: No bootstrap required, opened a new log
I20260709 12:23:02.771929 31928 raft_consensus.cc:359] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "903760ac998947c288b5e1e75acc13bc" member_type: VOTER }
I20260709 12:23:02.772429 31928 raft_consensus.cc:385] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.772673 31928 raft_consensus.cc:740] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 903760ac998947c288b5e1e75acc13bc, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.773352 31928 consensus_queue.cc:260] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "903760ac998947c288b5e1e75acc13bc" member_type: VOTER }
I20260709 12:23:02.773881 31928 raft_consensus.cc:399] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:02.774184 31928 raft_consensus.cc:493] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:02.774492 31928 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.779179 31928 raft_consensus.cc:515] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "903760ac998947c288b5e1e75acc13bc" member_type: VOTER }
I20260709 12:23:02.779750 31928 leader_election.cc:304] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 903760ac998947c288b5e1e75acc13bc; no voters: 
I20260709 12:23:02.780957 31928 leader_election.cc:290] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:02.781383 31931 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:02.782775 31931 raft_consensus.cc:697] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [term 1 LEADER]: Becoming Leader. State: Replica: 903760ac998947c288b5e1e75acc13bc, State: Running, Role: LEADER
I20260709 12:23:02.783504 31931 consensus_queue.cc:237] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "903760ac998947c288b5e1e75acc13bc" member_type: VOTER }
I20260709 12:23:02.784173 31928 sys_catalog.cc:565] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:02.793906 31932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "903760ac998947c288b5e1e75acc13bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "903760ac998947c288b5e1e75acc13bc" member_type: VOTER } }
I20260709 12:23:02.794857 31932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:02.795083 31933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 903760ac998947c288b5e1e75acc13bc. Latest consensus state: current_term: 1 leader_uuid: "903760ac998947c288b5e1e75acc13bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "903760ac998947c288b5e1e75acc13bc" member_type: VOTER } }
I20260709 12:23:02.795807 31933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:02.797020 31941 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:02.804852 31941 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:02.805881 23879 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:02.814162 31941 catalog_manager.cc:1383] Generated new cluster ID: 5c2368ca3c8e4dc59901589419428355
I20260709 12:23:02.814446 31941 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:02.845860 31941 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:02.847451 31941 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:02.873211 31941 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc: Generated new TSK 0
I20260709 12:23:02.873955 31941 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:02.936784 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:02.943881 31949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:02.945302 31950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:02.946934 31952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:02.948040 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:02.950493 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:02.950702 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:02.950837 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599782950825 us; error 0 us; skew 500 ppm
I20260709 12:23:02.951398 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:02.954093 23879 webserver.cc:533] Webserver started at http://127.23.81.193:42507/ using document root <none> and password file <none>
I20260709 12:23:02.954778 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:02.955050 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:02.955304 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:02.956593 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/instance:
uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
format_stamp: "Formatted at 2026-07-09 12:23:02 on dist-test-slave-mprf"
I20260709 12:23:02.961474 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:23:02.965126 31957 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:02.965909 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:02.966296 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-0-root
uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
format_stamp: "Formatted at 2026-07-09 12:23:02 on dist-test-slave-mprf"
I20260709 12:23:02.966588 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:02.976905 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:02.978220 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:02.979712 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:02.982157 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:02.982378 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:02.982620 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:02.982810 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.026486 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.193:41023
I20260709 12:23:03.026598 32019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.193:41023 every 8 connection(s)
I20260709 12:23:03.031898 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:03.040349 32024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.042771 32025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.044757 32027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:03.044839 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:03.048137 32020 heartbeater.cc:344] Connected to a master server at 127.23.81.254:34289
I20260709 12:23:03.048343 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:23:03.048559 32020 heartbeater.cc:461] Registering TS with master...
W20260709 12:23:03.048692 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:03.049018 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599783049006 us; error 0 us; skew 500 ppm
I20260709 12:23:03.049625 32020 heartbeater.cc:507] Master 127.23.81.254:34289 requested a full tablet report, sending...
I20260709 12:23:03.049669 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:03.052181 31893 ts_manager.cc:194] Registered new tserver with Master: 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:03.052722 23879 webserver.cc:533] Webserver started at http://127.23.81.194:40863/ using document root <none> and password file <none>
I20260709 12:23:03.053256 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:03.053468 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:03.053743 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:03.054389 31893 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33138
I20260709 12:23:03.055163 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/instance:
uuid: "13d67625d82d4304a0ebff87742a538d"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-mprf"
I20260709 12:23:03.059897 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:23:03.063406 32032 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.064206 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:23:03.064508 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-1-root
uuid: "13d67625d82d4304a0ebff87742a538d"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-mprf"
I20260709 12:23:03.064800 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:03.085992 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:03.087400 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:03.088991 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:03.091427 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:03.091660 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.091922 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:03.092103 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.136503 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.194:33135
I20260709 12:23:03.136636 32094 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.194:33135 every 8 connection(s)
I20260709 12:23:03.142221 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:03.149549 32098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.150480 32099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:03.154582 23879 server_base.cc:1061] running on GCE node
W20260709 12:23:03.154542 32101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:03.156076 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:03.156343 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:03.156646 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599783156619 us; error 0 us; skew 500 ppm
I20260709 12:23:03.157418 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:03.160570 32095 heartbeater.cc:344] Connected to a master server at 127.23.81.254:34289
I20260709 12:23:03.160601 23879 webserver.cc:533] Webserver started at http://127.23.81.195:46183/ using document root <none> and password file <none>
I20260709 12:23:03.161021 32095 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:03.161341 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:03.161643 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:03.161875 32095 heartbeater.cc:507] Master 127.23.81.254:34289 requested a full tablet report, sending...
I20260709 12:23:03.161938 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:03.163697 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/instance:
uuid: "c5524748d37141a1bca7d0cedaeb40f2"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-mprf"
I20260709 12:23:03.164143 31893 ts_manager.cc:194] Registered new tserver with Master: 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:03.165562 31893 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33144
I20260709 12:23:03.169332 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:23:03.173524 32106 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.174618 23879 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:23:03.174980 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-2-root
uuid: "c5524748d37141a1bca7d0cedaeb40f2"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-mprf"
I20260709 12:23:03.175287 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:03.194175 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:03.195539 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:03.197232 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:03.199744 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:03.199998 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.200253 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:03.200430 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.243829 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.195:43745
I20260709 12:23:03.243922 32168 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.195:43745 every 8 connection(s)
I20260709 12:23:03.249441 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:03.257197 32172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.257869 32173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.261305 32175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:03.262332 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:03.263163 32169 heartbeater.cc:344] Connected to a master server at 127.23.81.254:34289
I20260709 12:23:03.263413 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:23:03.263607 32169 heartbeater.cc:461] Registering TS with master...
W20260709 12:23:03.263716 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:03.264022 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599783263997 us; error 0 us; skew 500 ppm
I20260709 12:23:03.264605 32169 heartbeater.cc:507] Master 127.23.81.254:34289 requested a full tablet report, sending...
I20260709 12:23:03.264669 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:03.267050 31893 ts_manager.cc:194] Registered new tserver with Master: c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:03.267827 23879 webserver.cc:533] Webserver started at http://127.23.81.196:36639/ using document root <none> and password file <none>
I20260709 12:23:03.268569 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:03.268806 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:03.268875 31893 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33150
I20260709 12:23:03.269107 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:03.270584 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-3-root/instance:
uuid: "68991541d4134b4f89800c972fdad372"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-mprf"
I20260709 12:23:03.275243 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:23:03.278764 32180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.279551 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:03.279861 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-3-root
uuid: "68991541d4134b4f89800c972fdad372"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-mprf"
I20260709 12:23:03.280181 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:03.297149 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:03.298530 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:03.299791 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:03.301775 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:03.301999 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.302294 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:03.302467 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.344594 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.196:46375
I20260709 12:23:03.344673 32242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.196:46375 every 8 connection(s)
I20260709 12:23:03.358932 32243 heartbeater.cc:344] Connected to a master server at 127.23.81.254:34289
I20260709 12:23:03.359405 32243 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:03.360239 32243 heartbeater.cc:507] Master 127.23.81.254:34289 requested a full tablet report, sending...
I20260709 12:23:03.362289 31893 ts_manager.cc:194] Registered new tserver with Master: 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:03.363075 23879 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015058591s
I20260709 12:23:03.364055 31893 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33152
I20260709 12:23:03.392235 31893 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33156:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:23:03.661201 32207 tablet_service.cc:1511] Processing CreateTablet for tablet 51e6e3a7239949adaa6b5dacaf6ded22 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:03.663273 32060 tablet_service.cc:1511] Processing CreateTablet for tablet 45ffe4df6d544068be9090ac7db408a2 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:03.664898 32056 tablet_service.cc:1511] Processing CreateTablet for tablet a0bbc7593a9a40acbab37a51e0269bef (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:03.665123 32059 tablet_service.cc:1511] Processing CreateTablet for tablet 7f99752364a34ef88c766999394fce3a (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:03.665848 32205 tablet_service.cc:1511] Processing CreateTablet for tablet a0bbc7593a9a40acbab37a51e0269bef (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:03.671975 32207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e6e3a7239949adaa6b5dacaf6ded22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.672526 32133 tablet_service.cc:1511] Processing CreateTablet for tablet 51e6e3a7239949adaa6b5dacaf6ded22 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:03.672691 32058 tablet_service.cc:1511] Processing CreateTablet for tablet 3aaccd64e9ef4703af3eef217706d108 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:03.667063 32055 tablet_service.cc:1511] Processing CreateTablet for tablet ff9e76032b934159855ba6bc924e9dd4 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:03.667203 32057 tablet_service.cc:1511] Processing CreateTablet for tablet 62655659313345be94b5bdb515201711 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:03.668061 32204 tablet_service.cc:1511] Processing CreateTablet for tablet 30469d27ec5d450393d6116dbc4d0c7b (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:03.675429 32058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aaccd64e9ef4703af3eef217706d108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.676501 32057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62655659313345be94b5bdb515201711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.676066 32131 tablet_service.cc:1511] Processing CreateTablet for tablet 62655659313345be94b5bdb515201711 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:03.677407 32208 tablet_service.cc:1511] Processing CreateTablet for tablet 7f99752364a34ef88c766999394fce3a (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:03.677817 32054 tablet_service.cc:1511] Processing CreateTablet for tablet f8072e49f8e645f7b24c0f657e2d5c52 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:03.673666 32132 tablet_service.cc:1511] Processing CreateTablet for tablet 3aaccd64e9ef4703af3eef217706d108 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:03.679379 32054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8072e49f8e645f7b24c0f657e2d5c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.679697 32206 tablet_service.cc:1511] Processing CreateTablet for tablet 3aaccd64e9ef4703af3eef217706d108 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:03.681092 32134 tablet_service.cc:1511] Processing CreateTablet for tablet 45ffe4df6d544068be9090ac7db408a2 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:03.672518 32130 tablet_service.cc:1511] Processing CreateTablet for tablet 30469d27ec5d450393d6116dbc4d0c7b (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:03.683435 32059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f99752364a34ef88c766999394fce3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.686568 32201 tablet_service.cc:1511] Processing CreateTablet for tablet dae2aab0addf4c939688292e7118cbe0 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:03.674199 32133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e6e3a7239949adaa6b5dacaf6ded22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.687188 32202 tablet_service.cc:1511] Processing CreateTablet for tablet d663ad19f6a14af4b9a084536570893a (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:03.685469 32203 tablet_service.cc:1511] Processing CreateTablet for tablet ff9e76032b934159855ba6bc924e9dd4 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:03.689458 32131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62655659313345be94b5bdb515201711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.689996 32200 tablet_service.cc:1511] Processing CreateTablet for tablet e2e93bb1528747f2b573d12daa3b7fb0 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:03.690517 32134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ffe4df6d544068be9090ac7db408a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.691531 32132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aaccd64e9ef4703af3eef217706d108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.692590 32056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0bbc7593a9a40acbab37a51e0269bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.694439 32060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ffe4df6d544068be9090ac7db408a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.698997 32055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9e76032b934159855ba6bc924e9dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.700245 32205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0bbc7593a9a40acbab37a51e0269bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.701027 32208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f99752364a34ef88c766999394fce3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.702462 32204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30469d27ec5d450393d6116dbc4d0c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.706386 32202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d663ad19f6a14af4b9a084536570893a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.707043 32130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30469d27ec5d450393d6116dbc4d0c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.709733 32201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae2aab0addf4c939688292e7118cbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.712361 32203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9e76032b934159855ba6bc924e9dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.714432 32200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2e93bb1528747f2b573d12daa3b7fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.716039 32053 tablet_service.cc:1511] Processing CreateTablet for tablet d663ad19f6a14af4b9a084536570893a (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:03.718364 32206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aaccd64e9ef4703af3eef217706d108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.719515 32199 tablet_service.cc:1511] Processing CreateTablet for tablet d8c591c793c14148a28a7095ad7db608 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:03.720006 32052 tablet_service.cc:1511] Processing CreateTablet for tablet e2e93bb1528747f2b573d12daa3b7fb0 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:03.721050 32199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c591c793c14148a28a7095ad7db608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.723331 32051 tablet_service.cc:1511] Processing CreateTablet for tablet f214242a6fb64a23b3bf338f9189e209 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:03.724397 32129 tablet_service.cc:1511] Processing CreateTablet for tablet ff9e76032b934159855ba6bc924e9dd4 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:03.717866 32053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d663ad19f6a14af4b9a084536570893a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.727753 32052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2e93bb1528747f2b573d12daa3b7fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.727666 32128 tablet_service.cc:1511] Processing CreateTablet for tablet f8072e49f8e645f7b24c0f657e2d5c52 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:03.729475 32051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f214242a6fb64a23b3bf338f9189e209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.725867 32129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9e76032b934159855ba6bc924e9dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.731465 32128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8072e49f8e645f7b24c0f657e2d5c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.740507 32127 tablet_service.cc:1511] Processing CreateTablet for tablet dae2aab0addf4c939688292e7118cbe0 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:03.742385 32127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae2aab0addf4c939688292e7118cbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.747386 32126 tablet_service.cc:1511] Processing CreateTablet for tablet e2e93bb1528747f2b573d12daa3b7fb0 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:03.749270 32126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2e93bb1528747f2b573d12daa3b7fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.751621 32125 tablet_service.cc:1511] Processing CreateTablet for tablet f214242a6fb64a23b3bf338f9189e209 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:03.753404 32125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f214242a6fb64a23b3bf338f9189e209. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:03.799271 31940 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:03.827287 31985 tablet_service.cc:1511] Processing CreateTablet for tablet 45ffe4df6d544068be9090ac7db408a2 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:03.829203 31985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ffe4df6d544068be9090ac7db408a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.831645 31984 tablet_service.cc:1511] Processing CreateTablet for tablet 7f99752364a34ef88c766999394fce3a (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:03.833527 31984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f99752364a34ef88c766999394fce3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.839395 31979 tablet_service.cc:1511] Processing CreateTablet for tablet f8072e49f8e645f7b24c0f657e2d5c52 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:03.842363 31981 tablet_service.cc:1511] Processing CreateTablet for tablet a0bbc7593a9a40acbab37a51e0269bef (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:03.846921 31980 tablet_service.cc:1511] Processing CreateTablet for tablet 30469d27ec5d450393d6116dbc4d0c7b (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:03.835486 31983 tablet_service.cc:1511] Processing CreateTablet for tablet 51e6e3a7239949adaa6b5dacaf6ded22 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:03.845537 31982 tablet_service.cc:1511] Processing CreateTablet for tablet 62655659313345be94b5bdb515201711 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:03.872251 32207 tablet_service.cc:1511] Processing CreateTablet for tablet 4e692c206a274e1fbd3fb6b4ef2358ec (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:03.873777 32207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e692c206a274e1fbd3fb6b4ef2358ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.874791 32125 tablet_service.cc:1511] Processing CreateTablet for tablet 4e692c206a274e1fbd3fb6b4ef2358ec (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:03.927443 32125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e692c206a274e1fbd3fb6b4ef2358ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.879290 32060 tablet_service.cc:1511] Processing CreateTablet for tablet e711714b08b04798b67a243e1267184f (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:03.884552 32126 tablet_service.cc:1511] Processing CreateTablet for tablet e1e47eae61a3433591d82d8c67dcd74b (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:03.887163 32130 tablet_service.cc:1511] Processing CreateTablet for tablet e711714b08b04798b67a243e1267184f (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:03.887492 31978 tablet_service.cc:1511] Processing CreateTablet for tablet d663ad19f6a14af4b9a084536570893a (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:03.888476 32133 tablet_service.cc:1511] Processing CreateTablet for tablet fe944fa4b5a547758fe6318ebe933804 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:03.889086 32208 tablet_service.cc:1511] Processing CreateTablet for tablet e711714b08b04798b67a243e1267184f (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:03.889376 31977 tablet_service.cc:1511] Processing CreateTablet for tablet dae2aab0addf4c939688292e7118cbe0 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:03.891217 31976 tablet_service.cc:1511] Processing CreateTablet for tablet f214242a6fb64a23b3bf338f9189e209 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:03.891950 31983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e6e3a7239949adaa6b5dacaf6ded22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.897262 32200 tablet_service.cc:1511] Processing CreateTablet for tablet ba00ce5cdc6f4dbe8a36ecb3e82951e3 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:03.904841 32206 tablet_service.cc:1511] Processing CreateTablet for tablet 63b94a9b9d1441438a95bedc11c7a96f (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:03.907876 32052 tablet_service.cc:1511] Processing CreateTablet for tablet fe944fa4b5a547758fe6318ebe933804 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:03.911197 32058 tablet_service.cc:1511] Processing CreateTablet for tablet e1e47eae61a3433591d82d8c67dcd74b (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:03.915263 32202 tablet_service.cc:1511] Processing CreateTablet for tablet 3f112d6b795b47f2af4a725bc71441d5 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:03.921103 32203 tablet_service.cc:1511] Processing CreateTablet for tablet a2283c016207489eb71580db11ee3a02 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:03.922454 32054 tablet_service.cc:1511] Processing CreateTablet for tablet d8c591c793c14148a28a7095ad7db608 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:03.942952 32052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe944fa4b5a547758fe6318ebe933804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.947227 31982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62655659313345be94b5bdb515201711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.948006 31977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae2aab0addf4c939688292e7118cbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.949102 32263 tablet_bootstrap.cc:492] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:03.950017 31981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0bbc7593a9a40acbab37a51e0269bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.951381 31980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30469d27ec5d450393d6116dbc4d0c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.952306 32126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e47eae61a3433591d82d8c67dcd74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.954417 31979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8072e49f8e645f7b24c0f657e2d5c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.955215 31978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d663ad19f6a14af4b9a084536570893a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.961431 31976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f214242a6fb64a23b3bf338f9189e209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.966961 32130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e711714b08b04798b67a243e1267184f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.969102 32264 tablet_bootstrap.cc:492] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:03.970784 32133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe944fa4b5a547758fe6318ebe933804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.973019 32054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c591c793c14148a28a7095ad7db608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.979629 32199 tablet_service.cc:1511] Processing CreateTablet for tablet 9392ba9e91ca46f0ad3cdef6256aad0d (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:03.984239 32060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e711714b08b04798b67a243e1267184f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.999831 32058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e47eae61a3433591d82d8c67dcd74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.010952 32059 tablet_service.cc:1511] Processing CreateTablet for tablet 3f112d6b795b47f2af4a725bc71441d5 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:04.011818 32265 tablet_bootstrap.cc:492] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:04.013139 32128 tablet_service.cc:1511] Processing CreateTablet for tablet 3f112d6b795b47f2af4a725bc71441d5 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:04.014755 32128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f112d6b795b47f2af4a725bc71441d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.010952 32127 tablet_service.cc:1511] Processing CreateTablet for tablet 9392ba9e91ca46f0ad3cdef6256aad0d (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:04.017014 32051 tablet_service.cc:1511] Processing CreateTablet for tablet 535ba0401f8848e2a5f647e4ad5b1810 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:04.019640 32129 tablet_service.cc:1511] Processing CreateTablet for tablet 63b94a9b9d1441438a95bedc11c7a96f (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:04.022821 32056 tablet_service.cc:1511] Processing CreateTablet for tablet ba00ce5cdc6f4dbe8a36ecb3e82951e3 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:04.023275 32055 tablet_service.cc:1511] Processing CreateTablet for tablet a2283c016207489eb71580db11ee3a02 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:04.015184 32204 tablet_service.cc:1511] Processing CreateTablet for tablet 535ba0401f8848e2a5f647e4ad5b1810 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:04.041359 32205 tablet_service.cc:1511] Processing CreateTablet for tablet 737f0117f5e849cca1421fb53b5ccd31 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:04.024685 32057 tablet_service.cc:1511] Processing CreateTablet for tablet 3b058d5adbe84467b2bd4eb0a3ee9094 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:04.017515 32134 tablet_service.cc:1511] Processing CreateTablet for tablet 535ba0401f8848e2a5f647e4ad5b1810 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:04.032042 32127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9392ba9e91ca46f0ad3cdef6256aad0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.033958 32131 tablet_service.cc:1511] Processing CreateTablet for tablet 3b058d5adbe84467b2bd4eb0a3ee9094 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:04.044538 32131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b058d5adbe84467b2bd4eb0a3ee9094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.045423 32134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535ba0401f8848e2a5f647e4ad5b1810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.046826 32129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b94a9b9d1441438a95bedc11c7a96f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.047818 32059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f112d6b795b47f2af4a725bc71441d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.036823 32201 tablet_service.cc:1511] Processing CreateTablet for tablet 4c9929922e1c4f3899055b92ea3f0774 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:03.942953 32200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba00ce5cdc6f4dbe8a36ecb3e82951e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.054168 32202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f112d6b795b47f2af4a725bc71441d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.056354 32055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2283c016207489eb71580db11ee3a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.056736 32208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e711714b08b04798b67a243e1267184f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.057374 32020 heartbeater.cc:499] Master 127.23.81.254:34289 was elected leader, sending a full tablet report...
I20260709 12:23:04.017185 32264 tablet_bootstrap.cc:654] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.064978 32204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535ba0401f8848e2a5f647e4ad5b1810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.065809 32056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba00ce5cdc6f4dbe8a36ecb3e82951e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.070043 32206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b94a9b9d1441438a95bedc11c7a96f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.077880 32057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b058d5adbe84467b2bd4eb0a3ee9094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.080780 32051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535ba0401f8848e2a5f647e4ad5b1810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.076906 32205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737f0117f5e849cca1421fb53b5ccd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.083402 32132 tablet_service.cc:1511] Processing CreateTablet for tablet 737f0117f5e849cca1421fb53b5ccd31 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:04.084580 32203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2283c016207489eb71580db11ee3a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.084846 32132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737f0117f5e849cca1421fb53b5ccd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.095374 32199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9392ba9e91ca46f0ad3cdef6256aad0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.070868 32053 tablet_service.cc:1511] Processing CreateTablet for tablet 4c9929922e1c4f3899055b92ea3f0774 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:04.107089 32265 tablet_bootstrap.cc:654] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.123591 32263 tablet_bootstrap.cc:654] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.137400 32052 tablet_service.cc:1511] Processing CreateTablet for tablet 89aa175b867642f79ec8ea8c4b4bb970 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:04.148813 32052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89aa175b867642f79ec8ea8c4b4bb970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.116412 32201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c9929922e1c4f3899055b92ea3f0774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.168718 32095 heartbeater.cc:499] Master 127.23.81.254:34289 was elected leader, sending a full tablet report...
I20260709 12:23:04.171602 32264 tablet_bootstrap.cc:492] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:04.172179 32264 ts_tablet_manager.cc:1403] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.204s	user 0.012s	sys 0.004s
W20260709 12:23:04.117689 31880 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.23.81.194:33135, user_credentials={real_user=slave}} blocked reactor thread for 66787.9us
W20260709 12:23:04.150216 31877 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.23.81.196:46375, user_credentials={real_user=slave}} blocked reactor thread for 71978.6us
I20260709 12:23:04.162855 32125 tablet_service.cc:1511] Processing CreateTablet for tablet 89aa175b867642f79ec8ea8c4b4bb970 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:04.217319 32053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c9929922e1c4f3899055b92ea3f0774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.233739 32263 tablet_bootstrap.cc:492] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:04.234380 32263 ts_tablet_manager.cc:1403] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.286s	user 0.044s	sys 0.029s
I20260709 12:23:04.238919 32130 tablet_service.cc:1511] Processing CreateTablet for tablet e21e73e86f4b4b22ad881e5a80716ec7 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:04.250922 32130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21e73e86f4b4b22ad881e5a80716ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.255276 32126 tablet_service.cc:1511] Processing CreateTablet for tablet 4a35467eb315463dae6edfd61cdb4a79 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:04.257083 32126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a35467eb315463dae6edfd61cdb4a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.237459 32263 raft_consensus.cc:359] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:04.209609 32200 tablet_service.cc:1511] Processing CreateTablet for tablet 89aa175b867642f79ec8ea8c4b4bb970 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:04.246964 32058 tablet_service.cc:1511] Processing CreateTablet for tablet e21e73e86f4b4b22ad881e5a80716ec7 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:04.247469 31982 tablet_service.cc:1511] Processing CreateTablet for tablet fe944fa4b5a547758fe6318ebe933804 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:04.240923 31977 tablet_service.cc:1511] Processing CreateTablet for tablet d8c591c793c14148a28a7095ad7db608 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:04.266850 31984 tablet_service.cc:1511] Processing CreateTablet for tablet a2283c016207489eb71580db11ee3a02 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:04.268603 31982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe944fa4b5a547758fe6318ebe933804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.268826 32058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21e73e86f4b4b22ad881e5a80716ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.298964 31984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2283c016207489eb71580db11ee3a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.299397 32129 tablet_service.cc:1511] Processing CreateTablet for tablet e04a298de8bc48c795631812d4179057 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:04.301319 31977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c591c793c14148a28a7095ad7db608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.302183 31979 tablet_service.cc:1511] Processing CreateTablet for tablet 4c9929922e1c4f3899055b92ea3f0774 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:04.303478 31979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c9929922e1c4f3899055b92ea3f0774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.268915 31981 tablet_service.cc:1511] Processing CreateTablet for tablet 4e692c206a274e1fbd3fb6b4ef2358ec (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:04.270745 32269 tablet_bootstrap.cc:492] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:04.271615 32169 heartbeater.cc:499] Master 127.23.81.254:34289 was elected leader, sending a full tablet report...
I20260709 12:23:04.306730 32200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89aa175b867642f79ec8ea8c4b4bb970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.271018 31980 tablet_service.cc:1511] Processing CreateTablet for tablet ba00ce5cdc6f4dbe8a36ecb3e82951e3 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:04.308770 32203 tablet_service.cc:1511] Processing CreateTablet for tablet 441e813540114eb4928246a962aaf360 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:04.310066 31980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba00ce5cdc6f4dbe8a36ecb3e82951e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.311115 32060 tablet_service.cc:1511] Processing CreateTablet for tablet 441e813540114eb4928246a962aaf360 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:04.312546 32207 tablet_service.cc:1511] Processing CreateTablet for tablet e04a298de8bc48c795631812d4179057 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:04.315836 32055 tablet_service.cc:1511] Processing CreateTablet for tablet e04a298de8bc48c795631812d4179057 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:04.319113 32265 tablet_bootstrap.cc:492] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:04.319705 32265 ts_tablet_manager.cc:1403] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.308s	user 0.011s	sys 0.014s
I20260709 12:23:04.322357 32057 tablet_service.cc:1511] Processing CreateTablet for tablet 480a9699f3b4488980be9862ced447cb (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:04.273605 31978 tablet_service.cc:1511] Processing CreateTablet for tablet 63b94a9b9d1441438a95bedc11c7a96f (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:04.274187 32125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89aa175b867642f79ec8ea8c4b4bb970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.325295 32265 raft_consensus.cc:359] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:04.279043 31976 tablet_service.cc:1511] Processing CreateTablet for tablet e1e47eae61a3433591d82d8c67dcd74b (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:04.326196 32265 raft_consensus.cc:385] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.326557 32265 raft_consensus.cc:740] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.327180 31976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e47eae61a3433591d82d8c67dcd74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.327595 32129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04a298de8bc48c795631812d4179057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.327365 32265 consensus_queue.cc:260] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:04.280691 32264 raft_consensus.cc:359] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:04.328858 32264 raft_consensus.cc:385] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.329200 32264 raft_consensus.cc:740] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.329982 32264 consensus_queue.cc:260] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:04.283404 31985 tablet_service.cc:1511] Processing CreateTablet for tablet 9392ba9e91ca46f0ad3cdef6256aad0d (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:04.263650 32263 raft_consensus.cc:385] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.330998 32131 tablet_service.cc:1511] Processing CreateTablet for tablet ab51a346acba496aa7601f0835510af0 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:04.331380 32263 raft_consensus.cc:740] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.331926 31985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9392ba9e91ca46f0ad3cdef6256aad0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.332341 32131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab51a346acba496aa7601f0835510af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.332226 32263 consensus_queue.cc:260] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:04.339731 32269 tablet_bootstrap.cc:654] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.290656 31983 tablet_service.cc:1511] Processing CreateTablet for tablet 3b058d5adbe84467b2bd4eb0a3ee9094 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:04.295509 32133 tablet_service.cc:1511] Processing CreateTablet for tablet 6473d98e1f49484c888a0fb622b9b083 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:04.341742 32133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6473d98e1f49484c888a0fb622b9b083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.343449 32059 tablet_service.cc:1511] Processing CreateTablet for tablet ab51a346acba496aa7601f0835510af0 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:04.341742 31983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b058d5adbe84467b2bd4eb0a3ee9094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.346916 31978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b94a9b9d1441438a95bedc11c7a96f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.347515 31981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e692c206a274e1fbd3fb6b4ef2358ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.354547 32055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04a298de8bc48c795631812d4179057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.356274 32057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480a9699f3b4488980be9862ced447cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.352242 32203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441e813540114eb4928246a962aaf360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.367475 32243 heartbeater.cc:499] Master 127.23.81.254:34289 was elected leader, sending a full tablet report...
I20260709 12:23:04.370617 32059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab51a346acba496aa7601f0835510af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.377707 32060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441e813540114eb4928246a962aaf360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.354542 32264 ts_tablet_manager.cc:1434] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.182s	user 0.010s	sys 0.002s
I20260709 12:23:04.383353 32264 tablet_bootstrap.cc:492] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:04.399258 32201 tablet_service.cc:1511] Processing CreateTablet for tablet 4a35467eb315463dae6edfd61cdb4a79 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:04.400643 32202 tablet_service.cc:1511] Processing CreateTablet for tablet 480a9699f3b4488980be9862ced447cb (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:04.401517 32206 tablet_service.cc:1511] Processing CreateTablet for tablet 6473d98e1f49484c888a0fb622b9b083 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:04.410507 32207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04a298de8bc48c795631812d4179057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.416963 32271 raft_consensus.cc:493] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.423907 32271 raft_consensus.cc:515] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:04.424959 32128 tablet_service.cc:1511] Processing CreateTablet for tablet 36f311ee508648669be858c85efab949 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:04.426421 32128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f311ee508648669be858c85efab949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.438987 32264 tablet_bootstrap.cc:654] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.443081 32053 tablet_service.cc:1511] Processing CreateTablet for tablet 36f311ee508648669be858c85efab949 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:04.466209 32270 raft_consensus.cc:493] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.466892 32270 raft_consensus.cc:515] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:04.470364 32263 ts_tablet_manager.cc:1434] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.236s	user 0.020s	sys 0.002s
I20260709 12:23:04.454591 32271 leader_election.cc:290] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:04.498297 32272 raft_consensus.cc:493] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:04.502840 32170 tablet.cc:2406] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:04.503387 32263 tablet_bootstrap.cc:492] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:04.503166 32272 raft_consensus.cc:515] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:04.504091 32204 tablet_service.cc:1511] Processing CreateTablet for tablet 36f311ee508648669be858c85efab949 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:04.506439 32206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6473d98e1f49484c888a0fb622b9b083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.504163 31985 tablet_service.cc:1511] Processing CreateTablet for tablet 737f0117f5e849cca1421fb53b5ccd31 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:04.493602 32270 leader_election.cc:290] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:04.502374 32053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f311ee508648669be858c85efab949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.512789 32202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480a9699f3b4488980be9862ced447cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.507901 32272 leader_election.cc:290] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:04.545950 31981 tablet_service.cc:1511] Processing CreateTablet for tablet e21e73e86f4b4b22ad881e5a80716ec7 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:04.530746 31985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737f0117f5e849cca1421fb53b5ccd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.539245 32204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f311ee508648669be858c85efab949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.556437 32265 ts_tablet_manager.cc:1434] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.234s	user 0.011s	sys 0.004s
I20260709 12:23:04.591869 32264 tablet_bootstrap.cc:492] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:04.592438 32264 ts_tablet_manager.cc:1403] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.209s	user 0.023s	sys 0.019s
I20260709 12:23:04.597440 32052 tablet_service.cc:1511] Processing CreateTablet for tablet 7a13a27f78154b4ebdf87e3009f09aa4 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:04.599710 31980 tablet_service.cc:1511] Processing CreateTablet for tablet 4a35467eb315463dae6edfd61cdb4a79 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:04.601599 32269 tablet_bootstrap.cc:492] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:04.605904 31982 tablet_service.cc:1511] Processing CreateTablet for tablet 441e813540114eb4928246a962aaf360 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:04.607823 32264 raft_consensus.cc:359] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:04.586797 31981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21e73e86f4b4b22ad881e5a80716ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.612185 32201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a35467eb315463dae6edfd61cdb4a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.618337 32269 ts_tablet_manager.cc:1403] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.348s	user 0.020s	sys 0.010s
I20260709 12:23:04.613368 32264 raft_consensus.cc:385] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.625433 32265 tablet_bootstrap.cc:492] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:04.625459 32052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a13a27f78154b4ebdf87e3009f09aa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.627658 32264 raft_consensus.cc:740] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.634505 32205 tablet_service.cc:1511] Processing CreateTablet for tablet 7a13a27f78154b4ebdf87e3009f09aa4 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:04.634829 32264 consensus_queue.cc:260] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:04.635869 32205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a13a27f78154b4ebdf87e3009f09aa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.637385 32264 ts_tablet_manager.cc:1434] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 12:23:04.642697 32208 tablet_service.cc:1511] Processing CreateTablet for tablet 19d55921a3ee4ee18232cdd3f94fcbb9 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:04.643059 31976 tablet_service.cc:1511] Processing CreateTablet for tablet 480a9699f3b4488980be9862ced447cb (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:04.644395 31979 tablet_service.cc:1511] Processing CreateTablet for tablet 6473d98e1f49484c888a0fb622b9b083 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:04.650914 32208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d55921a3ee4ee18232cdd3f94fcbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.625826 31984 tablet_service.cc:1511] Processing CreateTablet for tablet ab51a346acba496aa7601f0835510af0 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:04.654507 31983 tablet_service.cc:1511] Processing CreateTablet for tablet 9bafc1117fee410a852a9784f5ac967c (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:04.655939 32051 tablet_service.cc:1511] Processing CreateTablet for tablet 88877f73a5e94a759151a9e87e1f9c6b (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:04.657254 32051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88877f73a5e94a759151a9e87e1f9c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.650365 32264 tablet_bootstrap.cc:492] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:04.646631 31980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a35467eb315463dae6edfd61cdb4a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.638747 32269 raft_consensus.cc:359] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:04.678938 32269 raft_consensus.cc:385] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.681710 32269 raft_consensus.cc:740] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.682912 32269 consensus_queue.cc:260] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:04.679212 31982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441e813540114eb4928246a962aaf360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.687734 31977 tablet_service.cc:1511] Processing CreateTablet for tablet 7a13a27f78154b4ebdf87e3009f09aa4 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:04.679503 32058 tablet_service.cc:1511] Processing CreateTablet for tablet 9bafc1117fee410a852a9784f5ac967c (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:04.690897 32058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bafc1117fee410a852a9784f5ac967c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.721608 31976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480a9699f3b4488980be9862ced447cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.724989 32131 tablet_service.cc:1511] Processing CreateTablet for tablet 9bafc1117fee410a852a9784f5ac967c (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:04.726454 32131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bafc1117fee410a852a9784f5ac967c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.734407 32130 tablet_service.cc:1511] Processing CreateTablet for tablet 88877f73a5e94a759151a9e87e1f9c6b (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:04.737133 32130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88877f73a5e94a759151a9e87e1f9c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.729518 32126 tablet_service.cc:1511] Processing CreateTablet for tablet 19d55921a3ee4ee18232cdd3f94fcbb9 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:04.740353 32126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d55921a3ee4ee18232cdd3f94fcbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.742272 31983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bafc1117fee410a852a9784f5ac967c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.746397 31984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab51a346acba496aa7601f0835510af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.754839 32200 tablet_service.cc:1511] Processing CreateTablet for tablet 88877f73a5e94a759151a9e87e1f9c6b (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:04.756318 32200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88877f73a5e94a759151a9e87e1f9c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.745695 31978 tablet_service.cc:1511] Processing CreateTablet for tablet 19d55921a3ee4ee18232cdd3f94fcbb9 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:04.760859 31978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d55921a3ee4ee18232cdd3f94fcbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.763053 31979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6473d98e1f49484c888a0fb622b9b083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.766202 32203 tablet_service.cc:1511] Processing CreateTablet for tablet a20c391002194c58ab7f13a5df063f55 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:04.766556 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f214242a6fb64a23b3bf338f9189e209" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:04.729518 32060 tablet_service.cc:1511] Processing CreateTablet for tablet 760cfc460de34e6bbe34af04b225d26f (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:04.767776 32203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20c391002194c58ab7f13a5df063f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.768297 32060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760cfc460de34e6bbe34af04b225d26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.767876 32129 tablet_service.cc:1511] Processing CreateTablet for tablet 760cfc460de34e6bbe34af04b225d26f (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 12:23:04.770741 32110 leader_election.cc:343] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.771235 32129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760cfc460de34e6bbe34af04b225d26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.730813 32263 tablet_bootstrap.cc:654] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.794600 31977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a13a27f78154b4ebdf87e3009f09aa4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:04.802320 31940 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:04.805858 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f214242a6fb64a23b3bf338f9189e209" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:04.810210 32108 leader_election.cc:343] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.810878 32108 leader_election.cc:304] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:04.853127 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:04.855057 32182 leader_election.cc:343] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.858480 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
W20260709 12:23:04.860325 32184 leader_election.cc:343] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.860716 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62655659313345be94b5bdb515201711" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:04.860788 32184 leader_election.cc:304] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:04.861604 31995 raft_consensus.cc:2468] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:04.861867 32272 raft_consensus.cc:2749] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.862975 32034 leader_election.cc:304] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:04.863889 32270 raft_consensus.cc:2804] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.864235 32270 raft_consensus.cc:493] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.864555 32270 raft_consensus.cc:3060] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.867967 32059 tablet_service.cc:1511] Processing CreateTablet for tablet a20c391002194c58ab7f13a5df063f55 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:04.869410 32059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20c391002194c58ab7f13a5df063f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.872993 32270 raft_consensus.cc:515] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:04.874502 32269 ts_tablet_manager.cc:1434] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.247s	user 0.006s	sys 0.017s
I20260709 12:23:04.878356 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62655659313345be94b5bdb515201711" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:04.879062 31995 raft_consensus.cc:3060] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.879424 32271 raft_consensus.cc:2749] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:04.880407 32108 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:41023, user_credentials={real_user=slave}} blocked reactor thread for 70450.9us
I20260709 12:23:04.882081 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62655659313345be94b5bdb515201711" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
W20260709 12:23:04.883659 32034 leader_election.cc:343] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.891377 31995 raft_consensus.cc:2468] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:04.892791 32270 leader_election.cc:290] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:04.893955 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62655659313345be94b5bdb515201711" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:04.894939 32034 leader_election.cc:304] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:04.895843 32270 raft_consensus.cc:2804] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:23:04.895957 32034 leader_election.cc:343] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.899041 32265 tablet_bootstrap.cc:654] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.901276 32269 tablet_bootstrap.cc:492] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:04.896103 32264 tablet_bootstrap.cc:654] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.924803 32129 tablet_service.cc:1511] Processing CreateTablet for tablet 95d960ac97c848b8be5d62f6f5175144 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:04.926775 32129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d960ac97c848b8be5d62f6f5175144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.939225 32205 tablet_service.cc:1511] Processing CreateTablet for tablet 95d960ac97c848b8be5d62f6f5175144 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:04.940784 32205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d960ac97c848b8be5d62f6f5175144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.965148 32269 tablet_bootstrap.cc:654] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.995399 32265 tablet_bootstrap.cc:492] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:04.995973 32265 ts_tablet_manager.cc:1403] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.378s	user 0.010s	sys 0.009s
I20260709 12:23:04.999210 31981 tablet_service.cc:1511] Processing CreateTablet for tablet 760cfc460de34e6bbe34af04b225d26f (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:05.000622 31981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760cfc460de34e6bbe34af04b225d26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.011117 32051 tablet_service.cc:1511] Processing CreateTablet for tablet 13aeab79371a4849b6886db4cc9205d1 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:05.012617 32051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13aeab79371a4849b6886db4cc9205d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.022666 32265 raft_consensus.cc:359] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:05.023543 32265 raft_consensus.cc:385] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.023855 32265 raft_consensus.cc:740] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.024801 32265 consensus_queue.cc:260] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:05.039268 32202 tablet_service.cc:1511] Processing CreateTablet for tablet 13aeab79371a4849b6886db4cc9205d1 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:05.040743 32202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13aeab79371a4849b6886db4cc9205d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.040778 31984 tablet_service.cc:1511] Processing CreateTablet for tablet a20c391002194c58ab7f13a5df063f55 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:05.042011 31984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20c391002194c58ab7f13a5df063f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.047116 32263 tablet_bootstrap.cc:492] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:05.047801 32263 ts_tablet_manager.cc:1403] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.545s	user 0.016s	sys 0.027s
I20260709 12:23:05.051219 32263 raft_consensus.cc:359] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.055276 32271 raft_consensus.cc:493] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.062963 32130 tablet_service.cc:1511] Processing CreateTablet for tablet 13aeab79371a4849b6886db4cc9205d1 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:05.045428 31977 tablet_service.cc:1511] Processing CreateTablet for tablet 95d960ac97c848b8be5d62f6f5175144 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:05.078114 32271 raft_consensus.cc:515] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.078738 32130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13aeab79371a4849b6886db4cc9205d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.078815 31977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d960ac97c848b8be5d62f6f5175144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.080744 32271 leader_election.cc:290] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:05.030215 32270 raft_consensus.cc:697] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:05.082268 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30469d27ec5d450393d6116dbc4d0c7b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:05.083257 32270 consensus_queue.cc:237] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:05.070968 31985 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39130 (request call id 20) took 1113 ms. Trace:
I20260709 12:23:05.072187 32264 tablet_bootstrap.cc:492] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:05.084713 32264 ts_tablet_manager.cc:1403] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.446s	user 0.046s	sys 0.036s
W20260709 12:23:05.084618 32108 leader_election.cc:343] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.086846 32263 raft_consensus.cc:385] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.087332 32263 raft_consensus.cc:740] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.087975 32264 raft_consensus.cc:359] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.088799 32264 raft_consensus.cc:385] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.088274 32263 consensus_queue.cc:260] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.089123 32264 raft_consensus.cc:740] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.076337 32269 tablet_bootstrap.cc:492] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:05.090324 32269 ts_tablet_manager.cc:1403] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.189s	user 0.012s	sys 0.008s
I20260709 12:23:05.091776 32060 tablet_service.cc:1511] Processing CreateTablet for tablet 6edffd8d7fac40d1b74f6a23d3517e8b (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:05.093897 32269 raft_consensus.cc:359] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.105108 32269 raft_consensus.cc:385] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.097229 32264 consensus_queue.cc:260] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.098570 31979 tablet_service.cc:1511] Processing CreateTablet for tablet dc23d93569d44dd8a4bafcb504fc056a (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:05.096832 31985 rpcz_store.cc:276] 0709 12:23:03.958007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.493269 (+535262us) service_pool.cc:224] Handling call
0709 12:23:04.513022 (+ 19753us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:23:04.519185 (+  6163us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:23:04.975236 (+456051us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:05.069533 (+ 94297us) tablet_replica.cc:206] Creating consensus instance
0709 12:23:05.070897 (+  1364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:05.102676 32126 tablet_service.cc:1511] Processing CreateTablet for tablet e99b876f266b452a8e5d9782c08a1616 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:05.110360 32060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6edffd8d7fac40d1b74f6a23d3517e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.096803 32131 tablet_service.cc:1511] Processing CreateTablet for tablet 6edffd8d7fac40d1b74f6a23d3517e8b (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:05.110620 31983 tablet_service.cc:1511] Processing CreateTablet for tablet 6edffd8d7fac40d1b74f6a23d3517e8b (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:05.111090 32126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e99b876f266b452a8e5d9782c08a1616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.111940 32131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6edffd8d7fac40d1b74f6a23d3517e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.111089 31979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc23d93569d44dd8a4bafcb504fc056a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.115882 32059 tablet_service.cc:1511] Processing CreateTablet for tablet e4c7b8290b2a448cb9acb35da128eb8e (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:05.117239 32059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4c7b8290b2a448cb9acb35da128eb8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.105543 32269 raft_consensus.cc:740] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.118391 31983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6edffd8d7fac40d1b74f6a23d3517e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.118263 32269 consensus_queue.cc:260] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.122509 31982 tablet_service.cc:1511] Processing CreateTablet for tablet e99b876f266b452a8e5d9782c08a1616 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:05.123760 32269 ts_tablet_manager.cc:1434] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 12:23:05.123946 31982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e99b876f266b452a8e5d9782c08a1616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.124926 32269 tablet_bootstrap.cc:492] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:05.127640 32264 ts_tablet_manager.cc:1434] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:23:05.131527 32286 raft_consensus.cc:493] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.131788 32265 ts_tablet_manager.cc:1434] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.135s	user 0.018s	sys 0.004s
I20260709 12:23:05.132090 32286 raft_consensus.cc:515] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.132972 32265 tablet_bootstrap.cc:492] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:05.135507 32128 tablet_service.cc:1511] Processing CreateTablet for tablet e4c7b8290b2a448cb9acb35da128eb8e (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:05.136966 32128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4c7b8290b2a448cb9acb35da128eb8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.140202 32265 tablet_bootstrap.cc:654] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.114217 32051 tablet_service.cc:1511] Processing CreateTablet for tablet dc23d93569d44dd8a4bafcb504fc056a (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:05.150857 32051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc23d93569d44dd8a4bafcb504fc056a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.143996 32286 leader_election.cc:290] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:05.150979 32263 ts_tablet_manager.cc:1434] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.001s
I20260709 12:23:05.154974 32263 tablet_bootstrap.cc:492] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:05.151750 32264 tablet_bootstrap.cc:492] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:05.153448 32058 tablet_service.cc:1511] Processing CreateTablet for tablet 136a4f0e01594acc9dc1c8fdb8bd5ce2 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:05.159062 32058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136a4f0e01594acc9dc1c8fdb8bd5ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.164656 32129 tablet_service.cc:1511] Processing CreateTablet for tablet 136a4f0e01594acc9dc1c8fdb8bd5ce2 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:05.166121 32129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136a4f0e01594acc9dc1c8fdb8bd5ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.136933 32269 tablet_bootstrap.cc:654] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.194556 31977 tablet_service.cc:1511] Processing CreateTablet for tablet 136a4f0e01594acc9dc1c8fdb8bd5ce2 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:05.195480 32203 tablet_service.cc:1511] Processing CreateTablet for tablet e99b876f266b452a8e5d9782c08a1616 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:05.196506 32202 tablet_service.cc:1511] Processing CreateTablet for tablet e4c7b8290b2a448cb9acb35da128eb8e (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:05.197562 32203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e99b876f266b452a8e5d9782c08a1616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.198581 32200 tablet_service.cc:1511] Processing CreateTablet for tablet 749cde1030064b6198575299b10620c5 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:05.199842 32200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 749cde1030064b6198575299b10620c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.203013 32125 tablet_service.cc:1511] Processing CreateTablet for tablet 0ccc89be17b447c0bc6982d607a2983a (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:05.203742 32133 tablet_service.cc:1511] Processing CreateTablet for tablet a38d8cb74c1344a180ca94cfd755e103 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:05.203868 32201 tablet_service.cc:1511] Processing CreateTablet for tablet dc23d93569d44dd8a4bafcb504fc056a (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:05.204418 32125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccc89be17b447c0bc6982d607a2983a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.204998 32133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38d8cb74c1344a180ca94cfd755e103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.205197 32201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc23d93569d44dd8a4bafcb504fc056a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.208815 31985 tablet_service.cc:1511] Processing CreateTablet for tablet 0ccc89be17b447c0bc6982d607a2983a (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:05.208995 32204 tablet_service.cc:1511] Processing CreateTablet for tablet 0ccc89be17b447c0bc6982d607a2983a (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:05.210244 32204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccc89be17b447c0bc6982d607a2983a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.212466 32053 tablet_service.cc:1511] Processing CreateTablet for tablet a38d8cb74c1344a180ca94cfd755e103 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:05.213811 32053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38d8cb74c1344a180ca94cfd755e103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.214262 32052 tablet_service.cc:1511] Processing CreateTablet for tablet 749cde1030064b6198575299b10620c5 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:05.213594 31891 catalog_manager.cc:5697] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 1 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.218533 32202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4c7b8290b2a448cb9acb35da128eb8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.222407 32206 tablet_service.cc:1511] Processing CreateTablet for tablet a38d8cb74c1344a180ca94cfd755e103 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:05.226725 32206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38d8cb74c1344a180ca94cfd755e103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.228820 31977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136a4f0e01594acc9dc1c8fdb8bd5ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.229775 32263 tablet_bootstrap.cc:654] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.234347 32272 raft_consensus.cc:493] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.239930 32272 raft_consensus.cc:515] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.241613 31981 tablet_service.cc:1511] Processing CreateTablet for tablet 749cde1030064b6198575299b10620c5 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:05.242362 32272 leader_election.cc:290] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:05.243053 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:05.243295 32052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 749cde1030064b6198575299b10620c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.238010 31978 tablet_service.cc:1511] Processing CreateTablet for tablet 398afdbb52444496b0a87720c22f44a4 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 12:23:05.248674 32182 leader_election.cc:343] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.249095 32293 raft_consensus.cc:493] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.253893 32293 raft_consensus.cc:515] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:05.252014 32057 tablet_service.cc:1511] Processing CreateTablet for tablet 398afdbb52444496b0a87720c22f44a4 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:05.256973 32057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398afdbb52444496b0a87720c22f44a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.234457 31985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccc89be17b447c0bc6982d607a2983a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.266762 32128 tablet_service.cc:1511] Processing CreateTablet for tablet 398afdbb52444496b0a87720c22f44a4 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:05.268273 32128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398afdbb52444496b0a87720c22f44a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.274452 31981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 749cde1030064b6198575299b10620c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.278527 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:05.279639 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
W20260709 12:23:05.288030 32034 leader_election.cc:343] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.291270 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30469d27ec5d450393d6116dbc4d0c7b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
W20260709 12:23:05.294353 32107 leader_election.cc:343] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.294888 32107 leader_election.cc:304] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:05.295888 32271 raft_consensus.cc:2749] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.297948 32205 tablet_service.cc:1511] Processing CreateTablet for tablet fb989fb1126c4cc18ed28296301844a2 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:05.299456 32205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb989fb1126c4cc18ed28296301844a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.303102 32055 tablet_service.cc:1511] Processing CreateTablet for tablet fb989fb1126c4cc18ed28296301844a2 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:05.304554 32055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb989fb1126c4cc18ed28296301844a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.307245 31982 tablet_service.cc:1511] Processing CreateTablet for tablet fb989fb1126c4cc18ed28296301844a2 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:05.310668 32130 tablet_service.cc:1511] Processing CreateTablet for tablet 12128bac871f458ea02ff3b811378a98 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:05.312143 32130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12128bac871f458ea02ff3b811378a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.318491 32293 leader_election.cc:290] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
W20260709 12:23:05.281807 32184 leader_election.cc:343] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.328105 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:05.333781 32208 tablet_service.cc:1511] Processing CreateTablet for tablet 12128bac871f458ea02ff3b811378a98 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:05.335752 32208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12128bac871f458ea02ff3b811378a98. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:05.333841 32034 leader_election.cc:343] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.338866 32034 leader_election.cc:304] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:05.340409 32293 raft_consensus.cc:2749] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.351735 31979 tablet_service.cc:1511] Processing CreateTablet for tablet 12128bac871f458ea02ff3b811378a98 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:05.360147 32056 tablet_service.cc:1511] Processing CreateTablet for tablet f80df47302fb41ccae5b05949d696d98 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:05.326918 32184 leader_election.cc:304] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:05.363154 32272 raft_consensus.cc:2749] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.363535 32056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80df47302fb41ccae5b05949d696d98. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:05.364287 32184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:33135, user_credentials={real_user=slave}} blocked reactor thread for 82514.5us
I20260709 12:23:05.325448 32264 tablet_bootstrap.cc:654] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.332715 31978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398afdbb52444496b0a87720c22f44a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.401806 32131 tablet_service.cc:1511] Processing CreateTablet for tablet f80df47302fb41ccae5b05949d696d98 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:05.403258 32131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80df47302fb41ccae5b05949d696d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.408231 32207 tablet_service.cc:1511] Processing CreateTablet for tablet f80df47302fb41ccae5b05949d696d98 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:05.409400 32265 tablet_bootstrap.cc:492] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:05.409727 32207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80df47302fb41ccae5b05949d696d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.409973 32265 ts_tablet_manager.cc:1403] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.277s	user 0.041s	sys 0.025s
I20260709 12:23:05.413341 32265 raft_consensus.cc:359] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.414433 32265 raft_consensus.cc:385] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.414733 32265 raft_consensus.cc:740] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.415551 32265 consensus_queue.cc:260] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.417835 32265 ts_tablet_manager.cc:1434] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:05.418306 31982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb989fb1126c4cc18ed28296301844a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.418938 32265 tablet_bootstrap.cc:492] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:05.423120 31979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12128bac871f458ea02ff3b811378a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.444578 32263 tablet_bootstrap.cc:492] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:05.445179 32263 ts_tablet_manager.cc:1403] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.290s	user 0.021s	sys 0.012s
I20260709 12:23:05.445489 31977 tablet_service.cc:1511] Processing CreateTablet for tablet 3c31ec08af4642a8a25265fcb3dd6c11 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:05.446923 31977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c31ec08af4642a8a25265fcb3dd6c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.448575 32263 raft_consensus.cc:359] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.449404 32263 raft_consensus.cc:385] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.449695 32263 raft_consensus.cc:740] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.450635 32263 consensus_queue.cc:260] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.459728 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bbc7593a9a40acbab37a51e0269bef" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:05.463862 32199 tablet_service.cc:1511] Processing CreateTablet for tablet 97a7ca73ef254c8b9bbe684f81fa6af8 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:23:05.461935 31961 leader_election.cc:343] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.468008 31983 tablet_service.cc:1511] Processing CreateTablet for tablet 97a7ca73ef254c8b9bbe684f81fa6af8 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:05.468796 32131 tablet_service.cc:1511] Processing CreateTablet for tablet 3c31ec08af4642a8a25265fcb3dd6c11 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:05.469489 31983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a7ca73ef254c8b9bbe684f81fa6af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.470151 32131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c31ec08af4642a8a25265fcb3dd6c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.471784 31976 tablet_service.cc:1511] Processing CreateTablet for tablet 77f5edcc0d06488fb238c7ea0af75378 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:05.469177 32133 tablet_service.cc:1511] Processing CreateTablet for tablet 77f5edcc0d06488fb238c7ea0af75378 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:05.473132 31976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f5edcc0d06488fb238c7ea0af75378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.474094 32271 raft_consensus.cc:493] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.474634 32271 raft_consensus.cc:515] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.476610 32060 tablet_service.cc:1511] Processing CreateTablet for tablet 3c31ec08af4642a8a25265fcb3dd6c11 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:05.477982 32060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c31ec08af4642a8a25265fcb3dd6c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.478044 32133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f5edcc0d06488fb238c7ea0af75378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.484390 32200 tablet_service.cc:1511] Processing CreateTablet for tablet 77f5edcc0d06488fb238c7ea0af75378 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:05.487361 32199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a7ca73ef254c8b9bbe684f81fa6af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.495460 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e93bb1528747f2b573d12daa3b7fb0" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
W20260709 12:23:05.497215 32110 leader_election.cc:343] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.508814 32264 tablet_bootstrap.cc:492] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:05.509487 32264 ts_tablet_manager.cc:1403] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.358s	user 0.002s	sys 0.022s
I20260709 12:23:05.515167 32269 tablet_bootstrap.cc:492] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:05.515858 32269 ts_tablet_manager.cc:1403] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.391s	user 0.019s	sys 0.008s
I20260709 12:23:05.519284 32269 raft_consensus.cc:359] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:05.520622 32264 raft_consensus.cc:359] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.521735 32293 consensus_queue.cc:1048] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:05.526526 32271 leader_election.cc:290] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:05.527828 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e93bb1528747f2b573d12daa3b7fb0" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:05.533473 32200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f5edcc0d06488fb238c7ea0af75378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.533850 32263 ts_tablet_manager.cc:1434] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.000s
I20260709 12:23:05.533948 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bbc7593a9a40acbab37a51e0269bef" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:05.515314 32058 tablet_service.cc:1511] Processing CreateTablet for tablet 97a7ca73ef254c8b9bbe684f81fa6af8 (DEFAULT_TABLE table=test-workload [id=87f6f759cd904b828cb5b6eeeb47446c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:23:05.603111 32107 leader_election.cc:343] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.603847 32107 leader_election.cc:304] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372
I20260709 12:23:05.604681 32271 raft_consensus.cc:2749] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.537006 32269 raft_consensus.cc:385] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.541522 32265 tablet_bootstrap.cc:654] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.537107 32264 raft_consensus.cc:385] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:05.557497 32034 consensus_peers.cc:597] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d -> Peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Couldn't send request to peer c5524748d37141a1bca7d0cedaeb40f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:05.610543 32269 raft_consensus.cc:740] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
W20260709 12:23:05.620144 31958 leader_election.cc:343] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.620728 31958 leader_election.cc:304] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372
I20260709 12:23:05.622957 32286 raft_consensus.cc:2749] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.613776 32264 raft_consensus.cc:740] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.628294 32263 tablet_bootstrap.cc:492] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:05.629078 32264 consensus_queue.cc:260] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.631524 32264 ts_tablet_manager.cc:1434] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.000s
I20260709 12:23:05.632709 32264 tablet_bootstrap.cc:492] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:05.634552 32269 consensus_queue.cc:260] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:05.635228 32263 tablet_bootstrap.cc:654] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:05.616304 32034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 59017.7us
I20260709 12:23:05.637017 32269 ts_tablet_manager.cc:1434] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.121s	user 0.022s	sys 0.013s
I20260709 12:23:05.649653 32272 raft_consensus.cc:493] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.650753 32272 raft_consensus.cc:515] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.655422 32058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a7ca73ef254c8b9bbe684f81fa6af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.656399 32272 leader_election.cc:290] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:05.686247 32265 tablet_bootstrap.cc:492] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:05.687347 32263 tablet_bootstrap.cc:492] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:05.687932 32263 ts_tablet_manager.cc:1403] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.017s
I20260709 12:23:05.691074 32263 raft_consensus.cc:359] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.691803 32263 raft_consensus.cc:385] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.692093 32263 raft_consensus.cc:740] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.694172 32265 ts_tablet_manager.cc:1403] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.275s	user 0.015s	sys 0.014s
I20260709 12:23:05.696208 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e6e3a7239949adaa6b5dacaf6ded22" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:05.697736 32182 leader_election.cc:343] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.699678 32264 tablet_bootstrap.cc:654] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.699290 32263 consensus_queue.cc:260] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.683729 32269 tablet_bootstrap.cc:492] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:05.699265 32265 raft_consensus.cc:359] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.703123 32265 raft_consensus.cc:385] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.703490 32265 raft_consensus.cc:740] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.704304 32265 consensus_queue.cc:260] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.706939 32265 ts_tablet_manager.cc:1434] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:23:05.708027 32265 tablet_bootstrap.cc:492] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:05.713414 32263 ts_tablet_manager.cc:1434] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 12:23:05.714684 32263 tablet_bootstrap.cc:492] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:05.715546 32269 tablet_bootstrap.cc:654] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.717057 32265 tablet_bootstrap.cc:654] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.722394 32263 tablet_bootstrap.cc:654] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.727247 32272 raft_consensus.cc:493] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.727974 32272 raft_consensus.cc:515] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.731043 32272 leader_election.cc:290] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:05.731866 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:05.733914 32182 leader_election.cc:343] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.735639 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:05.737438 32265 tablet_bootstrap.cc:492] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
W20260709 12:23:05.737555 32184 leader_election.cc:343] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.738283 32265 ts_tablet_manager.cc:1403] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.002s
I20260709 12:23:05.738320 32184 leader_election.cc:304] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:05.739589 32272 raft_consensus.cc:2749] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.742516 32265 raft_consensus.cc:359] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.743561 32265 raft_consensus.cc:385] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.743947 32265 raft_consensus.cc:740] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.745213 32265 consensus_queue.cc:260] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.748919 32265 ts_tablet_manager.cc:1434] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:23:05.750329 32265 tablet_bootstrap.cc:492] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:05.752193 32264 tablet_bootstrap.cc:492] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:05.752774 32264 ts_tablet_manager.cc:1403] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.005s
I20260709 12:23:05.757122 32264 raft_consensus.cc:359] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.757866 32264 raft_consensus.cc:385] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.758185 32264 raft_consensus.cc:740] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.759363 32265 tablet_bootstrap.cc:654] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.760576 32264 consensus_queue.cc:260] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.771863 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e6e3a7239949adaa6b5dacaf6ded22" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:05.772131 32264 ts_tablet_manager.cc:1434] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:23:05.772540 32144 raft_consensus.cc:2468] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
I20260709 12:23:05.773391 32264 tablet_bootstrap.cc:492] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:05.773876 32182 leader_election.cc:304] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:05.774780 32272 raft_consensus.cc:2804] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.775177 32272 raft_consensus.cc:493] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.775519 32272 raft_consensus.cc:3060] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.777114 32265 tablet_bootstrap.cc:492] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:05.777524 32269 tablet_bootstrap.cc:492] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:05.777618 32265 ts_tablet_manager.cc:1403] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.003s
I20260709 12:23:05.778158 32269 ts_tablet_manager.cc:1403] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.098s	user 0.021s	sys 0.003s
I20260709 12:23:05.781071 32265 raft_consensus.cc:359] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.781903 32265 raft_consensus.cc:385] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.781610 32269 raft_consensus.cc:359] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.782290 32265 raft_consensus.cc:740] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.782431 32269 raft_consensus.cc:385] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.782838 32269 raft_consensus.cc:740] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.783282 32265 consensus_queue.cc:260] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.783751 32269 consensus_queue.cc:260] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.774322 32263 tablet_bootstrap.cc:492] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:05.783887 32272 raft_consensus.cc:515] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.786659 32269 ts_tablet_manager.cc:1434] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:05.785076 32263 ts_tablet_manager.cc:1403] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.034s
I20260709 12:23:05.787846 32269 tablet_bootstrap.cc:492] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:05.789314 32264 tablet_bootstrap.cc:654] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.790555 32263 raft_consensus.cc:359] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.791419 32263 raft_consensus.cc:385] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.790913 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e6e3a7239949adaa6b5dacaf6ded22" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:05.791625 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e6e3a7239949adaa6b5dacaf6ded22" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:05.791976 32144 raft_consensus.cc:3060] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:05.793033 32182 leader_election.cc:343] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.794337 32265 ts_tablet_manager.cc:1434] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:23:05.795400 32265 tablet_bootstrap.cc:492] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:05.799726 32144 raft_consensus.cc:2468] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:05.801622 32182 leader_election.cc:304] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:05.802449 32293 raft_consensus.cc:493] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.803002 32293 raft_consensus.cc:515] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.804461 32264 tablet_bootstrap.cc:492] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:05.806146 32264 ts_tablet_manager.cc:1403] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.008s
I20260709 12:23:05.806269 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ffe4df6d544068be9090ac7db408a2" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:05.806888 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ffe4df6d544068be9090ac7db408a2" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:05.800237 32263 raft_consensus.cc:740] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.808354 32263 consensus_queue.cc:260] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
W20260709 12:23:05.808511 32034 leader_election.cc:343] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.789680 32272 leader_election.cc:290] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:05.804682 32265 tablet_bootstrap.cc:654] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.805302 32293 leader_election.cc:290] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
W20260709 12:23:05.810433 32034 leader_election.cc:343] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.811034 32034 leader_election.cc:304] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:05.812134 32270 raft_consensus.cc:2749] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:05.813675 31940 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:05.812836 32264 raft_consensus.cc:359] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:05.814468 32264 raft_consensus.cc:385] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.814826 32264 raft_consensus.cc:740] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.815649 32264 consensus_queue.cc:260] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:05.818271 32272 raft_consensus.cc:2804] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.821367 32264 ts_tablet_manager.cc:1434] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:23:05.822620 32264 tablet_bootstrap.cc:492] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:05.822996 32272 raft_consensus.cc:697] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:05.824230 32272 consensus_queue.cc:237] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.830224 32264 tablet_bootstrap.cc:654] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.830391 32263 ts_tablet_manager.cc:1434] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.010s
I20260709 12:23:05.831157 32269 tablet_bootstrap.cc:654] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.831607 32263 tablet_bootstrap.cc:492] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:05.836957 32265 tablet_bootstrap.cc:492] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:05.837553 32265 ts_tablet_manager.cc:1403] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 12:23:05.841732 32269 tablet_bootstrap.cc:492] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:05.842332 32269 ts_tablet_manager.cc:1403] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.004s
I20260709 12:23:05.843891 32263 tablet_bootstrap.cc:654] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.840394 32265 raft_consensus.cc:359] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.845827 32264 tablet_bootstrap.cc:492] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:05.846341 32265 raft_consensus.cc:385] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.846704 32264 ts_tablet_manager.cc:1403] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.003s
I20260709 12:23:05.846776 32265 raft_consensus.cc:740] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.847920 32265 consensus_queue.cc:260] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.847656 31893 catalog_manager.cc:5697] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.845427 32269 raft_consensus.cc:359] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.850265 32269 raft_consensus.cc:385] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.850682 32265 ts_tablet_manager.cc:1434] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:23:05.851805 32265 tablet_bootstrap.cc:492] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:05.851265 32264 raft_consensus.cc:359] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.852315 32264 raft_consensus.cc:385] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.852718 32264 raft_consensus.cc:740] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.853850 32264 consensus_queue.cc:260] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.857113 32264 ts_tablet_manager.cc:1434] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:05.858745 32264 tablet_bootstrap.cc:492] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:05.859025 32265 tablet_bootstrap.cc:654] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.850680 32269 raft_consensus.cc:740] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.862908 32269 consensus_queue.cc:260] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.865588 32269 ts_tablet_manager.cc:1434] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:23:05.866818 32269 tablet_bootstrap.cc:492] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:05.873678 32264 tablet_bootstrap.cc:654] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.878324 32269 tablet_bootstrap.cc:654] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.898916 32264 tablet_bootstrap.cc:492] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:05.899439 32264 ts_tablet_manager.cc:1403] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.013s
I20260709 12:23:05.899545 32263 tablet_bootstrap.cc:492] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:05.900068 32263 ts_tablet_manager.cc:1403] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.069s	user 0.025s	sys 0.033s
I20260709 12:23:05.902444 32269 tablet_bootstrap.cc:492] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:05.903218 32269 ts_tablet_manager.cc:1403] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.004s
I20260709 12:23:05.903157 32263 raft_consensus.cc:359] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.904095 32263 raft_consensus.cc:385] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.904415 32263 raft_consensus.cc:740] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.905850 32271 raft_consensus.cc:493] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.906303 32263 consensus_queue.cc:260] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.906410 32271 raft_consensus.cc:515] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.907469 32269 raft_consensus.cc:359] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.907536 32264 raft_consensus.cc:359] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:05.908816 32271 leader_election.cc:290] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:05.909040 32269 raft_consensus.cc:385] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.909098 32264 raft_consensus.cc:385] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.909631 32269 raft_consensus.cc:740] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.909727 32264 raft_consensus.cc:740] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.911394 32263 ts_tablet_manager.cc:1434] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.008s
I20260709 12:23:05.911230 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e76032b934159855ba6bc924e9dd4" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:05.921033 32263 tablet_bootstrap.cc:492] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:05.920640 32269 consensus_queue.cc:260] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
W20260709 12:23:05.921442 32107 leader_election.cc:343] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.910145 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e76032b934159855ba6bc924e9dd4" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
W20260709 12:23:05.923898 32110 leader_election.cc:343] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.924373 32110 leader_election.cc:304] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372
I20260709 12:23:05.925505 32293 raft_consensus.cc:493] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.926044 32293 raft_consensus.cc:515] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.927031 32264 consensus_queue.cc:260] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:05.928064 32263 tablet_bootstrap.cc:654] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.928339 32293 leader_election.cc:290] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:05.928999 32271 raft_consensus.cc:2749] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.931412 32269 ts_tablet_manager.cc:1434] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.012s
I20260709 12:23:05.935129 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aaccd64e9ef4703af3eef217706d108" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:05.936038 32264 ts_tablet_manager.cc:1434] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.007s
I20260709 12:23:05.937089 32264 tablet_bootstrap.cc:492] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
W20260709 12:23:05.938016 32034 leader_election.cc:343] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.938234 32263 tablet_bootstrap.cc:492] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:05.938848 32263 ts_tablet_manager.cc:1403] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:23:05.939400 32293 raft_consensus.cc:493] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.939970 32293 raft_consensus.cc:515] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.942046 32263 raft_consensus.cc:359] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.943044 32264 tablet_bootstrap.cc:654] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.942801 32263 raft_consensus.cc:385] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.944790 32263 raft_consensus.cc:740] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.944967 32269 tablet_bootstrap.cc:492] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:05.946786 32265 tablet_bootstrap.cc:492] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:05.947389 32265 ts_tablet_manager.cc:1403] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.096s	user 0.024s	sys 0.001s
I20260709 12:23:05.946906 32263 consensus_queue.cc:260] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.948007 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bbc7593a9a40acbab37a51e0269bef" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:05.948738 31995 raft_consensus.cc:2468] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:05.950345 32034 leader_election.cc:304] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:05.946627 32293 leader_election.cc:290] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:05.951171 32270 raft_consensus.cc:2804] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.951588 32270 raft_consensus.cc:493] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.951957 32270 raft_consensus.cc:3060] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.954912 32263 ts_tablet_manager.cc:1434] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:23:05.956526 32263 tablet_bootstrap.cc:492] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:05.957821 32265 raft_consensus.cc:359] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:05.958684 32265 raft_consensus.cc:385] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.963421 32270 raft_consensus.cc:515] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:05.959000 32265 raft_consensus.cc:740] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.967175 32263 tablet_bootstrap.cc:654] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.970005 32286 raft_consensus.cc:493] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.967173 32264 tablet_bootstrap.cc:492] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:05.971545 32264 ts_tablet_manager.cc:1403] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.008s
I20260709 12:23:05.971186 32286 raft_consensus.cc:515] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:05.974634 32270 leader_election.cc:290] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:05.975771 32269 tablet_bootstrap.cc:654] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.976141 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bbc7593a9a40acbab37a51e0269bef" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:05.976861 31995 raft_consensus.cc:3060] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.977272 32264 raft_consensus.cc:359] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.978004 32264 raft_consensus.cc:385] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.978293 32264 raft_consensus.cc:740] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.978408 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aaccd64e9ef4703af3eef217706d108" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:05.979075 32264 consensus_queue.cc:260] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:05.980018 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bbc7593a9a40acbab37a51e0269bef" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:05.980608 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:05.981381 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bbc7593a9a40acbab37a51e0269bef" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:05.981499 32070 raft_consensus.cc:2468] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:05.981666 32264 ts_tablet_manager.cc:1434] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:23:05.983881 32330 raft_consensus.cc:493] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.984501 32330 raft_consensus.cc:515] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
W20260709 12:23:05.985364 32033 leader_election.cc:343] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:05.986527 32033 leader_election.cc:343] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.979077 32217 raft_consensus.cc:2468] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:05.988109 32033 leader_election.cc:304] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:05.988533 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62655659313345be94b5bdb515201711" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:05.989003 32270 raft_consensus.cc:2804] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.989444 32270 raft_consensus.cc:493] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.989770 31961 leader_election.cc:304] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:05.990196 32330 leader_election.cc:290] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:05.991603 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62655659313345be94b5bdb515201711" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:05.992497 32264 tablet_bootstrap.cc:492] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:05.989791 32270 raft_consensus.cc:3060] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.999500 32264 tablet_bootstrap.cc:654] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.973877 32286 leader_election.cc:290] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:06.007321 32286 raft_consensus.cc:2804] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.008072 32286 raft_consensus.cc:493] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.008775 32286 raft_consensus.cc:3060] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.011502 32264 tablet_bootstrap.cc:492] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:06.012081 32264 ts_tablet_manager.cc:1403] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:23:06.015242 32264 raft_consensus.cc:359] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.016281 32264 raft_consensus.cc:385] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.016631 32264 raft_consensus.cc:740] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.016786 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:06.017803 32144 raft_consensus.cc:2468] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:06.017796 32264 consensus_queue.cc:260] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.024196 32330 raft_consensus.cc:493] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.024734 32330 raft_consensus.cc:515] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.027093 32330 leader_election.cc:290] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:06.028770 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ffe4df6d544068be9090ac7db408a2" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:06.029543 32264 ts_tablet_manager.cc:1434] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:23:06.029495 32070 raft_consensus.cc:2468] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:06.030675 32264 tablet_bootstrap.cc:492] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:06.030933 32110 leader_election.cc:304] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:06.032894 32330 raft_consensus.cc:2804] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.033270 32330 raft_consensus.cc:493] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.033607 32330 raft_consensus.cc:3060] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.037878 32264 tablet_bootstrap.cc:654] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.971158 32265 consensus_queue.cc:260] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.047392 32270 raft_consensus.cc:515] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.049721 32330 raft_consensus.cc:515] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.051512 32265 ts_tablet_manager.cc:1434] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.104s	user 0.002s	sys 0.004s
I20260709 12:23:06.053522 31995 raft_consensus.cc:2468] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:06.057298 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ffe4df6d544068be9090ac7db408a2" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:06.058234 32070 raft_consensus.cc:3060] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.059254 32270 leader_election.cc:290] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:06.060038 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aaccd64e9ef4703af3eef217706d108" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:06.060402 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aaccd64e9ef4703af3eef217706d108" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:06.060693 32144 raft_consensus.cc:3060] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.061120 32217 raft_consensus.cc:3060] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.061551 32286 raft_consensus.cc:515] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.062278 32272 raft_consensus.cc:493] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.062806 32272 raft_consensus.cc:515] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.064996 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:06.065673 32143 raft_consensus.cc:3060] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.065953 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e93bb1528747f2b573d12daa3b7fb0" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:06.066646 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e93bb1528747f2b573d12daa3b7fb0" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:06.067402 32142 raft_consensus.cc:2468] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
I20260709 12:23:06.069149 32182 leader_election.cc:304] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:06.065019 32272 leader_election.cc:290] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:06.070650 32272 raft_consensus.cc:2804] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.071076 32272 raft_consensus.cc:493] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.071468 32272 raft_consensus.cc:3060] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.072094 32144 raft_consensus.cc:2468] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:06.073280 32034 leader_election.cc:304] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:06.074928 32271 raft_consensus.cc:493] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.075520 32271 raft_consensus.cc:515] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.077823 32271 leader_election.cc:290] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:06.074905 32217 raft_consensus.cc:2468] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:06.079358 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae2aab0addf4c939688292e7118cbe0" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:06.057766 32265 tablet_bootstrap.cc:492] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:06.066807 32069 raft_consensus.cc:2468] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
W20260709 12:23:06.080951 32107 leader_election.cc:343] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:06.056056 31961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:33135, user_credentials={real_user=slave}} blocked reactor thread for 66375.1us
I20260709 12:23:06.083674 32034 leader_election.cc:304] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:06.084057 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ffe4df6d544068be9090ac7db408a2" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:06.084967 32293 raft_consensus.cc:2804] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.053984 32330 leader_election.cc:290] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:06.087637 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ffe4df6d544068be9090ac7db408a2" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:06.086309 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:06.089421 32069 raft_consensus.cc:3060] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.090176 32143 raft_consensus.cc:2468] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:06.090363 32269 tablet_bootstrap.cc:492] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:06.091012 32269 ts_tablet_manager.cc:1403] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.153s	user 0.050s	sys 0.044s
I20260709 12:23:06.091034 32270 raft_consensus.cc:2804] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.083660 32264 tablet_bootstrap.cc:492] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:06.088832 32286 leader_election.cc:290] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:06.092140 32264 ts_tablet_manager.cc:1403] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.010s
I20260709 12:23:06.092293 32108 leader_election.cc:304] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:06.094475 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae2aab0addf4c939688292e7118cbe0" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:06.095037 31959 leader_election.cc:304] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:06.095166 31994 raft_consensus.cc:2468] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:06.096201 32336 raft_consensus.cc:2804] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.098417 32330 raft_consensus.cc:2749] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.106684 32265 tablet_bootstrap.cc:654] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.105945 32070 raft_consensus.cc:2468] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
W20260709 12:23:06.106813 32108 leader_election.cc:343] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.109844 32263 tablet_bootstrap.cc:492] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:06.110327 32263 ts_tablet_manager.cc:1403] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.154s	user 0.017s	sys 0.017s
I20260709 12:23:06.104140 32264 raft_consensus.cc:359] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.111243 32264 raft_consensus.cc:385] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.111506 32264 raft_consensus.cc:740] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.107252 32336 raft_consensus.cc:697] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:06.109107 32293 raft_consensus.cc:697] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:06.115114 32293 consensus_queue.cc:237] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.115114 32336 consensus_queue.cc:237] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
W20260709 12:23:06.115480 32108 leader_election.cc:343] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.120854 32264 consensus_queue.cc:260] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.122068 32108 leader_election.cc:304] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:06.126560 32069 raft_consensus.cc:2468] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:06.128607 32330 raft_consensus.cc:2804] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.129614 32330 raft_consensus.cc:493] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.129966 32330 raft_consensus.cc:3060] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.136746 32264 ts_tablet_manager.cc:1434] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 12:23:06.135246 32270 raft_consensus.cc:697] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:06.153506 32264 tablet_bootstrap.cc:492] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:06.154181 32330 raft_consensus.cc:515] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.156708 32330 leader_election.cc:290] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:06.144451 32272 raft_consensus.cc:515] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.159703 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae2aab0addf4c939688292e7118cbe0" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:06.160197 32263 raft_consensus.cc:359] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.160830 32272 leader_election.cc:290] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:06.160912 32263 raft_consensus.cc:385] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.161469 32263 raft_consensus.cc:740] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.162205 32263 consensus_queue.cc:260] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.162577 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae2aab0addf4c939688292e7118cbe0" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:06.163283 31995 raft_consensus.cc:3060] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.163710 32263 ts_tablet_manager.cc:1434] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 12:23:06.164456 32336 raft_consensus.cc:493] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.165114 32263 tablet_bootstrap.cc:492] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:06.165050 32336 raft_consensus.cc:515] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.143810 32143 raft_consensus.cc:3060] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.164485 31893 catalog_manager.cc:5697] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.158861 32110 leader_election.cc:304] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
W20260709 12:23:06.167212 32107 leader_election.cc:343] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.170562 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:06.171157 32336 leader_election.cc:290] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:06.171273 32217 raft_consensus.cc:2468] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:06.172652 31958 leader_election.cc:304] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:06.172739 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:06.173487 32069 raft_consensus.cc:2468] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:06.173583 32336 raft_consensus.cc:2804] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.174053 32336 raft_consensus.cc:493] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.174254 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e93bb1528747f2b573d12daa3b7fb0" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:06.174973 32144 raft_consensus.cc:3060] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.174436 32336 raft_consensus.cc:3060] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.180228 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e93bb1528747f2b573d12daa3b7fb0" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:06.181085 32069 raft_consensus.cc:3060] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.183597 32330 raft_consensus.cc:2804] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.136425 32269 raft_consensus.cc:359] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.184465 32269 raft_consensus.cc:385] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.185632 32269 raft_consensus.cc:740] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.188453 32269 consensus_queue.cc:260] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.189294 32144 raft_consensus.cc:2468] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:06.190618 32182 leader_election.cc:304] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:06.191345 32269 ts_tablet_manager.cc:1434] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.001s
I20260709 12:23:06.192273 32272 raft_consensus.cc:2804] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.192512 32269 tablet_bootstrap.cc:492] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:06.193063 32272 raft_consensus.cc:697] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:06.193972 32272 consensus_queue.cc:237] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.197114 32340 raft_consensus.cc:493] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.197842 32340 raft_consensus.cc:515] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.198314 32264 tablet_bootstrap.cc:654] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.184861 32330 raft_consensus.cc:697] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:06.202118 31995 raft_consensus.cc:2468] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:06.202796 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e76032b934159855ba6bc924e9dd4" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:06.203303 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e76032b934159855ba6bc924e9dd4" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:06.203914 32340 leader_election.cc:290] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:06.208295 32142 raft_consensus.cc:2468] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:06.209180 32217 raft_consensus.cc:2468] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:06.205471 32069 raft_consensus.cc:2468] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:06.205919 32269 tablet_bootstrap.cc:654] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.196179 32270 consensus_queue.cc:237] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.209766 32108 leader_election.cc:304] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:06.210435 32033 leader_election.cc:304] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:06.201128 32330 consensus_queue.cc:237] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.212965 32340 raft_consensus.cc:2804] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.214663 32340 raft_consensus.cc:493] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.220690 32265 tablet_bootstrap.cc:492] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:06.221451 32265 ts_tablet_manager.cc:1403] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.164s	user 0.011s	sys 0.015s
I20260709 12:23:06.212931 32271 raft_consensus.cc:2804] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.226591 32263 tablet_bootstrap.cc:654] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.228857 32269 tablet_bootstrap.cc:492] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:06.222303 32340 raft_consensus.cc:3060] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.229583 32269 ts_tablet_manager.cc:1403] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.003s
I20260709 12:23:06.223717 32336 raft_consensus.cc:515] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.244696 32265 raft_consensus.cc:359] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.245507 32265 raft_consensus.cc:385] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.246537 31891 catalog_manager.cc:5697] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.256706 32336 leader_election.cc:290] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:06.254158 32269 raft_consensus.cc:359] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.257946 32269 raft_consensus.cc:385] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.258416 32269 raft_consensus.cc:740] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.258975 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:06.259114 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:06.259598 32069 raft_consensus.cc:3060] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.245816 32265 raft_consensus.cc:740] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.259608 32269 consensus_queue.cc:260] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.260540 32217 raft_consensus.cc:3060] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.263934 32269 ts_tablet_manager.cc:1434] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 12:23:06.268107 32336 raft_consensus.cc:493] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.272033 32272 consensus_queue.cc:1048] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.268162 32265 consensus_queue.cc:260] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.271970 32336 raft_consensus.cc:515] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.275323 32265 ts_tablet_manager.cc:1434] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.001s
I20260709 12:23:06.277359 32265 tablet_bootstrap.cc:492] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:06.265254 32269 tablet_bootstrap.cc:492] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:06.279785 32271 raft_consensus.cc:697] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:06.300978 32069 raft_consensus.cc:2468] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:06.302469 31961 leader_election.cc:304] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:06.302520 31893 catalog_manager.cc:5697] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 1 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.304112 32341 raft_consensus.cc:2804] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.304440 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30469d27ec5d450393d6116dbc4d0c7b" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:06.304652 32341 raft_consensus.cc:697] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:06.304349 31893 catalog_manager.cc:5697] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 1 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.307672 32264 tablet_bootstrap.cc:492] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:06.308166 32264 ts_tablet_manager.cc:1403] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.156s	user 0.019s	sys 0.019s
I20260709 12:23:06.305272 32216 raft_consensus.cc:2468] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:06.311156 32341 consensus_queue.cc:237] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.311538 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30469d27ec5d450393d6116dbc4d0c7b" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:06.312284 32142 raft_consensus.cc:2468] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:06.313326 32269 tablet_bootstrap.cc:654] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.313088 32271 consensus_queue.cc:237] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.311149 31958 leader_election.cc:304] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:06.314961 32286 raft_consensus.cc:2804] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.315351 32286 raft_consensus.cc:493] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.315723 32286 raft_consensus.cc:3060] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.316727 32264 raft_consensus.cc:359] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.317441 32264 raft_consensus.cc:385] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.317718 32264 raft_consensus.cc:740] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.320776 32340 raft_consensus.cc:515] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.320698 32264 consensus_queue.cc:260] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.306228 32336 leader_election.cc:290] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:06.323205 32264 ts_tablet_manager.cc:1434] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:23:06.324394 32264 tablet_bootstrap.cc:492] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:06.328055 32340 leader_election.cc:290] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:06.336879 32265 tablet_bootstrap.cc:654] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.329430 32286 raft_consensus.cc:515] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.323619 32217 raft_consensus.cc:2468] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:06.330907 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e76032b934159855ba6bc924e9dd4" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:06.344354 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e76032b934159855ba6bc924e9dd4" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:06.344859 32216 raft_consensus.cc:3060] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.345116 32142 raft_consensus.cc:3060] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.346638 31890 catalog_manager.cc:5697] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.351140 32286 leader_election.cc:290] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:06.356983 32353 raft_consensus.cc:493] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.357534 32353 raft_consensus.cc:515] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.359746 32353 leader_election.cc:290] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:06.359984 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30469d27ec5d450393d6116dbc4d0c7b" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:06.360682 32144 raft_consensus.cc:3060] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.362355 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e47eae61a3433591d82d8c67dcd74b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:06.363929 32108 leader_election.cc:343] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.365804 32263 tablet_bootstrap.cc:492] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:06.366619 32263 ts_tablet_manager.cc:1403] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.202s	user 0.018s	sys 0.004s
I20260709 12:23:06.367965 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30469d27ec5d450393d6116dbc4d0c7b" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:06.369318 32217 raft_consensus.cc:3060] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.373668 32263 raft_consensus.cc:359] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.368247 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e47eae61a3433591d82d8c67dcd74b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:06.386546 32263 raft_consensus.cc:385] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.387073 32269 tablet_bootstrap.cc:492] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:06.386950 32263 raft_consensus.cc:740] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.388512 32269 ts_tablet_manager.cc:1403] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.013s
I20260709 12:23:06.384582 32216 raft_consensus.cc:2468] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:06.389751 32033 leader_election.cc:304] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:06.389920 32217 raft_consensus.cc:2468] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:06.390650 32340 raft_consensus.cc:2804] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.390918 32264 tablet_bootstrap.cc:654] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.391148 32340 raft_consensus.cc:697] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:06.391258 31958 leader_election.cc:304] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:06.392305 32286 raft_consensus.cc:2804] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.392171 32340 consensus_queue.cc:237] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.393054 32286 raft_consensus.cc:697] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
W20260709 12:23:06.387887 32110 leader_election.cc:343] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.393884 32110 leader_election.cc:304] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:06.394068 32286 consensus_queue.cc:237] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.395341 32353 raft_consensus.cc:2749] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.384652 31893 catalog_manager.cc:5697] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.385924 32142 raft_consensus.cc:2468] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:06.368273 32144 raft_consensus.cc:2468] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:06.402606 32263 consensus_queue.cc:260] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.417291 32263 ts_tablet_manager.cc:1434] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
W20260709 12:23:06.408721 32182 consensus_peers.cc:597] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:06.408721 31890 catalog_manager.cc:5697] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 1 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.410804 32265 tablet_bootstrap.cc:492] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:06.397868 32269 raft_consensus.cc:359] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.421156 32269 raft_consensus.cc:385] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.420444 31891 catalog_manager.cc:5697] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.421582 32269 raft_consensus.cc:740] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.422430 32269 consensus_queue.cc:260] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.424451 32269 ts_tablet_manager.cc:1434] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:23:06.425209 32269 tablet_bootstrap.cc:492] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:06.426359 32265 ts_tablet_manager.cc:1403] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.001s
I20260709 12:23:06.429292 32265 raft_consensus.cc:359] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.430680 32263 tablet_bootstrap.cc:492] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:06.430920 32269 tablet_bootstrap.cc:654] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.437330 31890 catalog_manager.cc:5697] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.438894 32263 tablet_bootstrap.cc:654] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.430979 32265 raft_consensus.cc:385] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.442051 32265 raft_consensus.cc:740] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.442268 32269 tablet_bootstrap.cc:492] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:06.442761 32269 ts_tablet_manager.cc:1403] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:23:06.442925 32265 consensus_queue.cc:260] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.421314 32264 tablet_bootstrap.cc:492] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:06.444963 32264 ts_tablet_manager.cc:1403] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.121s	user 0.019s	sys 0.011s
I20260709 12:23:06.445981 32265 ts_tablet_manager.cc:1434] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:23:06.445957 32269 raft_consensus.cc:359] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.446918 32269 raft_consensus.cc:385] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.447207 32269 raft_consensus.cc:740] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.447379 32265 tablet_bootstrap.cc:492] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:06.448055 32264 raft_consensus.cc:359] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.448129 32269 consensus_queue.cc:260] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.451884 32269 ts_tablet_manager.cc:1434] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:23:06.452862 32269 tablet_bootstrap.cc:492] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:06.454352 32265 tablet_bootstrap.cc:654] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.455231 32264 raft_consensus.cc:385] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.455577 32264 raft_consensus.cc:740] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.456321 32264 consensus_queue.cc:260] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.457676 32286 raft_consensus.cc:493] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.459378 32263 tablet_bootstrap.cc:492] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:06.459838 32269 tablet_bootstrap.cc:654] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.459868 32263 ts_tablet_manager.cc:1403] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.001s
I20260709 12:23:06.461323 32286 raft_consensus.cc:515] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.462617 32271 raft_consensus.cc:493] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.463279 32271 raft_consensus.cc:515] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.464181 32286 leader_election.cc:290] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:06.465034 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:06.465694 32216 raft_consensus.cc:2468] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:06.466694 32264 ts_tablet_manager.cc:1434] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:23:06.466768 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:06.467451 32069 raft_consensus.cc:2468] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:06.467859 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:06.468770 32271 leader_election.cc:290] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:06.470007 31958 leader_election.cc:304] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
W20260709 12:23:06.470293 32108 leader_election.cc:343] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.470144 32263 raft_consensus.cc:359] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.471050 32286 raft_consensus.cc:2804] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.471243 32263 raft_consensus.cc:385] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.471521 32286 raft_consensus.cc:493] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.471750 32263 raft_consensus.cc:740] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.471963 32286 raft_consensus.cc:3060] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.472111 32341 raft_consensus.cc:493] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.472656 32341 raft_consensus.cc:515] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.473033 32263 consensus_queue.cc:260] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.474501 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:06.474891 32341 leader_election.cc:290] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
W20260709 12:23:06.475943 32107 leader_election.cc:343] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.476378 32107 leader_election.cc:304] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:06.477141 32271 raft_consensus.cc:2749] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.478099 32263 ts_tablet_manager.cc:1434] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:23:06.478721 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f214242a6fb64a23b3bf338f9189e209" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:06.479444 32263 tablet_bootstrap.cc:492] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:06.479391 32144 raft_consensus.cc:2468] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:06.481505 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f214242a6fb64a23b3bf338f9189e209" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:06.482721 31959 leader_election.cc:304] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:06.483654 32069 raft_consensus.cc:2468] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:06.485482 32341 raft_consensus.cc:2804] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.486012 32341 raft_consensus.cc:493] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.486472 32341 raft_consensus.cc:3060] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.487630 32263 tablet_bootstrap.cc:654] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.467792 32264 tablet_bootstrap.cc:492] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:06.496955 32265 tablet_bootstrap.cc:492] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:06.503533 32265 ts_tablet_manager.cc:1403] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.001s
I20260709 12:23:06.506631 32265 raft_consensus.cc:359] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.507421 32265 raft_consensus.cc:385] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.507750 32265 raft_consensus.cc:740] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.508551 32265 consensus_queue.cc:260] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.511396 32265 ts_tablet_manager.cc:1434] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:06.512406 32265 tablet_bootstrap.cc:492] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:06.494365 32341 raft_consensus.cc:515] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.489214 32286 raft_consensus.cc:515] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.521278 32341 leader_election.cc:290] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:06.521193 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:06.521193 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f214242a6fb64a23b3bf338f9189e209" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:06.522773 32144 raft_consensus.cc:3060] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.524057 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f214242a6fb64a23b3bf338f9189e209" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:06.524904 32069 raft_consensus.cc:3060] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.526355 32216 raft_consensus.cc:3060] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.530663 32286 leader_election.cc:290] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:06.534076 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:06.534833 32265 tablet_bootstrap.cc:654] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.535053 32070 raft_consensus.cc:3060] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.540473 32216 raft_consensus.cc:2468] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:06.541900 31958 leader_election.cc:304] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:06.542920 32286 raft_consensus.cc:2804] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.543483 32286 raft_consensus.cc:697] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:06.544382 32286 consensus_queue.cc:237] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.547793 32269 tablet_bootstrap.cc:492] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:06.548321 32269 ts_tablet_manager.cc:1403] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.096s	user 0.026s	sys 0.058s
I20260709 12:23:06.522235 32272 raft_consensus.cc:493] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.548919 32272 raft_consensus.cc:515] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.551379 32272 leader_election.cc:290] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:06.551576 32269 raft_consensus.cc:359] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.552326 32269 raft_consensus.cc:385] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.552601 32269 raft_consensus.cc:740] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.552948 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bbc7593a9a40acbab37a51e0269bef" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:06.553344 32269 consensus_queue.cc:260] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.501482 32264 tablet_bootstrap.cc:654] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.548177 32069 raft_consensus.cc:2468] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:06.500151 32263 tablet_bootstrap.cc:492] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:06.555513 32263 ts_tablet_manager.cc:1403] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.004s
I20260709 12:23:06.555559 31961 leader_election.cc:304] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:06.556566 32336 raft_consensus.cc:2804] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.553087 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bbc7593a9a40acbab37a51e0269bef" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:06.553900 31995 raft_consensus.cc:2393] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68991541d4134b4f89800c972fdad372 in current term 1: Already voted for candidate 13d67625d82d4304a0ebff87742a538d in this term.
I20260709 12:23:06.557389 32144 raft_consensus.cc:2468] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:06.558519 32263 raft_consensus.cc:359] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.567986 32263 raft_consensus.cc:385] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.568326 32263 raft_consensus.cc:740] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.569124 32263 consensus_queue.cc:260] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.559702 32184 leader_election.cc:304] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:06.571511 32272 raft_consensus.cc:3060] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.555526 32269 ts_tablet_manager.cc:1434] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:06.572796 32269 tablet_bootstrap.cc:492] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:06.573335 32340 consensus_queue.cc:1048] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.574889 32265 tablet_bootstrap.cc:492] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:06.578835 32269 tablet_bootstrap.cc:654] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.579625 32272 raft_consensus.cc:2749] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.560603 32070 raft_consensus.cc:2468] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:06.571596 32263 ts_tablet_manager.cc:1434] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:23:06.583220 32263 tablet_bootstrap.cc:492] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:06.588102 32340 consensus_queue.cc:1048] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:06.589429 32265 ts_tablet_manager.cc:1403] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.013s
I20260709 12:23:06.590731 32269 tablet_bootstrap.cc:492] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:06.591286 32269 ts_tablet_manager.cc:1403] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:23:06.594218 32265 raft_consensus.cc:359] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.595603 32269 raft_consensus.cc:359] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.605082 32269 raft_consensus.cc:385] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.605443 32269 raft_consensus.cc:740] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.597294 32336 raft_consensus.cc:697] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:06.593847 32263 tablet_bootstrap.cc:654] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.606791 32336 consensus_queue.cc:237] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.605742 32340 consensus_queue.cc:1048] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.610342 32269 consensus_queue.cc:260] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.613415 32269 ts_tablet_manager.cc:1434] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:23:06.616289 32269 tablet_bootstrap.cc:492] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:06.601250 32264 tablet_bootstrap.cc:492] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:06.602092 32374 consensus_queue.cc:1048] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:06.621335 32265 raft_consensus.cc:385] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.621762 32265 raft_consensus.cc:740] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.625833 32265 consensus_queue.cc:260] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.629536 32265 ts_tablet_manager.cc:1434] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 12:23:06.630762 32265 tablet_bootstrap.cc:492] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:06.634135 32264 ts_tablet_manager.cc:1403] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.009s
I20260709 12:23:06.624903 32269 tablet_bootstrap.cc:654] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.637225 32264 raft_consensus.cc:359] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.643622 32263 tablet_bootstrap.cc:492] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:06.649976 32263 ts_tablet_manager.cc:1403] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.008s
I20260709 12:23:06.650570 32269 tablet_bootstrap.cc:492] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:06.651085 32269 ts_tablet_manager.cc:1403] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.005s
I20260709 12:23:06.652958 32263 raft_consensus.cc:359] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.648511 32264 raft_consensus.cc:385] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.649041 32339 consensus_queue.cc:1048] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:23:06.654428 32269 raft_consensus.cc:359] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.655265 32269 raft_consensus.cc:385] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.655562 32269 raft_consensus.cc:740] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.656436 32269 consensus_queue.cc:260] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.658761 32269 ts_tablet_manager.cc:1434] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:06.659696 32269 tablet_bootstrap.cc:492] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:06.664582 32341 raft_consensus.cc:493] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.665176 32341 raft_consensus.cc:515] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.654569 32264 raft_consensus.cc:740] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.667109 32264 consensus_queue.cc:260] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.641253 32265 tablet_bootstrap.cc:654] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.669194 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:06.669876 32144 raft_consensus.cc:2468] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:06.671330 31959 leader_election.cc:304] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:06.672264 32286 raft_consensus.cc:2804] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.672683 32286 raft_consensus.cc:493] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.673027 32286 raft_consensus.cc:3060] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.674173 32264 ts_tablet_manager.cc:1434] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:23:06.653972 32263 raft_consensus.cc:385] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.675210 32263 raft_consensus.cc:740] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.675808 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:06.676347 32263 consensus_queue.cc:260] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.679011 32264 tablet_bootstrap.cc:492] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:06.679322 32341 leader_election.cc:290] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
W20260709 12:23:06.680743 31958 leader_election.cc:343] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.692066 32286 raft_consensus.cc:515] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.694996 32374 consensus_queue.cc:1048] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.695230 31890 catalog_manager.cc:5697] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.696031 32265 tablet_bootstrap.cc:492] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:06.699919 31890 catalog_manager.cc:5697] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.700886 32265 ts_tablet_manager.cc:1403] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.070s	user 0.002s	sys 0.014s
I20260709 12:23:06.703850 32263 ts_tablet_manager.cc:1434] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 12:23:06.704926 32263 tablet_bootstrap.cc:492] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:06.708420 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:06.709157 32142 raft_consensus.cc:3060] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.713631 32272 raft_consensus.cc:493] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.714236 32272 raft_consensus.cc:515] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.716503 32272 leader_election.cc:290] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:06.717103 32142 raft_consensus.cc:2468] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:06.718559 31959 leader_election.cc:304] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:06.719651 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:06.697522 32269 tablet_bootstrap.cc:654] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.721300 32264 tablet_bootstrap.cc:654] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:06.721307 32184 leader_election.cc:343] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.719651 32374 raft_consensus.cc:2804] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.722965 32374 raft_consensus.cc:697] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:06.721300 32263 tablet_bootstrap.cc:654] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.724028 32374 consensus_queue.cc:237] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.725535 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:06.725235 32265 raft_consensus.cc:359] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.726169 32265 raft_consensus.cc:385] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:06.726780 31961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:33135, user_credentials={real_user=slave}} blocked reactor thread for 52332.6us
W20260709 12:23:06.727042 31958 leader_election.cc:343] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.727680 32265 raft_consensus.cc:740] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.727994 32286 leader_election.cc:290] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:06.728859 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:06.734100 32182 leader_election.cc:343] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.734578 32182 leader_election.cc:304] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:06.735715 32272 raft_consensus.cc:2749] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.736212 32320 consensus_queue.cc:1048] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:06.742486 32263 tablet_bootstrap.cc:492] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:06.743310 32263 ts_tablet_manager.cc:1403] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.000s
I20260709 12:23:06.745224 32265 consensus_queue.cc:260] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.751374 32265 ts_tablet_manager.cc:1434] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 12:23:06.753216 32286 consensus_queue.cc:1048] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.754159 32271 consensus_queue.cc:1048] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.757669 32320 raft_consensus.cc:493] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.758344 32320 raft_consensus.cc:515] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.758893 32269 tablet_bootstrap.cc:492] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:06.759472 32269 ts_tablet_manager.cc:1403] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.003s
I20260709 12:23:06.761613 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:06.763144 32182 leader_election.cc:343] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.762984 32269 raft_consensus.cc:359] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.764038 32269 raft_consensus.cc:385] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.764397 32269 raft_consensus.cc:740] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.765825 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:06.765513 32269 consensus_queue.cc:260] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
W20260709 12:23:06.767391 32184 leader_election.cc:343] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.767894 32184 leader_election.cc:304] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:06.753623 32265 tablet_bootstrap.cc:492] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:06.768193 32269 ts_tablet_manager.cc:1434] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:06.768858 32272 raft_consensus.cc:2749] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.769836 32320 leader_election.cc:290] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:06.770015 32269 tablet_bootstrap.cc:492] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:06.771669 31891 catalog_manager.cc:5697] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.775874 32264 tablet_bootstrap.cc:492] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:06.776423 32264 ts_tablet_manager.cc:1403] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.020s
I20260709 12:23:06.777841 32269 tablet_bootstrap.cc:654] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.787189 32339 raft_consensus.cc:493] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.787791 32339 raft_consensus.cc:515] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.788892 32265 tablet_bootstrap.cc:654] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.791592 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e711714b08b04798b67a243e1267184f" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:06.792495 32144 raft_consensus.cc:2468] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:06.792730 32270 consensus_queue.cc:1048] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.794126 32339 leader_election.cc:290] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:06.766954 32263 raft_consensus.cc:359] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.800830 32263 raft_consensus.cc:385] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.801266 32263 raft_consensus.cc:740] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.802073 32034 leader_election.cc:304] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:06.803546 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e711714b08b04798b67a243e1267184f" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:06.803829 32270 raft_consensus.cc:2804] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.804211 32270 raft_consensus.cc:493] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.804559 32270 raft_consensus.cc:3060] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:06.806957 32033 leader_election.cc:343] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.808323 32374 raft_consensus.cc:493] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.809031 32374 raft_consensus.cc:515] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.810204 32339 consensus_queue.cc:1048] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.813616 32374 leader_election.cc:290] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:06.818372 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e6e3a7239949adaa6b5dacaf6ded22" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:06.819008 32339 raft_consensus.cc:493] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.819558 32339 raft_consensus.cc:515] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.821746 32339 leader_election.cc:290] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:06.822439 32286 consensus_queue.cc:1048] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:06.823546 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e6e3a7239949adaa6b5dacaf6ded22" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:06.823884 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe944fa4b5a547758fe6318ebe933804" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:06.825521 31994 raft_consensus.cc:2468] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:06.826004 31995 raft_consensus.cc:3060] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.826678 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe944fa4b5a547758fe6318ebe933804" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:06.827010 32034 leader_election.cc:304] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:06.832624 31958 leader_election.cc:304] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2
W20260709 12:23:06.832873 32034 leader_election.cc:343] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.830751 32286 raft_consensus.cc:493] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.834154 32286 raft_consensus.cc:515] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.834396 32270 raft_consensus.cc:515] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.836374 32286 leader_election.cc:290] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:06.836913 32286 raft_consensus.cc:2749] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.837023 32270 leader_election.cc:290] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:06.837653 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e711714b08b04798b67a243e1267184f" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:06.838312 32142 raft_consensus.cc:3060] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.837611 32286 consensus_queue.cc:1048] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:06.840919 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9392ba9e91ca46f0ad3cdef6256aad0d" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:06.842311 32263 consensus_queue.cc:260] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
W20260709 12:23:06.842396 31959 leader_election.cc:343] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.831041 32339 raft_consensus.cc:2804] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.843783 32339 raft_consensus.cc:493] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.844220 32339 raft_consensus.cc:3060] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.851789 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e711714b08b04798b67a243e1267184f" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:06.852485 32263 ts_tablet_manager.cc:1434] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.001s
I20260709 12:23:06.854769 32263 tablet_bootstrap.cc:492] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:06.853193 32215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9392ba9e91ca46f0ad3cdef6256aad0d" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
W20260709 12:23:06.860123 32033 leader_election.cc:343] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.848784 32320 consensus_queue.cc:1048] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:23:06.849206 32142 raft_consensus.cc:2468] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:06.880098 32264 raft_consensus.cc:359] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.882906 32264 raft_consensus.cc:385] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.883183 32264 raft_consensus.cc:740] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
W20260709 12:23:06.878373 31958 leader_election.cc:343] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.884619 32034 leader_election.cc:304] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:06.890339 32270 raft_consensus.cc:2804] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.884624 31958 leader_election.cc:304] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:06.894448 32374 raft_consensus.cc:2749] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:06.873129 31940 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:06.899538 32264 consensus_queue.cc:260] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:06.902089 32271 consensus_queue.cc:1048] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.891121 32270 raft_consensus.cc:697] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:06.906858 32270 consensus_queue.cc:237] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:06.910838 32263 tablet_bootstrap.cc:654] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:06.872987 32182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 67370.2us
I20260709 12:23:06.921972 32264 ts_tablet_manager.cc:1434] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.145s	user 0.009s	sys 0.000s
I20260709 12:23:06.923494 32264 tablet_bootstrap.cc:492] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:06.930231 32401 raft_consensus.cc:493] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.931839 32401 raft_consensus.cc:515] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:06.935782 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae2aab0addf4c939688292e7118cbe0" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:06.927630 32272 raft_consensus.cc:493] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.936589 31995 raft_consensus.cc:2393] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68991541d4134b4f89800c972fdad372 in current term 1: Already voted for candidate c5524748d37141a1bca7d0cedaeb40f2 in this term.
I20260709 12:23:06.936198 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae2aab0addf4c939688292e7118cbe0" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:06.936791 32272 raft_consensus.cc:515] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.936285 32215 raft_consensus.cc:3060] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.938530 32182 leader_election.cc:304] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:06.939769 32272 leader_election.cc:290] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:06.940840 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:06.941809 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:06.942781 32401 leader_election.cc:290] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
W20260709 12:23:06.944015 32182 leader_election.cc:343] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.945999 31995 raft_consensus.cc:3060] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:06.947296 32184 leader_election.cc:343] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.947795 32184 leader_election.cc:304] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:06.949471 32264 tablet_bootstrap.cc:654] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.951349 32401 raft_consensus.cc:2749] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.967463 32269 tablet_bootstrap.cc:492] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:06.968137 32269 ts_tablet_manager.cc:1403] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.199s	user 0.014s	sys 0.012s
I20260709 12:23:06.975945 32265 tablet_bootstrap.cc:492] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:06.976589 32265 ts_tablet_manager.cc:1403] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.223s	user 0.036s	sys 0.042s
I20260709 12:23:06.983228 32271 consensus_queue.cc:1048] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.985246 31890 catalog_manager.cc:5697] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 1 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.992380 32399 raft_consensus.cc:2749] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.995303 32269 raft_consensus.cc:359] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.996104 32269 raft_consensus.cc:385] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.996402 32269 raft_consensus.cc:740] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.997496 32411 consensus_queue.cc:1048] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:07.001139 32388 consensus_queue.cc:1048] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:07.002470 32286 consensus_queue.cc:1048] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.013327 32388 consensus_queue.cc:1048] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:07.006351 32265 raft_consensus.cc:359] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.018103 32265 raft_consensus.cc:385] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.018561 32265 raft_consensus.cc:740] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.015214 32269 consensus_queue.cc:260] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:06.983564 32339 raft_consensus.cc:515] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.023002 32265 consensus_queue.cc:260] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.023627 32374 consensus_queue.cc:1048] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:07.025177 32339 leader_election.cc:290] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:07.020743 32286 raft_consensus.cc:493] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.023664 32263 tablet_bootstrap.cc:492] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:07.026260 32263 ts_tablet_manager.cc:1403] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.173s	user 0.016s	sys 0.009s
I20260709 12:23:07.026086 32286 raft_consensus.cc:515] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.026803 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe944fa4b5a547758fe6318ebe933804" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:07.027498 32141 raft_consensus.cc:3060] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.029434 32263 raft_consensus.cc:359] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.030210 32263 raft_consensus.cc:385] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.030478 32263 raft_consensus.cc:740] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.030575 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe944fa4b5a547758fe6318ebe933804" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:07.031389 31994 raft_consensus.cc:3060] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.031245 32263 consensus_queue.cc:260] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.034476 32399 raft_consensus.cc:493] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.034945 32399 raft_consensus.cc:515] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.035439 32263 ts_tablet_manager.cc:1434] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:07.036451 32263 tablet_bootstrap.cc:492] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:07.037091 32399 leader_election.cc:290] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:07.039317 31992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b94a9b9d1441438a95bedc11c7a96f" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:07.041388 32182 leader_election.cc:343] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.044304 32140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b94a9b9d1441438a95bedc11c7a96f" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:07.045118 32140 raft_consensus.cc:2468] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
I20260709 12:23:07.047017 32182 leader_election.cc:304] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:07.048957 32399 raft_consensus.cc:2804] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.049345 32399 raft_consensus.cc:493] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.049705 32399 raft_consensus.cc:3060] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.058648 32265 ts_tablet_manager.cc:1434] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.000s
I20260709 12:23:07.059531 32269 ts_tablet_manager.cc:1434] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.001s
I20260709 12:23:07.061308 32269 tablet_bootstrap.cc:492] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:07.063232 32265 tablet_bootstrap.cc:492] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:07.066977 32270 raft_consensus.cc:493] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.068035 32401 raft_consensus.cc:493] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.085139 32270 raft_consensus.cc:515] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.089058 32401 raft_consensus.cc:515] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.091488 32401 leader_election.cc:290] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:07.092692 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:07.101218 32264 tablet_bootstrap.cc:492] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:07.101657 32264 ts_tablet_manager.cc:1403] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.010s
I20260709 12:23:07.084648 31994 raft_consensus.cc:2468] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:07.108249 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:07.109630 32034 leader_election.cc:304] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:07.119171 32270 leader_election.cc:290] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:07.119983 32270 raft_consensus.cc:2804] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.120580 32270 raft_consensus.cc:697] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:07.121502 32270 consensus_queue.cc:237] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.123339 32399 raft_consensus.cc:515] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.125562 32263 tablet_bootstrap.cc:654] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.109724 32216 raft_consensus.cc:2468] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:07.128571 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b94a9b9d1441438a95bedc11c7a96f" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:07.126984 32399 leader_election.cc:290] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:07.131752 32264 raft_consensus.cc:359] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.133795 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:07.134244 32264 raft_consensus.cc:385] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.134716 32264 raft_consensus.cc:740] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.129384 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b94a9b9d1441438a95bedc11c7a96f" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
W20260709 12:23:07.135643 31961 leader_election.cc:343] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.129318 32141 raft_consensus.cc:2468] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:07.135771 32142 raft_consensus.cc:3060] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.136379 32264 consensus_queue.cc:260] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.138793 32264 ts_tablet_manager.cc:1434] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:23:07.139807 32264 tablet_bootstrap.cc:492] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:07.140182 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e47eae61a3433591d82d8c67dcd74b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:07.139824 32389 consensus_queue.cc:1048] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:07.140997 32144 raft_consensus.cc:2468] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
W20260709 12:23:07.143622 32182 leader_election.cc:343] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.126961 32286 leader_election.cc:290] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:07.145277 31958 leader_election.cc:304] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:07.145830 32034 leader_election.cc:304] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:07.146744 32389 raft_consensus.cc:2804] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.147186 32389 raft_consensus.cc:493] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.147540 32389 raft_consensus.cc:3060] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.148965 32264 tablet_bootstrap.cc:654] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.150314 32339 raft_consensus.cc:2804] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.150756 32339 raft_consensus.cc:493] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.151099 32339 raft_consensus.cc:3060] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.104825 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:07.140285 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e47eae61a3433591d82d8c67dcd74b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:07.161679 32269 tablet_bootstrap.cc:654] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.169847 32142 raft_consensus.cc:2468] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
W20260709 12:23:07.171026 32034 leader_election.cc:343] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.174664 32143 raft_consensus.cc:2393] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68991541d4134b4f89800c972fdad372 in current term 1: Already voted for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in this term.
I20260709 12:23:07.181497 32182 leader_election.cc:304] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:07.182382 32399 raft_consensus.cc:3060] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.185443 32182 leader_election.cc:304] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:07.186185 32265 tablet_bootstrap.cc:654] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.187187 32401 raft_consensus.cc:2804] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.187763 32401 raft_consensus.cc:697] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:07.188580 32401 consensus_queue.cc:237] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.189834 32389 raft_consensus.cc:515] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.197944 32389 leader_election.cc:290] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:07.198678 32215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:07.199262 32215 raft_consensus.cc:3060] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.199433 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:07.195007 32399 raft_consensus.cc:2749] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:07.203936 31961 leader_election.cc:343] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.204164 32264 tablet_bootstrap.cc:492] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:07.204671 32264 ts_tablet_manager.cc:1403] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.065s	user 0.027s	sys 0.006s
I20260709 12:23:07.206957 32263 tablet_bootstrap.cc:492] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:07.207552 32263 ts_tablet_manager.cc:1403] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.171s	user 0.011s	sys 0.002s
I20260709 12:23:07.209715 32215 raft_consensus.cc:2468] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:07.211220 31958 leader_election.cc:304] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:07.213739 32264 raft_consensus.cc:359] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.214537 32264 raft_consensus.cc:385] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.214819 32264 raft_consensus.cc:740] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.215528 32264 consensus_queue.cc:260] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.216240 32339 raft_consensus.cc:515] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.216606 32336 raft_consensus.cc:2804] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.220330 32336 raft_consensus.cc:697] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:07.221216 32336 consensus_queue.cc:237] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.221808 32388 consensus_queue.cc:1048] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.226799 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e47eae61a3433591d82d8c67dcd74b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
W20260709 12:23:07.229212 32034 leader_election.cc:343] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.231500 32263 raft_consensus.cc:359] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.232916 32263 raft_consensus.cc:385] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.233345 32263 raft_consensus.cc:740] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.234345 32263 consensus_queue.cc:260] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.232345 32339 leader_election.cc:290] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:07.246800 32389 raft_consensus.cc:493] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.247376 32389 raft_consensus.cc:515] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.240341 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e47eae61a3433591d82d8c67dcd74b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:07.250962 32143 raft_consensus.cc:3060] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.298017 32263 ts_tablet_manager.cc:1434] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.090s	user 0.016s	sys 0.002s
I20260709 12:23:07.230202 31890 catalog_manager.cc:5697] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 1 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.256417 32264 ts_tablet_manager.cc:1434] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:23:07.308873 32264 tablet_bootstrap.cc:492] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:07.314356 31889 catalog_manager.cc:5697] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.299454 32263 tablet_bootstrap.cc:492] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:07.300415 32269 tablet_bootstrap.cc:492] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:07.305703 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:07.316408 32264 tablet_bootstrap.cc:654] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.317131 32269 ts_tablet_manager.cc:1403] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.256s	user 0.025s	sys 0.045s
I20260709 12:23:07.306190 32265 tablet_bootstrap.cc:492] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:07.306957 32215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:07.318626 32215 raft_consensus.cc:2468] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:07.306484 32389 leader_election.cc:290] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:07.319862 32265 ts_tablet_manager.cc:1403] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.257s	user 0.014s	sys 0.016s
I20260709 12:23:07.320057 32269 raft_consensus.cc:359] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.320787 32269 raft_consensus.cc:385] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.321055 32269 raft_consensus.cc:740] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
W20260709 12:23:07.322213 31961 leader_election.cc:343] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.323100 32265 raft_consensus.cc:359] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.323812 32265 raft_consensus.cc:385] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.324074 32265 raft_consensus.cc:740] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.325469 31958 leader_election.cc:304] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:07.327140 32341 consensus_queue.cc:1048] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:07.328681 32263 tablet_bootstrap.cc:654] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.329135 32341 raft_consensus.cc:2804] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.329691 32341 raft_consensus.cc:493] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.334988 32341 raft_consensus.cc:3060] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.330207 32339 raft_consensus.cc:493] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.335830 32339 raft_consensus.cc:515] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.339406 32339 leader_election.cc:290] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:07.341485 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f112d6b795b47f2af4a725bc71441d5" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:07.342346 32141 raft_consensus.cc:2468] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:07.344558 32034 leader_election.cc:304] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:07.345191 32263 tablet_bootstrap.cc:492] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:07.345727 32263 ts_tablet_manager.cc:1403] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.007s
I20260709 12:23:07.321769 32269 consensus_queue.cc:260] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.347728 32269 ts_tablet_manager.cc:1434] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:23:07.348707 32269 tablet_bootstrap.cc:492] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:07.350773 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f112d6b795b47f2af4a725bc71441d5" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
W20260709 12:23:07.352650 32033 leader_election.cc:343] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.353138 32263 raft_consensus.cc:359] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.353885 32263 raft_consensus.cc:385] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.354182 32263 raft_consensus.cc:740] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.354864 32263 consensus_queue.cc:260] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.355396 32339 raft_consensus.cc:2804] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.355820 32339 raft_consensus.cc:493] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.356168 32339 raft_consensus.cc:3060] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.356226 32143 raft_consensus.cc:2468] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:07.357120 32263 ts_tablet_manager.cc:1434] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:07.357609 32034 leader_election.cc:304] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:07.358530 32340 raft_consensus.cc:2804] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.359041 32340 raft_consensus.cc:697] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:07.359894 32340 consensus_queue.cc:237] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.365206 32263 tablet_bootstrap.cc:492] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:07.349803 31890 catalog_manager.cc:5697] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.377679 32265 consensus_queue.cc:260] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.382836 32263 tablet_bootstrap.cc:654] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.389892 32341 raft_consensus.cc:515] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.394939 32269 tablet_bootstrap.cc:654] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.395587 32265 ts_tablet_manager.cc:1434] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.000s
I20260709 12:23:07.396733 32265 tablet_bootstrap.cc:492] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:07.404114 32342 consensus_queue.cc:1048] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:23:07.407688 32263 tablet_bootstrap.cc:492] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:07.408267 32263 ts_tablet_manager.cc:1403] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.002s
I20260709 12:23:07.403442 32339 raft_consensus.cc:515] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.422300 32263 raft_consensus.cc:359] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.422999 32264 tablet_bootstrap.cc:492] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:07.423743 32264 ts_tablet_manager.cc:1403] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.115s	user 0.035s	sys 0.008s
I20260709 12:23:07.426316 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:07.426370 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:07.423010 32263 raft_consensus.cc:385] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.428310 32216 raft_consensus.cc:3060] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.428606 32263 raft_consensus.cc:740] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
W20260709 12:23:07.429970 31961 leader_election.cc:343] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.429759 32263 consensus_queue.cc:260] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.431975 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f112d6b795b47f2af4a725bc71441d5" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:07.432600 32141 raft_consensus.cc:3060] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.438755 32339 leader_election.cc:290] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:07.440900 31892 catalog_manager.cc:5697] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 1 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.427274 32264 raft_consensus.cc:359] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.443523 32264 raft_consensus.cc:385] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.443864 32264 raft_consensus.cc:740] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.445014 32389 raft_consensus.cc:493] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.439152 32216 raft_consensus.cc:2468] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:07.444595 32341 leader_election.cc:290] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:07.441864 32141 raft_consensus.cc:2468] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:07.445487 32389 raft_consensus.cc:515] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.447173 31958 leader_election.cc:304] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:07.447376 32034 leader_election.cc:304] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:07.439965 32215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f112d6b795b47f2af4a725bc71441d5" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:07.448239 32389 leader_election.cc:290] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:07.448334 32339 raft_consensus.cc:2804] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.448916 32389 raft_consensus.cc:2804] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.449120 32339 raft_consensus.cc:697] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
W20260709 12:23:07.449363 32033 leader_election.cc:343] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.450309 32339 consensus_queue.cc:237] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.450794 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e47eae61a3433591d82d8c67dcd74b" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:07.451570 32142 raft_consensus.cc:2393] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c26adea8e3a48ce82a0abbd2fc17196 in current term 1: Already voted for candidate 13d67625d82d4304a0ebff87742a538d in this term.
I20260709 12:23:07.445854 32265 tablet_bootstrap.cc:654] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.456589 32263 ts_tablet_manager.cc:1434] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:23:07.456820 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e47eae61a3433591d82d8c67dcd74b" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:07.457720 32263 tablet_bootstrap.cc:492] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:07.460894 32389 raft_consensus.cc:697] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:07.472560 32216 raft_consensus.cc:3060] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.474009 31961 leader_election.cc:304] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:07.475708 32388 raft_consensus.cc:3060] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.483215 32342 consensus_queue.cc:1048] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.481093 32389 consensus_queue.cc:237] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.484874 32320 raft_consensus.cc:493] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.485517 32320 raft_consensus.cc:515] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.489234 32320 leader_election.cc:290] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:07.489408 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e711714b08b04798b67a243e1267184f" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:07.493662 32269 tablet_bootstrap.cc:492] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:07.494266 32269 ts_tablet_manager.cc:1403] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.146s	user 0.013s	sys 0.001s
I20260709 12:23:07.496474 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e711714b08b04798b67a243e1267184f" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:07.497283 32269 raft_consensus.cc:359] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.498059 32269 raft_consensus.cc:385] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.498337 32269 raft_consensus.cc:740] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.500989 32269 consensus_queue.cc:260] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.498852 32184 leader_election.cc:304] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:07.502981 32399 raft_consensus.cc:493] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.503450 32399 raft_consensus.cc:515] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.504391 32269 ts_tablet_manager.cc:1434] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:07.505419 32269 tablet_bootstrap.cc:492] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:07.510004 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535ba0401f8848e2a5f647e4ad5b1810" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
W20260709 12:23:07.511711 32184 leader_election.cc:343] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.513538 32269 tablet_bootstrap.cc:654] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.515866 32263 tablet_bootstrap.cc:654] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.518440 32399 leader_election.cc:290] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:07.518743 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535ba0401f8848e2a5f647e4ad5b1810" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:07.520473 32264 consensus_queue.cc:260] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.522359 32143 raft_consensus.cc:2468] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
I20260709 12:23:07.528898 32264 ts_tablet_manager.cc:1434] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.000s
I20260709 12:23:07.527168 32399 raft_consensus.cc:493] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.529579 32399 raft_consensus.cc:515] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.530210 32264 tablet_bootstrap.cc:492] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:07.531961 32182 leader_election.cc:304] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:07.533640 32320 raft_consensus.cc:2804] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.534021 32320 raft_consensus.cc:493] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.534374 32320 raft_consensus.cc:3060] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.539960 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9929922e1c4f3899055b92ea3f0774" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:07.540786 31993 raft_consensus.cc:2468] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
I20260709 12:23:07.542212 32182 leader_election.cc:304] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:07.550917 32399 leader_election.cc:290] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:07.551498 32399 raft_consensus.cc:2804] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.551857 32399 raft_consensus.cc:493] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.552175 32399 raft_consensus.cc:3060] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.554275 31891 catalog_manager.cc:5697] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.556668 32320 raft_consensus.cc:515] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.563330 32269 tablet_bootstrap.cc:492] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:07.563868 32269 ts_tablet_manager.cc:1403] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.006s
I20260709 12:23:07.566679 32388 raft_consensus.cc:2749] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.566751 32269 raft_consensus.cc:359] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.567584 32269 raft_consensus.cc:385] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.567874 32269 raft_consensus.cc:740] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.568562 32269 consensus_queue.cc:260] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.569000 32401 raft_consensus.cc:2749] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:07.569736 32263 tablet_bootstrap.cc:492] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:07.570662 32269 ts_tablet_manager.cc:1434] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:23:07.571597 32269 tablet_bootstrap.cc:492] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:07.572674 32320 leader_election.cc:290] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:07.570235 32263 ts_tablet_manager.cc:1403] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.113s	user 0.016s	sys 0.000s
I20260709 12:23:07.577558 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9929922e1c4f3899055b92ea3f0774" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:07.577576 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535ba0401f8848e2a5f647e4ad5b1810" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
W20260709 12:23:07.579875 32184 leader_election.cc:343] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.580195 32269 tablet_bootstrap.cc:654] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:07.580852 32184 leader_election.cc:343] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.581341 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535ba0401f8848e2a5f647e4ad5b1810" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:07.581974 32143 raft_consensus.cc:3060] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.593165 32399 raft_consensus.cc:515] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.594697 32143 raft_consensus.cc:2468] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:07.600154 32410 raft_consensus.cc:493] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.600745 32410 raft_consensus.cc:515] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.602260 32399 leader_election.cc:290] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:07.616433 32263 raft_consensus.cc:359] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.617238 32263 raft_consensus.cc:385] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.617559 32263 raft_consensus.cc:740] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.618076 32265 tablet_bootstrap.cc:492] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:07.618583 32265 ts_tablet_manager.cc:1403] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.222s	user 0.018s	sys 0.030s
I20260709 12:23:07.618256 32263 consensus_queue.cc:260] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.619381 32182 leader_election.cc:304] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:07.621443 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b058d5adbe84467b2bd4eb0a3ee9094" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:07.622146 31993 raft_consensus.cc:2468] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:07.622370 32264 tablet_bootstrap.cc:654] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.623435 32108 leader_election.cc:304] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:07.625550 32411 raft_consensus.cc:2804] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.625867 32263 ts_tablet_manager.cc:1434] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.052s	user 0.019s	sys 0.005s
I20260709 12:23:07.626080 32411 raft_consensus.cc:493] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.626915 32263 tablet_bootstrap.cc:492] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:07.626550 32411 raft_consensus.cc:3060] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.628944 32399 raft_consensus.cc:2804] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.629470 32399 raft_consensus.cc:697] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:07.619870 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9929922e1c4f3899055b92ea3f0774" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:07.633172 32399 consensus_queue.cc:237] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:07.638406 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9929922e1c4f3899055b92ea3f0774" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:07.639235 31993 raft_consensus.cc:3060] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:07.640676 32182 consensus_peers.cc:597] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:07.644986 32184 leader_election.cc:343] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.645797 32263 tablet_bootstrap.cc:654] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.653219 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b058d5adbe84467b2bd4eb0a3ee9094" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:07.650734 32410 leader_election.cc:290] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:07.654963 32342 consensus_queue.cc:1048] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:07.653940 32070 raft_consensus.cc:2468] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:07.656482 32265 raft_consensus.cc:359] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.657833 32265 raft_consensus.cc:385] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.658198 32265 raft_consensus.cc:740] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.659101 32265 consensus_queue.cc:260] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.662173 32265 ts_tablet_manager.cc:1434] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.003s
I20260709 12:23:07.663410 32265 tablet_bootstrap.cc:492] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:07.664803 32411 raft_consensus.cc:515] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.724221 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b058d5adbe84467b2bd4eb0a3ee9094" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:07.727320 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b058d5adbe84467b2bd4eb0a3ee9094" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:07.728765 32070 raft_consensus.cc:3060] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.709197 31892 catalog_manager.cc:5697] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 1 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.738075 32264 tablet_bootstrap.cc:492] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:07.739050 32269 tablet_bootstrap.cc:492] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:07.739214 32264 ts_tablet_manager.cc:1403] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.209s	user 0.022s	sys 0.005s
I20260709 12:23:07.740149 32269 ts_tablet_manager.cc:1403] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.169s	user 0.014s	sys 0.008s
I20260709 12:23:07.733752 31994 raft_consensus.cc:3060] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.745007 32342 consensus_queue.cc:1048] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:07.748550 32269 raft_consensus.cc:359] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.749768 32269 raft_consensus.cc:385] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.750250 32269 raft_consensus.cc:740] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.750700 32270 raft_consensus.cc:493] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.751443 32269 consensus_queue.cc:260] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.751622 32270 raft_consensus.cc:515] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.755856 32270 leader_election.cc:290] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:07.756749 32269 ts_tablet_manager.cc:1434] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.016s	user 0.016s	sys 0.000s
I20260709 12:23:07.758826 32269 tablet_bootstrap.cc:492] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:07.758627 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:07.759984 32216 raft_consensus.cc:2393] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13d67625d82d4304a0ebff87742a538d in current term 1: Already voted for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in this term.
I20260709 12:23:07.763933 32068 raft_consensus.cc:3060] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.768744 32269 tablet_bootstrap.cc:654] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.675392 32411 leader_election.cc:290] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:07.792474 31992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:07.804768 32265 tablet_bootstrap.cc:654] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.812958 32263 tablet_bootstrap.cc:492] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:07.815711 32264 raft_consensus.cc:359] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.817157 32264 raft_consensus.cc:385] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.825794 32389 consensus_queue.cc:1048] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:07.830840 32263 ts_tablet_manager.cc:1403] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.204s	user 0.012s	sys 0.009s
I20260709 12:23:07.817741 32264 raft_consensus.cc:740] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.835160 32264 consensus_queue.cc:260] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.838868 32034 leader_election.cc:304] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:07.840010 32215 raft_consensus.cc:3060] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.847707 32410 raft_consensus.cc:493] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.848027 32451 raft_consensus.cc:2749] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.848423 32410 raft_consensus.cc:515] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.848637 32263 raft_consensus.cc:359] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.849535 32263 raft_consensus.cc:385] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.849849 32263 raft_consensus.cc:740] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.855594 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737f0117f5e849cca1421fb53b5ccd31" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:07.855777 32399 consensus_queue.cc:1048] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:23:07.855530 32410 leader_election.cc:290] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:07.852695 32389 consensus_queue.cc:1048] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:23:07.859416 32263 consensus_queue.cc:260] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.860517 32217 raft_consensus.cc:2468] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:07.862277 32269 tablet_bootstrap.cc:492] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:07.862375 32263 ts_tablet_manager.cc:1434] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 12:23:07.862308 31993 raft_consensus.cc:2468] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:07.862941 32269 ts_tablet_manager.cc:1403] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.105s	user 0.028s	sys 0.016s
I20260709 12:23:07.864624 32263 tablet_bootstrap.cc:492] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:07.864686 32182 leader_election.cc:304] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:07.865792 32399 raft_consensus.cc:2804] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.866465 32399 raft_consensus.cc:697] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:07.866982 32107 leader_election.cc:304] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:07.867972 32410 raft_consensus.cc:2804] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.868439 32410 raft_consensus.cc:493] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.868026 32399 consensus_queue.cc:237] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.868803 32410 raft_consensus.cc:3060] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.873549 31994 raft_consensus.cc:2468] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:07.884267 32264 ts_tablet_manager.cc:1434] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.145s	user 0.012s	sys 0.001s
I20260709 12:23:07.885741 32108 leader_election.cc:304] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:07.886662 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737f0117f5e849cca1421fb53b5ccd31" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:07.887934 31891 catalog_manager.cc:5697] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:07.892392 32070 raft_consensus.cc:2468] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:07.903551 32265 tablet_bootstrap.cc:492] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:07.904582 32265 ts_tablet_manager.cc:1403] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.241s	user 0.015s	sys 0.005s
I20260709 12:23:07.912452 32411 raft_consensus.cc:2804] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.913398 32411 raft_consensus.cc:697] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:07.915867 32411 consensus_queue.cc:237] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:07.917306 32264 tablet_bootstrap.cc:492] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:07.905005 32269 raft_consensus.cc:359] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.921908 32269 raft_consensus.cc:385] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.922330 32269 raft_consensus.cc:740] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.927523 32410 raft_consensus.cc:515] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.932281 32263 tablet_bootstrap.cc:654] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.933507 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737f0117f5e849cca1421fb53b5ccd31" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:07.934284 32216 raft_consensus.cc:3060] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.942411 32264 tablet_bootstrap.cc:654] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:07.945662 32108 leader_election.cc:343] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.950695 32410 leader_election.cc:290] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:07.956638 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737f0117f5e849cca1421fb53b5ccd31" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:07.961007 32269 consensus_queue.cc:260] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:07.978180 32340 consensus_queue.cc:1048] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:07.965201 32108 leader_election.cc:343] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.988885 32389 raft_consensus.cc:493] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.989504 32389 raft_consensus.cc:515] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:07.992836 32389 leader_election.cc:290] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:07.994958 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:07.996091 32269 ts_tablet_manager.cc:1434] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.133s	user 0.009s	sys 0.000s
I20260709 12:23:07.995993 32217 raft_consensus.cc:2468] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:07.995081 32265 raft_consensus.cc:359] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.000825 32265 raft_consensus.cc:385] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.001114 32265 raft_consensus.cc:740] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.013002 32265 consensus_queue.cc:260] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.021101 32265 ts_tablet_manager.cc:1434] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.001s
I20260709 12:23:08.025229 31958 leader_election.cc:304] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:08.027264 32342 consensus_queue.cc:1048] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:08.028131 32286 raft_consensus.cc:2804] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.028586 32286 raft_consensus.cc:493] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.029006 32286 raft_consensus.cc:3060] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.029261 32265 tablet_bootstrap.cc:492] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:08.032371 32216 raft_consensus.cc:2468] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:08.032406 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:08.033996 32070 raft_consensus.cc:2468] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:08.035583 32264 tablet_bootstrap.cc:492] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:08.036103 32264 ts_tablet_manager.cc:1403] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.142s	user 0.009s	sys 0.014s
I20260709 12:23:08.037948 32107 leader_election.cc:304] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:08.039422 32411 raft_consensus.cc:2804] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.039973 32411 raft_consensus.cc:697] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:08.040169 31891 catalog_manager.cc:5697] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:08.041024 32411 consensus_queue.cc:237] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.055656 32269 tablet_bootstrap.cc:492] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:08.062877 32263 tablet_bootstrap.cc:492] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:08.063652 32263 ts_tablet_manager.cc:1403] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.200s	user 0.023s	sys 0.010s
I20260709 12:23:08.091621 31992 raft_consensus.cc:3060] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.099858 31889 catalog_manager.cc:5697] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:08.124079 31961 consensus_peers.cc:597] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.124516 32264 raft_consensus.cc:359] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.125577 32264 raft_consensus.cc:385] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.125944 32264 raft_consensus.cc:740] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.126920 32264 consensus_queue.cc:260] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.067768 32263 raft_consensus.cc:359] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.129752 32263 raft_consensus.cc:385] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.130237 32263 raft_consensus.cc:740] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.149693 32340 consensus_queue.cc:1048] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:23:08.158339 32263 consensus_queue.cc:260] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.160145 32264 ts_tablet_manager.cc:1434] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.124s	user 0.010s	sys 0.001s
I20260709 12:23:08.174698 32265 tablet_bootstrap.cc:654] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:08.171145 31940 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:08.192879 32399 consensus_queue.cc:1048] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:08.194366 32264 tablet_bootstrap.cc:492] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:08.202989 32263 ts_tablet_manager.cc:1434] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.139s	user 0.016s	sys 0.001s
W20260709 12:23:08.174753 31958 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:46375, user_credentials={real_user=slave}} blocked reactor thread for 149770us
I20260709 12:23:08.212604 32286 raft_consensus.cc:515] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.218976 32264 tablet_bootstrap.cc:654] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.224372 32339 consensus_queue.cc:1048] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:08.234179 32269 tablet_bootstrap.cc:654] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:08.266167 32184 consensus_peers.cc:597] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.273483 32263 tablet_bootstrap.cc:492] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:08.276017 32464 consensus_queue.cc:1048] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:08.282868 31891 catalog_manager.cc:5697] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.317791 32401 raft_consensus.cc:493] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.318522 32401 raft_consensus.cc:515] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.321075 32401 leader_election.cc:290] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:08.336050 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9392ba9e91ca46f0ad3cdef6256aad0d" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:08.336880 32142 raft_consensus.cc:2468] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
W20260709 12:23:08.338850 32184 consensus_peers.cc:597] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.341516 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9392ba9e91ca46f0ad3cdef6256aad0d" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:08.342346 31995 raft_consensus.cc:2468] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
I20260709 12:23:08.346632 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:08.353317 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:08.354267 32070 raft_consensus.cc:3060] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.347445 32216 raft_consensus.cc:3060] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.359306 32263 tablet_bootstrap.cc:654] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.363014 32182 leader_election.cc:304] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:08.364948 32320 raft_consensus.cc:2804] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.365337 32320 raft_consensus.cc:493] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.365688 32320 raft_consensus.cc:3060] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.369235 32286 leader_election.cc:290] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:08.372979 32401 consensus_queue.cc:1048] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:08.382879 32411 consensus_queue.cc:1048] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:08.395802 32410 consensus_queue.cc:1048] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:08.397300 32320 raft_consensus.cc:515] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.419399 32070 raft_consensus.cc:2468] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:08.431921 31961 leader_election.cc:304] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:08.434964 32388 raft_consensus.cc:2804] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.441694 32269 tablet_bootstrap.cc:492] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:08.442276 32269 ts_tablet_manager.cc:1403] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.419s	user 0.021s	sys 0.029s
I20260709 12:23:08.446403 32269 raft_consensus.cc:359] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.447187 32269 raft_consensus.cc:385] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.447491 32269 raft_consensus.cc:740] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.448275 32269 consensus_queue.cc:260] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.454717 32264 tablet_bootstrap.cc:492] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:08.455391 32264 ts_tablet_manager.cc:1403] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.276s	user 0.011s	sys 0.008s
I20260709 12:23:08.457437 32320 leader_election.cc:290] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:08.416647 32216 raft_consensus.cc:2468] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:08.459895 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9392ba9e91ca46f0ad3cdef6256aad0d" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:08.460263 32265 tablet_bootstrap.cc:492] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:08.473121 32265 ts_tablet_manager.cc:1403] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.444s	user 0.034s	sys 0.061s
I20260709 12:23:08.473886 32269 ts_tablet_manager.cc:1434] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:23:08.478164 32143 raft_consensus.cc:3060] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.471594 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9392ba9e91ca46f0ad3cdef6256aad0d" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:08.488454 31994 raft_consensus.cc:3060] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.489079 32265 raft_consensus.cc:359] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.489843 32265 raft_consensus.cc:385] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.490128 32265 raft_consensus.cc:740] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.490865 32265 consensus_queue.cc:260] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.493005 32265 ts_tablet_manager.cc:1434] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 12:23:08.496623 32265 tablet_bootstrap.cc:492] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:08.485863 32264 raft_consensus.cc:359] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.500993 32264 raft_consensus.cc:385] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.501709 32264 raft_consensus.cc:740] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.502887 32265 tablet_bootstrap.cc:654] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.502838 32264 consensus_queue.cc:260] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.509487 32263 tablet_bootstrap.cc:492] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:08.509904 32263 ts_tablet_manager.cc:1403] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.241s	user 0.018s	sys 0.039s
I20260709 12:23:08.511180 32264 ts_tablet_manager.cc:1434] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:23:08.512362 32264 tablet_bootstrap.cc:492] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:08.512784 32263 raft_consensus.cc:359] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.513471 32263 raft_consensus.cc:385] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.513715 32263 raft_consensus.cc:740] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.514869 32143 raft_consensus.cc:2468] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:08.516631 32269 tablet_bootstrap.cc:492] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:08.516733 32182 leader_election.cc:304] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:08.517684 32320 raft_consensus.cc:2804] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.518252 32320 raft_consensus.cc:697] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:08.519459 32264 tablet_bootstrap.cc:654] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.519074 32320 consensus_queue.cc:237] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.480121 32388 raft_consensus.cc:697] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:08.516849 32263 consensus_queue.cc:260] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.534682 32263 ts_tablet_manager.cc:1434] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 12:23:08.536204 32263 tablet_bootstrap.cc:492] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:08.541263 32388 consensus_queue.cc:237] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.542994 31994 raft_consensus.cc:2468] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:08.547478 32263 tablet_bootstrap.cc:654] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.547601 32265 tablet_bootstrap.cc:492] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:08.548312 32265 ts_tablet_manager.cc:1403] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.012s
I20260709 12:23:08.552129 32264 tablet_bootstrap.cc:492] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:08.552793 32264 ts_tablet_manager.cc:1403] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.010s
W20260709 12:23:08.554471 32108 consensus_peers.cc:597] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.557070 32269 tablet_bootstrap.cc:654] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.556813 32264 raft_consensus.cc:359] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.557971 32264 raft_consensus.cc:385] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.558385 32264 raft_consensus.cc:740] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.559401 32264 consensus_queue.cc:260] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.561580 32264 ts_tablet_manager.cc:1434] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:08.564623 32265 raft_consensus.cc:359] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.565212 32264 tablet_bootstrap.cc:492] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:08.565420 32265 raft_consensus.cc:385] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.565699 32265 raft_consensus.cc:740] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.566463 32265 consensus_queue.cc:260] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.568396 32263 tablet_bootstrap.cc:492] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:08.568920 32263 ts_tablet_manager.cc:1403] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.008s
I20260709 12:23:08.570595 32411 raft_consensus.cc:493] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.571097 32411 raft_consensus.cc:515] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.571810 32263 raft_consensus.cc:359] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.572512 32263 raft_consensus.cc:385] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.572769 32263 raft_consensus.cc:740] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.573464 32264 tablet_bootstrap.cc:654] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.573511 32263 consensus_queue.cc:260] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.574683 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6473d98e1f49484c888a0fb622b9b083" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:08.576469 32263 ts_tablet_manager.cc:1434] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.004s
W20260709 12:23:08.576440 32107 leader_election.cc:343] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.577500 32265 ts_tablet_manager.cc:1434] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:23:08.577641 32263 tablet_bootstrap.cc:492] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:08.578137 32411 leader_election.cc:290] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:08.579116 32265 tablet_bootstrap.cc:492] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:08.580693 31892 catalog_manager.cc:5697] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.584692 32263 tablet_bootstrap.cc:654] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.579128 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6473d98e1f49484c888a0fb622b9b083" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:08.590842 32108 leader_election.cc:343] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.591328 32108 leader_election.cc:304] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:08.592298 32410 raft_consensus.cc:2749] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.592470 32264 tablet_bootstrap.cc:492] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:08.592619 32263 tablet_bootstrap.cc:492] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:08.593032 32264 ts_tablet_manager.cc:1403] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.007s
I20260709 12:23:08.593171 32263 ts_tablet_manager.cc:1403] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:23:08.596482 32263 raft_consensus.cc:359] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.596750 32264 raft_consensus.cc:359] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.597218 32263 raft_consensus.cc:385] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.597543 32264 raft_consensus.cc:385] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.597609 32263 raft_consensus.cc:740] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.597934 32264 raft_consensus.cc:740] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.598773 32264 consensus_queue.cc:260] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.599761 32263 consensus_queue.cc:260] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.600360 32264 ts_tablet_manager.cc:1434] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:08.601588 32264 tablet_bootstrap.cc:492] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:08.602461 32263 ts_tablet_manager.cc:1434] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:08.585294 31891 catalog_manager.cc:5697] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.608093 32264 tablet_bootstrap.cc:654] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.608687 32269 tablet_bootstrap.cc:492] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:08.609359 32269 ts_tablet_manager.cc:1403] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.002s
I20260709 12:23:08.612896 32269 raft_consensus.cc:359] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.603636 32263 tablet_bootstrap.cc:492] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:08.622179 32269 raft_consensus.cc:385] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.622601 32269 raft_consensus.cc:740] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.623397 32269 consensus_queue.cc:260] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.626101 32269 ts_tablet_manager.cc:1434] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 12:23:08.623525 32264 tablet_bootstrap.cc:492] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:08.631686 32264 ts_tablet_manager.cc:1403] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.004s
I20260709 12:23:08.632261 32269 tablet_bootstrap.cc:492] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:08.634616 32264 raft_consensus.cc:359] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.635303 32264 raft_consensus.cc:385] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.635604 32264 raft_consensus.cc:740] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.636327 32264 consensus_queue.cc:260] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.631048 32265 tablet_bootstrap.cc:654] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.638867 32269 tablet_bootstrap.cc:654] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.641523 32263 tablet_bootstrap.cc:654] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.641806 32264 ts_tablet_manager.cc:1434] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:23:08.643031 32264 tablet_bootstrap.cc:492] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:08.649260 32069 raft_consensus.cc:3060] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.658211 32264 tablet_bootstrap.cc:654] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.663731 32269 tablet_bootstrap.cc:492] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:08.666209 32263 tablet_bootstrap.cc:492] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:08.666929 32263 ts_tablet_manager.cc:1403] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.003s
I20260709 12:23:08.670570 32263 raft_consensus.cc:359] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.671067 32265 tablet_bootstrap.cc:492] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:08.671270 32263 raft_consensus.cc:385] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.671615 32265 ts_tablet_manager.cc:1403] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.009s
I20260709 12:23:08.672192 32269 ts_tablet_manager.cc:1403] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.007s
I20260709 12:23:08.674642 32265 raft_consensus.cc:359] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.675376 32265 raft_consensus.cc:385] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.671562 32263 raft_consensus.cc:740] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.675678 32265 raft_consensus.cc:740] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.676285 32263 consensus_queue.cc:260] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.676379 32265 consensus_queue.cc:260] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.675076 32269 raft_consensus.cc:359] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.677402 32269 raft_consensus.cc:385] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.677698 32269 raft_consensus.cc:740] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.678519 32269 consensus_queue.cc:260] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.679100 32265 ts_tablet_manager.cc:1434] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:08.680234 32265 tablet_bootstrap.cc:492] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:08.681077 32263 ts_tablet_manager.cc:1434] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:23:08.684453 32269 ts_tablet_manager.cc:1434] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:23:08.685945 32263 tablet_bootstrap.cc:492] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:08.686887 32264 tablet_bootstrap.cc:492] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:08.687377 32264 ts_tablet_manager.cc:1403] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.005s
I20260709 12:23:08.691731 32264 raft_consensus.cc:359] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.692400 32264 raft_consensus.cc:385] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.692672 32263 tablet_bootstrap.cc:654] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.692701 32264 raft_consensus.cc:740] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.693768 32264 consensus_queue.cc:260] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.696687 32269 tablet_bootstrap.cc:492] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:08.701673 32388 raft_consensus.cc:493] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.702454 32264 ts_tablet_manager.cc:1434] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:23:08.702266 32388 raft_consensus.cc:515] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.703630 32264 tablet_bootstrap.cc:492] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:08.704450 32388 leader_election.cc:290] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:08.705538 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21e73e86f4b4b22ad881e5a80716ec7" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:08.706226 32142 raft_consensus.cc:2468] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:08.706749 32269 tablet_bootstrap.cc:654] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.707597 31959 leader_election.cc:304] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:08.708251 32388 raft_consensus.cc:493] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.708619 32481 raft_consensus.cc:2804] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.708778 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21e73e86f4b4b22ad881e5a80716ec7" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:08.709168 32481 raft_consensus.cc:493] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.709671 32481 raft_consensus.cc:3060] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.710326 32265 tablet_bootstrap.cc:654] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.708835 32388 raft_consensus.cc:515] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.714951 32388 leader_election.cc:290] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
W20260709 12:23:08.717953 31961 leader_election.cc:343] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.717576 32481 raft_consensus.cc:515] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.719832 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab51a346acba496aa7601f0835510af0" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:08.720589 32342 raft_consensus.cc:493] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:08.721238 32342 raft_consensus.cc:515] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.721643 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab51a346acba496aa7601f0835510af0" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:08.722965 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21e73e86f4b4b22ad881e5a80716ec7" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:08.723620 32142 raft_consensus.cc:2468] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:08.724579 32067 raft_consensus.cc:3060] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.724969 32068 raft_consensus.cc:3060] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.730772 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:08.730942 31959 leader_election.cc:304] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:08.732285 32286 raft_consensus.cc:2804] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.732411 32444 raft_consensus.cc:493] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.732789 32286 raft_consensus.cc:493] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.733237 32286 raft_consensus.cc:3060] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.733004 32444 raft_consensus.cc:515] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.734745 32481 leader_election.cc:290] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
W20260709 12:23:08.734870 31961 leader_election.cc:343] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.740613 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21e73e86f4b4b22ad881e5a80716ec7" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:08.741276 32142 raft_consensus.cc:3060] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.749163 32342 leader_election.cc:290] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:08.748927 32411 consensus_queue.cc:1048] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:08.750380 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a13a27f78154b4ebdf87e3009f09aa4" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:08.750813 31961 leader_election.cc:343] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.751199 31994 raft_consensus.cc:2468] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
I20260709 12:23:08.752072 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:08.754215 32182 leader_election.cc:304] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:08.755366 32263 tablet_bootstrap.cc:492] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:08.755942 32263 ts_tablet_manager.cc:1403] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.070s	user 0.003s	sys 0.008s
I20260709 12:23:08.758325 32399 raft_consensus.cc:2804] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.764608 32399 raft_consensus.cc:493] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.765609 32399 raft_consensus.cc:3060] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.768497 32444 leader_election.cc:290] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:08.768879 32411 raft_consensus.cc:493] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.746235 32286 raft_consensus.cc:515] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.758199 32034 leader_election.cc:304] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:08.783386 32339 raft_consensus.cc:2749] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:08.784626 32286 leader_election.cc:290] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:08.769580 32411 raft_consensus.cc:515] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.774286 32263 raft_consensus.cc:359] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.785424 32263 raft_consensus.cc:385] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.785322 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab51a346acba496aa7601f0835510af0" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:08.785845 32263 raft_consensus.cc:740] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.786186 32143 raft_consensus.cc:3060] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.786939 32264 tablet_bootstrap.cc:654] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.786639 32263 consensus_queue.cc:260] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.778190 32399 raft_consensus.cc:515] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.786844 32411 leader_election.cc:290] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:08.789880 32215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89aa175b867642f79ec8ea8c4b4bb970" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:08.789971 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab51a346acba496aa7601f0835510af0" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:08.790577 32215 raft_consensus.cc:2468] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
W20260709 12:23:08.791401 31961 leader_election.cc:343] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.792209 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a13a27f78154b4ebdf87e3009f09aa4" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:08.797338 32263 ts_tablet_manager.cc:1434] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 12:23:08.792558 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89aa175b867642f79ec8ea8c4b4bb970" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:08.793352 31995 raft_consensus.cc:3060] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.799320 32399 leader_election.cc:290] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:08.800279 32107 leader_election.cc:304] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:08.804929 32411 raft_consensus.cc:2804] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:08.805491 32110 leader_election.cc:343] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.806730 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a13a27f78154b4ebdf87e3009f09aa4" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:08.805411 32411 raft_consensus.cc:493] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.808064 32411 raft_consensus.cc:3060] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.809166 32263 tablet_bootstrap.cc:492] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:08.811724 32269 tablet_bootstrap.cc:492] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:08.812280 32269 ts_tablet_manager.cc:1403] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.004s
I20260709 12:23:08.801954 32265 tablet_bootstrap.cc:492] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:08.803009 32143 raft_consensus.cc:2468] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:08.812949 32265 ts_tablet_manager.cc:1403] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.133s	user 0.015s	sys 0.000s
I20260709 12:23:08.815892 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a13a27f78154b4ebdf87e3009f09aa4" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
W20260709 12:23:08.817655 32184 leader_election.cc:343] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.810529 32142 raft_consensus.cc:2468] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
W20260709 12:23:08.819037 32184 leader_election.cc:343] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.819880 31959 leader_election.cc:304] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:08.823210 32286 raft_consensus.cc:2804] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.823683 31959 leader_election.cc:304] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:08.824064 32286 raft_consensus.cc:697] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:08.824618 32388 raft_consensus.cc:2804] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.825075 32286 consensus_queue.cc:237] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.825129 32388 raft_consensus.cc:697] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:08.827296 32388 consensus_queue.cc:237] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.831431 32265 raft_consensus.cc:359] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.836627 32265 raft_consensus.cc:385] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.837177 32265 raft_consensus.cc:740] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.838285 32265 consensus_queue.cc:260] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.842489 32269 raft_consensus.cc:359] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.843570 32269 raft_consensus.cc:385] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.843823 32269 raft_consensus.cc:740] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.844498 32269 consensus_queue.cc:260] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:08.847250 31995 raft_consensus.cc:2468] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:08.848392 32264 tablet_bootstrap.cc:492] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:08.851516 32264 ts_tablet_manager.cc:1403] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.148s	user 0.014s	sys 0.006s
I20260709 12:23:08.850112 32411 raft_consensus.cc:515] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.853940 32182 leader_election.cc:304] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:08.854928 32265 ts_tablet_manager.cc:1434] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:23:08.854576 32264 raft_consensus.cc:359] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.855448 32264 raft_consensus.cc:385] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.855753 32264 raft_consensus.cc:740] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.856035 32265 tablet_bootstrap.cc:492] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:08.856084 32444 raft_consensus.cc:2804] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.856727 32444 raft_consensus.cc:697] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:08.857168 32264 consensus_queue.cc:260] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.857509 32444 consensus_queue.cc:237] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.858753 32264 ts_tablet_manager.cc:1434] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:08.860327 32264 tablet_bootstrap.cc:492] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:08.863303 32263 tablet_bootstrap.cc:654] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.864591 32269 ts_tablet_manager.cc:1434] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260709 12:23:08.869653 32269 tablet_bootstrap.cc:492] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:08.876520 32411 leader_election.cc:290] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:08.879618 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89aa175b867642f79ec8ea8c4b4bb970" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:08.880328 32069 raft_consensus.cc:3060] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.884369 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89aa175b867642f79ec8ea8c4b4bb970" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:08.885351 32217 raft_consensus.cc:3060] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.881839 32264 tablet_bootstrap.cc:654] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.898029 31889 catalog_manager.cc:5697] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.902328 32269 tablet_bootstrap.cc:654] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.924607 32069 raft_consensus.cc:2468] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:08.925983 32110 leader_election.cc:304] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:08.927186 32265 tablet_bootstrap.cc:654] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.932905 31890 catalog_manager.cc:5697] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.935567 32217 raft_consensus.cc:2468] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:08.959935 31889 catalog_manager.cc:5697] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.937834 32410 raft_consensus.cc:2804] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.975824 32410 raft_consensus.cc:697] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:08.984292 32265 tablet_bootstrap.cc:492] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:08.984622 32269 tablet_bootstrap.cc:492] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:08.985172 32269 ts_tablet_manager.cc:1403] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.029s
I20260709 12:23:08.985351 32265 ts_tablet_manager.cc:1403] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.130s	user 0.017s	sys 0.004s
I20260709 12:23:08.986733 32263 tablet_bootstrap.cc:492] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:08.987272 32263 ts_tablet_manager.cc:1403] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.184s	user 0.014s	sys 0.000s
I20260709 12:23:08.989573 32265 raft_consensus.cc:359] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.990386 32265 raft_consensus.cc:385] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.990688 32265 raft_consensus.cc:740] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.991845 32399 consensus_queue.cc:1048] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:08.992448 32264 tablet_bootstrap.cc:492] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:08.992975 32264 ts_tablet_manager.cc:1403] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.004s
I20260709 12:23:08.976955 32410 consensus_queue.cc:237] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:08.990633 32269 raft_consensus.cc:359] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.995303 32269 raft_consensus.cc:385] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.995625 32269 raft_consensus.cc:740] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.996419 32269 consensus_queue.cc:260] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.996584 32265 consensus_queue.cc:260] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:08.998235 32263 raft_consensus.cc:359] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:08.998610 32399 raft_consensus.cc:493] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.998896 32263 raft_consensus.cc:385] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.999095 32269 ts_tablet_manager.cc:1434] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 12:23:08.999195 32399 raft_consensus.cc:515] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.001398 32264 raft_consensus.cc:359] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:09.002434 32264 raft_consensus.cc:385] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.002739 32264 raft_consensus.cc:740] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.003172 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04a298de8bc48c795631812d4179057" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:09.003628 32264 consensus_queue.cc:260] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:09.003389 32265 ts_tablet_manager.cc:1434] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:23:09.018292 32411 raft_consensus.cc:493] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.018857 32411 raft_consensus.cc:515] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.019713 32265 tablet_bootstrap.cc:492] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:09.021320 32411 leader_election.cc:290] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
W20260709 12:23:09.022087 32184 leader_election.cc:343] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.024091 32399 leader_election.cc:290] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:09.026453 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a35467eb315463dae6edfd61cdb4a79" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:09.027223 32269 tablet_bootstrap.cc:492] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:09.028707 32502 raft_consensus.cc:493] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.029300 32502 raft_consensus.cc:515] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
W20260709 12:23:09.030535 32107 leader_election.cc:343] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.031831 32502 leader_election.cc:290] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:09.018819 32264 ts_tablet_manager.cc:1434] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:23:09.034317 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04a298de8bc48c795631812d4179057" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:09.035018 32217 raft_consensus.cc:2468] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:09.035159 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a35467eb315463dae6edfd61cdb4a79" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:09.035799 31994 raft_consensus.cc:2468] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:09.037153 32340 raft_consensus.cc:493] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.037660 32340 raft_consensus.cc:515] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:09.039844 32340 leader_election.cc:290] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:09.041733 32107 leader_election.cc:304] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:09.038206 31892 catalog_manager.cc:5697] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.999228 32263 raft_consensus.cc:740] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.041181 32269 tablet_bootstrap.cc:654] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.026492 32411 raft_consensus.cc:493] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.050895 32263 consensus_queue.cc:260] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.055024 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21e73e86f4b4b22ad881e5a80716ec7" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:09.059123 32388 consensus_queue.cc:1048] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.059521 32263 ts_tablet_manager.cc:1434] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 12:23:09.061690 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04a298de8bc48c795631812d4179057" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:09.063544 32264 tablet_bootstrap.cc:492] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:09.052191 32411 raft_consensus.cc:515] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:09.051671 32410 raft_consensus.cc:2804] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.071601 32108 leader_election.cc:304] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:09.072852 32502 raft_consensus.cc:2804] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.073225 32502 raft_consensus.cc:493] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.073577 32502 raft_consensus.cc:3060] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.074018 32263 tablet_bootstrap.cc:492] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:09.074231 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21e73e86f4b4b22ad881e5a80716ec7" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:09.075176 32143 raft_consensus.cc:2393] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13d67625d82d4304a0ebff87742a538d in current term 1: Already voted for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in this term.
I20260709 12:23:09.076700 32034 leader_election.cc:304] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:09.077538 32339 raft_consensus.cc:3060] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.070408 32410 raft_consensus.cc:493] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.082091 32410 raft_consensus.cc:3060] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.083427 32411 leader_election.cc:290] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:09.088475 32444 raft_consensus.cc:493] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.089116 32444 raft_consensus.cc:515] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.095438 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04a298de8bc48c795631812d4179057" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:09.099807 32265 tablet_bootstrap.cc:654] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.103967 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760cfc460de34e6bbe34af04b225d26f" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:09.107504 32264 tablet_bootstrap.cc:654] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.108389 32444 leader_election.cc:290] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:09.108505 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:09.109092 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760cfc460de34e6bbe34af04b225d26f" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:09.109360 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
W20260709 12:23:09.116765 32182 leader_election.cc:343] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:09.116369 32110 leader_election.cc:343] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:09.120117 32184 leader_election.cc:343] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:09.126183 32108 leader_election.cc:343] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.123451 32184 leader_election.cc:304] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
W20260709 12:23:09.131857 32110 leader_election.cc:343] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.131938 32320 raft_consensus.cc:2749] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.132937 32110 leader_election.cc:304] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:09.134446 32514 raft_consensus.cc:2749] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.134238 32502 raft_consensus.cc:515] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.136809 32502 leader_election.cc:290] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:09.138533 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a35467eb315463dae6edfd61cdb4a79" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:09.139678 32320 consensus_queue.cc:1048] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:09.141345 32107 leader_election.cc:343] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.153195 32264 tablet_bootstrap.cc:492] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:09.156203 32410 raft_consensus.cc:515] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.152842 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a35467eb315463dae6edfd61cdb4a79" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:09.160795 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04a298de8bc48c795631812d4179057" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:09.158443 32264 ts_tablet_manager.cc:1403] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.010s
I20260709 12:23:09.160986 31995 raft_consensus.cc:3060] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.158933 32144 raft_consensus.cc:2393] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68991541d4134b4f89800c972fdad372 in current term 1: Already voted for candidate c5524748d37141a1bca7d0cedaeb40f2 in this term.
I20260709 12:23:09.150540 32339 raft_consensus.cc:2749] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:09.169312 32110 leader_election.cc:343] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.175323 32263 tablet_bootstrap.cc:654] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.178815 32182 leader_election.cc:304] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:09.185881 32517 raft_consensus.cc:3060] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.206926 32264 raft_consensus.cc:359] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.208485 32264 raft_consensus.cc:385] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.209317 32264 raft_consensus.cc:740] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.203140 32410 leader_election.cc:290] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:09.214910 31995 raft_consensus.cc:2468] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:09.223045 32444 raft_consensus.cc:493] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.216126 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04a298de8bc48c795631812d4179057" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:09.222419 32269 tablet_bootstrap.cc:492] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:09.223711 32444 raft_consensus.cc:515] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.224252 32269 ts_tablet_manager.cc:1403] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.197s	user 0.013s	sys 0.018s
I20260709 12:23:09.226012 32444 leader_election.cc:290] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:09.227371 32269 raft_consensus.cc:359] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.228164 32269 raft_consensus.cc:385] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.228492 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d55921a3ee4ee18232cdd3f94fcbb9" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:09.226249 32264 consensus_queue.cc:260] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.228303 32517 raft_consensus.cc:2749] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.204787 32388 consensus_queue.cc:1048] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:23:09.233848 32108 leader_election.cc:304] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
W20260709 12:23:09.231976 32182 leader_election.cc:343] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.228495 32269 raft_consensus.cc:740] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.238266 32502 raft_consensus.cc:2804] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.238655 32269 consensus_queue.cc:260] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.246873 32269 ts_tablet_manager.cc:1434] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:23:09.242174 32502 raft_consensus.cc:697] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:09.249719 32502 consensus_queue.cc:237] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.236747 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d55921a3ee4ee18232cdd3f94fcbb9" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:09.253693 32269 tablet_bootstrap.cc:492] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
W20260709 12:23:09.255052 32182 leader_election.cc:343] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.255537 32182 leader_election.cc:304] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:09.256568 32517 raft_consensus.cc:2749] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.267406 32264 ts_tablet_manager.cc:1434] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.104s	user 0.005s	sys 0.003s
I20260709 12:23:09.271348 32388 raft_consensus.cc:493] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.271924 32388 raft_consensus.cc:515] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.275451 32388 leader_election.cc:290] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:09.276852 32263 tablet_bootstrap.cc:492] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:09.279556 32263 ts_tablet_manager.cc:1403] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.206s	user 0.021s	sys 0.012s
I20260709 12:23:09.283229 32263 raft_consensus.cc:359] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.284339 32263 raft_consensus.cc:385] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.289909 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:09.284828 32263 raft_consensus.cc:740] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.291877 32263 consensus_queue.cc:260] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.294212 32263 ts_tablet_manager.cc:1434] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
W20260709 12:23:09.304756 31940 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:09.297577 32388 consensus_queue.cc:1048] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:23:09.307981 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:09.309032 32269 tablet_bootstrap.cc:654] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.308946 32216 raft_consensus.cc:2468] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:09.312366 32265 tablet_bootstrap.cc:492] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:09.312932 32265 ts_tablet_manager.cc:1403] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.293s	user 0.037s	sys 0.003s
I20260709 12:23:09.314203 32264 tablet_bootstrap.cc:492] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:09.306751 32481 consensus_queue.cc:1048] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:23:09.315156 32263 tablet_bootstrap.cc:492] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
W20260709 12:23:09.305969 31961 leader_election.cc:343] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.317659 32265 raft_consensus.cc:359] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.318430 32265 raft_consensus.cc:385] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.318732 32265 raft_consensus.cc:740] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.319656 32265 consensus_queue.cc:260] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.324009 32263 tablet_bootstrap.cc:654] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.335388 32265 ts_tablet_manager.cc:1434] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:23:09.335727 31891 catalog_manager.cc:5697] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.342497 32517 raft_consensus.cc:493] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.345880 31958 leader_election.cc:304] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:09.346338 32517 raft_consensus.cc:515] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.350479 32481 raft_consensus.cc:2804] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.350884 32481 raft_consensus.cc:493] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.351224 32481 raft_consensus.cc:3060] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.351850 32517 leader_election.cc:290] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:09.365046 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6473d98e1f49484c888a0fb622b9b083" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:09.366571 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6473d98e1f49484c888a0fb622b9b083" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:09.367586 32143 raft_consensus.cc:2468] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
W20260709 12:23:09.369158 32182 leader_election.cc:343] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.369865 32182 leader_election.cc:304] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:09.371491 32444 raft_consensus.cc:2804] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.371872 32444 raft_consensus.cc:493] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.372195 32444 raft_consensus.cc:3060] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.376792 32481 raft_consensus.cc:515] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.378876 32342 raft_consensus.cc:493] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.379443 32342 raft_consensus.cc:515] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.381567 32342 leader_election.cc:290] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:09.399183 32217 raft_consensus.cc:2468] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:09.401775 32107 leader_election.cc:304] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:09.407935 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480a9699f3b4488980be9862ced447cb" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:09.408802 32217 raft_consensus.cc:2468] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:09.411486 32264 tablet_bootstrap.cc:654] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.412420 32265 tablet_bootstrap.cc:492] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:09.414633 32215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:09.415346 32215 raft_consensus.cc:3060] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.405575 32502 raft_consensus.cc:2804] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.425609 32265 tablet_bootstrap.cc:654] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.431284 32444 raft_consensus.cc:515] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.433549 32444 leader_election.cc:290] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:09.429662 32215 raft_consensus.cc:2468] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:09.440665 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6473d98e1f49484c888a0fb622b9b083" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:09.438894 32502 raft_consensus.cc:697] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:09.442873 32033 leader_election.cc:304] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:09.444343 32263 tablet_bootstrap.cc:492] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:09.444201 32502 consensus_queue.cc:237] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.444612 32342 raft_consensus.cc:2804] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.445322 32342 raft_consensus.cc:493] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.445914 32481 leader_election.cc:290] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:09.445847 32342 raft_consensus.cc:3060] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:09.448915 31961 consensus_peers.cc:597] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.451917 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:09.452189 32517 consensus_queue.cc:1048] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.451997 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6473d98e1f49484c888a0fb622b9b083" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:09.455287 32143 raft_consensus.cc:3060] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.444855 32263 ts_tablet_manager.cc:1403] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.149s	user 0.009s	sys 0.010s
I20260709 12:23:09.461108 32263 raft_consensus.cc:359] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
W20260709 12:23:09.467159 32182 leader_election.cc:343] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.482306 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480a9699f3b4488980be9862ced447cb" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:09.490299 32034 leader_election.cc:343] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.495703 32410 consensus_queue.cc:1048] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:09.497426 32184 consensus_peers.cc:597] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.498747 31958 leader_election.cc:304] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:09.500815 32341 raft_consensus.cc:2804] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.501317 32341 raft_consensus.cc:697] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:09.461835 32263 raft_consensus.cc:385] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.502347 32263 raft_consensus.cc:740] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.506237 32263 consensus_queue.cc:260] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.490322 32143 raft_consensus.cc:2468] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:09.521065 32265 tablet_bootstrap.cc:492] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:09.521581 32263 ts_tablet_manager.cc:1434] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
I20260709 12:23:09.521579 32265 ts_tablet_manager.cc:1403] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.110s	user 0.006s	sys 0.016s
I20260709 12:23:09.523510 32269 tablet_bootstrap.cc:492] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:09.523978 32269 ts_tablet_manager.cc:1403] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.271s	user 0.009s	sys 0.023s
I20260709 12:23:09.502790 32341 consensus_queue.cc:237] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.528674 32263 tablet_bootstrap.cc:492] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:09.530014 32517 raft_consensus.cc:493] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.531839 32517 raft_consensus.cc:515] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.516119 32342 raft_consensus.cc:515] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.537748 32264 tablet_bootstrap.cc:492] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:09.550598 32264 ts_tablet_manager.cc:1403] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.255s	user 0.048s	sys 0.021s
I20260709 12:23:09.554003 32264 raft_consensus.cc:359] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.554471 32265 raft_consensus.cc:359] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.555218 32265 raft_consensus.cc:385] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.555549 32265 raft_consensus.cc:740] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.556368 32269 raft_consensus.cc:359] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.530472 32182 leader_election.cc:304] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:09.562458 32342 leader_election.cc:290] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
W20260709 12:23:09.534449 31961 leader_election.cc:343] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.563755 32265 consensus_queue.cc:260] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.564397 32401 raft_consensus.cc:2804] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.564970 32401 raft_consensus.cc:697] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:09.555181 32264 raft_consensus.cc:385] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.566066 32264 raft_consensus.cc:740] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.565836 32401 consensus_queue.cc:237] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.566817 32264 consensus_queue.cc:260] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.539252 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f311ee508648669be858c85efab949" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:09.570310 32265 ts_tablet_manager.cc:1434] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.003s
I20260709 12:23:09.524875 32481 consensus_queue.cc:1048] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:23:09.571518 32265 tablet_bootstrap.cc:492] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
W20260709 12:23:09.572546 32184 leader_election.cc:343] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.575069 32411 consensus_queue.cc:1048] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.542426 32517 leader_election.cc:290] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:09.583142 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f311ee508648669be858c85efab949" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:09.538134 32263 tablet_bootstrap.cc:654] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.559537 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480a9699f3b4488980be9862ced447cb" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:09.558230 31890 catalog_manager.cc:5697] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.587237 32216 raft_consensus.cc:3060] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.584798 32264 ts_tablet_manager.cc:1434] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:23:09.589732 32264 tablet_bootstrap.cc:492] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:09.586752 32269 raft_consensus.cc:385] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.594547 32269 raft_consensus.cc:740] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.595331 32269 consensus_queue.cc:260] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.597215 32216 raft_consensus.cc:2468] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:09.598356 32143 raft_consensus.cc:2468] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
I20260709 12:23:09.602522 32265 tablet_bootstrap.cc:654] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.611302 32269 ts_tablet_manager.cc:1434] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.001s
I20260709 12:23:09.612336 32264 tablet_bootstrap.cc:654] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.613473 32481 raft_consensus.cc:493] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.621304 32269 tablet_bootstrap.cc:492] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:09.622862 32033 leader_election.cc:304] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:09.623631 32481 raft_consensus.cc:515] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.616616 32182 leader_election.cc:304] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:09.625874 32481 leader_election.cc:290] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:09.631043 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20c391002194c58ab7f13a5df063f55" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:09.633776 32340 raft_consensus.cc:2804] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.634406 32340 raft_consensus.cc:697] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:09.635288 32340 consensus_queue.cc:237] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.636286 32517 raft_consensus.cc:2804] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.636713 32517 raft_consensus.cc:493] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.637058 32517 raft_consensus.cc:3060] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.638833 31992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480a9699f3b4488980be9862ced447cb" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:09.639487 31992 raft_consensus.cc:3060] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.646252 31890 catalog_manager.cc:5697] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:09.651335 31958 leader_election.cc:343] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.661209 32067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20c391002194c58ab7f13a5df063f55" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:09.659876 32514 raft_consensus.cc:493] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.675420 32514 raft_consensus.cc:515] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.683617 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d960ac97c848b8be5d62f6f5175144" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
W20260709 12:23:09.690141 32107 leader_election.cc:343] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.687820 32514 leader_election.cc:290] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
W20260709 12:23:09.696185 31961 leader_election.cc:343] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.696875 31961 leader_election.cc:304] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372
I20260709 12:23:09.705282 32388 raft_consensus.cc:2749] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.710755 32517 raft_consensus.cc:515] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.714481 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f311ee508648669be858c85efab949" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:09.714818 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f311ee508648669be858c85efab949" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:09.715408 32143 raft_consensus.cc:3060] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:09.716248 32184 leader_election.cc:343] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.718164 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d960ac97c848b8be5d62f6f5175144" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:09.719626 32514 consensus_queue.cc:1048] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.713743 32517 leader_election.cc:290] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:09.728380 32263 tablet_bootstrap.cc:492] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:09.728929 32263 ts_tablet_manager.cc:1403] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.206s	user 0.015s	sys 0.013s
W20260709 12:23:09.730449 32108 leader_election.cc:343] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.731290 32108 leader_election.cc:304] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:09.735963 32263 raft_consensus.cc:359] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.739164 32263 raft_consensus.cc:385] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.739620 32263 raft_consensus.cc:740] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.740454 32263 consensus_queue.cc:260] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.741726 32263 ts_tablet_manager.cc:1434] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:23:09.742749 32263 tablet_bootstrap.cc:492] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:09.745052 32143 raft_consensus.cc:2468] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:09.746289 32182 leader_election.cc:304] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:09.747808 32517 raft_consensus.cc:2804] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.748860 32264 tablet_bootstrap.cc:492] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:09.748859 32517 raft_consensus.cc:697] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:09.749523 32264 ts_tablet_manager.cc:1403] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.160s	user 0.020s	sys 0.012s
I20260709 12:23:09.750136 32517 consensus_queue.cc:237] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.736399 32265 tablet_bootstrap.cc:492] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:09.737152 32514 raft_consensus.cc:2749] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.756621 32265 ts_tablet_manager.cc:1403] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.185s	user 0.030s	sys 0.043s
I20260709 12:23:09.737048 31992 raft_consensus.cc:2468] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:09.752401 32264 raft_consensus.cc:359] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.759083 32264 raft_consensus.cc:385] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.759433 32264 raft_consensus.cc:740] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.759536 32265 raft_consensus.cc:359] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.760281 32265 raft_consensus.cc:385] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.760632 32265 raft_consensus.cc:740] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.762338 32269 tablet_bootstrap.cc:654] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.760722 32264 consensus_queue.cc:260] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.768890 32263 tablet_bootstrap.cc:654] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.761524 32265 consensus_queue.cc:260] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:09.773474 32265 ts_tablet_manager.cc:1434] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:09.774550 32265 tablet_bootstrap.cc:492] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:09.785602 32265 tablet_bootstrap.cc:654] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.787178 32264 ts_tablet_manager.cc:1434] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.005s
I20260709 12:23:09.788748 32264 tablet_bootstrap.cc:492] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:09.805030 32264 tablet_bootstrap.cc:654] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.812403 31892 catalog_manager.cc:5697] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.840799 31890 catalog_manager.cc:5697] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:09.864981 31893 catalog_manager.cc:5697] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 1 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:09.857805 32068 raft_consensus.cc:3060] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.886927 32264 tablet_bootstrap.cc:492] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:09.887691 32264 ts_tablet_manager.cc:1403] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.099s	user 0.035s	sys 0.016s
I20260709 12:23:09.890780 32264 raft_consensus.cc:359] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.891587 32264 raft_consensus.cc:385] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.892046 32411 consensus_queue.cc:1048] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.893922 32263 tablet_bootstrap.cc:492] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:09.894685 32263 ts_tablet_manager.cc:1403] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.152s	user 0.002s	sys 0.016s
I20260709 12:23:09.891975 32264 raft_consensus.cc:740] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.902470 32263 raft_consensus.cc:359] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.903857 32263 raft_consensus.cc:385] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.904134 32263 raft_consensus.cc:740] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.904846 32263 consensus_queue.cc:260] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.906416 32264 consensus_queue.cc:260] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.910181 32264 ts_tablet_manager.cc:1434] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:23:09.912084 32264 tablet_bootstrap.cc:492] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:09.918442 32269 tablet_bootstrap.cc:492] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:09.919338 32269 ts_tablet_manager.cc:1403] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.298s	user 0.037s	sys 0.042s
I20260709 12:23:09.920876 32264 tablet_bootstrap.cc:654] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:09.934134 32107 consensus_peers.cc:597] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Couldn't send request to peer 68991541d4134b4f89800c972fdad372. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.941648 32263 ts_tablet_manager.cc:1434] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
W20260709 12:23:09.942526 32544 log.cc:927] Time spent T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:23:09.943110 32263 tablet_bootstrap.cc:492] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:09.946916 32514 consensus_queue.cc:1048] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.951375 32269 raft_consensus.cc:359] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.952099 32269 raft_consensus.cc:385] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.952292 32269 raft_consensus.cc:740] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.952891 32269 consensus_queue.cc:260] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:09.955026 32269 ts_tablet_manager.cc:1434] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.002s
I20260709 12:23:09.956851 32269 tablet_bootstrap.cc:492] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:09.957566 32444 raft_consensus.cc:493] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.958140 32444 raft_consensus.cc:515] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.960579 32444 leader_election.cc:290] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:09.961668 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:09.962802 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:09.963369 32269 tablet_bootstrap.cc:654] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.963487 32142 raft_consensus.cc:2468] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
W20260709 12:23:09.963639 32184 leader_election.cc:343] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.966775 32182 leader_election.cc:304] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:09.969085 32444 raft_consensus.cc:2804] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.970120 32444 raft_consensus.cc:493] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.970750 32444 raft_consensus.cc:3060] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.981853 32265 tablet_bootstrap.cc:492] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:09.982420 32265 ts_tablet_manager.cc:1403] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.208s	user 0.040s	sys 0.038s
I20260709 12:23:09.985280 32265 raft_consensus.cc:359] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.985989 32265 raft_consensus.cc:385] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.986275 32265 raft_consensus.cc:740] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.987437 32265 consensus_queue.cc:260] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:09.987929 32070 raft_consensus.cc:3060] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.992244 32265 ts_tablet_manager.cc:1434] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:09.993314 32265 tablet_bootstrap.cc:492] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:10.001101 32265 tablet_bootstrap.cc:654] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.023561 32401 consensus_queue.cc:1048] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.030296 32341 consensus_queue.cc:1048] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.056895 32340 raft_consensus.cc:493] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.057808 32340 raft_consensus.cc:515] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
W20260709 12:23:10.056732 32182 consensus_peers.cc:597] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:10.063891 32264 tablet_bootstrap.cc:492] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:10.064456 32264 ts_tablet_manager.cc:1403] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.153s	user 0.018s	sys 0.050s
I20260709 12:23:10.067415 32264 raft_consensus.cc:359] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.068125 32264 raft_consensus.cc:385] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.068404 32264 raft_consensus.cc:740] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.069231 32264 consensus_queue.cc:260] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.071540 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:10.072322 32264 ts_tablet_manager.cc:1434] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 12:23:10.075245 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:10.078919 32034 leader_election.cc:304] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:10.080425 32339 raft_consensus.cc:2749] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.069180 32340 leader_election.cc:290] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:10.082402 32264 tablet_bootstrap.cc:492] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:10.110208 32341 consensus_queue.cc:1048] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.148556 32264 tablet_bootstrap.cc:654] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.168819 32263 tablet_bootstrap.cc:654] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.182955 32265 tablet_bootstrap.cc:492] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:10.183485 32265 ts_tablet_manager.cc:1403] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.190s	user 0.015s	sys 0.062s
I20260709 12:23:10.185907 32269 tablet_bootstrap.cc:492] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:10.186499 32269 ts_tablet_manager.cc:1403] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.230s	user 0.072s	sys 0.101s
I20260709 12:23:10.209270 32269 raft_consensus.cc:359] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.210573 32269 raft_consensus.cc:385] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.211112 32269 raft_consensus.cc:740] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.211710 31993 raft_consensus.cc:3060] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.212105 32269 consensus_queue.cc:260] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.188848 32444 raft_consensus.cc:515] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:10.216413 32444 leader_election.cc:290] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:10.219678 32269 ts_tablet_manager.cc:1434] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:23:10.224174 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:10.224917 32142 raft_consensus.cc:3060] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.226475 32401 consensus_queue.cc:1048] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.232493 32265 raft_consensus.cc:359] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.233342 32265 raft_consensus.cc:385] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.233685 32265 raft_consensus.cc:740] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.234540 32265 consensus_queue.cc:260] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.236887 32265 ts_tablet_manager.cc:1434] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 12:23:10.237061 32264 tablet_bootstrap.cc:492] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:10.237627 32264 ts_tablet_manager.cc:1403] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.164s	user 0.027s	sys 0.018s
I20260709 12:23:10.237943 32265 tablet_bootstrap.cc:492] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:10.240518 32264 raft_consensus.cc:359] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.241240 32264 raft_consensus.cc:385] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.240983 32339 consensus_queue.cc:1048] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.241514 32264 raft_consensus.cc:740] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.243381 32269 tablet_bootstrap.cc:492] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:10.243458 32264 consensus_queue.cc:260] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.249472 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:10.254611 32264 ts_tablet_manager.cc:1434] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.017s	user 0.013s	sys 0.004s
I20260709 12:23:10.255827 32264 tablet_bootstrap.cc:492] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:10.259176 32269 tablet_bootstrap.cc:654] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.261076 32263 tablet_bootstrap.cc:492] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:10.261622 32263 ts_tablet_manager.cc:1403] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.319s	user 0.024s	sys 0.013s
I20260709 12:23:10.262774 32264 tablet_bootstrap.cc:654] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.264514 32263 raft_consensus.cc:359] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:10.265352 32263 raft_consensus.cc:385] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.265607 32263 raft_consensus.cc:740] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.278719 32444 raft_consensus.cc:493] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.279681 32444 raft_consensus.cc:515] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:10.281369 32269 tablet_bootstrap.cc:492] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
W20260709 12:23:10.282543 32184 leader_election.cc:343] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.288406 32444 leader_election.cc:290] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:10.292405 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13aeab79371a4849b6886db4cc9205d1" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
W20260709 12:23:10.295924 32182 leader_election.cc:343] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.293310 32069 raft_consensus.cc:3060] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.286183 32263 consensus_queue.cc:260] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:10.303540 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13aeab79371a4849b6886db4cc9205d1" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:10.306079 32263 ts_tablet_manager.cc:1434] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.003s
I20260709 12:23:10.305920 32269 ts_tablet_manager.cc:1403] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.001s
W20260709 12:23:10.307461 32184 leader_election.cc:343] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.308095 32184 leader_election.cc:304] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:10.312373 32517 raft_consensus.cc:2749] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.313761 32263 tablet_bootstrap.cc:492] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:10.314595 32514 raft_consensus.cc:493] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.315233 32514 raft_consensus.cc:515] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.317669 32514 leader_election.cc:290] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:10.318706 32506 raft_consensus.cc:493] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.319314 32506 raft_consensus.cc:515] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.319964 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d55921a3ee4ee18232cdd3f94fcbb9" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:10.320633 31993 raft_consensus.cc:2468] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:10.323150 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bafc1117fee410a852a9784f5ac967c" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:10.321810 32070 raft_consensus.cc:3060] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:10.326745 32110 leader_election.cc:343] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.327365 32339 consensus_queue.cc:1048] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.327786 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d55921a3ee4ee18232cdd3f94fcbb9" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:10.328564 32216 raft_consensus.cc:2468] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:10.330060 32107 leader_election.cc:304] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:10.331086 32410 raft_consensus.cc:2804] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.331522 32410 raft_consensus.cc:493] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.331874 32410 raft_consensus.cc:3060] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.333801 32263 tablet_bootstrap.cc:654] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.321764 32506 leader_election.cc:290] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:10.337092 32265 tablet_bootstrap.cc:654] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.304314 32142 raft_consensus.cc:2468] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:10.339749 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bafc1117fee410a852a9784f5ac967c" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:10.340713 32269 raft_consensus.cc:359] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.343108 32269 raft_consensus.cc:385] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.343464 32269 raft_consensus.cc:740] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.345551 32182 leader_election.cc:304] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:10.348187 32444 raft_consensus.cc:2804] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.349748 32269 consensus_queue.cc:260] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.350132 32444 raft_consensus.cc:697] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:10.361968 32444 consensus_queue.cc:237] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:10.353277 31993 raft_consensus.cc:2468] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:10.357682 32269 ts_tablet_manager.cc:1434] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:23:10.374784 32108 leader_election.cc:304] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:10.375828 32514 raft_consensus.cc:2804] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.376341 32514 raft_consensus.cc:493] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.376927 32514 raft_consensus.cc:3060] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.395563 32269 tablet_bootstrap.cc:492] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:10.394507 32410 raft_consensus.cc:515] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.416148 32410 leader_election.cc:290] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:10.426976 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d55921a3ee4ee18232cdd3f94fcbb9" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:10.427727 31995 raft_consensus.cc:3060] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.443707 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d55921a3ee4ee18232cdd3f94fcbb9" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:10.444453 32218 raft_consensus.cc:3060] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.453117 32410 raft_consensus.cc:493] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.453810 32218 raft_consensus.cc:2468] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:10.453742 32410 raft_consensus.cc:515] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.457489 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:10.457647 32107 leader_election.cc:304] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:10.458597 32506 raft_consensus.cc:2804] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.459203 32506 raft_consensus.cc:697] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:10.460285 32506 consensus_queue.cc:237] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.465586 32269 tablet_bootstrap.cc:654] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.467780 32264 tablet_bootstrap.cc:492] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:10.468426 32264 ts_tablet_manager.cc:1403] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.213s	user 0.049s	sys 0.033s
I20260709 12:23:10.471462 32265 tablet_bootstrap.cc:492] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:10.472147 32265 ts_tablet_manager.cc:1403] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.234s	user 0.015s	sys 0.008s
I20260709 12:23:10.495168 32342 raft_consensus.cc:493] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.503775 32342 raft_consensus.cc:515] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
W20260709 12:23:10.509684 32560 log.cc:927] Time spent T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2: Append to log took a long time: real 0.091s	user 0.004s	sys 0.000s
W20260709 12:23:10.482712 32107 leader_election.cc:343] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.516027 32265 raft_consensus.cc:359] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:10.516994 32265 raft_consensus.cc:385] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.517293 32265 raft_consensus.cc:740] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.517921 32265 consensus_queue.cc:260] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:10.521565 32342 leader_election.cc:290] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:10.512416 32264 raft_consensus.cc:359] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:10.526772 32264 raft_consensus.cc:385] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.527011 32265 ts_tablet_manager.cc:1434] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:23:10.526082 32410 leader_election.cc:290] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:10.525972 32514 raft_consensus.cc:515] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.536682 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bafc1117fee410a852a9784f5ac967c" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:10.527920 32264 raft_consensus.cc:740] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.536597 32514 leader_election.cc:290] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:10.505343 31891 catalog_manager.cc:5697] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.539103 32264 consensus_queue.cc:260] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
W20260709 12:23:10.540092 32110 leader_election.cc:343] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.543917 32265 tablet_bootstrap.cc:492] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:10.553821 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bafc1117fee410a852a9784f5ac967c" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:10.554576 31994 raft_consensus.cc:3060] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.555013 31995 raft_consensus.cc:2468] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:10.558513 32401 consensus_queue.cc:1048] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.559760 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f311ee508648669be858c85efab949" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
W20260709 12:23:10.526609 32033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:46375, user_credentials={real_user=slave}} blocked reactor thread for 157615us
I20260709 12:23:10.568217 32264 ts_tablet_manager.cc:1434] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.001s
I20260709 12:23:10.580163 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f311ee508648669be858c85efab949" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:10.586282 32264 tablet_bootstrap.cc:492] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:10.589373 32263 tablet_bootstrap.cc:492] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:10.589943 32263 ts_tablet_manager.cc:1403] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.277s	user 0.029s	sys 0.035s
I20260709 12:23:10.588723 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:10.595111 32565 log.cc:927] Time spent T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:23:10.595603 32108 leader_election.cc:343] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.596120 32108 leader_election.cc:304] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:10.597772 32514 raft_consensus.cc:2749] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.599383 31994 raft_consensus.cc:2468] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:10.601171 32033 leader_election.cc:304] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:10.601908 32108 leader_election.cc:304] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:10.604365 32514 raft_consensus.cc:2804] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.623235 32269 tablet_bootstrap.cc:492] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:10.623811 32269 ts_tablet_manager.cc:1403] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.237s	user 0.013s	sys 0.022s
I20260709 12:23:10.618332 32263 raft_consensus.cc:359] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.627451 32269 raft_consensus.cc:359] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.629112 31890 catalog_manager.cc:5697] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.630748 32263 raft_consensus.cc:385] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.630936 32269 raft_consensus.cc:385] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:10.630245 32570 log.cc:927] Time spent T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372: Append to log took a long time: real 0.170s	user 0.000s	sys 0.004s
I20260709 12:23:10.631170 32263 raft_consensus.cc:740] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.631392 32269 raft_consensus.cc:740] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.633590 32269 consensus_queue.cc:260] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.634202 32340 raft_consensus.cc:2749] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.636070 32269 ts_tablet_manager.cc:1434] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:23:10.637336 32269 tablet_bootstrap.cc:492] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:10.636798 32263 consensus_queue.cc:260] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.630707 32514 raft_consensus.cc:697] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:10.639632 32263 ts_tablet_manager.cc:1434] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 12:23:10.644096 32269 tablet_bootstrap.cc:654] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.644197 32514 consensus_queue.cc:237] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.644899 32263 tablet_bootstrap.cc:492] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:10.658887 32265 tablet_bootstrap.cc:654] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:10.665617 31940 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:10.666996 32264 tablet_bootstrap.cc:654] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.672092 32574 raft_consensus.cc:493] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.672737 32574 raft_consensus.cc:515] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:10.675266 32574 leader_election.cc:290] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:10.676036 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a13a27f78154b4ebdf87e3009f09aa4" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:10.688251 32265 tablet_bootstrap.cc:492] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:10.688874 32265 ts_tablet_manager.cc:1403] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.145s	user 0.008s	sys 0.006s
I20260709 12:23:10.689711 31992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a13a27f78154b4ebdf87e3009f09aa4" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:10.692926 32033 leader_election.cc:304] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:10.693121 32265 raft_consensus.cc:359] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:10.693845 32339 raft_consensus.cc:2749] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.693907 32265 raft_consensus.cc:385] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.694412 32265 raft_consensus.cc:740] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.684988 32263 tablet_bootstrap.cc:654] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.697569 32265 consensus_queue.cc:260] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:10.699853 32269 tablet_bootstrap.cc:492] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:10.700688 32269 ts_tablet_manager.cc:1403] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.024s
I20260709 12:23:10.701301 32265 ts_tablet_manager.cc:1434] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:10.706887 32264 tablet_bootstrap.cc:492] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:10.707422 32264 ts_tablet_manager.cc:1403] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.121s	user 0.021s	sys 0.004s
I20260709 12:23:10.707562 32265 tablet_bootstrap.cc:492] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:10.711669 32264 raft_consensus.cc:359] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:10.712472 32264 raft_consensus.cc:385] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.712831 32264 raft_consensus.cc:740] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.713521 32264 consensus_queue.cc:260] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:10.715971 32264 ts_tablet_manager.cc:1434] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:10.716682 32263 tablet_bootstrap.cc:492] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:10.717075 32264 tablet_bootstrap.cc:492] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:10.717391 32263 ts_tablet_manager.cc:1403] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.013s
I20260709 12:23:10.717190 32269 raft_consensus.cc:359] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.717625 32265 tablet_bootstrap.cc:654] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.718571 32444 raft_consensus.cc:493] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.719049 32444 raft_consensus.cc:515] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:10.717931 32269 raft_consensus.cc:385] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.720355 32269 raft_consensus.cc:740] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.721241 32444 leader_election.cc:290] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:10.721153 32269 consensus_queue.cc:260] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.725076 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20c391002194c58ab7f13a5df063f55" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:10.725960 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20c391002194c58ab7f13a5df063f55" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:10.726610 31994 raft_consensus.cc:2468] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
W20260709 12:23:10.726790 32184 leader_election.cc:343] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.732106 32069 raft_consensus.cc:3060] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.732278 32182 leader_election.cc:304] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:10.733497 32265 tablet_bootstrap.cc:492] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:10.733565 32569 raft_consensus.cc:2804] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.734241 32569 raft_consensus.cc:493] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.734751 32569 raft_consensus.cc:3060] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.735747 32269 ts_tablet_manager.cc:1434] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 12:23:10.736997 32269 tablet_bootstrap.cc:492] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:10.737872 32265 ts_tablet_manager.cc:1403] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.003s
I20260709 12:23:10.750819 32264 tablet_bootstrap.cc:654] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.756063 32265 raft_consensus.cc:359] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.756901 32265 raft_consensus.cc:385] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.757189 32265 raft_consensus.cc:740] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.757875 32265 consensus_queue.cc:260] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.760663 32265 ts_tablet_manager.cc:1434] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:23:10.761793 32265 tablet_bootstrap.cc:492] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:10.768616 32265 tablet_bootstrap.cc:654] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.776502 31892 catalog_manager.cc:5697] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.785633 32265 tablet_bootstrap.cc:492] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:10.786347 32265 ts_tablet_manager.cc:1403] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.000s
I20260709 12:23:10.789742 32265 raft_consensus.cc:359] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.790512 32265 raft_consensus.cc:385] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.790802 32265 raft_consensus.cc:740] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.792243 32265 consensus_queue.cc:260] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.794430 32269 tablet_bootstrap.cc:654] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.794863 32265 ts_tablet_manager.cc:1434] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:10.802569 32265 tablet_bootstrap.cc:492] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:10.809391 32265 tablet_bootstrap.cc:654] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.721386 32263 raft_consensus.cc:359] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.810240 32263 raft_consensus.cc:385] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.810585 32263 raft_consensus.cc:740] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.811416 32263 consensus_queue.cc:260] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.814091 32263 ts_tablet_manager.cc:1434] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
I20260709 12:23:10.800272 32569 raft_consensus.cc:515] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:10.816394 32569 leader_election.cc:290] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:10.818931 32263 tablet_bootstrap.cc:492] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:10.819133 32264 tablet_bootstrap.cc:492] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:10.851833 32264 ts_tablet_manager.cc:1403] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.135s	user 0.020s	sys 0.008s
I20260709 12:23:10.854882 32264 raft_consensus.cc:359] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.855645 32264 raft_consensus.cc:385] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.855912 32264 raft_consensus.cc:740] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.819356 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20c391002194c58ab7f13a5df063f55" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
W20260709 12:23:10.857731 32184 leader_election.cc:343] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.821192 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20c391002194c58ab7f13a5df063f55" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:10.829620 32388 raft_consensus.cc:493] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.859016 31994 raft_consensus.cc:3060] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.859248 32388 raft_consensus.cc:515] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.861491 32388 leader_election.cc:290] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:10.835062 32265 tablet_bootstrap.cc:492] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:10.862593 32265 ts_tablet_manager.cc:1403] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.006s
I20260709 12:23:10.863189 32217 raft_consensus.cc:3060] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.840713 32068 raft_consensus.cc:3060] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.867049 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6473d98e1f49484c888a0fb622b9b083" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:10.867451 32265 raft_consensus.cc:359] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:10.875696 32265 raft_consensus.cc:385] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.875998 32265 raft_consensus.cc:740] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.877732 32265 consensus_queue.cc:260] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:10.880158 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6473d98e1f49484c888a0fb622b9b083" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:10.881260 32265 ts_tablet_manager.cc:1434] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:23:10.881294 32569 consensus_queue.cc:1048] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:23:10.886914 32339 raft_consensus.cc:493] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.887429 32339 raft_consensus.cc:515] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:10.881511 32264 consensus_queue.cc:260] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.889598 32339 leader_election.cc:290] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:10.891489 32265 tablet_bootstrap.cc:492] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:10.891837 32286 raft_consensus.cc:493] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.892313 32286 raft_consensus.cc:515] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.894693 32286 leader_election.cc:290] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:10.898350 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d960ac97c848b8be5d62f6f5175144" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:10.898994 32216 raft_consensus.cc:2468] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:10.900676 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:10.902408 31959 leader_election.cc:304] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:10.902585 32514 raft_consensus.cc:493] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.903180 32514 raft_consensus.cc:515] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:10.904162 32575 raft_consensus.cc:493] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.904652 32575 raft_consensus.cc:515] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:10.906481 32269 tablet_bootstrap.cc:492] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:10.906329 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13aeab79371a4849b6886db4cc9205d1" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:10.907056 32269 ts_tablet_manager.cc:1403] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.170s	user 0.059s	sys 0.038s
I20260709 12:23:10.907657 32388 raft_consensus.cc:2749] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.908448 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c7b8290b2a448cb9acb35da128eb8e" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:10.909332 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c7b8290b2a448cb9acb35da128eb8e" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:10.910255 32514 leader_election.cc:290] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:10.910614 32269 raft_consensus.cc:359] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.906988 32575 leader_election.cc:290] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
W20260709 12:23:10.911281 32107 leader_election.cc:343] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:10.908360 32110 leader_election.cc:343] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.911291 32269 raft_consensus.cc:385] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.912012 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13aeab79371a4849b6886db4cc9205d1" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:10.912569 32269 raft_consensus.cc:740] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.912576 31958 leader_election.cc:304] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
W20260709 12:23:10.912693 32110 leader_election.cc:343] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.913988 32388 raft_consensus.cc:2804] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.914276 32264 ts_tablet_manager.cc:1434] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 12:23:10.914529 32388 raft_consensus.cc:493] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.914932 32388 raft_consensus.cc:3060] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.915112 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d960ac97c848b8be5d62f6f5175144" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:10.915848 32143 raft_consensus.cc:2468] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:10.916829 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:10.917472 32141 raft_consensus.cc:2468] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:10.913887 32110 leader_election.cc:304] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372
I20260709 12:23:10.918330 32264 tablet_bootstrap.cc:492] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:10.918865 32514 raft_consensus.cc:493] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.919389 32514 raft_consensus.cc:515] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.920729 31994 raft_consensus.cc:2468] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:10.921479 32514 leader_election.cc:290] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:10.922130 32034 leader_election.cc:304] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:10.912845 32216 raft_consensus.cc:2468] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:10.924691 32514 raft_consensus.cc:2749] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.925801 32107 leader_election.cc:304] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:10.926895 31992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760cfc460de34e6bbe34af04b225d26f" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:10.927127 32514 raft_consensus.cc:2804] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.928243 32514 raft_consensus.cc:493] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.928721 32514 raft_consensus.cc:3060] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.913887 32269 consensus_queue.cc:260] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.931910 31992 raft_consensus.cc:2468] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:10.932418 32269 ts_tablet_manager.cc:1434] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:23:10.933525 32269 tablet_bootstrap.cc:492] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:10.934384 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760cfc460de34e6bbe34af04b225d26f" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:10.935076 32068 raft_consensus.cc:2468] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:10.936033 32569 consensus_queue.cc:1048] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.938766 32339 raft_consensus.cc:2804] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:10.936180 32110 leader_election.cc:304] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:10.939915 32339 raft_consensus.cc:493] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 68991541d4134b4f89800c972fdad372)
I20260709 12:23:10.940354 32339 raft_consensus.cc:3060] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.940543 32575 raft_consensus.cc:2804] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.940955 32575 raft_consensus.cc:493] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.941321 32263 tablet_bootstrap.cc:654] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.941296 32575 raft_consensus.cc:3060] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.943877 32182 leader_election.cc:304] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:10.904654 32265 tablet_bootstrap.cc:654] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.948153 32444 raft_consensus.cc:2804] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.948737 32444 raft_consensus.cc:697] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:10.949615 32444 consensus_queue.cc:237] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:10.954013 32269 tablet_bootstrap.cc:654] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.960408 32388 raft_consensus.cc:515] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:10.969301 32575 raft_consensus.cc:515] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:10.973811 32410 consensus_queue.cc:1048] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.975425 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760cfc460de34e6bbe34af04b225d26f" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:10.976080 32070 raft_consensus.cc:3060] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.978981 32388 leader_election.cc:290] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:10.958469 32264 tablet_bootstrap.cc:654] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.982841 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d960ac97c848b8be5d62f6f5175144" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:10.983522 32144 raft_consensus.cc:3060] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.986586 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d960ac97c848b8be5d62f6f5175144" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:10.987280 32216 raft_consensus.cc:3060] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.999608 32575 leader_election.cc:290] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:10.985347 32339 raft_consensus.cc:515] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.007730 32339 leader_election.cc:290] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:11.016474 32069 raft_consensus.cc:1240] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Rejecting Update request from peer 68991541d4134b4f89800c972fdad372 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:11.018390 32216 raft_consensus.cc:2468] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:11.010133 32070 raft_consensus.cc:2468] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:11.019971 32110 leader_election.cc:304] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:11.012475 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760cfc460de34e6bbe34af04b225d26f" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:11.021095 31994 raft_consensus.cc:3060] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.021297 31958 leader_election.cc:304] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:11.011758 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:11.023123 32265 tablet_bootstrap.cc:492] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:11.023773 32265 ts_tablet_manager.cc:1403] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.001s
I20260709 12:23:11.026412 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:11.027994 32410 raft_consensus.cc:2804] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.028541 32410 raft_consensus.cc:697] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:11.029520 32569 consensus_queue.cc:1059] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.029428 32410 consensus_queue.cc:237] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.030297 31994 raft_consensus.cc:2468] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:11.030400 32569 raft_consensus.cc:3055] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.030833 32569 raft_consensus.cc:740] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:11.031613 32569 consensus_queue.cc:260] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.032904 32506 raft_consensus.cc:493] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.032413 32514 raft_consensus.cc:515] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.033387 32506 raft_consensus.cc:515] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.036538 32506 leader_election.cc:290] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:11.036952 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13aeab79371a4849b6886db4cc9205d1" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
W20260709 12:23:11.039019 32110 leader_election.cc:343] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.039229 32569 raft_consensus.cc:3060] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.023226 32388 raft_consensus.cc:2804] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.043219 32388 raft_consensus.cc:697] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:11.044463 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136a4f0e01594acc9dc1c8fdb8bd5ce2" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:11.044142 32388 consensus_queue.cc:237] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
W20260709 12:23:11.047775 32110 leader_election.cc:343] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.047981 32514 leader_election.cc:290] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:11.048306 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13aeab79371a4849b6886db4cc9205d1" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:11.049223 32217 raft_consensus.cc:3060] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.048064 31891 catalog_manager.cc:5697] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.051571 32264 tablet_bootstrap.cc:492] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:11.052270 32264 ts_tablet_manager.cc:1403] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.000s
I20260709 12:23:11.054262 32269 tablet_bootstrap.cc:492] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:11.054760 32269 ts_tablet_manager.cc:1403] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.037s
I20260709 12:23:11.056582 32034 leader_election.cc:304] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:11.057452 32573 raft_consensus.cc:2749] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:11.057597 32269 raft_consensus.cc:359] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.058404 32269 raft_consensus.cc:385] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.058693 32269 raft_consensus.cc:740] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.059639 32269 consensus_queue.cc:260] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.061264 32269 ts_tablet_manager.cc:1434] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:11.063419 32269 tablet_bootstrap.cc:492] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:11.067085 32217 raft_consensus.cc:2468] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:11.068480 32107 leader_election.cc:304] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:11.069335 32410 raft_consensus.cc:2804] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.069824 32410 raft_consensus.cc:697] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:11.070007 32269 tablet_bootstrap.cc:654] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.070725 32410 consensus_queue.cc:237] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.077728 32573 raft_consensus.cc:493] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.078359 32573 raft_consensus.cc:515] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.081094 32573 leader_election.cc:290] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:11.083933 32265 raft_consensus.cc:359] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.084669 31893 catalog_manager.cc:5697] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.086212 32144 raft_consensus.cc:2468] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:11.087667 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136a4f0e01594acc9dc1c8fdb8bd5ce2" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:11.089491 32269 tablet_bootstrap.cc:492] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:11.089509 32410 consensus_queue.cc:1048] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.090152 32269 ts_tablet_manager.cc:1403] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 12:23:11.090886 31992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20c391002194c58ab7f13a5df063f55" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:11.084689 32265 raft_consensus.cc:385] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.092135 32265 raft_consensus.cc:740] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.091784 31992 raft_consensus.cc:2393] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13d67625d82d4304a0ebff87742a538d in current term 1: Already voted for candidate 68991541d4134b4f89800c972fdad372 in this term.
I20260709 12:23:11.095589 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20c391002194c58ab7f13a5df063f55" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
W20260709 12:23:11.093711 32108 leader_election.cc:343] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.093271 32269 raft_consensus.cc:359] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:11.096902 32269 raft_consensus.cc:385] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.097213 32033 leader_election.cc:304] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:11.097244 32269 raft_consensus.cc:740] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.098354 32573 raft_consensus.cc:3060] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.100553 31992 raft_consensus.cc:3060] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.104485 31890 catalog_manager.cc:5697] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.097349 32108 leader_election.cc:304] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:11.121244 32410 raft_consensus.cc:2749] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.125237 32265 consensus_queue.cc:260] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.126827 32340 raft_consensus.cc:493] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.126672 32577 consensus_queue.cc:1048] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.127337 32340 raft_consensus.cc:515] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.129473 32340 leader_election.cc:290] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:11.130846 32388 raft_consensus.cc:493] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.125288 32269 consensus_queue.cc:260] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:11.131353 32388 raft_consensus.cc:515] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.132349 32269 ts_tablet_manager.cc:1434] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.023s
I20260709 12:23:11.133378 32269 tablet_bootstrap.cc:492] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:11.133524 32388 leader_election.cc:290] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:11.136448 32264 raft_consensus.cc:359] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.136929 32573 raft_consensus.cc:2749] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.137207 32264 raft_consensus.cc:385] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.137564 32264 raft_consensus.cc:740] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.139503 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc23d93569d44dd8a4bafcb504fc056a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
W20260709 12:23:11.141685 31961 leader_election.cc:343] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.142088 32481 raft_consensus.cc:493] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.142629 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc23d93569d44dd8a4bafcb504fc056a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:11.142585 32481 raft_consensus.cc:515] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:11.144886 32481 leader_election.cc:290] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:11.145828 32339 raft_consensus.cc:493] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.146414 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13aeab79371a4849b6886db4cc9205d1" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:11.146354 32339 raft_consensus.cc:515] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.147286 32218 raft_consensus.cc:2393] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13d67625d82d4304a0ebff87742a538d in current term 1: Already voted for candidate c5524748d37141a1bca7d0cedaeb40f2 in this term.
I20260709 12:23:11.148464 32339 leader_election.cc:290] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:11.152299 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
W20260709 12:23:11.152524 31958 leader_election.cc:343] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.153066 31958 leader_election.cc:304] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372
I20260709 12:23:11.154709 32388 raft_consensus.cc:2749] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:11.156095 31958 leader_election.cc:343] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.154539 32264 consensus_queue.cc:260] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.163085 32264 ts_tablet_manager.cc:1434] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 12:23:11.164902 32264 tablet_bootstrap.cc:492] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:11.167300 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13aeab79371a4849b6886db4cc9205d1" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:11.170008 32265 ts_tablet_manager.cc:1434] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.146s	user 0.007s	sys 0.001s
I20260709 12:23:11.171087 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:11.171762 32141 raft_consensus.cc:2468] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:11.172271 32034 leader_election.cc:304] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:11.153890 32269 tablet_bootstrap.cc:654] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.173415 32340 raft_consensus.cc:3060] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.175624 32265 tablet_bootstrap.cc:492] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:11.179519 32263 tablet_bootstrap.cc:492] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:11.179674 32264 tablet_bootstrap.cc:654] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.169253 31889 catalog_manager.cc:5697] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.180102 32263 ts_tablet_manager.cc:1403] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.361s	user 0.015s	sys 0.001s
I20260709 12:23:11.187472 32340 raft_consensus.cc:2749] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.189505 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bafc1117fee410a852a9784f5ac967c" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:11.195262 32269 tablet_bootstrap.cc:492] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:11.195832 32269 ts_tablet_manager.cc:1403] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.007s
I20260709 12:23:11.200275 31959 leader_election.cc:304] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:11.201550 32481 raft_consensus.cc:2804] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.201931 32481 raft_consensus.cc:493] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.202270 32481 raft_consensus.cc:3060] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.205559 32264 tablet_bootstrap.cc:492] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:11.206135 32264 ts_tablet_manager.cc:1403] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.000s
I20260709 12:23:11.208894 32264 raft_consensus.cc:359] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.209754 32264 raft_consensus.cc:385] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.216425 32264 raft_consensus.cc:740] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.210817 32481 raft_consensus.cc:515] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
W20260709 12:23:11.213770 31961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:33135, user_credentials={real_user=slave}} blocked reactor thread for 71423.1us
I20260709 12:23:11.215586 32269 raft_consensus.cc:359] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.222610 32269 raft_consensus.cc:385] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.222926 32269 raft_consensus.cc:740] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.223575 32269 consensus_queue.cc:260] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.226233 31991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bafc1117fee410a852a9784f5ac967c" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:11.226485 32269 ts_tablet_manager.cc:1434] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.002s
I20260709 12:23:11.228643 32269 tablet_bootstrap.cc:492] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:11.217304 32264 consensus_queue.cc:260] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.233254 32034 leader_election.cc:304] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:11.236014 32269 tablet_bootstrap.cc:654] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.236706 32340 raft_consensus.cc:2749] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.240811 32069 raft_consensus.cc:3060] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.240666 32263 raft_consensus.cc:359] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.241123 32264 ts_tablet_manager.cc:1434] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:23:11.245225 32264 tablet_bootstrap.cc:492] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:11.247885 32481 leader_election.cc:290] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:11.248988 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
W20260709 12:23:11.250628 31958 leader_election.cc:343] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.251202 32265 tablet_bootstrap.cc:654] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.251748 32264 tablet_bootstrap.cc:654] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.241458 32263 raft_consensus.cc:385] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.255160 32263 raft_consensus.cc:740] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.255910 32263 consensus_queue.cc:260] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.262454 32269 tablet_bootstrap.cc:492] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:11.263015 32269 ts_tablet_manager.cc:1403] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.035s	user 0.002s	sys 0.009s
I20260709 12:23:11.265781 32269 raft_consensus.cc:359] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.268352 32269 raft_consensus.cc:385] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.268635 32269 raft_consensus.cc:740] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.272027 32264 tablet_bootstrap.cc:492] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:11.272599 32264 ts_tablet_manager.cc:1403] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.029s	user 0.002s	sys 0.013s
I20260709 12:23:11.274533 32269 consensus_queue.cc:260] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.276974 32269 ts_tablet_manager.cc:1434] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:23:11.278016 32269 tablet_bootstrap.cc:492] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:11.284505 32269 tablet_bootstrap.cc:654] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.286542 32575 consensus_queue.cc:1048] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.287853 32264 raft_consensus.cc:359] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.289670 32264 raft_consensus.cc:385] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.289994 32264 raft_consensus.cc:740] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.290932 32264 consensus_queue.cc:260] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.286592 32514 raft_consensus.cc:493] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.293928 32514 raft_consensus.cc:515] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.296382 32514 leader_election.cc:290] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:11.299189 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38d8cb74c1344a180ca94cfd755e103" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:11.300503 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:11.301170 32142 raft_consensus.cc:3060] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.304844 32263 ts_tablet_manager.cc:1434] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.124s	user 0.004s	sys 0.002s
I20260709 12:23:11.308110 32263 tablet_bootstrap.cc:492] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:11.318542 32265 tablet_bootstrap.cc:492] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:11.319633 32263 tablet_bootstrap.cc:654] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.319339 32265 ts_tablet_manager.cc:1403] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.144s	user 0.025s	sys 0.010s
I20260709 12:23:11.324769 32265 raft_consensus.cc:359] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.325246 32269 tablet_bootstrap.cc:492] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:11.325438 32265 raft_consensus.cc:385] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.325762 32269 ts_tablet_manager.cc:1403] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.022s
I20260709 12:23:11.325737 32265 raft_consensus.cc:740] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.328783 32265 consensus_queue.cc:260] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.331339 32265 ts_tablet_manager.cc:1434] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:23:11.332370 32265 tablet_bootstrap.cc:492] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:11.335067 32506 raft_consensus.cc:493] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.334817 32269 raft_consensus.cc:359] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.335537 32506 raft_consensus.cc:515] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.335999 32269 raft_consensus.cc:385] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.336289 32269 raft_consensus.cc:740] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.337033 32269 consensus_queue.cc:260] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.337626 32506 leader_election.cc:290] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:11.339140 32269 ts_tablet_manager.cc:1434] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:23:11.340255 32269 tablet_bootstrap.cc:492] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
W20260709 12:23:11.346776 32110 leader_election.cc:343] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.348408 32269 tablet_bootstrap.cc:654] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.348445 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edffd8d7fac40d1b74f6a23d3517e8b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:11.293326 32264 ts_tablet_manager.cc:1434] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:23:11.359089 32264 tablet_bootstrap.cc:492] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:11.347051 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edffd8d7fac40d1b74f6a23d3517e8b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:11.360427 31993 raft_consensus.cc:2468] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:11.337673 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38d8cb74c1344a180ca94cfd755e103" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:11.364243 32108 leader_election.cc:304] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:11.365135 32142 raft_consensus.cc:2468] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:11.365916 32514 raft_consensus.cc:2804] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:11.365978 32110 leader_election.cc:343] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.359134 32263 tablet_bootstrap.cc:492] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
W20260709 12:23:11.366770 32107 leader_election.cc:343] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.356675 32265 tablet_bootstrap.cc:654] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.372010 32263 ts_tablet_manager.cc:1403] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.066s	user 0.025s	sys 0.019s
I20260709 12:23:11.385192 32263 raft_consensus.cc:359] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.371642 32514 raft_consensus.cc:493] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.386220 32514 raft_consensus.cc:3060] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.388154 32569 consensus_queue.cc:1048] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.372535 32107 leader_election.cc:304] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372
I20260709 12:23:11.376287 31959 leader_election.cc:304] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:11.390776 32481 raft_consensus.cc:2804] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.391089 32575 raft_consensus.cc:2749] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.391252 32481 raft_consensus.cc:697] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:11.377785 32264 tablet_bootstrap.cc:654] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.392278 32481 consensus_queue.cc:237] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:11.394789 32265 tablet_bootstrap.cc:492] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:11.395311 32265 ts_tablet_manager.cc:1403] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.001s
I20260709 12:23:11.385852 32263 raft_consensus.cc:385] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.398221 32263 raft_consensus.cc:740] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.398904 32263 consensus_queue.cc:260] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.400714 32263 ts_tablet_manager.cc:1434] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.000s
I20260709 12:23:11.378057 32269 tablet_bootstrap.cc:492] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:11.381805 32286 raft_consensus.cc:493] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.398211 32265 raft_consensus.cc:359] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.404346 32269 ts_tablet_manager.cc:1403] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.004s
I20260709 12:23:11.402797 32514 raft_consensus.cc:515] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.404099 32286 raft_consensus.cc:515] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.409473 32286 leader_election.cc:290] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:11.403790 32263 tablet_bootstrap.cc:492] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:11.410866 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136a4f0e01594acc9dc1c8fdb8bd5ce2" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:11.407166 32265 raft_consensus.cc:385] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.411680 32265 raft_consensus.cc:740] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
W20260709 12:23:11.412143 31961 leader_election.cc:343] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.412341 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edffd8d7fac40d1b74f6a23d3517e8b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:11.413265 32265 consensus_queue.cc:260] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.413585 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edffd8d7fac40d1b74f6a23d3517e8b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:11.409682 32514 leader_election.cc:290] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
W20260709 12:23:11.421149 32110 leader_election.cc:343] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.421757 32265 ts_tablet_manager.cc:1434] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:23:11.418115 31994 raft_consensus.cc:3060] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.422853 32265 tablet_bootstrap.cc:492] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:11.426452 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136a4f0e01594acc9dc1c8fdb8bd5ce2" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:11.427258 32142 raft_consensus.cc:2468] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:11.428527 31959 leader_election.cc:304] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:11.430521 32286 raft_consensus.cc:2804] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.430851 32286 raft_consensus.cc:493] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.431143 32286 raft_consensus.cc:3060] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.435060 31994 raft_consensus.cc:2468] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:11.437103 32108 leader_election.cc:304] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:11.438833 32506 raft_consensus.cc:2804] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.439352 32506 raft_consensus.cc:697] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:11.440208 32506 consensus_queue.cc:237] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.442220 32575 consensus_queue.cc:1048] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.455304 32263 tablet_bootstrap.cc:654] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.456287 31891 catalog_manager.cc:5697] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.463999 32575 consensus_queue.cc:1048] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.414197 32269 raft_consensus.cc:359] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:11.468338 32269 raft_consensus.cc:385] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.468788 32269 raft_consensus.cc:740] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.469619 32269 consensus_queue.cc:260] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:11.485646 32269 ts_tablet_manager.cc:1434] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 12:23:11.488883 32269 tablet_bootstrap.cc:492] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:11.495260 32269 tablet_bootstrap.cc:654] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.501291 32569 consensus_queue.cc:1048] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.503495 32481 consensus_queue.cc:1048] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.514559 32264 tablet_bootstrap.cc:492] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:11.515120 32264 ts_tablet_manager.cc:1403] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.156s	user 0.002s	sys 0.012s
I20260709 12:23:11.517515 32269 tablet_bootstrap.cc:492] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:11.518095 32269 ts_tablet_manager.cc:1403] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.003s
I20260709 12:23:11.520936 32269 raft_consensus.cc:359] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:11.521682 32269 raft_consensus.cc:385] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.522063 32269 raft_consensus.cc:740] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.522887 32269 consensus_queue.cc:260] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:11.527328 32269 ts_tablet_manager.cc:1434] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:23:11.528445 32269 tablet_bootstrap.cc:492] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:11.509835 32265 tablet_bootstrap.cc:654] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.538429 32269 tablet_bootstrap.cc:654] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.538475 32286 raft_consensus.cc:515] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.546896 32269 tablet_bootstrap.cc:492] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:11.550249 32514 consensus_queue.cc:1048] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.554891 32269 ts_tablet_manager.cc:1403] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 12:23:11.556437 32265 tablet_bootstrap.cc:492] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:11.556952 32265 ts_tablet_manager.cc:1403] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.002s
I20260709 12:23:11.557227 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136a4f0e01594acc9dc1c8fdb8bd5ce2" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:11.557860 32269 raft_consensus.cc:359] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.558615 32269 raft_consensus.cc:385] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:11.558972 31961 leader_election.cc:343] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.517882 32264 raft_consensus.cc:359] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.560585 32264 raft_consensus.cc:385] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.560933 32573 raft_consensus.cc:493] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.560997 32286 leader_election.cc:290] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:11.560885 32264 raft_consensus.cc:740] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.561539 32573 raft_consensus.cc:515] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.562191 32140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136a4f0e01594acc9dc1c8fdb8bd5ce2" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:11.562829 32140 raft_consensus.cc:3060] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.563858 32573 leader_election.cc:290] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:11.558933 32269 raft_consensus.cc:740] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.565912 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c7b8290b2a448cb9acb35da128eb8e" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:11.566134 32264 consensus_queue.cc:260] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
W20260709 12:23:11.567973 32033 leader_election.cc:343] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.568921 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c7b8290b2a448cb9acb35da128eb8e" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:11.559834 32265 raft_consensus.cc:359] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.569746 32142 raft_consensus.cc:2468] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:11.569756 32265 raft_consensus.cc:385] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.570611 32265 raft_consensus.cc:740] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.571272 32265 consensus_queue.cc:260] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.571949 32514 raft_consensus.cc:493] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.572863 32514 raft_consensus.cc:515] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.577031 32514 leader_election.cc:290] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:11.577244 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80df47302fb41ccae5b05949d696d98" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:11.577607 32265 ts_tablet_manager.cc:1434] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:23:11.579092 32034 leader_election.cc:304] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:11.580785 32265 tablet_bootstrap.cc:492] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
W20260709 12:23:11.581751 32107 leader_election.cc:343] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.580948 32340 raft_consensus.cc:2804] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.582764 32340 raft_consensus.cc:493] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.582617 32269 consensus_queue.cc:260] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.583132 32340 raft_consensus.cc:3060] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.584820 32269 ts_tablet_manager.cc:1434] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.003s
I20260709 12:23:11.585924 32269 tablet_bootstrap.cc:492] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:11.593813 32264 ts_tablet_manager.cc:1434] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 12:23:11.594576 32265 tablet_bootstrap.cc:654] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.601554 32264 tablet_bootstrap.cc:492] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:11.605506 32610 raft_consensus.cc:493] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.606247 32610 raft_consensus.cc:515] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:11.610952 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12128bac871f458ea02ff3b811378a98" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:11.585268 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80df47302fb41ccae5b05949d696d98" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:11.617460 31889 catalog_manager.cc:5697] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.618670 32517 raft_consensus.cc:493] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.622707 32517 raft_consensus.cc:515] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.624833 32517 leader_election.cc:290] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
W20260709 12:23:11.618073 31959 leader_election.cc:343] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:11.631711 32110 leader_election.cc:343] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.632296 32110 leader_election.cc:304] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372
I20260709 12:23:11.633405 32610 leader_election.cc:290] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:11.633644 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:11.635357 31992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:11.639149 32269 tablet_bootstrap.cc:654] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:11.642117 32184 leader_election.cc:343] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.644380 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12128bac871f458ea02ff3b811378a98" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
W20260709 12:23:11.645179 32182 leader_election.cc:343] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.645637 32182 leader_election.cc:304] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:11.647017 32569 raft_consensus.cc:2749] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.647809 32340 raft_consensus.cc:515] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
W20260709 12:23:11.648864 31958 leader_election.cc:343] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.649369 31958 leader_election.cc:304] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:11.650192 32506 raft_consensus.cc:2749] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.653759 32340 leader_election.cc:290] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:11.654724 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c7b8290b2a448cb9acb35da128eb8e" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
W20260709 12:23:11.655973 32033 leader_election.cc:343] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.656047 32264 tablet_bootstrap.cc:654] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.656487 32263 tablet_bootstrap.cc:492] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:11.656988 32263 ts_tablet_manager.cc:1403] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.253s	user 0.047s	sys 0.081s
I20260709 12:23:11.656059 32610 raft_consensus.cc:2749] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.659224 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c7b8290b2a448cb9acb35da128eb8e" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:11.659904 32142 raft_consensus.cc:3060] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.659713 32263 raft_consensus.cc:359] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.660455 32263 raft_consensus.cc:385] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.660737 32263 raft_consensus.cc:740] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.662283 32263 consensus_queue.cc:260] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.665679 32263 ts_tablet_manager.cc:1434] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:23:11.663213 32140 raft_consensus.cc:2468] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:11.689520 32506 consensus_queue.cc:1048] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.696576 31959 leader_election.cc:304] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:11.708688 32142 raft_consensus.cc:2468] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:11.709961 32034 leader_election.cc:304] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:11.713778 32263 tablet_bootstrap.cc:492] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:11.716807 32286 consensus_queue.cc:1048] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.718346 32340 raft_consensus.cc:2804] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.718885 32340 raft_consensus.cc:697] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:11.719713 32340 consensus_queue.cc:237] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.721138 32263 tablet_bootstrap.cc:654] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.725179 32286 raft_consensus.cc:493] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.709896 32388 raft_consensus.cc:2804] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.725665 32286 raft_consensus.cc:515] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.727533 32286 leader_election.cc:290] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:11.728689 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb989fb1126c4cc18ed28296301844a2" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
W20260709 12:23:11.730141 31958 leader_election.cc:343] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.725874 32388 raft_consensus.cc:697] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:11.733788 32388 consensus_queue.cc:237] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.735033 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb989fb1126c4cc18ed28296301844a2" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
W20260709 12:23:11.738575 31961 leader_election.cc:343] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.739009 31961 leader_election.cc:304] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372
I20260709 12:23:11.745318 32286 raft_consensus.cc:2749] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.755268 32286 raft_consensus.cc:493] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.755713 32286 raft_consensus.cc:515] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.757633 32286 leader_election.cc:290] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:11.759362 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398afdbb52444496b0a87720c22f44a4" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:11.760031 32142 raft_consensus.cc:2468] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:11.761749 31959 leader_election.cc:304] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:11.764997 32286 raft_consensus.cc:2804] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.765467 32286 raft_consensus.cc:493] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.765830 32286 raft_consensus.cc:3060] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.785349 32269 tablet_bootstrap.cc:492] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:11.786036 32269 ts_tablet_manager.cc:1403] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.200s	user 0.016s	sys 0.015s
W20260709 12:23:11.787170 31940 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:11.806957 32070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398afdbb52444496b0a87720c22f44a4" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:11.808311 32264 tablet_bootstrap.cc:492] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:11.808954 32264 ts_tablet_manager.cc:1403] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.208s	user 0.024s	sys 0.013s
I20260709 12:23:11.812506 32286 raft_consensus.cc:515] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.814128 32617 raft_consensus.cc:493] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.827972 32517 raft_consensus.cc:493] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.836167 32517 raft_consensus.cc:515] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.836972 32481 raft_consensus.cc:493] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.837488 32481 raft_consensus.cc:515] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:11.838845 32265 tablet_bootstrap.cc:492] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:11.839371 32265 ts_tablet_manager.cc:1403] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.259s	user 0.013s	sys 0.011s
I20260709 12:23:11.848277 32269 raft_consensus.cc:359] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.849078 32269 raft_consensus.cc:385] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.827678 32573 raft_consensus.cc:493] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.851681 32286 leader_election.cc:290] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:11.849360 32269 raft_consensus.cc:740] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
W20260709 12:23:11.853109 31961 leader_election.cc:343] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.853938 32269 consensus_queue.cc:260] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.856217 32269 ts_tablet_manager.cc:1434] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 12:23:11.856314 32517 leader_election.cc:290] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:11.857267 32269 tablet_bootstrap.cc:492] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:11.829663 32617 raft_consensus.cc:515] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.859122 32617 leader_election.cc:290] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:11.860149 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc23d93569d44dd8a4bafcb504fc056a" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:11.860816 32218 raft_consensus.cc:2468] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:11.866248 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc23d93569d44dd8a4bafcb504fc056a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:11.867081 32069 raft_consensus.cc:2468] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
I20260709 12:23:11.868861 32184 leader_election.cc:304] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:11.874109 32569 raft_consensus.cc:2804] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.874532 32569 raft_consensus.cc:493] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.876727 32569 raft_consensus.cc:3060] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.882416 32265 raft_consensus.cc:359] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.883176 32265 raft_consensus.cc:385] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.883474 32265 raft_consensus.cc:740] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.885509 32263 tablet_bootstrap.cc:492] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:11.886672 32066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398afdbb52444496b0a87720c22f44a4" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:11.889694 32263 ts_tablet_manager.cc:1403] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.196s	user 0.013s	sys 0.015s
I20260709 12:23:11.863524 32573 raft_consensus.cc:515] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.896706 32264 raft_consensus.cc:359] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.899263 32264 raft_consensus.cc:385] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.899724 32264 raft_consensus.cc:740] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.900596 32264 consensus_queue.cc:260] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:11.906430 32264 ts_tablet_manager.cc:1434] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.003s
I20260709 12:23:11.907810 32264 tablet_bootstrap.cc:492] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:11.908538 32269 tablet_bootstrap.cc:654] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.900564 32481 leader_election.cc:290] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:11.923504 32569 raft_consensus.cc:515] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.899792 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc23d93569d44dd8a4bafcb504fc056a" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:11.926190 31993 raft_consensus.cc:2468] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:11.927428 32141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccc89be17b447c0bc6982d607a2983a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:11.929098 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398afdbb52444496b0a87720c22f44a4" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:11.920902 32573 leader_election.cc:290] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:11.898540 32033 leader_election.cc:304] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:11.930008 32142 raft_consensus.cc:3060] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.923561 32263 raft_consensus.cc:359] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.934273 32263 raft_consensus.cc:385] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.934588 32263 raft_consensus.cc:740] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.935317 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccc89be17b447c0bc6982d607a2983a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:11.937314 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc23d93569d44dd8a4bafcb504fc056a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
W20260709 12:23:11.937955 32033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:46375, user_credentials={real_user=slave}} blocked reactor thread for 45932.2us
I20260709 12:23:11.940133 32263 consensus_queue.cc:260] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:11.933324 32569 leader_election.cc:290] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
W20260709 12:23:11.943087 31958 leader_election.cc:343] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.943324 32263 ts_tablet_manager.cc:1434] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 12:23:11.943272 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38d8cb74c1344a180ca94cfd755e103" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:11.937973 32068 raft_consensus.cc:3060] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.944604 32264 tablet_bootstrap.cc:654] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.945122 32263 tablet_bootstrap.cc:492] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:11.947829 31992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc23d93569d44dd8a4bafcb504fc056a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:11.948534 31992 raft_consensus.cc:2468] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
I20260709 12:23:11.951473 32263 tablet_bootstrap.cc:654] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:11.951642 32033 leader_election.cc:343] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:11.959095 32110 consensus_peers.cc:597] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.977860 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc23d93569d44dd8a4bafcb504fc056a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:11.978997 31995 raft_consensus.cc:3060] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.982045 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38d8cb74c1344a180ca94cfd755e103" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:11.982748 32144 raft_consensus.cc:2468] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:11.987859 32569 raft_consensus.cc:493] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.988602 32569 raft_consensus.cc:515] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:11.991892 32569 leader_election.cc:290] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
W20260709 12:23:11.992964 32034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.193:41023, user_credentials={real_user=slave}} blocked reactor thread for 63214.4us
I20260709 12:23:11.994378 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c7b8290b2a448cb9acb35da128eb8e" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:11.994658 32068 raft_consensus.cc:2468] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:11.995211 32573 raft_consensus.cc:2764] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:23:11.997539 32034 leader_election.cc:304] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:12.004840 32617 raft_consensus.cc:2804] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.005249 32617 raft_consensus.cc:493] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.005581 32617 raft_consensus.cc:3060] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:12.005811 31961 leader_election.cc:343] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.987193 32265 consensus_queue.cc:260] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:12.010747 32066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c7b8290b2a448cb9acb35da128eb8e" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:12.012787 32265 ts_tablet_manager.cc:1434] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.173s	user 0.010s	sys 0.001s
I20260709 12:23:12.015389 32184 leader_election.cc:304] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:12.016536 32517 raft_consensus.cc:2804] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.017248 32517 raft_consensus.cc:697] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:12.018675 32517 consensus_queue.cc:237] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.022275 31890 catalog_manager.cc:5697] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:12.023967 31959 leader_election.cc:343] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.024554 31959 leader_election.cc:304] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:12.026332 32647 raft_consensus.cc:2749] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.028955 32286 consensus_queue.cc:1048] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.001616 32142 raft_consensus.cc:2468] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:11.995314 32144 raft_consensus.cc:2393] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68991541d4134b4f89800c972fdad372 in current term 1: Already voted for candidate 13d67625d82d4304a0ebff87742a538d in this term.
I20260709 12:23:12.024019 31891 catalog_manager.cc:5697] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 1 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.038194 32617 raft_consensus.cc:515] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:12.038663 32184 leader_election.cc:304] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:12.041080 32401 raft_consensus.cc:3060] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.041189 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38d8cb74c1344a180ca94cfd755e103" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:12.041857 32142 raft_consensus.cc:3060] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.051590 32617 leader_election.cc:290] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:12.052017 32142 raft_consensus.cc:2468] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:12.053141 32034 leader_election.cc:304] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:12.053659 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38d8cb74c1344a180ca94cfd755e103" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
W20260709 12:23:12.055138 32033 leader_election.cc:343] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.055570 32617 raft_consensus.cc:2804] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.056627 32617 raft_consensus.cc:697] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:12.057168 32401 raft_consensus.cc:2749] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.057555 32617 consensus_queue.cc:237] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:12.063855 32506 raft_consensus.cc:493] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.090790 32506 raft_consensus.cc:515] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:12.093974 32506 leader_election.cc:290] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:12.095603 32065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
W20260709 12:23:12.098212 32110 leader_election.cc:343] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.093170 31890 catalog_manager.cc:5697] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.104369 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:12.105718 32108 leader_election.cc:343] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.108736 32108 leader_election.cc:304] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:12.065682 32265 tablet_bootstrap.cc:492] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:12.071120 31959 leader_election.cc:304] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:12.075766 32411 consensus_queue.cc:1048] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:12.116564 31959 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 45758.4us
I20260709 12:23:12.080819 32264 tablet_bootstrap.cc:492] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
W20260709 12:23:12.082716 31958 consensus_peers.cc:597] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 -> Peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Couldn't send request to peer 68991541d4134b4f89800c972fdad372. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:12.083479 32269 tablet_bootstrap.cc:492] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:12.120014 32269 ts_tablet_manager.cc:1403] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.263s	user 0.013s	sys 0.000s
I20260709 12:23:12.122620 32264 ts_tablet_manager.cc:1403] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.215s	user 0.027s	sys 0.013s
I20260709 12:23:12.122960 32269 raft_consensus.cc:359] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:12.123780 32269 raft_consensus.cc:385] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.124074 32269 raft_consensus.cc:740] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.111562 32506 raft_consensus.cc:2749] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.119254 32649 raft_consensus.cc:2804] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.128024 32269 consensus_queue.cc:260] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:12.129701 32649 raft_consensus.cc:697] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:12.131397 32269 ts_tablet_manager.cc:1434] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:12.130651 32649 consensus_queue.cc:237] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:12.135866 32263 tablet_bootstrap.cc:492] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:12.136384 32263 ts_tablet_manager.cc:1403] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.191s	user 0.030s	sys 0.069s
I20260709 12:23:12.135658 31892 catalog_manager.cc:5697] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 1 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.139928 32269 tablet_bootstrap.cc:492] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:12.087370 31995 raft_consensus.cc:2468] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:12.128615 32264 raft_consensus.cc:359] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.143224 32264 raft_consensus.cc:385] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.143579 32264 raft_consensus.cc:740] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.144281 32264 consensus_queue.cc:260] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.145965 32265 tablet_bootstrap.cc:654] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.144399 32263 raft_consensus.cc:359] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.147468 32263 raft_consensus.cc:385] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.147825 32263 raft_consensus.cc:740] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.148737 32269 tablet_bootstrap.cc:654] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.151208 32263 consensus_queue.cc:260] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.147094 32264 ts_tablet_manager.cc:1434] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:23:12.165417 32269 tablet_bootstrap.cc:492] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:12.168308 32286 raft_consensus.cc:493] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.170495 32269 ts_tablet_manager.cc:1403] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.007s
I20260709 12:23:12.170574 32286 raft_consensus.cc:515] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.172600 32286 leader_election.cc:290] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:12.173419 32269 raft_consensus.cc:359] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.174216 32269 raft_consensus.cc:385] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.174484 32269 raft_consensus.cc:740] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.174382 32066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
W20260709 12:23:12.176272 31961 leader_election.cc:343] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.176452 32264 tablet_bootstrap.cc:492] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:12.177675 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:12.178418 32218 raft_consensus.cc:2468] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:12.179103 32263 ts_tablet_manager.cc:1434] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:23:12.180127 32263 tablet_bootstrap.cc:492] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:12.181236 31958 leader_election.cc:304] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:12.182900 32286 raft_consensus.cc:2804] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.183182 32066 raft_consensus.cc:3060] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.183398 32286 raft_consensus.cc:493] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.183782 32286 raft_consensus.cc:3060] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.186244 32269 consensus_queue.cc:260] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.188951 32269 ts_tablet_manager.cc:1434] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:23:12.190043 32269 tablet_bootstrap.cc:492] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:12.190255 32617 consensus_queue.cc:1048] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.191474 32264 tablet_bootstrap.cc:654] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.189671 31890 catalog_manager.cc:5697] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.196847 32263 tablet_bootstrap.cc:654] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.196847 32269 tablet_bootstrap.cc:654] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.204610 32649 consensus_queue.cc:1048] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.208824 32517 raft_consensus.cc:493] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.209417 32517 raft_consensus.cc:515] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:12.212267 32265 tablet_bootstrap.cc:492] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:12.212780 32517 leader_election.cc:290] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:12.212821 32265 ts_tablet_manager.cc:1403] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.199s	user 0.014s	sys 0.011s
I20260709 12:23:12.215396 32649 consensus_queue.cc:1048] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.216374 32265 raft_consensus.cc:359] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:12.221331 32265 raft_consensus.cc:385] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.232792 32265 raft_consensus.cc:740] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.222723 32065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:12.225005 32140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:12.232098 32617 consensus_queue.cc:1048] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:12.236147 32182 leader_election.cc:304] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:12.237504 32401 raft_consensus.cc:2749] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:12.233736 32265 consensus_queue.cc:260] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:12.244455 32265 ts_tablet_manager.cc:1434] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 12:23:12.261418 32265 tablet_bootstrap.cc:492] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:12.247795 32286 raft_consensus.cc:515] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.248152 32269 tablet_bootstrap.cc:492] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196: No bootstrap required, opened a new log
I20260709 12:23:12.269866 32269 ts_tablet_manager.cc:1403] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.004s
I20260709 12:23:12.245260 32263 tablet_bootstrap.cc:492] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:12.274621 32263 ts_tablet_manager.cc:1403] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.004s
I20260709 12:23:12.275679 32265 tablet_bootstrap.cc:654] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.263012 32264 tablet_bootstrap.cc:492] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:12.282950 32264 ts_tablet_manager.cc:1403] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.107s	user 0.033s	sys 0.024s
I20260709 12:23:12.284251 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:12.284880 32217 raft_consensus.cc:3060] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.273890 32269 raft_consensus.cc:359] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.287729 32269 raft_consensus.cc:385] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.287993 32269 raft_consensus.cc:740] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.280457 32263 raft_consensus.cc:359] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.288848 32263 raft_consensus.cc:385] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.289146 32263 raft_consensus.cc:740] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.289947 32269 consensus_queue.cc:260] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.291090 32263 consensus_queue.cc:260] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.293371 32263 ts_tablet_manager.cc:1434] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:23:12.294521 32263 tablet_bootstrap.cc:492] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:12.294656 32617 raft_consensus.cc:493] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.295202 32617 raft_consensus.cc:515] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:12.296057 32065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
W20260709 12:23:12.297639 31961 leader_election.cc:343] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.293421 32217 raft_consensus.cc:2468] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:12.299722 31958 leader_election.cc:304] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:12.298539 32286 leader_election.cc:290] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:12.301093 32286 raft_consensus.cc:2804] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.305748 32286 raft_consensus.cc:697] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:12.308311 32286 consensus_queue.cc:237] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.310645 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80df47302fb41ccae5b05949d696d98" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:12.311257 32617 leader_election.cc:290] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:12.311406 32143 raft_consensus.cc:2468] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 0.
I20260709 12:23:12.313747 32034 leader_election.cc:304] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:12.314745 32573 raft_consensus.cc:2804] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.285977 32264 raft_consensus.cc:359] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.315130 32573 raft_consensus.cc:493] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.315546 32573 raft_consensus.cc:3060] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.316648 32269 ts_tablet_manager.cc:1434] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:23:12.320026 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80df47302fb41ccae5b05949d696d98" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
W20260709 12:23:12.321810 32033 leader_election.cc:343] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.324430 32265 tablet_bootstrap.cc:492] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:12.325217 32265 ts_tablet_manager.cc:1403] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.008s
I20260709 12:23:12.315413 32264 raft_consensus.cc:385] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.337754 32264 raft_consensus.cc:740] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.338768 32264 consensus_queue.cc:260] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.339854 32517 raft_consensus.cc:493] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.340656 32517 raft_consensus.cc:515] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.339968 32265 raft_consensus.cc:359] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:12.341666 32265 raft_consensus.cc:385] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.341939 32265 raft_consensus.cc:740] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.342316 32647 raft_consensus.cc:493] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.342594 32265 consensus_queue.cc:260] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:12.342996 32517 leader_election.cc:290] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:12.342826 32647 raft_consensus.cc:515] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:12.344388 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb989fb1126c4cc18ed28296301844a2" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:12.344877 32065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb989fb1126c4cc18ed28296301844a2" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:12.345067 31994 raft_consensus.cc:2468] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
I20260709 12:23:12.345481 32647 leader_election.cc:290] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:12.345326 32573 raft_consensus.cc:515] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
W20260709 12:23:12.346181 32184 leader_election.cc:343] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.346705 32182 leader_election.cc:304] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:12.347060 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:12.347905 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
W20260709 12:23:12.348384 31961 leader_election.cc:343] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.348492 32143 raft_consensus.cc:2468] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:12.348784 32517 raft_consensus.cc:2804] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.348448 32264 ts_tablet_manager.cc:1434] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:23:12.349298 32517 raft_consensus.cc:493] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.349889 32517 raft_consensus.cc:3060] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.350332 31959 leader_election.cc:304] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:12.350944 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80df47302fb41ccae5b05949d696d98" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:12.351486 32143 raft_consensus.cc:3060] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.352166 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80df47302fb41ccae5b05949d696d98" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
W20260709 12:23:12.353549 32033 leader_election.cc:343] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.354370 32573 leader_election.cc:290] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:12.358201 32401 raft_consensus.cc:493] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.358531 32143 raft_consensus.cc:2468] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:12.358770 32401 raft_consensus.cc:515] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.360870 32401 leader_election.cc:290] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:12.362200 32649 raft_consensus.cc:2804] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.362658 32649 raft_consensus.cc:493] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.362787 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:12.362546 32034 leader_election.cc:304] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:12.363104 32649 raft_consensus.cc:3060] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.367341 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:12.350505 32264 tablet_bootstrap.cc:492] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2: Bootstrap starting.
I20260709 12:23:12.372840 32263 tablet_bootstrap.cc:654] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.374063 32182 leader_election.cc:304] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:12.374868 32401 raft_consensus.cc:2749] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.388511 32265 ts_tablet_manager.cc:1434] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.054s	user 0.001s	sys 0.006s
I20260709 12:23:12.389672 32265 tablet_bootstrap.cc:492] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:12.382774 32573 raft_consensus.cc:2804] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.395465 32573 raft_consensus.cc:697] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:12.396701 32573 consensus_queue.cc:237] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:12.397970 32264 tablet_bootstrap.cc:654] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.395757 32265 tablet_bootstrap.cc:654] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.401866 32649 raft_consensus.cc:515] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:12.404336 32649 leader_election.cc:290] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:12.395634 31892 catalog_manager.cc:5697] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.411607 32517 raft_consensus.cc:515] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.414175 32066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:12.415001 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb989fb1126c4cc18ed28296301844a2" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
W20260709 12:23:12.415917 31961 leader_election.cc:343] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.417972 31994 raft_consensus.cc:3060] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.424194 32506 raft_consensus.cc:493] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.424777 32506 raft_consensus.cc:515] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.425459 32573 raft_consensus.cc:493] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.426059 32573 raft_consensus.cc:515] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:12.426318 31994 raft_consensus.cc:2468] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:12.426927 32506 leader_election.cc:290] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:12.423547 32517 leader_election.cc:290] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:12.428449 32182 leader_election.cc:304] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:12.430140 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:12.430742 32143 raft_consensus.cc:3060] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.432044 32569 raft_consensus.cc:2804] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.432540 32569 raft_consensus.cc:697] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:12.433365 32569 consensus_queue.cc:237] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.434998 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12128bac871f458ea02ff3b811378a98" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:12.435679 31993 raft_consensus.cc:2468] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:12.436805 32573 leader_election.cc:290] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:12.437625 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edffd8d7fac40d1b74f6a23d3517e8b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:12.438162 32143 raft_consensus.cc:2468] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:12.442142 32401 consensus_queue.cc:1048] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.444154 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12128bac871f458ea02ff3b811378a98" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:12.445091 32068 raft_consensus.cc:3060] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.446122 32265 tablet_bootstrap.cc:492] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:12.447062 32265 ts_tablet_manager.cc:1403] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.003s
W20260709 12:23:12.448436 32107 leader_election.cc:343] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.451539 32265 raft_consensus.cc:359] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.452356 32066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb989fb1126c4cc18ed28296301844a2" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:12.453424 32108 leader_election.cc:304] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:12.454437 32575 raft_consensus.cc:2804] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.454995 31959 leader_election.cc:304] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:12.454988 32575 raft_consensus.cc:493] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.456152 32575 raft_consensus.cc:3060] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:12.458662 32184 leader_election.cc:343] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.461958 32610 raft_consensus.cc:2804] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.462563 32610 raft_consensus.cc:697] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:12.463568 32610 consensus_queue.cc:237] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:12.477615 32263 tablet_bootstrap.cc:492] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:12.478295 32263 ts_tablet_manager.cc:1403] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.184s	user 0.009s	sys 0.007s
I20260709 12:23:12.481153 32263 raft_consensus.cc:359] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:12.481851 32263 raft_consensus.cc:385] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.482959 32263 raft_consensus.cc:740] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.483836 32263 consensus_queue.cc:260] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:12.486385 32263 ts_tablet_manager.cc:1434] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:12.486778 32575 raft_consensus.cc:515] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.487536 32263 tablet_bootstrap.cc:492] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:12.452329 32265 raft_consensus.cc:385] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.490012 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12128bac871f458ea02ff3b811378a98" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
W20260709 12:23:12.492221 32107 leader_election.cc:343] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.493384 32575 leader_election.cc:290] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:12.490440 32143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edffd8d7fac40d1b74f6a23d3517e8b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:12.490337 32265 raft_consensus.cc:740] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.495144 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12128bac871f458ea02ff3b811378a98" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:12.495743 31994 raft_consensus.cc:3060] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.495903 32265 consensus_queue.cc:260] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.496594 32263 tablet_bootstrap.cc:654] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.497465 32617 consensus_queue.cc:1048] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.498324 32265 ts_tablet_manager.cc:1434] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:23:12.500020 32034 leader_election.cc:304] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:12.500803 32265 tablet_bootstrap.cc:492] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:12.504051 32264 tablet_bootstrap.cc:492] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2: No bootstrap required, opened a new log
I20260709 12:23:12.504644 32264 ts_tablet_manager.cc:1403] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2: Time spent bootstrapping tablet: real 0.154s	user 0.017s	sys 0.026s
I20260709 12:23:12.520344 32617 raft_consensus.cc:2749] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.519888 31892 catalog_manager.cc:5697] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.522965 32401 consensus_queue.cc:1048] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.525030 31994 raft_consensus.cc:2468] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:12.528509 32217 raft_consensus.cc:3060] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.529305 32108 leader_election.cc:304] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:12.530150 32514 raft_consensus.cc:2804] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.530647 32514 raft_consensus.cc:697] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:12.531657 32514 consensus_queue.cc:237] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.532208 32577 raft_consensus.cc:493] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.532752 32577 raft_consensus.cc:515] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.536139 31891 catalog_manager.cc:5697] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 1 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.508455 32264 raft_consensus.cc:359] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.539335 32577 leader_election.cc:290] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:12.539613 32264 raft_consensus.cc:385] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.540242 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccc89be17b447c0bc6982d607a2983a" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:12.540766 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccc89be17b447c0bc6982d607a2983a" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:12.541451 32218 raft_consensus.cc:2468] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:12.539925 32264 raft_consensus.cc:740] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.540860 31994 raft_consensus.cc:2468] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 0.
I20260709 12:23:12.542949 32108 leader_election.cc:304] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:12.542425 31890 catalog_manager.cc:5697] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.543906 32577 raft_consensus.cc:2804] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.544353 32577 raft_consensus.cc:493] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.544759 32577 raft_consensus.cc:3060] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:12.550454 31961 consensus_peers.cc:597] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:12.562666 32339 consensus_queue.cc:1048] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.567030 32649 consensus_queue.cc:1048] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.569150 32577 raft_consensus.cc:515] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.551903 32264 consensus_queue.cc:260] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.571976 32649 raft_consensus.cc:493] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.581614 32649 raft_consensus.cc:515] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.583969 32649 leader_election.cc:290] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:12.587025 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:12.587743 32142 raft_consensus.cc:2468] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 0.
I20260709 12:23:12.587248 32264 ts_tablet_manager.cc:1434] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.004s
I20260709 12:23:12.578318 32263 tablet_bootstrap.cc:492] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:12.590184 32577 leader_election.cc:290] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:12.590672 32263 ts_tablet_manager.cc:1403] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.003s
I20260709 12:23:12.590731 32577 raft_consensus.cc:493] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 68991541d4134b4f89800c972fdad372)
I20260709 12:23:12.591914 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccc89be17b447c0bc6982d607a2983a" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:12.592540 31993 raft_consensus.cc:3060] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.593466 32263 raft_consensus.cc:359] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.593796 31959 leader_election.cc:304] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:12.595468 32649 raft_consensus.cc:2804] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.595933 32649 raft_consensus.cc:493] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.596333 32649 raft_consensus.cc:3060] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.605566 31993 raft_consensus.cc:2468] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:12.594234 32263 raft_consensus.cc:385] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.606740 32263 raft_consensus.cc:740] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.606354 32265 tablet_bootstrap.cc:654] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.591281 32577 raft_consensus.cc:515] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:12.606925 32108 leader_election.cc:304] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:12.608078 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccc89be17b447c0bc6982d607a2983a" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:12.607591 32263 consensus_queue.cc:260] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.617098 32575 raft_consensus.cc:2804] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.617908 32575 raft_consensus.cc:697] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:12.618638 32577 leader_election.cc:290] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:12.618767 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:12.619696 32068 raft_consensus.cc:2393] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5524748d37141a1bca7d0cedaeb40f2 in current term 2: Already voted for candidate 13d67625d82d4304a0ebff87742a538d in this term.
I20260709 12:23:12.622087 32575 consensus_queue.cc:237] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.610195 32610 raft_consensus.cc:493] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.625000 32610 raft_consensus.cc:515] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.626765 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:12.627415 32216 raft_consensus.cc:2468] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
I20260709 12:23:12.628573 32107 leader_election.cc:304] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:12.629702 32411 raft_consensus.cc:2804] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:12.630128 32411 raft_consensus.cc:493] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 68991541d4134b4f89800c972fdad372)
I20260709 12:23:12.630455 32411 raft_consensus.cc:3060] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.638588 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
W20260709 12:23:12.644771 31958 leader_election.cc:343] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.645512 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a7ca73ef254c8b9bbe684f81fa6af8" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:12.648264 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a7ca73ef254c8b9bbe684f81fa6af8" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:12.625560 31890 catalog_manager.cc:5697] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:12.649981 31961 leader_election.cc:343] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.617158 32218 raft_consensus.cc:3060] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.652757 32649 raft_consensus.cc:515] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.653548 32610 leader_election.cc:290] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:12.653239 32411 raft_consensus.cc:515] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:12.661638 32263 ts_tablet_manager.cc:1434] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 12:23:12.661942 32140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:12.662973 32263 tablet_bootstrap.cc:492] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
I20260709 12:23:12.663519 32140 raft_consensus.cc:3060] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:12.667567 32034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:41023, user_credentials={real_user=slave}} blocked reactor thread for 94462.1us
I20260709 12:23:12.728003 32411 leader_election.cc:290] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:12.730227 32218 raft_consensus.cc:2468] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:12.730847 32265 tablet_bootstrap.cc:492] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:12.731369 32265 ts_tablet_manager.cc:1403] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.232s	user 0.013s	sys 0.005s
I20260709 12:23:12.731575 32263 tablet_bootstrap.cc:654] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:12.734599 31958 leader_election.cc:343] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.735265 31958 leader_election.cc:304] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372
I20260709 12:23:12.751062 32218 raft_consensus.cc:3060] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.755971 32649 leader_election.cc:290] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:12.758479 32215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:12.758664 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:12.751168 32140 raft_consensus.cc:2468] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 1.
I20260709 12:23:12.746058 32481 raft_consensus.cc:2749] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.767489 32265 raft_consensus.cc:359] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.768319 32265 raft_consensus.cc:385] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.768625 32265 raft_consensus.cc:740] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.769356 32265 consensus_queue.cc:260] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.776103 32068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
W20260709 12:23:12.780207 31958 leader_election.cc:343] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.799047 31959 leader_election.cc:304] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 68991541d4134b4f89800c972fdad372
I20260709 12:23:12.805400 32265 ts_tablet_manager.cc:1434] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:23:12.806686 32265 tablet_bootstrap.cc:492] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:12.807561 32569 raft_consensus.cc:493] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.808113 32569 raft_consensus.cc:515] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.795965 31892 catalog_manager.cc:5697] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.813457 32068 raft_consensus.cc:2393] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c5524748d37141a1bca7d0cedaeb40f2 in current term 2: Already voted for candidate 13d67625d82d4304a0ebff87742a538d in this term.
I20260709 12:23:12.812160 32649 raft_consensus.cc:2804] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.825201 32215 raft_consensus.cc:2468] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
I20260709 12:23:12.831051 32569 leader_election.cc:290] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
W20260709 12:23:12.836690 32184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:33135, user_credentials={real_user=slave}} blocked reactor thread for 49205.8us
I20260709 12:23:12.837375 32142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12128bac871f458ea02ff3b811378a98" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:12.833953 32649 raft_consensus.cc:697] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:12.846757 32263 tablet_bootstrap.cc:492] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:12.847362 32263 ts_tablet_manager.cc:1403] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.185s	user 0.034s	sys 0.046s
I20260709 12:23:12.836683 32107 leader_election.cc:304] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:12.854583 32506 raft_consensus.cc:2804] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:12.855172 32506 raft_consensus.cc:697] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:12.856030 32506 consensus_queue.cc:237] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:12.868594 32647 consensus_queue.cc:1048] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:12.845647 32340 consensus_queue.cc:1048] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:23:12.858438 32649 consensus_queue.cc:237] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:12.888738 32263 raft_consensus.cc:359] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:12.889472 32263 raft_consensus.cc:385] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.889762 32263 raft_consensus.cc:740] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.890450 32263 consensus_queue.cc:260] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
W20260709 12:23:12.890697 32110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:33135, user_credentials={real_user=slave}} blocked reactor thread for 55697us
I20260709 12:23:12.914891 32617 raft_consensus.cc:493] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.915792 32617 raft_consensus.cc:515] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
W20260709 12:23:12.920403 32687 log.cc:927] Time spent T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372: Append to log took a long time: real 0.118s	user 0.003s	sys 0.000s
I20260709 12:23:12.921469 32140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:12.941310 32263 ts_tablet_manager.cc:1434] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.000s
I20260709 12:23:12.949707 32263 tablet_bootstrap.cc:492] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
W20260709 12:23:12.963771 31940 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:23:12.973450 32033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:46375, user_credentials={real_user=slave}} blocked reactor thread for 108616us
W20260709 12:23:12.989742 32108 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:41023, user_credentials={real_user=slave}} blocked reactor thread for 63932.3us
I20260709 12:23:12.950714 32617 leader_election.cc:290] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:13.012916 32617 raft_consensus.cc:493] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.013446 32617 raft_consensus.cc:515] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:13.015708 32617 leader_election.cc:290] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:13.041188 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:13.042266 32216 raft_consensus.cc:2468] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 2.
I20260709 12:23:13.045536 32265 tablet_bootstrap.cc:654] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.050259 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12128bac871f458ea02ff3b811378a98" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:13.052667 31994 raft_consensus.cc:2393] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68991541d4134b4f89800c972fdad372 in current term 1: Already voted for candidate c5524748d37141a1bca7d0cedaeb40f2 in this term.
I20260709 12:23:13.058220 31995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:13.073869 32701 consensus_queue.cc:1048] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.083839 32708 raft_consensus.cc:493] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:13.045936 31959 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 96151.7us
W20260709 12:23:13.096177 31961 consensus_peers.cc:597] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:13.084496 32708 raft_consensus.cc:515] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:13.115027 32182 leader_election.cc:304] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:13.138808 32033 leader_election.cc:304] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: c5524748d37141a1bca7d0cedaeb40f2
W20260709 12:23:13.140326 32033 consensus_peers.cc:597] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d -> Peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Couldn't send request to peer 68991541d4134b4f89800c972fdad372. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:13.141357 32647 consensus_queue.cc:1048] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.142854 32700 raft_consensus.cc:2804] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:13.143352 32700 raft_consensus.cc:493] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.143714 32700 raft_consensus.cc:3060] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:13.143814 32214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:13.124650 32712 raft_consensus.cc:3060] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.155247 32063 raft_consensus.cc:3060] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.163359 32263 tablet_bootstrap.cc:654] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:13.180253 32711 log.cc:927] Time spent T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:23:13.201113 32070 raft_consensus.cc:3060] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.227934 32401 raft_consensus.cc:493] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.220073 31889 catalog_manager.cc:5697] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.228596 32401 raft_consensus.cc:515] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:13.277423 32700 raft_consensus.cc:515] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
W20260709 12:23:13.316723 32715 log.cc:927] Time spent T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:23:13.309229 32514 consensus_queue.cc:1048] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:23:13.320449 32708 leader_election.cc:290] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:13.321985 32401 leader_election.cc:290] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:13.337260 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb989fb1126c4cc18ed28296301844a2" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:13.338020 32263 tablet_bootstrap.cc:492] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:13.338240 31993 raft_consensus.cc:2393] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13d67625d82d4304a0ebff87742a538d in current term 1: Already voted for candidate 68991541d4134b4f89800c972fdad372 in this term.
I20260709 12:23:13.338603 32263 ts_tablet_manager.cc:1403] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.389s	user 0.023s	sys 0.017s
I20260709 12:23:13.339735 32061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a7ca73ef254c8b9bbe684f81fa6af8" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:13.341073 32401 consensus_queue.cc:1048] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:13.345760 32184 leader_election.cc:343] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.341547 32263 raft_consensus.cc:359] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:13.346918 32263 raft_consensus.cc:385] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.347244 32263 raft_consensus.cc:740] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.341849 32712 raft_consensus.cc:2749] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.359551 32263 consensus_queue.cc:260] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:13.371454 32693 consensus_queue.cc:1048] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 12:23:13.382859 32720 log.cc:927] Time spent T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2: Append to log took a long time: real 0.071s	user 0.004s	sys 0.000s
I20260709 12:23:13.379590 32700 leader_election.cc:290] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 3 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:13.419940 32265 tablet_bootstrap.cc:492] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:13.420503 32265 ts_tablet_manager.cc:1403] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.614s	user 0.008s	sys 0.015s
I20260709 12:23:13.423579 32265 raft_consensus.cc:359] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:13.424330 32265 raft_consensus.cc:385] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.424641 32265 raft_consensus.cc:740] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.425256 32411 consensus_queue.cc:1048] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.425513 32577 consensus_queue.cc:1048] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.426239 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a7ca73ef254c8b9bbe684f81fa6af8" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:13.426541 32140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:13.426982 31993 raft_consensus.cc:2468] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 0.
I20260709 12:23:13.358342 32033 leader_election.cc:304] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:13.430977 32263 ts_tablet_manager.cc:1434] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.001s
I20260709 12:23:13.432090 32263 tablet_bootstrap.cc:492] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372: Bootstrap starting.
W20260709 12:23:13.431981 32033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:46375, user_credentials={real_user=slave}} blocked reactor thread for 81528.6us
I20260709 12:23:13.433545 32694 raft_consensus.cc:2749] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.436157 32481 consensus_queue.cc:1048] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.436003 32182 leader_election.cc:304] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:13.440549 32688 raft_consensus.cc:2804] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.441021 32688 raft_consensus.cc:493] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.441385 32688 raft_consensus.cc:3060] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.425400 32265 consensus_queue.cc:260] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:13.448837 32265 ts_tablet_manager.cc:1434] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:23:13.451980 32214 raft_consensus.cc:1275] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:13.452284 32217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88877f73a5e94a759151a9e87e1f9c6b" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:13.452931 32217 raft_consensus.cc:3060] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:13.454720 32213 raft_consensus.cc:3060] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.463198 32265 tablet_bootstrap.cc:492] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:13.472282 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb989fb1126c4cc18ed28296301844a2" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:13.472633 32217 raft_consensus.cc:2468] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 3.
I20260709 12:23:13.482414 32033 leader_election.cc:304] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:13.479533 31890 catalog_manager.cc:5697] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 1 to 2, leader changed from 68991541d4134b4f89800c972fdad372 (127.23.81.196) to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.486788 32694 raft_consensus.cc:2804] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:13.490756 32694 raft_consensus.cc:697] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 3 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:13.492075 32577 consensus_queue.cc:1048] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:13.491616 32694 consensus_queue.cc:237] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:13.500115 32216 raft_consensus.cc:1240] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Rejecting Update request from peer c5524748d37141a1bca7d0cedaeb40f2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:13.515836 32263 tablet_bootstrap.cc:654] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.500941 32033 leader_election.cc:304] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:13.525792 32701 consensus_queue.cc:1059] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:23:13.529534 32575 raft_consensus.cc:3055] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:13.529927 32575 raft_consensus.cc:740] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:13.530756 32575 consensus_queue.cc:260] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:13.531965 32575 raft_consensus.cc:3060] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:13.537372 32708 raft_consensus.cc:2749] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:13.541496 31958 consensus_peers.cc:597] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 -> Peer 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375): Couldn't send request to peer 68991541d4134b4f89800c972fdad372. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:13.541664 32481 consensus_queue.cc:1048] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.548115 32265 tablet_bootstrap.cc:654] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.542484 32688 raft_consensus.cc:515] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:13.595672 31994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a7ca73ef254c8b9bbe684f81fa6af8" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:13.596318 31994 raft_consensus.cc:3060] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.611884 31994 raft_consensus.cc:2468] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:13.615332 32182 leader_election.cc:304] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:13.617775 32692 raft_consensus.cc:2804] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.618592 32692 raft_consensus.cc:697] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:13.624166 32688 leader_election.cc:290] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
W20260709 12:23:13.627368 32727 log.cc:927] Time spent T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 12:23:13.653273 32728 log.cc:927] Time spent T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260709 12:23:13.631909 32263 tablet_bootstrap.cc:492] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372: No bootstrap required, opened a new log
I20260709 12:23:13.654342 32263 ts_tablet_manager.cc:1403] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372: Time spent bootstrapping tablet: real 0.222s	user 0.024s	sys 0.009s
I20260709 12:23:13.657061 32263 raft_consensus.cc:359] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:13.631734 32065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a7ca73ef254c8b9bbe684f81fa6af8" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
W20260709 12:23:13.643766 32726 log.cc:927] Time spent T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Append to log took a long time: real 0.082s	user 0.004s	sys 0.000s
W20260709 12:23:13.666290 32184 leader_election.cc:343] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.657761 32263 raft_consensus.cc:385] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.667856 32692 consensus_queue.cc:237] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:13.668267 32263 raft_consensus.cc:740] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.677983 32263 consensus_queue.cc:260] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:13.678867 32694 raft_consensus.cc:493] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.679452 32694 raft_consensus.cc:515] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:13.681517 32694 leader_election.cc:290] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:13.682152 32263 ts_tablet_manager.cc:1434] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:23:13.688117 32140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398afdbb52444496b0a87720c22f44a4" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:13.689884 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398afdbb52444496b0a87720c22f44a4" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:13.694325 32265 tablet_bootstrap.cc:492] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:13.694866 32265 ts_tablet_manager.cc:1403] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.232s	user 0.016s	sys 0.017s
I20260709 12:23:13.697460 32034 leader_election.cc:304] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:13.699779 32700 raft_consensus.cc:2749] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.707274 32265 raft_consensus.cc:359] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:13.708002 32265 raft_consensus.cc:385] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.708271 32265 raft_consensus.cc:740] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.708809 32067 raft_consensus.cc:3060] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.720723 32265 consensus_queue.cc:260] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:13.728066 32265 ts_tablet_manager.cc:1434] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:23:13.729483 32265 tablet_bootstrap.cc:492] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d: Bootstrap starting.
I20260709 12:23:13.738315 32265 tablet_bootstrap.cc:654] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.740037 31892 catalog_manager.cc:5697] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 2 to 3, leader changed from c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195) to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 3 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.774689 31888 catalog_manager.cc:5697] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 1 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.776302 32265 tablet_bootstrap.cc:492] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d: No bootstrap required, opened a new log
I20260709 12:23:13.776871 32265 ts_tablet_manager.cc:1403] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.026s
I20260709 12:23:13.779657 32265 raft_consensus.cc:359] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:13.780306 32265 raft_consensus.cc:385] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.780584 32265 raft_consensus.cc:740] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.781293 32265 consensus_queue.cc:260] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:13.787854 32265 ts_tablet_manager.cc:1434] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:23:13.800283 32700 raft_consensus.cc:493] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.800825 32700 raft_consensus.cc:515] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:13.803074 32700 leader_election.cc:290] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:13.805279 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a7ca73ef254c8b9bbe684f81fa6af8" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:13.806268 31993 raft_consensus.cc:2393] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13d67625d82d4304a0ebff87742a538d in current term 1: Already voted for candidate 68991541d4134b4f89800c972fdad372 in this term.
I20260709 12:23:13.808089 32214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a7ca73ef254c8b9bbe684f81fa6af8" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:13.809633 32033 leader_election.cc:304] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:13.810385 32694 raft_consensus.cc:3060] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.815948 32694 raft_consensus.cc:2749] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.969702 32137 raft_consensus.cc:1275] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 3 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:23:13.970160 32137 pending_rounds.cc:85] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2: Aborting all ops after (but not including) 1
I20260709 12:23:13.970425 32137 pending_rounds.cc:107] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:23:13.970729 32137 raft_consensus.cc:2889] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:13.972115 32573 consensus_queue.cc:1048] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:13.993808 32573 raft_consensus.cc:493] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.995244 32573 raft_consensus.cc:515] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:13.999639 32573 leader_election.cc:290] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:14.003811 32214 raft_consensus.cc:1275] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:14.008275 32573 consensus_queue.cc:1048] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.011637 31993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:14.014753 32140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:14.019081 32065 raft_consensus.cc:3060] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.033782 32034 leader_election.cc:304] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:14.054469 32700 raft_consensus.cc:2749] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:14.086488 32692 consensus_queue.cc:1048] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:14.098063 32688 consensus_queue.cc:1048] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:14.109035 32688 raft_consensus.cc:493] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.109577 32688 raft_consensus.cc:515] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:14.114941 23879 tablet_server.cc:179] TabletServer@127.23.81.193:0 shutting down...
I20260709 12:23:14.119284 32688 leader_election.cc:290] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:14.124020 32137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
W20260709 12:23:14.128000 32182 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 12:23:14.136662 32213 raft_consensus.cc:3060] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:14.142143 32182 leader_election.cc:336] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:14.142669 32182 leader_election.cc:304] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
W20260709 12:23:14.150787 32034 consensus_peers.cc:597] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.152213 32569 raft_consensus.cc:2749] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:14.184015 32034 consensus_peers.cc:597] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:14.189138 32182 consensus_peers.cc:597] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:14.199213 32182 consensus_peers.cc:597] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.199981 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:14.201046 23879 tablet_replica.cc:333] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
W20260709 12:23:14.201297 32108 consensus_peers.cc:597] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.201835 23879 raft_consensus.cc:2243] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.202913 23879 raft_consensus.cc:2272] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.205754 23879 tablet_replica.cc:333] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.206768 23879 raft_consensus.cc:2243] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.207271 23879 raft_consensus.cc:2272] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.210338 23879 tablet_replica.cc:333] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.211258 23879 raft_consensus.cc:2243] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:23:14.211845 32647 consensus_queue.cc:1175] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c5524748d37141a1bca7d0cedaeb40f2" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:23:14.213239 23879 raft_consensus.cc:2272] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.216006 23879 tablet_replica.cc:333] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
W20260709 12:23:14.216627 32182 consensus_peers.cc:597] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.216897 23879 raft_consensus.cc:2243] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.217543 23879 raft_consensus.cc:2272] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.219900 23879 tablet_replica.cc:333] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
W20260709 12:23:14.220600 32034 consensus_peers.cc:597] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.220711 23879 raft_consensus.cc:2243] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.221889 23879 raft_consensus.cc:2272] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.225693 23879 tablet_replica.cc:333] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.227665 23879 raft_consensus.cc:2243] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.228557 23879 raft_consensus.cc:2272] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.230916 23879 tablet_replica.cc:333] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
W20260709 12:23:14.231383 32108 consensus_peers.cc:597] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.231576 23879 raft_consensus.cc:2243] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.232169 23879 raft_consensus.cc:2272] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.234364 23879 tablet_replica.cc:333] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.234987 23879 raft_consensus.cc:2243] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.235777 23879 raft_consensus.cc:2272] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.237623 23879 tablet_replica.cc:333] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.238266 23879 raft_consensus.cc:2243] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.238682 23879 raft_consensus.cc:2272] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.240382 23879 tablet_replica.cc:333] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.240944 23879 raft_consensus.cc:2243] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.241354 23879 raft_consensus.cc:2272] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.244233 23879 tablet_replica.cc:333] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.245031 23879 raft_consensus.cc:2243] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.245482 23879 raft_consensus.cc:2272] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.247624 23879 tablet_replica.cc:333] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.248383 23879 raft_consensus.cc:2243] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.248873 23879 raft_consensus.cc:2272] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:14.249024 32182 consensus_peers.cc:597] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.250805 23879 tablet_replica.cc:333] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.251519 23879 raft_consensus.cc:2243] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.251943 23879 raft_consensus.cc:2272] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.253744 23879 tablet_replica.cc:333] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.254408 23879 raft_consensus.cc:2243] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.254820 23879 raft_consensus.cc:2272] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.256726 23879 tablet_replica.cc:333] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.257447 23879 raft_consensus.cc:2243] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.257911 23879 raft_consensus.cc:2272] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.260061 23879 tablet_replica.cc:333] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
W20260709 12:23:14.260234 32182 consensus_peers.cc:597] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.260612 23879 raft_consensus.cc:2243] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.261157 23879 raft_consensus.cc:2272] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.263432 23879 tablet_replica.cc:333] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.263954 23879 raft_consensus.cc:2243] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.264365 23879 raft_consensus.cc:2272] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.266533 23879 tablet_replica.cc:333] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.267267 23879 raft_consensus.cc:2243] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.267738 23879 raft_consensus.cc:2272] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.270005 23879 tablet_replica.cc:333] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.270619 23879 raft_consensus.cc:2243] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.271116 23879 raft_consensus.cc:2272] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.273752 23879 tablet_replica.cc:333] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.274679 23879 raft_consensus.cc:2243] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.275377 23879 raft_consensus.cc:2272] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:14.276322 32108 consensus_peers.cc:597] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.277693 23879 tablet_replica.cc:333] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.278432 23879 raft_consensus.cc:2243] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.279209 23879 raft_consensus.cc:2272] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.281102 23879 tablet_replica.cc:333] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.281926 23879 raft_consensus.cc:2243] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.282783 23879 raft_consensus.cc:2272] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.285218 23879 tablet_replica.cc:333] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.285980 23879 raft_consensus.cc:2243] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.286998 23879 raft_consensus.cc:2272] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.289716 23879 tablet_replica.cc:333] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.290593 23879 raft_consensus.cc:2243] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.291062 23879 raft_consensus.cc:2272] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.293133 23879 tablet_replica.cc:333] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.293774 23879 raft_consensus.cc:2243] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.294275 23879 raft_consensus.cc:2272] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.296384 23879 tablet_replica.cc:333] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.297122 23879 raft_consensus.cc:2243] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.297982 23879 raft_consensus.cc:2272] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.300120 23879 tablet_replica.cc:333] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.300866 23879 raft_consensus.cc:2243] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.301394 23879 raft_consensus.cc:2272] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.304492 23879 tablet_replica.cc:333] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.305328 23879 raft_consensus.cc:2243] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.305891 23879 raft_consensus.cc:2272] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.308568 23879 tablet_replica.cc:333] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.309342 23879 raft_consensus.cc:2243] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.310417 23879 raft_consensus.cc:2272] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.312615 23879 tablet_replica.cc:333] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.313160 23879 raft_consensus.cc:2243] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.313540 23879 raft_consensus.cc:2272] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.315522 23879 tablet_replica.cc:333] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.316524 23879 raft_consensus.cc:2243] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.317562 23879 raft_consensus.cc:2272] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.320581 23879 tablet_replica.cc:333] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.321399 23879 raft_consensus.cc:2243] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.322516 23879 raft_consensus.cc:2272] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:14.323942 32108 consensus_peers.cc:597] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.325031 23879 tablet_replica.cc:333] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.325917 23879 raft_consensus.cc:2243] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:14.326311 32034 consensus_peers.cc:597] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.326491 23879 raft_consensus.cc:2272] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.329380 23879 tablet_replica.cc:333] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.330176 23879 raft_consensus.cc:2243] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.331077 23879 raft_consensus.cc:2272] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.333786 23879 tablet_replica.cc:333] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.334628 23879 raft_consensus.cc:2243] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.335654 23879 raft_consensus.cc:2272] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.338372 23879 tablet_replica.cc:333] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
W20260709 12:23:14.338644 32108 consensus_peers.cc:597] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.339035 23879 raft_consensus.cc:2243] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.339926 23879 raft_consensus.cc:2272] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.341909 23879 tablet_replica.cc:333] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.342553 23879 raft_consensus.cc:2243] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.342995 23879 raft_consensus.cc:2272] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.344877 23879 tablet_replica.cc:333] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.345481 23879 raft_consensus.cc:2243] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.345917 23879 raft_consensus.cc:2272] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.348141 23879 tablet_replica.cc:333] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.348796 23879 raft_consensus.cc:2243] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.349817 23879 raft_consensus.cc:2272] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.352425 23879 tablet_replica.cc:333] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.352985 23879 raft_consensus.cc:2243] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.353425 23879 raft_consensus.cc:2272] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.355379 23879 tablet_replica.cc:333] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.355928 23879 raft_consensus.cc:2243] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.356681 23879 raft_consensus.cc:2272] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.358790 23879 tablet_replica.cc:333] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.359503 23879 raft_consensus.cc:2243] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.360494 23879 raft_consensus.cc:2272] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:14.361518 32182 consensus_peers.cc:597] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.363018 23879 tablet_replica.cc:333] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.363884 23879 raft_consensus.cc:2243] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:14.364809 23879 raft_consensus.cc:2272] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.367290 23879 tablet_replica.cc:333] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.367915 23879 raft_consensus.cc:2243] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.368435 23879 raft_consensus.cc:2272] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.370611 23879 tablet_replica.cc:333] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196: stopping tablet replica
I20260709 12:23:14.371121 23879 raft_consensus.cc:2243] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.371588 23879 raft_consensus.cc:2272] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:14.404038 32108 consensus_peers.cc:597] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:14.418255 32182 consensus_peers.cc:597] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:14.435446 31961 connection.cc:466] server connection from 127.0.0.1:39132 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39132 (request call id 151) could send its response
W20260709 12:23:14.442215 32108 consensus_peers.cc:597] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.454011 23879 tablet_server.cc:196] TabletServer@127.23.81.193:0 shutdown complete.
W20260709 12:23:14.525799 32108 consensus_peers.cc:597] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.531009 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:14.538759 32748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:14.538765 32749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:14.544195 32751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:14.545162 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:14.549149 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:14.549490 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:14.549734 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599794549713 us; error 0 us; skew 500 ppm
I20260709 12:23:14.550623 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 12:23:14.552642 32182 consensus_peers.cc:597] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.554227 23879 webserver.cc:533] Webserver started at http://127.23.81.193:42507/ using document root <none> and password file <none>
I20260709 12:23:14.554821 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:14.555085 23879 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:23:14.559449 23879 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:23:14.568464 32757 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:14.569350 23879 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:23:14.569736 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-0-root
uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
format_stamp: "Formatted at 2026-07-09 12:23:02 on dist-test-slave-mprf"
I20260709 12:23:14.570190 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599468354575-23879-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:23:14.581600 32034 consensus_peers.cc:597] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:14.581918 32108 consensus_peers.cc:597] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:14.613078 32108 consensus_peers.cc:597] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.613332 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:14.615090 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:14.616961 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:14.622635 32765 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:23:14.632812 32182 consensus_peers.cc:597] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:14.722733 32108 consensus_peers.cc:597] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:14.728461 32182 consensus_peers.cc:597] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.894873 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:23:14.895296 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.274s	user 0.010s	sys 0.000s
I20260709 12:23:14.895727 23879 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:23:14.901412 32765 tablet_bootstrap.cc:492] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:14.916958 32765 tablet_bootstrap.cc:492] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:14.917910 32765 tablet_bootstrap.cc:492] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:14.918900 32765 ts_tablet_manager.cc:1403] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:23:14.921445 32765 raft_consensus.cc:359] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:14.922170 32765 raft_consensus.cc:740] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.922855 32765 consensus_queue.cc:260] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:14.930385 32765 ts_tablet_manager.cc:1434] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.008s
I20260709 12:23:14.931295 32765 tablet_bootstrap.cc:492] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:14.949425 32765 tablet_bootstrap.cc:492] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:14.950392 32765 tablet_bootstrap.cc:492] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:14.951025 32765 ts_tablet_manager.cc:1403] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 12:23:14.953363 32765 raft_consensus.cc:359] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:14.954046 32765 raft_consensus.cc:740] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.954699 32765 consensus_queue.cc:260] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:14.956513 32765 ts_tablet_manager.cc:1434] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:23:14.957261 32765 tablet_bootstrap.cc:492] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:14.972944 32765 tablet_bootstrap.cc:492] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:14.973969 32765 tablet_bootstrap.cc:492] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:14.974829 32765 ts_tablet_manager.cc:1403] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:23:14.977312 32765 raft_consensus.cc:359] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:14.978081 32765 raft_consensus.cc:740] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.978935 32765 consensus_queue.cc:260] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:14.980844 32765 ts_tablet_manager.cc:1434] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:14.981557 32765 tablet_bootstrap.cc:492] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:14.993384 32765 tablet_bootstrap.cc:492] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:14.994302 32765 tablet_bootstrap.cc:492] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:14.994927 32765 ts_tablet_manager.cc:1403] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:23:14.997324 32765 raft_consensus.cc:359] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:14.997965 32765 raft_consensus.cc:740] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.998744 32765 consensus_queue.cc:260] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.000638 32765 ts_tablet_manager.cc:1434] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260709 12:23:15.001381 32765 tablet_bootstrap.cc:492] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:15.019459 32765 tablet_bootstrap.cc:492] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.020430 32765 tablet_bootstrap.cc:492] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:15.021085 32765 ts_tablet_manager.cc:1403] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:23:15.023514 32765 raft_consensus.cc:359] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.024210 32765 raft_consensus.cc:740] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.024992 32765 consensus_queue.cc:260] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.027047 32765 ts_tablet_manager.cc:1434] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:15.027806 32765 tablet_bootstrap.cc:492] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:15.058184 32765 tablet_bootstrap.cc:492] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.059111 32765 tablet_bootstrap.cc:492] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:15.059742 32765 ts_tablet_manager.cc:1403] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.004s
I20260709 12:23:15.061972 32765 raft_consensus.cc:359] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.062680 32765 raft_consensus.cc:740] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.063396 32765 consensus_queue.cc:260] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.065541 32765 ts_tablet_manager.cc:1434] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:15.066330 32765 tablet_bootstrap.cc:492] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:15.095641 32765 tablet_bootstrap.cc:492] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.096618 32765 tablet_bootstrap.cc:492] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:15.097323 32765 ts_tablet_manager.cc:1403] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.004s
I20260709 12:23:15.099776 32765 raft_consensus.cc:359] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.100487 32765 raft_consensus.cc:740] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.101158 32765 consensus_queue.cc:260] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.103135 32765 ts_tablet_manager.cc:1434] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:23:15.103904 32765 tablet_bootstrap.cc:492] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:15.117918 32765 tablet_bootstrap.cc:492] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.118924 32765 tablet_bootstrap.cc:492] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:15.119566 32765 ts_tablet_manager.cc:1403] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:23:15.122129 32765 raft_consensus.cc:359] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.122839 32765 raft_consensus.cc:740] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.123692 32765 consensus_queue.cc:260] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.126255 32765 ts_tablet_manager.cc:1434] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:15.127310 32765 tablet_bootstrap.cc:492] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:15.159456 23879 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:23:15.159895 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.264s	user 0.253s	sys 0.004s
I20260709 12:23:15.222481 32765 tablet_bootstrap.cc:492] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.223670 32765 tablet_bootstrap.cc:492] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:15.224471 32765 ts_tablet_manager.cc:1403] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.097s	user 0.039s	sys 0.043s
I20260709 12:23:15.225730 32573 raft_consensus.cc:493] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.226370 32573 raft_consensus.cc:515] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.228494 32573 leader_election.cc:290] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:15.227937 32765 raft_consensus.cc:359] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.229103 32765 raft_consensus.cc:740] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.229902 32765 consensus_queue.cc:260] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.232673 32137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398afdbb52444496b0a87720c22f44a4" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:15.233006 32765 ts_tablet_manager.cc:1434] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:23:15.234289 32765 tablet_bootstrap.cc:492] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
W20260709 12:23:15.239352 32034 leader_election.cc:336] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111)
I20260709 12:23:15.239929 32034 leader_election.cc:304] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:15.241098 32573 raft_consensus.cc:2749] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.255645 32765 tablet_bootstrap.cc:492] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.256793 32765 tablet_bootstrap.cc:492] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:15.257594 32765 ts_tablet_manager.cc:1403] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 12:23:15.260113 32765 raft_consensus.cc:359] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.260887 32765 raft_consensus.cc:740] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.261706 32765 consensus_queue.cc:260] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.263716 32765 ts_tablet_manager.cc:1434] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:23:15.264541 32765 tablet_bootstrap.cc:492] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:15.279784 32765 tablet_bootstrap.cc:492] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.280738 32765 tablet_bootstrap.cc:492] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:15.281468 32765 ts_tablet_manager.cc:1403] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:23:15.284185 32765 raft_consensus.cc:359] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.284977 32765 raft_consensus.cc:740] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.286054 32765 consensus_queue.cc:260] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.288408 32765 ts_tablet_manager.cc:1434] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:15.289260 32765 tablet_bootstrap.cc:492] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:15.289892 32573 raft_consensus.cc:493] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.290503 32573 raft_consensus.cc:515] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.292752 32573 leader_election.cc:290] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:15.301036 32137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f214242a6fb64a23b3bf338f9189e209" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
W20260709 12:23:15.302518 32034 leader_election.cc:336] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111)
I20260709 12:23:15.305508 32034 leader_election.cc:304] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:15.306376 32573 raft_consensus.cc:2749] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.309298 32573 raft_consensus.cc:493] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.309729 32765 tablet_bootstrap.cc:492] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.309803 32573 raft_consensus.cc:515] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.311177 32765 tablet_bootstrap.cc:492] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:15.312088 32765 ts_tablet_manager.cc:1403] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 12:23:15.312255 32573 leader_election.cc:290] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:15.313230 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.193:41023
I20260709 12:23:15.313355   367 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.193:41023 every 8 connection(s)
I20260709 12:23:15.315114 32765 raft_consensus.cc:359] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.315879 32765 raft_consensus.cc:740] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.316745 32765 consensus_queue.cc:260] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.318856 32137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136a4f0e01594acc9dc1c8fdb8bd5ce2" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:15.319952 32765 ts_tablet_manager.cc:1434] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:15.321113 32765 tablet_bootstrap.cc:492] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:15.345048   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136a4f0e01594acc9dc1c8fdb8bd5ce2" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:15.348541 32034 leader_election.cc:343] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.349026 32034 leader_election.cc:304] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:15.350076 32573 raft_consensus.cc:2749] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.360713 32575 raft_consensus.cc:493] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.361068 32688 raft_consensus.cc:493] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.361485 32575 raft_consensus.cc:515] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.361639 32688 raft_consensus.cc:515] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.364161 32575 leader_election.cc:290] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.364748 32765 tablet_bootstrap.cc:492] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.365085 32065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:15.366096 32765 tablet_bootstrap.cc:492] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:15.367066 32765 ts_tablet_manager.cc:1403] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.015s
I20260709 12:23:15.367102 32688 leader_election.cc:290] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.370967 32065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:15.370888 32765 raft_consensus.cc:359] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.371914 32765 raft_consensus.cc:740] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.373101 32688 raft_consensus.cc:493] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.373713 32688 raft_consensus.cc:515] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.372860 32765 consensus_queue.cc:260] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.377065 32765 ts_tablet_manager.cc:1434] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:15.378171 32765 tablet_bootstrap.cc:492] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:15.378793 32688 leader_election.cc:290] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.380537 32137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:15.392978 32575 raft_consensus.cc:493] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.393541 32575 raft_consensus.cc:515] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.395627 32766 raft_consensus.cc:493] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.396205 32766 raft_consensus.cc:515] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.399381 32575 leader_election.cc:290] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.400070   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.401466   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:15.403272 32182 leader_election.cc:343] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.405187 32182 leader_election.cc:304] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:15.406174 32401 raft_consensus.cc:2749] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.403501 32766 leader_election.cc:290] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.404348 32067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab51a346acba496aa7601f0835510af0" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
W20260709 12:23:15.408391 32182 leader_election.cc:343] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.409183 32182 leader_election.cc:304] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:15.411307 32401 raft_consensus.cc:2749] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.411559 32213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:15.412562 32213 raft_consensus.cc:2468] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:15.416407 32107 leader_election.cc:304] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:15.417522 32575 raft_consensus.cc:2804] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.417990 32575 raft_consensus.cc:493] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.418438 32575 raft_consensus.cc:3060] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.427737 32575 raft_consensus.cc:515] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.429972 32575 leader_election.cc:290] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.431483 32213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:15.432147 32213 raft_consensus.cc:3060] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.433403 32765 tablet_bootstrap.cc:492] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.434442 32765 tablet_bootstrap.cc:492] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:15.435134 32765 ts_tablet_manager.cc:1403] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.025s
I20260709 12:23:15.437721 32573 raft_consensus.cc:493] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.438354 32573 raft_consensus.cc:515] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.438524 32765 raft_consensus.cc:359] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.439870 32765 raft_consensus.cc:740] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.440042   369 heartbeater.cc:344] Connected to a master server at 127.23.81.254:34289
I20260709 12:23:15.440481   369 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:15.440625 32765 consensus_queue.cc:260] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.441350 32213 raft_consensus.cc:2468] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
I20260709 12:23:15.441406   369 heartbeater.cc:507] Master 127.23.81.254:34289 requested a full tablet report, sending...
I20260709 12:23:15.442747 32765 ts_tablet_manager.cc:1434] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:23:15.442616   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab51a346acba496aa7601f0835510af0" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.443608 32765 tablet_bootstrap.cc:492] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:15.444123 32573 leader_election.cc:290] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:15.447124   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:15.444301 32034 leader_election.cc:343] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.448340 32107 leader_election.cc:304] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:15.449354 32575 raft_consensus.cc:2804] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:15.449570 32573 raft_consensus.cc:493] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.449908 32575 raft_consensus.cc:697] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:15.450453   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab51a346acba496aa7601f0835510af0" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.451956   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.452409 32137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab51a346acba496aa7601f0835510af0" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:15.453193 32137 raft_consensus.cc:2468] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:15.453617   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99b876f266b452a8e5d9782c08a1616" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:15.452361 32575 consensus_queue.cc:237] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.455948 32573 raft_consensus.cc:515] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
W20260709 12:23:15.456445 32108 leader_election.cc:343] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.460131 32108 leader_election.cc:304] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
W20260709 12:23:15.461472 32108 leader_election.cc:343] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.459076 32034 leader_election.cc:304] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:15.462327 32701 raft_consensus.cc:2749] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.462919 32573 leader_election.cc:290] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.463184 32700 raft_consensus.cc:2804] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.463636 32700 raft_consensus.cc:493] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.461869 32108 leader_election.cc:304] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:15.464105 32573 raft_consensus.cc:493] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.464583 32701 raft_consensus.cc:2749] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:15.464963 32108 leader_election.cc:343] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.464843 32573 raft_consensus.cc:515] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
W20260709 12:23:15.465869 32108 leader_election.cc:343] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.464013 32700 raft_consensus.cc:3060] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.467110 32213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:15.464879   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.469875 32573 leader_election.cc:290] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:15.475502 32700 raft_consensus.cc:515] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
W20260709 12:23:15.481264 32034 leader_election.cc:343] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.482291 32034 leader_election.cc:304] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:15.483233 32573 raft_consensus.cc:2749] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.504427   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21e73e86f4b4b22ad881e5a80716ec7" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.506696 32139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21e73e86f4b4b22ad881e5a80716ec7" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:15.507902   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab51a346acba496aa7601f0835510af0" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:15.508750 32700 leader_election.cc:290] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:15.509377 32569 raft_consensus.cc:493] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.509891 32569 raft_consensus.cc:515] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.511778 32569 leader_election.cc:290] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.513688 32137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab51a346acba496aa7601f0835510af0" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:15.513888 32700 raft_consensus.cc:493] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.514642 32137 raft_consensus.cc:3060] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.515237 32139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30469d27ec5d450393d6116dbc4d0c7b" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:15.517105   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30469d27ec5d450393d6116dbc4d0c7b" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:15.518474 32182 leader_election.cc:343] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.518887 32182 leader_election.cc:304] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
W20260709 12:23:15.514142 32034 leader_election.cc:343] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.519567 32034 leader_election.cc:304] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:15.514694 32700 raft_consensus.cc:515] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.522214 32688 raft_consensus.cc:2749] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.522945 32688 raft_consensus.cc:493] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.523425 32688 raft_consensus.cc:515] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.525593 32688 leader_election.cc:290] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.527539 31888 catalog_manager.cc:5697] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.528437 32700 leader_election.cc:290] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.528247   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:15.530194 32182 leader_election.cc:343] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.531427 32213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:15.532287 32213 raft_consensus.cc:2468] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:15.533406 32694 raft_consensus.cc:2749] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:15.536320 32034 leader_election.cc:343] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.537853 32137 raft_consensus.cc:2468] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 2.
I20260709 12:23:15.538491   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.545810 32067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:15.546559 32067 raft_consensus.cc:2468] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:15.547956 32034 leader_election.cc:304] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:15.548840 31892 ts_manager.cc:194] Re-registered known tserver with Master: 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.549131   378 raft_consensus.cc:2804] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:15.549499 32184 leader_election.cc:304] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:15.549758   378 raft_consensus.cc:697] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:15.550311 32569 raft_consensus.cc:2804] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.550690 32569 raft_consensus.cc:493] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.550668   378 consensus_queue.cc:237] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.551976 32569 raft_consensus.cc:3060] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.553606 32765 tablet_bootstrap.cc:492] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.554651 32765 tablet_bootstrap.cc:492] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:15.555930 32765 ts_tablet_manager.cc:1403] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.113s	user 0.032s	sys 0.058s
I20260709 12:23:15.559234 32765 raft_consensus.cc:359] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.560161 32765 raft_consensus.cc:740] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.560890 32765 consensus_queue.cc:260] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
W20260709 12:23:15.551302 32034 leader_election.cc:343] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.566005 32569 raft_consensus.cc:515] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.566630 32765 ts_tablet_manager.cc:1434] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:23:15.567909 32765 tablet_bootstrap.cc:492] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:15.570879 32700 raft_consensus.cc:493] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.571002 32033 leader_election.cc:304] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:15.571439 32700 raft_consensus.cc:515] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.572253 32694 raft_consensus.cc:493] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.572791 32694 raft_consensus.cc:515] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.571215 32575 raft_consensus.cc:493] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.573702 32700 leader_election.cc:290] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.574018 32575 raft_consensus.cc:515] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.576270   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.577194 32575 leader_election.cc:290] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.577770 32700 raft_consensus.cc:2804] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.574695 32766 raft_consensus.cc:493] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.578199 32700 raft_consensus.cc:493] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.579779   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.580004 32700 raft_consensus.cc:3060] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.580569   341 raft_consensus.cc:2468] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:15.580760   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.581444   338 raft_consensus.cc:2468] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:15.578823 32067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:15.582840 32067 raft_consensus.cc:2468] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:15.583889 32569 leader_election.cc:290] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.584375 32110 leader_election.cc:304] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:15.584564 32569 raft_consensus.cc:493] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.585037 32569 raft_consensus.cc:515] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.579082 32766 raft_consensus.cc:515] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.586195 32701 raft_consensus.cc:2804] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.586603 32701 raft_consensus.cc:493] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.586959 32701 raft_consensus.cc:3060] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.587625 32766 leader_election.cc:290] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
W20260709 12:23:15.587730 32034 leader_election.cc:343] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.574880 32694 leader_election.cc:290] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:15.588434 32034 leader_election.cc:304] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:15.589785 32765 tablet_bootstrap.cc:492] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.590648 32067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:15.590968 32765 tablet_bootstrap.cc:492] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:15.591486 32694 raft_consensus.cc:2804] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.591769 32765 ts_tablet_manager.cc:1403] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.000s
I20260709 12:23:15.591943 32694 raft_consensus.cc:493] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.592384 32694 raft_consensus.cc:3060] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.595363 32569 leader_election.cc:290] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.596151 32766 raft_consensus.cc:493] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.596256 32765 raft_consensus.cc:359] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.596982 32765 raft_consensus.cc:740] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.596761 32766 raft_consensus.cc:515] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.597905   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:15.598848 32766 leader_election.cc:290] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.599706 32765 consensus_queue.cc:260] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.601970 32137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:15.602675 32765 ts_tablet_manager.cc:1434] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:23:15.603735 32765 tablet_bootstrap.cc:492] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
W20260709 12:23:15.618605 32182 leader_election.cc:343] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.638226 32140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:15.638980 32140 raft_consensus.cc:2468] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:15.639950   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d960ac97c848b8be5d62f6f5175144" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.640697   340 raft_consensus.cc:2468] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:15.640818 32182 leader_election.cc:304] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:15.642067 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d960ac97c848b8be5d62f6f5175144" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:15.646302 32401 raft_consensus.cc:2804] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.646785 32401 raft_consensus.cc:493] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.646711 32700 raft_consensus.cc:515] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.647373 32401 raft_consensus.cc:3060] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.637373   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.651925 31888 catalog_manager.cc:5697] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 2 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.652904 32067 raft_consensus.cc:2393] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 68991541d4134b4f89800c972fdad372 in current term 2: Already voted for candidate 13d67625d82d4304a0ebff87742a538d in this term.
I20260709 12:23:15.654914 32214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:15.656055 32213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:15.632382 32701 raft_consensus.cc:515] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.659474 32701 leader_election.cc:290] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.659900   383 raft_consensus.cc:493] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.660296 32137 raft_consensus.cc:2393] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13d67625d82d4304a0ebff87742a538d in current term 2: Already voted for candidate c5524748d37141a1bca7d0cedaeb40f2 in this term.
I20260709 12:23:15.660698   383 raft_consensus.cc:515] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.663841   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.664377 32108 leader_election.cc:304] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
W20260709 12:23:15.665365 32108 leader_election.cc:343] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.666843   383 leader_election.cc:290] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
W20260709 12:23:15.669335 32182 leader_election.cc:343] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.671583 32184 leader_election.cc:304] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:15.671933 32688 raft_consensus.cc:493] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.672446 32688 raft_consensus.cc:515] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.673482   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.674230 32569 raft_consensus.cc:2749] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.677305 32401 raft_consensus.cc:515] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.679620 32575 raft_consensus.cc:493] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.682432 32701 raft_consensus.cc:2804] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.680174 32575 raft_consensus.cc:515] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.695312 32575 leader_election.cc:290] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.684033 32701 raft_consensus.cc:493] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.682247   341 raft_consensus.cc:2468] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:15.699024   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:15.706627   339 raft_consensus.cc:3060] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.706869 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:15.708292 32213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:15.708541 32688 leader_election.cc:290] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.708364 32065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:15.709232 32213 raft_consensus.cc:2393] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 13d67625d82d4304a0ebff87742a538d in current term 2: Already voted for candidate 68991541d4134b4f89800c972fdad372 in this term.
I20260709 12:23:15.711126 32766 raft_consensus.cc:493] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.711652 32766 raft_consensus.cc:515] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.713703 32766 leader_election.cc:290] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.703826 32214 raft_consensus.cc:2393] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5524748d37141a1bca7d0cedaeb40f2 in current term 2: Already voted for candidate 68991541d4134b4f89800c972fdad372 in this term.
I20260709 12:23:15.718375 32401 leader_election.cc:290] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.716742 32033 leader_election.cc:304] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:15.704209 32701 raft_consensus.cc:3060] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.721248 32401 raft_consensus.cc:493] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.721401 32034 leader_election.cc:304] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:15.722999 32401 raft_consensus.cc:515] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.724712   335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398afdbb52444496b0a87720c22f44a4" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.724807 32137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:15.725128 32700 leader_election.cc:290] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.725600 32137 raft_consensus.cc:3060] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:15.727530 32108 leader_election.cc:343] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.729154   337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.732892   339 raft_consensus.cc:2468] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
I20260709 12:23:15.709244 32688 raft_consensus.cc:493] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.734306 32688 raft_consensus.cc:515] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.734880 32108 leader_election.cc:304] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:15.724741 32065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:15.735479 32401 leader_election.cc:290] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.738215   386 raft_consensus.cc:2749] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.738329 32573 raft_consensus.cc:2804] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.739019 32573 raft_consensus.cc:493] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.738229 32766 raft_consensus.cc:2804] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:15.739470 32573 raft_consensus.cc:3060] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.739822 32766 raft_consensus.cc:697] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:15.740566 31892 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34268
I20260709 12:23:15.740752 32766 consensus_queue.cc:237] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.741348 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:15.742060 32069 raft_consensus.cc:2468] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:15.745232 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:15.745848 32069 raft_consensus.cc:2468] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:15.746425 32184 leader_election.cc:304] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:15.748571 32184 leader_election.cc:304] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:15.749543 32569 raft_consensus.cc:2804] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.749980 32569 raft_consensus.cc:493] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.750594 32569 raft_consensus.cc:3060] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:15.751778 32110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:33135, user_credentials={real_user=slave}} blocked reactor thread for 69790.3us
I20260709 12:23:15.745913   369 heartbeater.cc:499] Master 127.23.81.254:34289 was elected leader, sending a full tablet report...
I20260709 12:23:15.738593   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30469d27ec5d450393d6116dbc4d0c7b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.752424 32401 raft_consensus.cc:2804] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.755389 32401 raft_consensus.cc:493] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.755650 32401 raft_consensus.cc:3060] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.736650 32688 leader_election.cc:290] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
W20260709 12:23:15.756500 32182 leader_election.cc:343] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.764351 32182 leader_election.cc:304] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:15.746450 32701 raft_consensus.cc:515] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.771874 32569 raft_consensus.cc:515] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.773275 32701 leader_election.cc:290] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.768554   378 raft_consensus.cc:493] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.774602   378 raft_consensus.cc:515] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.779592 32569 leader_election.cc:290] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.765851   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:15.782951 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398afdbb52444496b0a87720c22f44a4" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:15.778712   383 raft_consensus.cc:493] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.784283 32573 raft_consensus.cc:515] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.784554   383 raft_consensus.cc:515] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.786491 32573 leader_election.cc:290] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.786729   383 leader_election.cc:290] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.783720 32069 raft_consensus.cc:2468] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
W20260709 12:23:15.783994 32108 leader_election.cc:343] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.790370 32401 raft_consensus.cc:515] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.791611 32110 leader_election.cc:304] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:15.778360 32701 raft_consensus.cc:493] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.769538 32688 raft_consensus.cc:493] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.787084   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:15.797745 32569 raft_consensus.cc:493] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.799928   334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.800062 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30469d27ec5d450393d6116dbc4d0c7b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:15.802755 32211 raft_consensus.cc:2468] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:15.802841 32064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:15.800693 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:15.803500 32064 raft_consensus.cc:3060] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.803824 32569 raft_consensus.cc:515] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.804828   389 raft_consensus.cc:493] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.805641   389 raft_consensus.cc:515] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.801002 32401 leader_election.cc:290] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.801195   390 raft_consensus.cc:2804] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.807041   390 raft_consensus.cc:493] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.798885 32701 raft_consensus.cc:515] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.807436   390 raft_consensus.cc:3060] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.802129 32214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:15.810479 32067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f214242a6fb64a23b3bf338f9189e209" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:15.810855   334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749cde1030064b6198575299b10620c5" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:15.811260 32067 raft_consensus.cc:2468] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:15.813352   334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f214242a6fb64a23b3bf338f9189e209" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:15.813881 32182 leader_election.cc:343] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.814042   334 raft_consensus.cc:2468] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
W20260709 12:23:15.814718 32182 leader_election.cc:343] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.806010 32688 raft_consensus.cc:515] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.816259   334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21e73e86f4b4b22ad881e5a80716ec7" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.816962   389 leader_election.cc:290] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
W20260709 12:23:15.816558 32182 leader_election.cc:343] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.818871 32067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21e73e86f4b4b22ad881e5a80716ec7" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:15.819235 32214 raft_consensus.cc:3060] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.796703 32213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:15.819604 32067 raft_consensus.cc:2468] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:15.819669 32569 leader_election.cc:290] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.820187 32213 raft_consensus.cc:2468] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:15.820823 32701 leader_election.cc:290] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.822302   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
W20260709 12:23:15.822376 32034 leader_election.cc:343] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.818151 32108 leader_election.cc:304] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:15.823503 32034 leader_election.cc:304] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:15.823992   335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d960ac97c848b8be5d62f6f5175144" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:15.824643   335 raft_consensus.cc:3060] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.824674 32573 raft_consensus.cc:2749] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.828410 32110 leader_election.cc:304] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:15.829859 32573 raft_consensus.cc:493] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.830586 32573 raft_consensus.cc:515] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
W20260709 12:23:15.830982 32108 leader_election.cc:343] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.832811 32575 raft_consensus.cc:2804] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.833385 32575 raft_consensus.cc:493] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.833853 32575 raft_consensus.cc:3060] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.836390 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:15.837334 32069 raft_consensus.cc:3060] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.839602 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d960ac97c848b8be5d62f6f5175144" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:15.796828   378 leader_election.cc:290] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.838073 32033 leader_election.cc:304] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:15.847869 32144 raft_consensus.cc:2393] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68991541d4134b4f89800c972fdad372 in current term 2: Already voted for candidate c5524748d37141a1bca7d0cedaeb40f2 in this term.
I20260709 12:23:15.794301   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e692c206a274e1fbd3fb6b4ef2358ec" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:15.850265   334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.851853   378 raft_consensus.cc:2804] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.852326   378 raft_consensus.cc:493] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.852681   378 raft_consensus.cc:3060] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.795743   391 raft_consensus.cc:2749] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.856794 32069 raft_consensus.cc:2468] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 2.
I20260709 12:23:15.806833   337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba00ce5cdc6f4dbe8a36ecb3e82951e3" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.859249   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:15.838878 32701 raft_consensus.cc:2804] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.876672   394 raft_consensus.cc:493] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.877269   394 raft_consensus.cc:515] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.878605 32137 raft_consensus.cc:2468] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 2.
I20260709 12:23:15.879382   394 leader_election.cc:290] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.881038 32182 leader_election.cc:304] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:15.881397 32184 leader_election.cc:304] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:15.882207 32569 raft_consensus.cc:2804] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:15.882827 32569 raft_consensus.cc:697] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:15.883473 32401 raft_consensus.cc:2804] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:15.884068 32401 raft_consensus.cc:697] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:15.888809 32573 leader_election.cc:290] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:15.884913 32401 consensus_queue.cc:237] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:15.873306 32701 raft_consensus.cc:493] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.893182 32701 raft_consensus.cc:3060] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.896888 32107 leader_election.cc:304] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:15.893985 32569 consensus_queue.cc:237] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
W20260709 12:23:15.897578 32182 leader_election.cc:343] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.897953 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d960ac97c848b8be5d62f6f5175144" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:15.900115 32216 raft_consensus.cc:3060] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.912447 32575 raft_consensus.cc:515] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.885303   338 raft_consensus.cc:3060] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:15.914065 32182 leader_election.cc:343] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.854319 32694 raft_consensus.cc:515] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.923693   390 raft_consensus.cc:515] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:15.920077 32216 raft_consensus.cc:2468] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
W20260709 12:23:15.921190 32034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 60495.7us
I20260709 12:23:15.928689 32575 leader_election.cc:290] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
W20260709 12:23:15.930145 32034 leader_election.cc:343] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.930667 32034 leader_election.cc:304] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372
I20260709 12:23:15.931881 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:15.891870   334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d960ac97c848b8be5d62f6f5175144" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.925915   390 leader_election.cc:290] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.932446 32575 raft_consensus.cc:2749] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.932499 32069 raft_consensus.cc:2468] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 1.
I20260709 12:23:15.894423   378 raft_consensus.cc:515] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
W20260709 12:23:15.933947 32034 leader_election.cc:343] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.896206 32766 raft_consensus.cc:493] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.953931 32184 leader_election.cc:304] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:15.905244   392 raft_consensus.cc:493] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:15.936249   383 raft_consensus.cc:2749] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:15.934537   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.960537 31888 catalog_manager.cc:5697] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.970146 32765 tablet_bootstrap.cc:492] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.957653 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:15.959566   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398afdbb52444496b0a87720c22f44a4" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:15.997265 32765 tablet_bootstrap.cc:492] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:16.000993 32765 ts_tablet_manager.cc:1403] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.397s	user 0.021s	sys 0.024s
I20260709 12:23:15.987892 32065 raft_consensus.cc:2393] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c5524748d37141a1bca7d0cedaeb40f2 in current term 2: Already voted for candidate 13d67625d82d4304a0ebff87742a538d in this term.
I20260709 12:23:16.023729 32694 leader_election.cc:290] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
W20260709 12:23:16.024798   396 log.cc:927] Time spent T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:23:15.970223   392 raft_consensus.cc:515] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:15.979478 32688 leader_election.cc:290] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:15.998615   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:15.959200 32766 raft_consensus.cc:515] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:16.031169   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:16.010306   394 raft_consensus.cc:2804] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:16.034503 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8072e49f8e645f7b24c0f657e2d5c52" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:16.013055   333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:16.039116   394 raft_consensus.cc:493] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:16.042979   394 raft_consensus.cc:3060] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.043373   378 leader_election.cc:290] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:16.043637 32064 raft_consensus.cc:2468] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 2.
I20260709 12:23:16.034584 32214 raft_consensus.cc:2468] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 2.
I20260709 12:23:16.046892   335 raft_consensus.cc:2468] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
I20260709 12:23:16.047751 32766 leader_election.cc:290] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:16.015381 32211 raft_consensus.cc:2468] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
W20260709 12:23:16.060233 32184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.194:33135, user_credentials={real_user=slave}} blocked reactor thread for 122266us
W20260709 12:23:16.062881 32182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 99221.7us
I20260709 12:23:16.066880 32765 raft_consensus.cc:359] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:16.067917 32765 raft_consensus.cc:740] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.068697 32765 consensus_queue.cc:260] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:16.068912 32182 leader_election.cc:304] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
W20260709 12:23:16.070214 32182 leader_election.cc:343] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.070523 32765 ts_tablet_manager.cc:1434] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 12:23:16.064680   340 raft_consensus.cc:2393] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 13d67625d82d4304a0ebff87742a538d in current term 2: Already voted for candidate c5524748d37141a1bca7d0cedaeb40f2 in this term.
W20260709 12:23:16.066677 32034 leader_election.cc:343] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.071512   393 raft_consensus.cc:2749] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:16.076900   392 leader_election.cc:290] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:16.077504   334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21e73e86f4b4b22ad881e5a80716ec7" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:16.070443 32064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c591c793c14148a28a7095ad7db608" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:16.081952 32701 raft_consensus.cc:515] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:16.084405 32765 tablet_bootstrap.cc:492] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:16.083657 32064 raft_consensus.cc:2393] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68991541d4134b4f89800c972fdad372 in current term 2: Already voted for candidate 13d67625d82d4304a0ebff87742a538d in this term.
I20260709 12:23:16.097213   338 raft_consensus.cc:2468] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 2.
I20260709 12:23:16.098516 32034 leader_election.cc:304] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:16.099228   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:16.099730 32701 leader_election.cc:290] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:16.088347   394 raft_consensus.cc:515] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:16.100452 32694 raft_consensus.cc:2804] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:23:16.100718 32034 leader_election.cc:343] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.101037 32694 raft_consensus.cc:697] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:16.101821   394 leader_election.cc:290] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:16.101958 32694 consensus_queue.cc:237] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:16.107818   331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136a4f0e01594acc9dc1c8fdb8bd5ce2" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:16.109920   331 raft_consensus.cc:2468] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:16.108862   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:16.114794 32064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398afdbb52444496b0a87720c22f44a4" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:16.115329   331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:16.115504 32064 raft_consensus.cc:3060] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.116194 32137 raft_consensus.cc:1275] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.117938 32067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21e73e86f4b4b22ad881e5a80716ec7" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:16.118599 32067 raft_consensus.cc:3060] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.123678 32034 leader_election.cc:304] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:16.125835   378 raft_consensus.cc:2749] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:16.123955 32064 raft_consensus.cc:2468] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
I20260709 12:23:16.127211   378 consensus_queue.cc:1048] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:16.131145 32067 raft_consensus.cc:2468] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
W20260709 12:23:16.009898 32107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.81.196:46375, user_credentials={real_user=slave}} blocked reactor thread for 113150us
W20260709 12:23:16.133940 32182 leader_election.cc:343] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.134698 32107 leader_election.cc:304] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:16.136440 32065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f214242a6fb64a23b3bf338f9189e209" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:16.138919 32065 raft_consensus.cc:3060] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.139812 32110 leader_election.cc:304] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:16.141261 32110 leader_election.cc:304] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:16.143370   392 raft_consensus.cc:2804] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.143751   339 raft_consensus.cc:3060] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.143898   392 raft_consensus.cc:697] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:16.144949   392 consensus_queue.cc:237] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:16.144961   331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f214242a6fb64a23b3bf338f9189e209" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:16.146231   331 raft_consensus.cc:3060] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.146862   399 raft_consensus.cc:2804] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.147459   399 raft_consensus.cc:697] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:16.148317   399 consensus_queue.cc:237] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:16.155471   331 raft_consensus.cc:2468] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
I20260709 12:23:16.156396   339 raft_consensus.cc:1275] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.158517 32107 leader_election.cc:304] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
W20260709 12:23:16.159255 32108 leader_election.cc:343] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:16.161194 32108 leader_election.cc:343] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.136842 32064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136a4f0e01594acc9dc1c8fdb8bd5ce2" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d" is_pre_election: true
I20260709 12:23:16.163529   385 consensus_queue.cc:1048] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:16.164327   406 raft_consensus.cc:2804] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:16.171527 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:16.172410 32216 raft_consensus.cc:3060] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.170706   406 raft_consensus.cc:493] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:16.180605   406 raft_consensus.cc:3060] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.185827 32216 raft_consensus.cc:2468] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 2.
I20260709 12:23:16.193073   406 raft_consensus.cc:515] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
W20260709 12:23:16.193150 32108 leader_election.cc:343] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.194090 32701 raft_consensus.cc:2804] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.194453 32108 leader_election.cc:304] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:16.194926 32701 raft_consensus.cc:697] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:16.199271 32701 consensus_queue.cc:237] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:16.202155   403 raft_consensus.cc:2804] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:16.202629   403 raft_consensus.cc:493] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:16.203009   403 raft_consensus.cc:3060] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:16.204867 32108 consensus_peers.cc:597] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:16.205727 32108 leader_election.cc:304] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:16.205999 32184 leader_election.cc:304] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:16.206642   389 raft_consensus.cc:2804] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.207269   389 raft_consensus.cc:697] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:16.207791 32213 raft_consensus.cc:1275] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.208117   389 consensus_queue.cc:237] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:16.211930 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:16.212762 32216 raft_consensus.cc:2468] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:16.197979 32064 raft_consensus.cc:2468] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 1.
I20260709 12:23:16.244131 32184 leader_election.cc:304] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:16.244939 32569 raft_consensus.cc:2749] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:16.242307   388 raft_consensus.cc:2804] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.251235   388 raft_consensus.cc:697] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:16.252138   388 consensus_queue.cc:237] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:16.253162 32067 raft_consensus.cc:1275] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.258839 32033 leader_election.cc:304] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:16.273577 32033 leader_election.cc:304] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:16.256115   400 raft_consensus.cc:493] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:16.274046   385 raft_consensus.cc:2804] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:16.301914 32575 consensus_queue.cc:1048] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:16.272277 32065 raft_consensus.cc:2468] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
I20260709 12:23:16.294181   383 raft_consensus.cc:2804] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.316104   383 raft_consensus.cc:697] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:16.316982   383 consensus_queue.cc:237] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:16.320389 32067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:16.321069 32067 raft_consensus.cc:3060] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:16.371556 32182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 61777.7us
I20260709 12:23:16.291356   400 raft_consensus.cc:515] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
W20260709 12:23:16.384891 32033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:46375, user_credentials={real_user=slave}} blocked reactor thread for 74603.3us
I20260709 12:23:16.307660   385 raft_consensus.cc:493] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:16.285315 32766 consensus_queue.cc:1048] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:23:16.323086   406 leader_election.cc:290] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:16.408631 32765 tablet_bootstrap.cc:492] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:23:16.408815 32107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:46375, user_credentials={real_user=slave}} blocked reactor thread for 108302us
I20260709 12:23:16.415201 32107 leader_election.cc:304] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:16.416739 32765 tablet_bootstrap.cc:492] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:16.392140   385 raft_consensus.cc:3060] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.417819 32701 raft_consensus.cc:2804] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:16.418913   400 leader_election.cc:290] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:16.420282 32765 ts_tablet_manager.cc:1403] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.336s	user 0.026s	sys 0.032s
W20260709 12:23:16.427846 32034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 104882us
I20260709 12:23:16.431197   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:16.432726 32765 raft_consensus.cc:359] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:16.433243 32140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2" is_pre_election: true
I20260709 12:23:16.433568 32765 raft_consensus.cc:740] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.433925 32140 raft_consensus.cc:2468] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 1.
I20260709 12:23:16.434473 32765 consensus_queue.cc:260] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:16.436889 32765 ts_tablet_manager.cc:1434] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 12:23:16.438544   331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30469d27ec5d450393d6116dbc4d0c7b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:16.438915 32034 leader_election.cc:304] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:16.425854 32701 raft_consensus.cc:493] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:16.439790   400 raft_consensus.cc:2804] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:16.440166 32701 raft_consensus.cc:3060] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.440191   400 raft_consensus.cc:493] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:16.440909   400 raft_consensus.cc:3060] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.440795   403 raft_consensus.cc:515] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
W20260709 12:23:16.444489 32108 leader_election.cc:343] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.447301 32064 raft_consensus.cc:1275] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer 68991541d4134b4f89800c972fdad372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.448451   400 raft_consensus.cc:515] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:16.458005   403 leader_election.cc:290] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:16.457048 31889 catalog_manager.cc:5697] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 2 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.464154 32701 raft_consensus.cc:515] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:16.467907 32569 consensus_queue.cc:1048] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:16.473965 32034 leader_election.cc:343] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:16.482627 32182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 75472.1us
I20260709 12:23:16.496361 32765 tablet_bootstrap.cc:492] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:16.532243 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:16.533228 32211 raft_consensus.cc:3060] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.541474 32212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30469d27ec5d450393d6116dbc4d0c7b" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:16.542210 32212 raft_consensus.cc:3060] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.487444 32701 leader_election.cc:290] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:16.528050   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136a4f0e01594acc9dc1c8fdb8bd5ce2" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:16.485742 32067 raft_consensus.cc:2468] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 2.
I20260709 12:23:16.486850   385 raft_consensus.cc:515] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:16.586581   385 leader_election.cc:290] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:16.574681   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:16.579672 32211 raft_consensus.cc:2468] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
I20260709 12:23:16.580358   335 raft_consensus.cc:1275] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.588866 31892 catalog_manager.cc:5697] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:16.590577 32184 leader_election.cc:304] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:16.569082   340 raft_consensus.cc:3060] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.593753   405 raft_consensus.cc:2804] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.594273   405 raft_consensus.cc:697] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:16.595134   405 consensus_queue.cc:237] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:16.599041 32107 leader_election.cc:304] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:16.589540   335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
I20260709 12:23:16.601697 32701 raft_consensus.cc:2804] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.607797 32701 raft_consensus.cc:697] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:16.608686 32701 consensus_queue.cc:237] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:16.610085   400 leader_election.cc:290] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Requested vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:16.603078 32137 raft_consensus.cc:1275] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Refusing update from remote peer 68991541d4134b4f89800c972fdad372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.613266   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
W20260709 12:23:16.614583 32034 leader_election.cc:343] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:16.615204 32034 leader_election.cc:343] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.615993 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c31ec08af4642a8a25265fcb3dd6c11" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:16.616593 32144 raft_consensus.cc:3060] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.617027 32212 raft_consensus.cc:2468] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
W20260709 12:23:16.609272 32182 consensus_peers.cc:597] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:16.590610 31892 catalog_manager.cc:5697] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:16.602818 31893 catalog_manager.cc:5697] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.621184 32107 leader_election.cc:304] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:16.621914 31893 catalog_manager.cc:5697] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.629233 32688 consensus_queue.cc:1048] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:16.629606   418 raft_consensus.cc:2804] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.630257   418 raft_consensus.cc:697] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:16.631153   418 consensus_queue.cc:237] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
W20260709 12:23:16.634174 32182 consensus_peers.cc:597] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:16.635746 32108 leader_election.cc:343] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.647415 32070 raft_consensus.cc:1275] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.650210 32069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136a4f0e01594acc9dc1c8fdb8bd5ce2" candidate_uuid: "c5524748d37141a1bca7d0cedaeb40f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:16.651285 32069 raft_consensus.cc:3060] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.654946 32216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:16.655617 32216 raft_consensus.cc:3060] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.667287 32144 raft_consensus.cc:2468] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 2.
I20260709 12:23:16.670859 32034 leader_election.cc:304] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:16.680227 32216 raft_consensus.cc:2468] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 2.
I20260709 12:23:16.673584 32069 raft_consensus.cc:2468] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
I20260709 12:23:16.651054   406 consensus_queue.cc:1048] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:23:16.697408 32033 leader_election.cc:304] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:16.704072 32110 leader_election.cc:304] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:16.656895   392 consensus_queue.cc:1048] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:23:16.709483   430 raft_consensus.cc:2804] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.710225   430 raft_consensus.cc:697] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:16.711227   430 consensus_queue.cc:237] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:16.711198 32062 raft_consensus.cc:1275] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.716233   401 raft_consensus.cc:2804] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.716794   401 raft_consensus.cc:697] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Becoming Leader. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:16.721422   402 consensus_queue.cc:1048] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:23:16.717641   401 consensus_queue.cc:237] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:16.734915   341 raft_consensus.cc:1275] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.702903   422 raft_consensus.cc:2804] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.713783   340 raft_consensus.cc:2468] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5524748d37141a1bca7d0cedaeb40f2 in term 2.
I20260709 12:23:16.759613 32765 tablet_bootstrap.cc:492] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:16.744509 32210 raft_consensus.cc:1275] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.775789   392 consensus_queue.cc:1048] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:16.772571 32765 tablet_bootstrap.cc:492] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:16.781275 32765 ts_tablet_manager.cc:1403] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.292s	user 0.018s	sys 0.005s
I20260709 12:23:16.765618 32062 raft_consensus.cc:1275] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.771301   422 raft_consensus.cc:697] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:16.804728   340 raft_consensus.cc:3060] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.783532   419 consensus_queue.cc:1048] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:23:16.799224   422 consensus_queue.cc:237] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
W20260709 12:23:16.825910 32034 consensus_peers.cc:597] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:16.826143 32765 raft_consensus.cc:359] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:16.826889 32765 raft_consensus.cc:740] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.835489 32765 consensus_queue.cc:260] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:16.838286 32212 raft_consensus.cc:1275] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.842836   390 consensus_queue.cc:1048] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:23:16.885083 32064 raft_consensus.cc:1275] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer 68991541d4134b4f89800c972fdad372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.885135   419 consensus_queue.cc:1048] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:16.888062   424 consensus_queue.cc:1048] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:16.892079 32108 consensus_peers.cc:597] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:16.892596 32108 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:41023, user_credentials={real_user=slave}} blocked reactor thread for 49687.4us
W20260709 12:23:16.893738 32108 consensus_peers.cc:597] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:16.878438 32213 raft_consensus.cc:1275] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:16.894474 32108 consensus_peers.cc:597] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:16.896901 32108 consensus_peers.cc:597] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:16.912611 32182 consensus_peers.cc:597] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:16.914688   430 consensus_queue.cc:1048] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:16.918473   341 raft_consensus.cc:1275] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:16.918880   340 raft_consensus.cc:1275] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Refusing update from remote peer 68991541d4134b4f89800c972fdad372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:16.928807 32108 consensus_peers.cc:597] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:16.929567 32108 consensus_peers.cc:597] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:16.933894 32182 consensus_peers.cc:597] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:16.946138   403 consensus_queue.cc:1048] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:23:16.949237 31889 catalog_manager.cc:5697] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 2 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.989135 32765 ts_tablet_manager.cc:1434] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.207s	user 0.016s	sys 0.005s
I20260709 12:23:16.997251 32765 tablet_bootstrap.cc:492] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:17.014900   331 raft_consensus.cc:1275] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:17.017300 32108 consensus_peers.cc:597] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:17.050923 32034 consensus_peers.cc:597] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:17.003624   394 consensus_queue.cc:1048] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:23:17.228087 32765 tablet_bootstrap.cc:700] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent opening tablet: real 0.104s	user 0.006s	sys 0.002s
I20260709 12:23:17.052620   406 consensus_queue.cc:1048] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
W20260709 12:23:17.244040   448 log.cc:927] Time spent T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372: Append to log took a long time: real 0.345s	user 0.000s	sys 0.010s
I20260709 12:23:17.271365 32067 raft_consensus.cc:1275] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer 68991541d4134b4f89800c972fdad372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:17.287312   453 log.cc:927] Time spent T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:23:17.300312 32063 raft_consensus.cc:1275] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:17.314962   401 consensus_queue.cc:1048] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 12:23:17.322603   455 log.cc:927] Time spent T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 12:23:17.334314   452 log.cc:927] Time spent T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d: Append to log took a long time: real 0.218s	user 0.007s	sys 0.008s
I20260709 12:23:17.347151 32210 raft_consensus.cc:1275] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:17.372236   394 consensus_queue.cc:1048] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:17.375622 32182 consensus_peers.cc:597] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:17.378496 32107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.196:46375, user_credentials={real_user=slave}} blocked reactor thread for 45204.6us
W20260709 12:23:17.387212 32034 consensus_peers.cc:597] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:17.387640 32034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:41023, user_credentials={real_user=slave}} blocked reactor thread for 47378.6us
I20260709 12:23:17.392760 32217 raft_consensus.cc:1275] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:17.402590   386 consensus_queue.cc:1048] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:17.437465 32034 consensus_peers.cc:597] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:17.440140   461 consensus_queue.cc:1048] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:23:17.439085 32214 raft_consensus.cc:1275] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:17.444391 31892 catalog_manager.cc:5697] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.456178 32765 tablet_bootstrap.cc:492] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:17.457499 32765 tablet_bootstrap.cc:492] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:17.458559 32765 ts_tablet_manager.cc:1403] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.469s	user 0.029s	sys 0.006s
W20260709 12:23:17.459158 32034 consensus_peers.cc:597] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:17.461210 31892 catalog_manager.cc:5697] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.462615 31892 catalog_manager.cc:5697] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } }
W20260709 12:23:17.467456 32182 consensus_peers.cc:597] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:17.480127   335 raft_consensus.cc:1275] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:17.464700   392 consensus_queue.cc:1048] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:23:17.482366   464 log.cc:927] Time spent T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:23:17.488255 32182 consensus_peers.cc:597] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:17.488639 32765 raft_consensus.cc:359] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:17.492383 32765 raft_consensus.cc:740] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.516420 32765 consensus_queue.cc:260] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:17.520788 32765 ts_tablet_manager.cc:1434] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 12:23:17.521763 32765 tablet_bootstrap.cc:492] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
W20260709 12:23:17.525750 32108 consensus_peers.cc:597] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:17.526577 32108 consensus_peers.cc:597] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:17.527398 32108 consensus_peers.cc:597] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:17.535648 32575 consensus_queue.cc:1048] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:17.516719   422 raft_consensus.cc:493] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.545711 32144 raft_consensus.cc:1275] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:17.545006   422 raft_consensus.cc:515] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
W20260709 12:23:17.563879   466 log.cc:927] Time spent T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:23:17.572065 32182 consensus_peers.cc:597] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:17.580201   422 leader_election.cc:290] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
W20260709 12:23:17.617004 32034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 88737.3us
I20260709 12:23:17.623474 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372" is_pre_election: true
I20260709 12:23:17.624262 32211 raft_consensus.cc:2468] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 2.
I20260709 12:23:17.630831 32033 leader_election.cc:304] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:17.634581   331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" is_pre_election: true
I20260709 12:23:17.641103   334 raft_consensus.cc:3060] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:17.663337   474 raft_consensus.cc:2804] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:17.663868   474 raft_consensus.cc:493] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.664242   474 raft_consensus.cc:3060] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:17.682394 32034 leader_election.cc:343] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.711555 31889 catalog_manager.cc:5697] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } }
W20260709 12:23:17.728866   476 log.cc:927] Time spent T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2: Append to log took a long time: real 0.119s	user 0.000s	sys 0.009s
I20260709 12:23:17.718165   419 consensus_queue.cc:1048] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:23:17.748366   470 log.cc:927] Time spent T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372: Append to log took a long time: real 0.188s	user 0.005s	sys 0.000s
I20260709 12:23:17.751649 32765 tablet_bootstrap.cc:492] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:17.752736 32765 tablet_bootstrap.cc:492] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:17.754572 32765 ts_tablet_manager.cc:1403] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.233s	user 0.018s	sys 0.006s
I20260709 12:23:17.759335   334 raft_consensus.cc:1275] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Refusing update from remote peer c5524748d37141a1bca7d0cedaeb40f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:17.769241   403 consensus_queue.cc:1048] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:17.777642 31889 catalog_manager.cc:5697] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 2 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.780926 31889 catalog_manager.cc:5697] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 2 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.806782 32765 raft_consensus.cc:359] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:17.807590 32765 raft_consensus.cc:740] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.808274 32765 consensus_queue.cc:260] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:17.809971 32765 ts_tablet_manager.cc:1434] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.050s	user 0.003s	sys 0.000s
I20260709 12:23:17.810813 32765 tablet_bootstrap.cc:492] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:17.897866   474 raft_consensus.cc:515] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:17.900290   474 leader_election.cc:290] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 3 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:18.021462   331 raft_consensus.cc:3060] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.062719   332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
W20260709 12:23:18.065809 32184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:33135, user_credentials={real_user=slave}} blocked reactor thread for 45896.9us
W20260709 12:23:18.076720 32182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 52113.7us
W20260709 12:23:18.089316 32034 leader_election.cc:343] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:18.157701 31893 catalog_manager.cc:5697] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.178499 32212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e813540114eb4928246a962aaf360" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:18.179648 32212 raft_consensus.cc:3060] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:18.200430 32765 tablet_bootstrap.cc:492] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.200299 31893 catalog_manager.cc:5697] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.204144 31893 catalog_manager.cc:5697] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 reported cstate change: term changed from 1 to 2, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "c5524748d37141a1bca7d0cedaeb40f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:18.201865 32765 tablet_bootstrap.cc:492] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.251040 31893 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33150 (request call id 116) took 1197 ms. Trace:
I20260709 12:23:18.253443 31888 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34268 (request call id 2) took 1998 ms. Trace:
I20260709 12:23:18.254220 32765 ts_tablet_manager.cc:1403] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.444s	user 0.027s	sys 0.003s
I20260709 12:23:18.262320 31888 rpcz_store.cc:276] 0709 12:23:16.254446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.274177 (+ 19731us) service_pool.cc:224] Handling call
0709 12:23:18.253245 (+1979068us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32550,"reported_tablets":45,"spinlock_wait_cycles":2432}
I20260709 12:23:18.258251 31893 rpcz_store.cc:276] 0709 12:23:17.056463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:17.089135 (+ 32672us) service_pool.cc:224] Handling call
0709 12:23:18.250921 (+1161786us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:18.210284 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:18.210963 (+   679us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:18.211023 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:23:18.211053 (+    30us) tablet.cc:662] Decoding operations
0709 12:23:18.211849 (+   796us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:18.211938 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:18.211965 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:23:18.212490 (+   525us) tablet.cc:701] Row locks acquired
0709 12:23:18.212542 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:23:18.212745 (+   203us) write_op.cc:270] Start()
0709 12:23:18.212932 (+   187us) write_op.cc:276] Timestamp: P: 1783599798212681 usec, L: 0
0709 12:23:18.212974 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:23:18.213876 (+   902us) log.cc:844] Serialized 1312 byte log entry
0709 12:23:18.223473 (+  9597us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b5400b4fda0. stack: 00007f2100def343 00007f2100def240 00007f210077e1d4 00007f210a4bc304 00007f210a4bc299 00007f2103e78090 00007f2103e856b8 00007f2103e852fa 00007f2103f09965 00007f2103f09e09 00007f2107944581 00007f2107943d58 00007f21079489f1 00007f21079489a9 00007f2107948939 00007f2107948901
0709 12:23:18.224006 (+   533us) op_driver.cc:464] REPLICATION: finished
0709 12:23:18.226147 (+  2141us) write_op.cc:301] APPLY: starting
0709 12:23:18.226268 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:18.226445 (+   177us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:18.226489 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:18.227133 (+   644us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:18.227444 (+   311us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:23:18.227494 (+    50us) write_op.cc:312] APPLY: finished
0709 12:23:18.227758 (+   264us) log.cc:844] Serialized 34 byte log entry
0709 12:23:18.227994 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:18.228086 (+    92us) write_op.cc:454] Released schema lock
0709 12:23:18.228153 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:18.234603 (+  6450us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:18.234641 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41208,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":1767,"apply.run_cpu_time_us":2483,"apply.run_wall_time_us":2483,"num_ops":3,"prepare.queue_time_us":330,"prepare.run_cpu_time_us":7085,"prepare.run_wall_time_us":22088,"replication_time_us":10708,"spinlock_wait_cycles":8297728}]]}
I20260709 12:23:18.280328 32765 raft_consensus.cc:359] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.285041 32765 raft_consensus.cc:740] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.312278 32212 raft_consensus.cc:2468] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 3.
I20260709 12:23:18.302953 32765 consensus_queue.cc:260] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.326095 32033 leader_election.cc:304] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:18.327630   386 raft_consensus.cc:2804] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:18.330549   386 raft_consensus.cc:697] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 3 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:18.331871   386 consensus_queue.cc:237] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.337026 32765 ts_tablet_manager.cc:1434] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.002s
I20260709 12:23:18.340018 32765 tablet_bootstrap.cc:492] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.386554 31889 catalog_manager.cc:5697] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 1 to 3, leader changed from 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193) to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 3 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:18.435132 32765 tablet_bootstrap.cc:492] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.436509 32765 tablet_bootstrap.cc:492] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.437480 32765 ts_tablet_manager.cc:1403] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.098s	user 0.015s	sys 0.011s
I20260709 12:23:18.441093 32765 raft_consensus.cc:359] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.441946 32765 raft_consensus.cc:740] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.442893 32765 consensus_queue.cc:260] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.445461 32765 ts_tablet_manager.cc:1434] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:23:18.446609 32765 tablet_bootstrap.cc:492] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.472575 32765 tablet_bootstrap.cc:492] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.474123 32765 tablet_bootstrap.cc:492] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.474902 32765 ts_tablet_manager.cc:1403] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.011s
I20260709 12:23:18.477995 32765 raft_consensus.cc:359] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.478834 32765 raft_consensus.cc:740] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.479710 32765 consensus_queue.cc:260] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.482272 32765 ts_tablet_manager.cc:1434] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 12:23:18.483273 32765 tablet_bootstrap.cc:492] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.506491 32765 tablet_bootstrap.cc:492] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.507550 32765 tablet_bootstrap.cc:492] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.508476 32765 ts_tablet_manager.cc:1403] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.010s
I20260709 12:23:18.511657 32765 raft_consensus.cc:359] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.512637 32765 raft_consensus.cc:740] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.514991 32765 consensus_queue.cc:260] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.517283 32765 ts_tablet_manager.cc:1434] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:23:18.518256 32765 tablet_bootstrap.cc:492] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.540798 32765 tablet_bootstrap.cc:492] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.541581 32765 tablet_bootstrap.cc:492] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.542240 32765 ts_tablet_manager.cc:1403] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.008s
I20260709 12:23:18.544373 32765 raft_consensus.cc:359] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.544905 32765 raft_consensus.cc:740] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.545526 32765 consensus_queue.cc:260] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.547547 32765 ts_tablet_manager.cc:1434] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:18.549104 32765 tablet_bootstrap.cc:492] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.586081 32765 tablet_bootstrap.cc:492] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.587095 32765 tablet_bootstrap.cc:492] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.587765 32765 ts_tablet_manager.cc:1403] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.006s
I20260709 12:23:18.590257 32765 raft_consensus.cc:359] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.590971 32765 raft_consensus.cc:740] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.591715 32765 consensus_queue.cc:260] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.593274 32765 ts_tablet_manager.cc:1434] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:23:18.597285 32765 tablet_bootstrap.cc:492] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
W20260709 12:23:18.608186 32108 consensus_peers.cc:597] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:18.617471 32765 tablet_bootstrap.cc:492] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.618448 32765 tablet_bootstrap.cc:492] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.619024 32765 ts_tablet_manager.cc:1403] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.003s
I20260709 12:23:18.621021 32765 raft_consensus.cc:359] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:18.621536 32765 raft_consensus.cc:740] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.622174 32765 consensus_queue.cc:260] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:18.624063 32765 ts_tablet_manager.cc:1434] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:18.625376 32765 tablet_bootstrap.cc:492] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.645882 32765 tablet_bootstrap.cc:492] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.646768 32765 tablet_bootstrap.cc:492] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.647423 32765 ts_tablet_manager.cc:1403] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:23:18.649960 32765 raft_consensus.cc:359] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.650655 32765 raft_consensus.cc:740] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.651335 32765 consensus_queue.cc:260] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.653019 32765 ts_tablet_manager.cc:1434] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:18.653970 32765 tablet_bootstrap.cc:492] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.669502 32765 tablet_bootstrap.cc:492] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.670398 32765 tablet_bootstrap.cc:492] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.670979 32765 ts_tablet_manager.cc:1403] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:23:18.672915 32765 raft_consensus.cc:359] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.673422 32765 raft_consensus.cc:740] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.673960 32765 consensus_queue.cc:260] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.675750 32765 ts_tablet_manager.cc:1434] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:23:18.676829 32765 tablet_bootstrap.cc:492] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.692076 32765 tablet_bootstrap.cc:492] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.692886 32765 tablet_bootstrap.cc:492] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.693526 32765 ts_tablet_manager.cc:1403] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.005s
I20260709 12:23:18.695974 32765 raft_consensus.cc:359] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.696681 32765 raft_consensus.cc:740] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.697443 32765 consensus_queue.cc:260] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.699584 32765 ts_tablet_manager.cc:1434] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.007s
I20260709 12:23:18.701007 32765 tablet_bootstrap.cc:492] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.722301 32765 tablet_bootstrap.cc:492] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.723178 32765 tablet_bootstrap.cc:492] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.723846 32765 ts_tablet_manager.cc:1403] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 12:23:18.726308 32765 raft_consensus.cc:359] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.726819 32765 raft_consensus.cc:740] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.727342 32765 consensus_queue.cc:260] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.729013 32765 ts_tablet_manager.cc:1434] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:18.730446 32765 tablet_bootstrap.cc:492] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
W20260709 12:23:18.738214 32182 consensus_peers.cc:597] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:18.746511 32765 tablet_bootstrap.cc:492] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.747606 32765 tablet_bootstrap.cc:492] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.748723 32765 ts_tablet_manager.cc:1403] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:23:18.751288 32765 raft_consensus.cc:359] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.751945 32765 raft_consensus.cc:740] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.752657 32765 consensus_queue.cc:260] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.754725 32765 ts_tablet_manager.cc:1434] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:18.755518 32765 tablet_bootstrap.cc:492] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.770601 32765 tablet_bootstrap.cc:492] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.771584 32765 tablet_bootstrap.cc:492] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.772226 32765 ts_tablet_manager.cc:1403] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 12:23:18.774627 32765 raft_consensus.cc:359] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.775275 32765 raft_consensus.cc:740] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.775926 32765 consensus_queue.cc:260] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.777912 32765 ts_tablet_manager.cc:1434] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:23:18.778610 32765 tablet_bootstrap.cc:492] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.793087 32765 tablet_bootstrap.cc:492] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.794080 32765 tablet_bootstrap.cc:492] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.794778 32765 ts_tablet_manager.cc:1403] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:23:18.798583 32765 raft_consensus.cc:359] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.799075 32765 raft_consensus.cc:740] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.799640 32765 consensus_queue.cc:260] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.801403 32765 ts_tablet_manager.cc:1434] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:23:18.802510 32765 tablet_bootstrap.cc:492] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.817443 32765 tablet_bootstrap.cc:492] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.819264 32765 tablet_bootstrap.cc:492] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.819856 32765 ts_tablet_manager.cc:1403] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:23:18.821771 32765 raft_consensus.cc:359] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.822357 32765 raft_consensus.cc:740] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.822928 32765 consensus_queue.cc:260] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:18.824853 32765 ts_tablet_manager.cc:1434] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:23:18.825855 32765 tablet_bootstrap.cc:492] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.846487 32765 tablet_bootstrap.cc:492] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.847419 32765 tablet_bootstrap.cc:492] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.848084 32765 ts_tablet_manager.cc:1403] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 12:23:18.851652 32765 raft_consensus.cc:359] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.852317 32765 raft_consensus.cc:740] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.853003 32765 consensus_queue.cc:260] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:18.855301 32765 ts_tablet_manager.cc:1434] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:23:18.856475 32765 tablet_bootstrap.cc:492] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:18.859019   331 raft_consensus.cc:3060] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.906809 32212 raft_consensus.cc:1275] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:18.942857   386 consensus_queue.cc:1048] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:23:18.954452 32765 tablet_bootstrap.cc:492] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:18.955495 32765 tablet_bootstrap.cc:492] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:18.959298 32765 ts_tablet_manager.cc:1403] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.103s	user 0.028s	sys 0.030s
I20260709 12:23:18.963379   337 raft_consensus.cc:3060] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:18.983487 32765 raft_consensus.cc:359] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:18.984459 32765 raft_consensus.cc:740] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:18.991078   332 raft_consensus.cc:3060] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.993920   337 raft_consensus.cc:1275] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:18.998945   515 consensus_queue.cc:1048] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:19.010387   341 raft_consensus.cc:3060] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.985174 32765 consensus_queue.cc:260] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:19.017549 32765 ts_tablet_manager.cc:1434] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 12:23:19.018527 32765 tablet_bootstrap.cc:492] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:19.021150   338 raft_consensus.cc:3060] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.034065   334 raft_consensus.cc:3060] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.067785 32765 tablet_bootstrap.cc:492] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.068935 32765 tablet_bootstrap.cc:492] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:19.069586 32765 ts_tablet_manager.cc:1403] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.010s
I20260709 12:23:19.085301 32765 raft_consensus.cc:359] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:19.086275 32765 raft_consensus.cc:740] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:19.087199 32765 consensus_queue.cc:260] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:19.090178 32765 ts_tablet_manager.cc:1434] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:23:19.091596 32765 tablet_bootstrap.cc:492] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:19.121901 32765 tablet_bootstrap.cc:492] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.122874 32765 tablet_bootstrap.cc:492] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:19.123588 32765 ts_tablet_manager.cc:1403] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.005s
I20260709 12:23:19.126782 32765 raft_consensus.cc:359] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:19.127477 32765 raft_consensus.cc:740] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:19.128167 32765 consensus_queue.cc:260] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:19.131805 32765 ts_tablet_manager.cc:1434] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:19.132902 32765 tablet_bootstrap.cc:492] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:19.149132 32765 tablet_bootstrap.cc:492] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.150236 32765 tablet_bootstrap.cc:492] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:19.150986 32765 ts_tablet_manager.cc:1403] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:23:19.153702 32765 raft_consensus.cc:359] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:19.154537 32765 raft_consensus.cc:740] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:19.155253 32765 consensus_queue.cc:260] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:19.157516 32765 ts_tablet_manager.cc:1434] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:19.158402 32765 tablet_bootstrap.cc:492] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:19.174001 32765 tablet_bootstrap.cc:492] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.174857 32765 tablet_bootstrap.cc:492] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:19.175514 32765 ts_tablet_manager.cc:1403] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 12:23:19.177312 32765 raft_consensus.cc:359] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:19.177822 32765 raft_consensus.cc:740] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:19.178432 32765 consensus_queue.cc:260] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:19.180141 32765 ts_tablet_manager.cc:1434] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:19.181133 32765 tablet_bootstrap.cc:492] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:19.184106   334 raft_consensus.cc:3060] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.212787 32765 tablet_bootstrap.cc:492] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.213546 32765 tablet_bootstrap.cc:492] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:19.214166 32765 ts_tablet_manager.cc:1403] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.033s	user 0.026s	sys 0.003s
I20260709 12:23:19.216440 32765 raft_consensus.cc:359] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:19.217069 32765 raft_consensus.cc:740] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:19.217691 32765 consensus_queue.cc:260] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:19.218950   334 raft_consensus.cc:3060] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.220260 32765 ts_tablet_manager.cc:1434] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:19.221068 32765 tablet_bootstrap.cc:492] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:19.249533 32765 tablet_bootstrap.cc:492] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.250445 32765 tablet_bootstrap.cc:492] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:19.251096 32765 ts_tablet_manager.cc:1403] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.030s	user 0.026s	sys 0.000s
I20260709 12:23:19.253610 32765 raft_consensus.cc:359] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:19.254279 32765 raft_consensus.cc:740] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:19.254932 32765 consensus_queue.cc:260] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:19.256986 32765 ts_tablet_manager.cc:1434] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:19.258234 32765 tablet_bootstrap.cc:492] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap starting.
I20260709 12:23:19.273474 32765 tablet_bootstrap.cc:492] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.274407 32765 tablet_bootstrap.cc:492] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196: Bootstrap complete.
I20260709 12:23:19.275079 32765 ts_tablet_manager.cc:1403] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:23:19.277493 32765 raft_consensus.cc:359] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:19.278167 32765 raft_consensus.cc:740] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Initialized, Role: FOLLOWER
I20260709 12:23:19.278774 32765 consensus_queue.cc:260] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:19.280939 32765 ts_tablet_manager.cc:1434] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:19.347318   334 raft_consensus.cc:3060] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.351265   332 raft_consensus.cc:3060] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.352996 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:25.419227 32063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f99752364a34ef88c766999394fce3a"
dest_uuid: "13d67625d82d4304a0ebff87742a538d"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:41266
I20260709 12:23:25.419843 32063 raft_consensus.cc:606] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:25.422742 32063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0bbc7593a9a40acbab37a51e0269bef"
dest_uuid: "13d67625d82d4304a0ebff87742a538d"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:41266
I20260709 12:23:25.423290 32063 raft_consensus.cc:606] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:25.455024 32212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a"
dest_uuid: "68991541d4134b4f89800c972fdad372"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:36960
I20260709 12:23:25.455679 32212 raft_consensus.cc:606] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:25.470477 32144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e04a298de8bc48c795631812d4179057"
dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
mode: GRACEFUL
new_leader_uuid: "13d67625d82d4304a0ebff87742a538d"
 from {username='slave'} at 127.0.0.1:51678
I20260709 12:23:25.471064 32144 raft_consensus.cc:606] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Received request to transfer leadership to TS 13d67625d82d4304a0ebff87742a538d
I20260709 12:23:25.474057 32063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e711714b08b04798b67a243e1267184f"
dest_uuid: "13d67625d82d4304a0ebff87742a538d"
mode: GRACEFUL
new_leader_uuid: "68991541d4134b4f89800c972fdad372"
 from {username='slave'} at 127.0.0.1:41266
I20260709 12:23:25.474612 32063 raft_consensus.cc:606] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Received request to transfer leadership to TS 68991541d4134b4f89800c972fdad372
I20260709 12:23:25.477479 32063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe944fa4b5a547758fe6318ebe933804"
dest_uuid: "13d67625d82d4304a0ebff87742a538d"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:41266
I20260709 12:23:25.478168 32063 raft_consensus.cc:606] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:25.479374 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:25.480746 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:25.481766 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:25.495916   549 raft_consensus.cc:993] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:25.497659   517 raft_consensus.cc:1081] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:25.500494   332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f99752364a34ef88c766999394fce3a"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57590
I20260709 12:23:25.501178   332 raft_consensus.cc:493] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.501878   332 raft_consensus.cc:3060] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.514063   332 raft_consensus.cc:515] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:25.519476   332 leader_election.cc:290] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 3 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:25.534381 32212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:25.534978 32212 raft_consensus.cc:3060] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.541052 32063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f99752364a34ef88c766999394fce3a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:25.541711 32063 raft_consensus.cc:3055] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:25.541975 32063 raft_consensus.cc:740] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:25.542765 32063 consensus_queue.cc:260] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:25.543993 32063 raft_consensus.cc:3060] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.550541 32212 raft_consensus.cc:2468] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 3.
I20260709 12:23:25.550908 32063 raft_consensus.cc:2468] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 3.
I20260709 12:23:25.552331 32758 leader_election.cc:304] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:25.554332   560 raft_consensus.cc:2804] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:25.555734   560 raft_consensus.cc:697] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:25.556656   560 consensus_queue.cc:237] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:25.569321 31888 catalog_manager.cc:5697] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 2 to 3, leader changed from 13d67625d82d4304a0ebff87742a538d (127.23.81.194) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 3 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.615330   557 raft_consensus.cc:993] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d: : Instructing follower 68991541d4134b4f89800c972fdad372 to start an election
I20260709 12:23:25.615798   557 raft_consensus.cc:1081] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Signalling peer 68991541d4134b4f89800c972fdad372 to start an election
I20260709 12:23:25.617242 32212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e711714b08b04798b67a243e1267184f"
dest_uuid: "68991541d4134b4f89800c972fdad372"
 from {username='slave'} at 127.0.0.1:40656
I20260709 12:23:25.617707 32212 raft_consensus.cc:493] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.617940 32212 raft_consensus.cc:3060] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.622956 32212 raft_consensus.cc:515] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:25.624874 32212 leader_election.cc:290] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:25.625674 32063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e711714b08b04798b67a243e1267184f" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:25.626327 32063 raft_consensus.cc:3055] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:25.626472 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e711714b08b04798b67a243e1267184f" candidate_uuid: "68991541d4134b4f89800c972fdad372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:25.627142 32144 raft_consensus.cc:3060] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.626654 32063 raft_consensus.cc:740] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:25.628379 32063 consensus_queue.cc:260] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:25.629418 32063 raft_consensus.cc:3060] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.632380 32144 raft_consensus.cc:2468] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 2.
I20260709 12:23:25.633548 32182 leader_election.cc:304] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68991541d4134b4f89800c972fdad372, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:25.634516   548 raft_consensus.cc:2804] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:25.634534 32063 raft_consensus.cc:2468] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68991541d4134b4f89800c972fdad372 in term 2.
I20260709 12:23:25.635028   548 raft_consensus.cc:697] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Becoming Leader. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:25.636008   548 consensus_queue.cc:237] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:25.647348 31888 catalog_manager.cc:5697] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 reported cstate change: term changed from 1 to 2, leader changed from 13d67625d82d4304a0ebff87742a538d (127.23.81.194) to 68991541d4134b4f89800c972fdad372 (127.23.81.196). New cstate: current_term: 2 leader_uuid: "68991541d4134b4f89800c972fdad372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:25.738071   557 raft_consensus.cc:993] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:25.738584   549 raft_consensus.cc:1081] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:25.741582   332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe944fa4b5a547758fe6318ebe933804"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57590
I20260709 12:23:25.742092   332 raft_consensus.cc:493] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.742431   332 raft_consensus.cc:3060] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.748706   332 raft_consensus.cc:515] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:25.751713   332 leader_election.cc:290] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:25.753232 32063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe944fa4b5a547758fe6318ebe933804" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:25.754241 32063 raft_consensus.cc:3055] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:25.754566 32063 raft_consensus.cc:740] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:25.757928   557 raft_consensus.cc:993] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:25.756613 32063 consensus_queue.cc:260] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:25.758697   557 raft_consensus.cc:1081] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:25.759244 32063 raft_consensus.cc:3060] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.760310   332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0bbc7593a9a40acbab37a51e0269bef"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57590
I20260709 12:23:25.760877   332 raft_consensus.cc:493] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.761226   332 raft_consensus.cc:3060] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.765043 32139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe944fa4b5a547758fe6318ebe933804" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:25.765663 32139 raft_consensus.cc:3060] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.766129 32063 raft_consensus.cc:2468] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:25.767206 32762 leader_election.cc:304] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:25.768251   560 raft_consensus.cc:2804] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:25.768079   332 raft_consensus.cc:515] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:25.768808   560 raft_consensus.cc:697] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:25.769671   560 consensus_queue.cc:237] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:25.770965 32212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bbc7593a9a40acbab37a51e0269bef" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:25.771384 32063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bbc7593a9a40acbab37a51e0269bef" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:25.771559 32212 raft_consensus.cc:3060] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.770232   332 leader_election.cc:290] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:25.775484 32139 raft_consensus.cc:2468] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:25.779917 32212 raft_consensus.cc:2468] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:25.781255 32758 leader_election.cc:304] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:25.781606 32063 raft_consensus.cc:3055] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:25.781966 32063 raft_consensus.cc:740] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:25.782397   561 raft_consensus.cc:2804] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:25.782882 32063 consensus_queue.cc:260] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:25.783963   561 raft_consensus.cc:697] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:25.784363 32063 raft_consensus.cc:3060] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.784911   561 consensus_queue.cc:237] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:25.791117 31888 catalog_manager.cc:5697] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 1 to 2, leader changed from 13d67625d82d4304a0ebff87742a538d (127.23.81.194) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.791893 32063 raft_consensus.cc:2468] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:25.808558 31888 catalog_manager.cc:5697] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 1 to 2, leader changed from 13d67625d82d4304a0ebff87742a538d (127.23.81.194) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.829130   548 raft_consensus.cc:993] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:25.829735   521 raft_consensus.cc:1081] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:25.831599   334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57596
I20260709 12:23:25.832181   334 raft_consensus.cc:493] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.832558   334 raft_consensus.cc:3060] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.835314   551 raft_consensus.cc:993] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2: : Instructing follower 13d67625d82d4304a0ebff87742a538d to start an election
I20260709 12:23:25.835945   571 raft_consensus.cc:1081] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Signalling peer 13d67625d82d4304a0ebff87742a538d to start an election
I20260709 12:23:25.837486 32063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e04a298de8bc48c795631812d4179057"
dest_uuid: "13d67625d82d4304a0ebff87742a538d"
 from {username='slave'} at 127.0.0.1:44130
I20260709 12:23:25.837960 32063 raft_consensus.cc:493] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.838332 32063 raft_consensus.cc:3060] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.839182   334 raft_consensus.cc:515] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:25.841758   334 leader_election.cc:290] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 3 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:25.842231 32212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:25.842835 32212 raft_consensus.cc:3055] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:25.843124 32212 raft_consensus.cc:740] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:25.843843 32212 consensus_queue.cc:260] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:25.844889 32212 raft_consensus.cc:3060] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.844787 32063 raft_consensus.cc:515] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:25.846520 32061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d663ad19f6a14af4b9a084536570893a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:25.847221 32061 raft_consensus.cc:3060] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.847496 32063 leader_election.cc:290] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:25.848686 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04a298de8bc48c795631812d4179057" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:25.849223 32144 raft_consensus.cc:3055] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:25.849453 32144 raft_consensus.cc:740] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:25.850188 32144 consensus_queue.cc:260] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:25.851122 32144 raft_consensus.cc:3060] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.853368 32061 raft_consensus.cc:2468] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 3.
I20260709 12:23:25.854482 32762 leader_election.cc:304] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:25.855271   561 raft_consensus.cc:2804] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:25.855777   561 raft_consensus.cc:697] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:25.856696   561 consensus_queue.cc:237] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:25.857788 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04a298de8bc48c795631812d4179057" candidate_uuid: "13d67625d82d4304a0ebff87742a538d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:25.858397 32211 raft_consensus.cc:3060] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.862282 32212 raft_consensus.cc:2468] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 3.
I20260709 12:23:25.863394 32144 raft_consensus.cc:2468] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 2.
I20260709 12:23:25.864624 32034 leader_election.cc:304] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:25.865582 32211 raft_consensus.cc:2468] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d67625d82d4304a0ebff87742a538d in term 2.
I20260709 12:23:25.871476   549 raft_consensus.cc:2804] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:25.873040   549 raft_consensus.cc:697] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Becoming Leader. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:25.873850   549 consensus_queue.cc:237] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } }
I20260709 12:23:25.882365 31888 catalog_manager.cc:5697] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 2 to 3, leader changed from 68991541d4134b4f89800c972fdad372 (127.23.81.196) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 3 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.887125 31889 catalog_manager.cc:5697] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d reported cstate change: term changed from 1 to 2, leader changed from c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195) to 13d67625d82d4304a0ebff87742a538d (127.23.81.194). New cstate: current_term: 2 leader_uuid: "13d67625d82d4304a0ebff87742a538d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.939356 32061 raft_consensus.cc:1275] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:25.940646   561 consensus_queue.cc:1048] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:25.952805 32211 raft_consensus.cc:1275] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:25.954200   561 consensus_queue.cc:1048] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.080533 32063 raft_consensus.cc:1275] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer 68991541d4134b4f89800c972fdad372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:26.081878   548 consensus_queue.cc:1048] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:26.100288 32139 raft_consensus.cc:1275] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Refusing update from remote peer 68991541d4134b4f89800c972fdad372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:26.102092   578 consensus_queue.cc:1048] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:26.215560 32063 raft_consensus.cc:1275] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:26.216913   561 consensus_queue.cc:1048] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:26.219060 32211 raft_consensus.cc:1275] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:26.220367   561 consensus_queue.cc:1048] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:26.233996 32139 raft_consensus.cc:1275] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:26.236583   569 consensus_queue.cc:1048] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:26.252074 32061 raft_consensus.cc:1275] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:26.256554   561 consensus_queue.cc:1048] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:26.315388 32211 raft_consensus.cc:1275] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:26.316711   561 consensus_queue.cc:1048] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.318529 32139 raft_consensus.cc:1275] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:26.320230   549 consensus_queue.cc:1048] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:26.329144 32061 raft_consensus.cc:1275] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:26.334187   560 consensus_queue.cc:1048] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.354233 32211 raft_consensus.cc:1275] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer 13d67625d82d4304a0ebff87742a538d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:26.356829   557 consensus_queue.cc:1048] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:26.536342 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:26.581324 32144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12128bac871f458ea02ff3b811378a98"
dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:51678
I20260709 12:23:26.581912 32144 raft_consensus.cc:606] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:26.584553 32144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378"
dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:51678
I20260709 12:23:26.585034 32144 raft_consensus.cc:606] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:26.587654 32211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97a7ca73ef254c8b9bbe684f81fa6af8"
dest_uuid: "68991541d4134b4f89800c972fdad372"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:36960
I20260709 12:23:26.588236 32211 raft_consensus.cc:606] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:26.592360 32063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2283c016207489eb71580db11ee3a02"
dest_uuid: "13d67625d82d4304a0ebff87742a538d"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:41266
I20260709 12:23:26.592825 32063 raft_consensus.cc:606] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:26.595562 32211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc23d93569d44dd8a4bafcb504fc056a"
dest_uuid: "68991541d4134b4f89800c972fdad372"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:36960
I20260709 12:23:26.596190 32211 raft_consensus.cc:606] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:26.598062 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:26.599414 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:26.600037 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:26.637264   571 raft_consensus.cc:993] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:26.637941   593 raft_consensus.cc:1081] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:26.639453   341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57598
I20260709 12:23:26.639918   341 raft_consensus.cc:493] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.640228   341 raft_consensus.cc:3060] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.645993   341 raft_consensus.cc:515] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:26.647362   341 leader_election.cc:290] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 3 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:26.648228 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:26.648849 32144 raft_consensus.cc:3055] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:26.649160 32144 raft_consensus.cc:740] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:26.649430 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f5edcc0d06488fb238c7ea0af75378" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:26.650069 32211 raft_consensus.cc:3060] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.649895 32144 consensus_queue.cc:260] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:26.651347 32144 raft_consensus.cc:3060] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.657855 32211 raft_consensus.cc:2468] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 3.
I20260709 12:23:26.658731 32144 raft_consensus.cc:2468] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 3.
I20260709 12:23:26.659307 32758 leader_election.cc:304] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:26.660269   569 raft_consensus.cc:2804] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:26.660740   569 raft_consensus.cc:697] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:26.661582   569 consensus_queue.cc:237] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:26.672128 31893 catalog_manager.cc:5697] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 2 to 3, leader changed from c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 3 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.701565   571 raft_consensus.cc:993] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:26.702209   571 raft_consensus.cc:1081] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:26.703781   334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12128bac871f458ea02ff3b811378a98"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57598
I20260709 12:23:26.704342   334 raft_consensus.cc:493] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.704667   334 raft_consensus.cc:3060] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.712457   334 raft_consensus.cc:515] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:26.714512   334 leader_election.cc:290] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:26.715005 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12128bac871f458ea02ff3b811378a98" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:26.714896 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12128bac871f458ea02ff3b811378a98" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:26.715679 32211 raft_consensus.cc:3060] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.715761 32144 raft_consensus.cc:3055] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:26.716179 32144 raft_consensus.cc:740] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:26.716862 32144 consensus_queue.cc:260] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:26.717810 32144 raft_consensus.cc:3060] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.720391 32211 raft_consensus.cc:2468] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:26.721521 32758 leader_election.cc:304] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:26.722405   569 raft_consensus.cc:2804] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:26.722944 32144 raft_consensus.cc:2468] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:26.723214   569 raft_consensus.cc:697] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:26.724195   569 consensus_queue.cc:237] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:26.733843 31893 catalog_manager.cc:5697] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 1 to 2, leader changed from c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.794165   521 raft_consensus.cc:993] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:26.794771   578 raft_consensus.cc:1081] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:26.796272   341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97a7ca73ef254c8b9bbe684f81fa6af8"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57596
I20260709 12:23:26.796952   341 raft_consensus.cc:493] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.797343   341 raft_consensus.cc:3060] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.803367   341 raft_consensus.cc:515] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:26.805539   341 leader_election.cc:290] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:26.806408 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a7ca73ef254c8b9bbe684f81fa6af8" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:26.807112 32211 raft_consensus.cc:3055] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:26.807433 32211 raft_consensus.cc:740] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:26.807863 32061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a7ca73ef254c8b9bbe684f81fa6af8" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:26.808471 32061 raft_consensus.cc:3060] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.808357 32211 consensus_queue.cc:260] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:26.809967 32211 raft_consensus.cc:3060] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.816959 32061 raft_consensus.cc:2468] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:26.817384 32211 raft_consensus.cc:2468] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:26.818570 32758 leader_election.cc:304] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:26.819429   569 raft_consensus.cc:2804] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:26.820021   569 raft_consensus.cc:697] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:26.820884   569 consensus_queue.cc:237] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:26.831931 31893 catalog_manager.cc:5697] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 1 to 2, leader changed from 68991541d4134b4f89800c972fdad372 (127.23.81.196) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.879405   591 raft_consensus.cc:993] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:26.879917   557 raft_consensus.cc:1081] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:26.881232   341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2283c016207489eb71580db11ee3a02"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57590
I20260709 12:23:26.881726   341 raft_consensus.cc:493] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.882045   341 raft_consensus.cc:3060] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.888007   341 raft_consensus.cc:515] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:26.889860   341 leader_election.cc:290] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 3 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:26.890488 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:26.891078 32211 raft_consensus.cc:3060] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.890911 32061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2283c016207489eb71580db11ee3a02" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:26.891625 32061 raft_consensus.cc:3055] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:26.891935 32061 raft_consensus.cc:740] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 13d67625d82d4304a0ebff87742a538d, State: Running, Role: LEADER
I20260709 12:23:26.892757 32061 consensus_queue.cc:260] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:26.893888 32061 raft_consensus.cc:3060] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.896814 32211 raft_consensus.cc:2468] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 3.
I20260709 12:23:26.898085 32758 leader_election.cc:304] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:26.899710   560 raft_consensus.cc:2804] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:26.899719 32061 raft_consensus.cc:2468] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 3.
I20260709 12:23:26.900285   560 raft_consensus.cc:697] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:26.901189   560 consensus_queue.cc:237] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:26.912599 31893 catalog_manager.cc:5697] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 2 to 3, leader changed from 13d67625d82d4304a0ebff87742a538d (127.23.81.194) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 3 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:27.152719 32144 raft_consensus.cc:1275] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 3 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:27.153820   560 consensus_queue.cc:1048] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.163093 32211 raft_consensus.cc:1275] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:27.164744   560 consensus_queue.cc:1048] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.176476   600 raft_consensus.cc:993] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:27.176997   600 raft_consensus.cc:1081] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:27.178927   341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc23d93569d44dd8a4bafcb504fc056a"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57596
I20260709 12:23:27.179481   341 raft_consensus.cc:493] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:27.179842   341 raft_consensus.cc:3060] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.186092   341 raft_consensus.cc:515] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:27.187803   341 leader_election.cc:290] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Requested vote from peers 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:27.188390 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc23d93569d44dd8a4bafcb504fc056a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:27.188748 32063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc23d93569d44dd8a4bafcb504fc056a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:27.189044 32211 raft_consensus.cc:3055] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:27.189368 32063 raft_consensus.cc:3060] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.189409 32211 raft_consensus.cc:740] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68991541d4134b4f89800c972fdad372, State: Running, Role: LEADER
I20260709 12:23:27.190524 32144 raft_consensus.cc:1275] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:27.190804 32211 consensus_queue.cc:260] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:27.191968   560 consensus_queue.cc:1048] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:27.192353 32211 raft_consensus.cc:3060] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.199083 32063 raft_consensus.cc:2468] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:27.200205 32762 leader_election.cc:304] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
I20260709 12:23:27.200213 32211 raft_consensus.cc:2468] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:27.201359   560 raft_consensus.cc:2804] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:27.207007   560 raft_consensus.cc:697] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:27.207983   560 consensus_queue.cc:237] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:27.209563 32211 raft_consensus.cc:1275] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:27.211583   561 consensus_queue.cc:1048] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:27.225919 31893 catalog_manager.cc:5697] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 1 to 2, leader changed from 68991541d4134b4f89800c972fdad372 (127.23.81.196) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:27.350332 32063 raft_consensus.cc:1275] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:27.351743   560 consensus_queue.cc:1048] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.361129 32211 raft_consensus.cc:1275] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:27.362865   610 consensus_queue.cc:1048] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.388789 32063 raft_consensus.cc:1275] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:27.390206   610 consensus_queue.cc:1048] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:27.411516 32211 raft_consensus.cc:1275] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:27.414342   560 consensus_queue.cc:1048] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:27.637674 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:27.680085 32139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccc89be17b447c0bc6982d607a2983a"
dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:51678
I20260709 12:23:27.680667 32139 raft_consensus.cc:606] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:27.683264 32139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19d55921a3ee4ee18232cdd3f94fcbb9"
dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:51678
I20260709 12:23:27.683898 32139 raft_consensus.cc:606] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:27.686532 32139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a35467eb315463dae6edfd61cdb4a79"
dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:51678
I20260709 12:23:27.687057 32139 raft_consensus.cc:606] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:27.689495 32139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6edffd8d7fac40d1b74f6a23d3517e8b"
dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:51678
I20260709 12:23:27.689975 32139 raft_consensus.cc:606] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:27.692405 32139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dae2aab0addf4c939688292e7118cbe0"
dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
mode: GRACEFUL
new_leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:51678
I20260709 12:23:27.692904 32139 raft_consensus.cc:606] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Received request to transfer leadership to TS 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:27.694937 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:27.696774 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:27.697624 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:27.702015 32211 raft_consensus.cc:1275] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:27.704077   560 consensus_queue.cc:1048] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:27.729568 32061 raft_consensus.cc:1275] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:27.731125   560 consensus_queue.cc:1048] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:27.825318   571 raft_consensus.cc:993] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:27.825841   593 raft_consensus.cc:1081] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:27.827339   341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dae2aab0addf4c939688292e7118cbe0"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57598
I20260709 12:23:27.827911   341 raft_consensus.cc:493] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:27.828222   341 raft_consensus.cc:3060] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.833871   341 raft_consensus.cc:515] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:27.835494   341 leader_election.cc:290] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:27.836190 32139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae2aab0addf4c939688292e7118cbe0" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:27.836512 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae2aab0addf4c939688292e7118cbe0" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:27.836823 32139 raft_consensus.cc:3055] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:27.837064 32211 raft_consensus.cc:3060] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.837138 32139 raft_consensus.cc:740] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:27.838065 32139 consensus_queue.cc:260] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:27.839334 32139 raft_consensus.cc:3060] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.844158 32211 raft_consensus.cc:2468] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:27.845299 32758 leader_election.cc:304] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:27.845773 32139 raft_consensus.cc:2468] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:27.846024   560 raft_consensus.cc:2804] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:27.846680   560 raft_consensus.cc:697] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:27.847525   560 consensus_queue.cc:237] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:27.858575 31888 catalog_manager.cc:5697] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 1 to 2, leader changed from c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:27.872385   593 raft_consensus.cc:993] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:27.872844   571 raft_consensus.cc:1081] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:27.874234   334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19d55921a3ee4ee18232cdd3f94fcbb9"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57598
I20260709 12:23:27.874732   334 raft_consensus.cc:493] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:27.875100   334 raft_consensus.cc:3060] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.879884   334 raft_consensus.cc:515] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:27.881610   334 leader_election.cc:290] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:27.882639 32139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d55921a3ee4ee18232cdd3f94fcbb9" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:27.882696 32211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d55921a3ee4ee18232cdd3f94fcbb9" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:27.883409 32211 raft_consensus.cc:3060] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.883978 32139 raft_consensus.cc:3055] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:27.884312 32139 raft_consensus.cc:740] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:27.885031 32139 consensus_queue.cc:260] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:27.886305 32139 raft_consensus.cc:3060] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.890599 32211 raft_consensus.cc:2468] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:27.891772 32758 leader_election.cc:304] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:27.892637   560 raft_consensus.cc:2804] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:27.893114   560 raft_consensus.cc:697] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:27.893553 32139 raft_consensus.cc:2468] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:27.893980   560 consensus_queue.cc:237] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:27.903637 31888 catalog_manager.cc:5697] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 1 to 2, leader changed from c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:27.957020   593 raft_consensus.cc:993] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:27.957526   571 raft_consensus.cc:1081] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:27.958922   334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a35467eb315463dae6edfd61cdb4a79"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57598
I20260709 12:23:27.959331   334 raft_consensus.cc:493] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:27.959570   334 raft_consensus.cc:3060] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.964105   334 raft_consensus.cc:515] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:27.966391 32144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a35467eb315463dae6edfd61cdb4a79" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:27.966109   334 leader_election.cc:290] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:27.966763 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a35467eb315463dae6edfd61cdb4a79" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:27.966980 32144 raft_consensus.cc:3055] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:27.967415 32218 raft_consensus.cc:3060] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.967425 32144 raft_consensus.cc:740] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:27.968371 32144 consensus_queue.cc:260] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:27.969635 32144 raft_consensus.cc:3060] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.974242 32218 raft_consensus.cc:2468] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:27.975029 32144 raft_consensus.cc:2468] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:27.975483 32758 leader_election.cc:304] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, 68991541d4134b4f89800c972fdad372; no voters: 
I20260709 12:23:27.976354   560 raft_consensus.cc:2804] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:27.976869   560 raft_consensus.cc:697] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:27.977730   560 consensus_queue.cc:237] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:27.990797 31888 catalog_manager.cc:5697] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 1 to 2, leader changed from c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:28.051028   571 raft_consensus.cc:993] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:28.051507   593 raft_consensus.cc:1081] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:28.053184   341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6edffd8d7fac40d1b74f6a23d3517e8b"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57598
I20260709 12:23:28.053838   341 raft_consensus.cc:493] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:28.054296   341 raft_consensus.cc:3060] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.063040   341 raft_consensus.cc:515] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:28.120673 32063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edffd8d7fac40d1b74f6a23d3517e8b" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13d67625d82d4304a0ebff87742a538d"
I20260709 12:23:28.130561 32063 raft_consensus.cc:3060] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.121753   341 leader_election.cc:290] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Requested vote from peers 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135), c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745)
I20260709 12:23:28.123178 32139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edffd8d7fac40d1b74f6a23d3517e8b" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:28.137768 32139 raft_consensus.cc:3055] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:28.138806 32139 raft_consensus.cc:740] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:28.141914 32139 consensus_queue.cc:260] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:28.144608 32139 raft_consensus.cc:3060] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.167892 32063 raft_consensus.cc:2468] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:28.169632 32139 raft_consensus.cc:2468] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:28.170059 32762 leader_election.cc:304] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196; no voters: 
W20260709 12:23:28.171795 32110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:33135, user_credentials={real_user=slave}} blocked reactor thread for 45908.8us
I20260709 12:23:28.172076   569 raft_consensus.cc:2804] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:28.173041   569 raft_consensus.cc:697] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:28.177677   569 consensus_queue.cc:237] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } }
I20260709 12:23:28.204511   571 raft_consensus.cc:993] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2: : Instructing follower 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:28.205304   571 raft_consensus.cc:1081] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Signalling peer 2c26adea8e3a48ce82a0abbd2fc17196 to start an election
I20260709 12:23:28.207921   341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ccc89be17b447c0bc6982d607a2983a"
dest_uuid: "2c26adea8e3a48ce82a0abbd2fc17196"
 from {username='slave'} at 127.0.0.1:57598
I20260709 12:23:28.208559   341 raft_consensus.cc:493] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:28.208873   341 raft_consensus.cc:3060] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.209899 31888 catalog_manager.cc:5697] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 1 to 2, leader changed from c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.221670   341 raft_consensus.cc:515] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:28.226982   341 leader_election.cc:290] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Requested vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 68991541d4134b4f89800c972fdad372 (127.23.81.196:46375)
I20260709 12:23:28.227239 32139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccc89be17b447c0bc6982d607a2983a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5524748d37141a1bca7d0cedaeb40f2"
I20260709 12:23:28.228019 32139 raft_consensus.cc:3055] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:28.228364 32139 raft_consensus.cc:740] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5524748d37141a1bca7d0cedaeb40f2, State: Running, Role: LEADER
I20260709 12:23:28.229452 32139 consensus_queue.cc:260] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:28.232528 32139 raft_consensus.cc:3060] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.233197 32218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccc89be17b447c0bc6982d607a2983a" candidate_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68991541d4134b4f89800c972fdad372"
I20260709 12:23:28.237500 32218 raft_consensus.cc:3060] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.252151 32139 raft_consensus.cc:2468] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:28.254004 32759 leader_election.cc:304] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2; no voters: 
I20260709 12:23:28.255143   609 raft_consensus.cc:2804] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:28.255719   609 raft_consensus.cc:697] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Becoming Leader. State: Replica: 2c26adea8e3a48ce82a0abbd2fc17196, State: Running, Role: LEADER
I20260709 12:23:28.256940   609 consensus_queue.cc:237] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:28.257714 32218 raft_consensus.cc:2468] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c26adea8e3a48ce82a0abbd2fc17196 in term 2.
I20260709 12:23:28.272670 31888 catalog_manager.cc:5697] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 reported cstate change: term changed from 1 to 2, leader changed from c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195) to 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:28.386492 32139 raft_consensus.cc:1275] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:28.387854   633 consensus_queue.cc:1048] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:28.402292 32218 raft_consensus.cc:1275] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:28.404249   560 consensus_queue.cc:1048] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:28.428349 32218 raft_consensus.cc:1275] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:28.430413   609 consensus_queue.cc:1048] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.444730 32141 raft_consensus.cc:1275] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:28.451395   560 consensus_queue.cc:1048] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:28.586397 32139 raft_consensus.cc:1275] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:28.588104   560 consensus_queue.cc:1048] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.589975 32061 raft_consensus.cc:1275] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:28.591881   633 consensus_queue.cc:1048] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.632035 32218 raft_consensus.cc:1275] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:28.640385   560 consensus_queue.cc:1048] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.645875 32141 raft_consensus.cc:1275] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:28.646641 32143 raft_consensus.cc:1275] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:28.650187   569 consensus_queue.cc:1048] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.651993   569 consensus_queue.cc:1048] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.679807 32218 raft_consensus.cc:1275] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Refusing update from remote peer 2c26adea8e3a48ce82a0abbd2fc17196: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:28.682616   609 consensus_queue.cc:1048] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:28.792335 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:28.829272 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:28.830309 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:28.830935 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:28.865232 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:28.900537 23879 tablet_server.cc:179] TabletServer@127.23.81.193:41023 shutting down...
W20260709 12:23:28.933447 32034 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 64 similar messages]
W20260709 12:23:28.937314 32034 consensus_peers.cc:597] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.953161 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:28.954425 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:28.955789 23879 raft_consensus.cc:2243] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:28.957001 23879 raft_consensus.cc:2272] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:28.958304 32034 consensus_peers.cc:597] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:28.959236 32034 consensus_peers.cc:597] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.961066 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:28.962270 23879 raft_consensus.cc:2243] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:28.963440 23879 raft_consensus.cc:2272] T 7f99752364a34ef88c766999394fce3a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:28.966168 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:28.966921 23879 raft_consensus.cc:2243] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:28.968405 23879 raft_consensus.cc:2272] T 12128bac871f458ea02ff3b811378a98 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:28.972208 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:28.973294 23879 raft_consensus.cc:2243] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:28.974529 23879 raft_consensus.cc:2272] T 6edffd8d7fac40d1b74f6a23d3517e8b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:28.975837 32182 consensus_peers.cc:597] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:28.978121 32182 consensus_peers.cc:597] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.980346 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:28.981923 23879 raft_consensus.cc:2243] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:28.983170 23879 raft_consensus.cc:2272] T a0bbc7593a9a40acbab37a51e0269bef P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:28.987335 23879 tablet_replica.cc:333] stopping tablet replica
W20260709 12:23:28.988062 32108 consensus_peers.cc:597] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.988305 23879 raft_consensus.cc:2243] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:28.988970 23879 raft_consensus.cc:2272] T 45ffe4df6d544068be9090ac7db408a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:28.980370 32034 consensus_peers.cc:597] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.992457 23879 tablet_replica.cc:333] stopping tablet replica
W20260709 12:23:28.992625 32182 consensus_peers.cc:597] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.993335 23879 raft_consensus.cc:2243] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:28.993956 23879 raft_consensus.cc:2272] T 30469d27ec5d450393d6116dbc4d0c7b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:28.996585 23879 tablet_replica.cc:333] stopping tablet replica
W20260709 12:23:28.996592 32108 consensus_peers.cc:597] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.997543 23879 raft_consensus.cc:2243] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:28.998732 23879 raft_consensus.cc:2272] T a2283c016207489eb71580db11ee3a02 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.001847 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.002699 23879 raft_consensus.cc:2243] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.003247 23879 raft_consensus.cc:2272] T e99b876f266b452a8e5d9782c08a1616 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.006357 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.007278 23879 raft_consensus.cc:2243] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.008302 23879 raft_consensus.cc:2272] T d663ad19f6a14af4b9a084536570893a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.011775 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.012632 23879 raft_consensus.cc:2243] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.013291 23879 raft_consensus.cc:2272] T 4e692c206a274e1fbd3fb6b4ef2358ec P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.014762 32108 consensus_peers.cc:597] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.016112 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.017022 23879 raft_consensus.cc:2243] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.017563 23879 raft_consensus.cc:2272] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.020656 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.021338 23879 raft_consensus.cc:2243] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.022221 23879 raft_consensus.cc:2272] T dae2aab0addf4c939688292e7118cbe0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.025161 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.025858 23879 raft_consensus.cc:2243] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.026371 23879 raft_consensus.cc:2272] T 3c31ec08af4642a8a25265fcb3dd6c11 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.028764 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.029525 23879 raft_consensus.cc:2243] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.030664 23879 raft_consensus.cc:2272] T 4a35467eb315463dae6edfd61cdb4a79 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.034158 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.034994 23879 raft_consensus.cc:2243] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.035506 23879 raft_consensus.cc:2272] T 737f0117f5e849cca1421fb53b5ccd31 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.038141 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.038751 23879 raft_consensus.cc:2243] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.039273 23879 raft_consensus.cc:2272] T 51e6e3a7239949adaa6b5dacaf6ded22 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.041828 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.042445 23879 raft_consensus.cc:2243] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.043279 23879 raft_consensus.cc:2272] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.045495 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.046275 23879 raft_consensus.cc:2243] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.046773 23879 raft_consensus.cc:2272] T 9392ba9e91ca46f0ad3cdef6256aad0d P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.049126 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.049757 23879 raft_consensus.cc:2243] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.050192 23879 raft_consensus.cc:2272] T ab51a346acba496aa7601f0835510af0 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.052332 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.052935 23879 raft_consensus.cc:2243] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.053740 23879 raft_consensus.cc:2272] T 77f5edcc0d06488fb238c7ea0af75378 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.055781 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.056284 23879 raft_consensus.cc:2243] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.056635 23879 raft_consensus.cc:2272] T 63b94a9b9d1441438a95bedc11c7a96f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.058616 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.059166 23879 raft_consensus.cc:2243] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.059918 23879 raft_consensus.cc:2272] T fe944fa4b5a547758fe6318ebe933804 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.061810 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.062390 23879 raft_consensus.cc:2243] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.062762 23879 raft_consensus.cc:2272] T fb989fb1126c4cc18ed28296301844a2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.064968 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.065450 23879 raft_consensus.cc:2243] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.065836 23879 raft_consensus.cc:2272] T 6473d98e1f49484c888a0fb622b9b083 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.067866 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.068583 23879 raft_consensus.cc:2243] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.069387 23879 raft_consensus.cc:2272] T dc23d93569d44dd8a4bafcb504fc056a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.071481 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.072166 23879 raft_consensus.cc:2243] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.072645 23879 raft_consensus.cc:2272] T d8c591c793c14148a28a7095ad7db608 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.074929 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.075502 23879 raft_consensus.cc:2243] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.075906 23879 raft_consensus.cc:2272] T 4c9929922e1c4f3899055b92ea3f0774 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.077925 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.078526 23879 raft_consensus.cc:2243] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.078960 23879 raft_consensus.cc:2272] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.080921 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.081470 23879 raft_consensus.cc:2243] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.081884 23879 raft_consensus.cc:2272] T a20c391002194c58ab7f13a5df063f55 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.083930 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.084494 23879 raft_consensus.cc:2243] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.084955 23879 raft_consensus.cc:2272] T f8072e49f8e645f7b24c0f657e2d5c52 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.087271 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.087836 23879 raft_consensus.cc:2243] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.088284 23879 raft_consensus.cc:2272] T 398afdbb52444496b0a87720c22f44a4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.090320 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.091053 23879 raft_consensus.cc:2243] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.091894 23879 raft_consensus.cc:2272] T 0ccc89be17b447c0bc6982d607a2983a P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.095105 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.095703 23879 raft_consensus.cc:2243] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:29.095924 32108 consensus_peers.cc:597] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.096253 23879 raft_consensus.cc:2272] T 749cde1030064b6198575299b10620c5 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.098688 32182 consensus_peers.cc:597] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.099085 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.099732 23879 raft_consensus.cc:2243] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.100191 23879 raft_consensus.cc:2272] T 760cfc460de34e6bbe34af04b225d26f P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.102869 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.103696 23879 raft_consensus.cc:2243] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.104274 23879 raft_consensus.cc:2272] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.107076 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.107728 23879 raft_consensus.cc:2243] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.108161 23879 raft_consensus.cc:2272] T 480a9699f3b4488980be9862ced447cb P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.110587 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.111191 23879 raft_consensus.cc:2243] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.111611 23879 raft_consensus.cc:2272] T 9bafc1117fee410a852a9784f5ac967c P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.113940 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.114673 23879 raft_consensus.cc:2243] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.115152 23879 raft_consensus.cc:2272] T e1e47eae61a3433591d82d8c67dcd74b P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.117648 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.118391 23879 raft_consensus.cc:2243] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.118783 23879 raft_consensus.cc:2272] T 441e813540114eb4928246a962aaf360 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.120918 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.121457 23879 raft_consensus.cc:2243] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.121850 23879 raft_consensus.cc:2272] T 62655659313345be94b5bdb515201711 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.124181 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.124696 23879 raft_consensus.cc:2243] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.125165 23879 raft_consensus.cc:2272] T e21e73e86f4b4b22ad881e5a80716ec7 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.127223 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.127722 23879 raft_consensus.cc:2243] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.128306 23879 raft_consensus.cc:2272] T 95d960ac97c848b8be5d62f6f5175144 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.131289 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.131922 23879 raft_consensus.cc:2243] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.132413 23879 raft_consensus.cc:2272] T 7a13a27f78154b4ebdf87e3009f09aa4 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.134855 32108 consensus_peers.cc:597] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.134989 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:29.135819 23879 raft_consensus.cc:2243] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.136374 23879 raft_consensus.cc:2272] T f214242a6fb64a23b3bf338f9189e209 P 2c26adea8e3a48ce82a0abbd2fc17196 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.152973 32108 consensus_peers.cc:597] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.154448 32182 consensus_peers.cc:597] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.158406 32182 consensus_peers.cc:597] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.168951 32108 consensus_peers.cc:597] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.189827 32108 consensus_peers.cc:597] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.203925 32034 connection.cc:573] client connection to 127.23.81.193:41023 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:23:29.204416 32034 consensus_peers.cc:597] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.223625 23879 tablet_server.cc:196] TabletServer@127.23.81.193:41023 shutdown complete.
W20260709 12:23:29.227929 32108 consensus_peers.cc:597] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.231544 32182 consensus_peers.cc:597] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.232183 32182 consensus_peers.cc:597] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.248812 32108 consensus_peers.cc:597] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.272505 32182 consensus_peers.cc:597] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.313956 32108 consensus_peers.cc:597] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.328495 23879 tablet_server.cc:179] TabletServer@127.23.81.194:0 shutting down...
W20260709 12:23:29.332882 32182 consensus_peers.cc:597] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.354465 32184 consensus_peers.cc:597] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.380149 32108 consensus_peers.cc:597] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.382438 32034 consensus_peers.cc:597] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.385823 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:29.386755 23879 tablet_replica.cc:333] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.387508 23879 raft_consensus.cc:2243] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.388517 23879 raft_consensus.cc:2272] T 3c31ec08af4642a8a25265fcb3dd6c11 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.390889 23879 tablet_replica.cc:333] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.391590 23879 raft_consensus.cc:2243] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.392096 23879 raft_consensus.cc:2272] T 6edffd8d7fac40d1b74f6a23d3517e8b P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.395298 23879 tablet_replica.cc:333] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.395951 23879 raft_consensus.cc:2243] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.396852 23879 raft_consensus.cc:2272] T f80df47302fb41ccae5b05949d696d98 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.399276 23879 tablet_replica.cc:333] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.400120 23879 raft_consensus.cc:2243] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.400722 23879 raft_consensus.cc:2272] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.403638 23879 tablet_replica.cc:333] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.404522 23879 raft_consensus.cc:2243] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.405076 23879 raft_consensus.cc:2272] T fb989fb1126c4cc18ed28296301844a2 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.407321 32108 consensus_peers.cc:597] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.409346 23879 tablet_replica.cc:333] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.410223 23879 raft_consensus.cc:2243] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.410702 23879 raft_consensus.cc:2272] T dc23d93569d44dd8a4bafcb504fc056a P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.413990 23879 tablet_replica.cc:333] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.414925 23879 raft_consensus.cc:2243] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.415571 23879 raft_consensus.cc:2272] T a20c391002194c58ab7f13a5df063f55 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.417615 32034 consensus_peers.cc:597] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.417691 32110 consensus_peers.cc:597] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.419322 23879 tablet_replica.cc:333] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.420326 23879 raft_consensus.cc:2243] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.420917 23879 raft_consensus.cc:2272] T 398afdbb52444496b0a87720c22f44a4 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.422066 32110 consensus_peers.cc:597] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.423458 32184 consensus_peers.cc:597] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.423719 23879 tablet_replica.cc:333] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.424448 23879 raft_consensus.cc:2243] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.424980 23879 raft_consensus.cc:2272] T 749cde1030064b6198575299b10620c5 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.427248 23879 tablet_replica.cc:333] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.427974 23879 raft_consensus.cc:2243] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.428522 23879 raft_consensus.cc:2272] T 760cfc460de34e6bbe34af04b225d26f P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.431529 23879 tablet_replica.cc:333] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.432556 23879 raft_consensus.cc:2243] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.433210 23879 raft_consensus.cc:2272] T 7a13a27f78154b4ebdf87e3009f09aa4 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.436599 23879 tablet_replica.cc:333] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.437382 23879 raft_consensus.cc:2243] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.438179 23879 raft_consensus.cc:2272] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.440441 32182 consensus_peers.cc:597] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 -> Peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Couldn't send request to peer 2c26adea8e3a48ce82a0abbd2fc17196. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.441592 23879 tablet_replica.cc:333] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.442579 23879 raft_consensus.cc:2243] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.443327 23879 raft_consensus.cc:2272] T 13aeab79371a4849b6886db4cc9205d1 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.446098 23879 tablet_replica.cc:333] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.446679 23879 raft_consensus.cc:2243] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.447485 23879 raft_consensus.cc:2272] T ab51a346acba496aa7601f0835510af0 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.449586 23879 tablet_replica.cc:333] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.450232 23879 raft_consensus.cc:2243] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.451038 23879 raft_consensus.cc:2272] T e04a298de8bc48c795631812d4179057 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.453287 23879 tablet_replica.cc:333] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.453819 23879 raft_consensus.cc:2243] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.454838 23879 raft_consensus.cc:2272] T 88877f73a5e94a759151a9e87e1f9c6b P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.457360 23879 tablet_replica.cc:333] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.457916 23879 raft_consensus.cc:2243] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.458444 23879 raft_consensus.cc:2272] T 89aa175b867642f79ec8ea8c4b4bb970 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.460870 23879 tablet_replica.cc:333] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.461652 23879 raft_consensus.cc:2243] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.462292 23879 raft_consensus.cc:2272] T 535ba0401f8848e2a5f647e4ad5b1810 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.465798 23879 tablet_replica.cc:333] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.466710 23879 raft_consensus.cc:2243] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.467362 23879 raft_consensus.cc:2272] T fe944fa4b5a547758fe6318ebe933804 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.471799 23879 tablet_replica.cc:333] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.473048 23879 raft_consensus.cc:2243] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.473901 23879 raft_consensus.cc:2272] T e711714b08b04798b67a243e1267184f P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.478214 23879 tablet_replica.cc:333] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.479347 23879 raft_consensus.cc:2243] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.480234 23879 raft_consensus.cc:2272] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.484665 23879 tablet_replica.cc:333] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.485540 23879 raft_consensus.cc:2243] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.486227 23879 raft_consensus.cc:2272] T d663ad19f6a14af4b9a084536570893a P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.489552 23879 tablet_replica.cc:333] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.490484 23879 raft_consensus.cc:2243] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.491060 23879 raft_consensus.cc:2272] T 9bafc1117fee410a852a9784f5ac967c P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.493944 23879 tablet_replica.cc:333] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.494768 23879 raft_consensus.cc:2243] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.495361 23879 raft_consensus.cc:2272] T e2e93bb1528747f2b573d12daa3b7fb0 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.498548 23879 tablet_replica.cc:333] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.499413 23879 raft_consensus.cc:2243] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.500590 23879 raft_consensus.cc:2272] T ff9e76032b934159855ba6bc924e9dd4 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.503463 23879 tablet_replica.cc:333] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.504338 23879 raft_consensus.cc:2243] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.504933 23879 raft_consensus.cc:2272] T 36f311ee508648669be858c85efab949 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.509004 23879 tablet_replica.cc:333] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.509698 23879 raft_consensus.cc:2243] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.510638 23879 raft_consensus.cc:2272] T 480a9699f3b4488980be9862ced447cb P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.513489 23879 tablet_replica.cc:333] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.514216 23879 raft_consensus.cc:2243] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.514744 23879 raft_consensus.cc:2272] T a0bbc7593a9a40acbab37a51e0269bef P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.517156 23879 tablet_replica.cc:333] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.517796 23879 raft_consensus.cc:2243] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.518260 23879 raft_consensus.cc:2272] T 4c9929922e1c4f3899055b92ea3f0774 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.520462 23879 tablet_replica.cc:333] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.521225 23879 raft_consensus.cc:2243] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.521796 23879 raft_consensus.cc:2272] T 3b058d5adbe84467b2bd4eb0a3ee9094 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.524521 23879 tablet_replica.cc:333] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.525098 23879 raft_consensus.cc:2243] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.525906 23879 raft_consensus.cc:2272] T a38d8cb74c1344a180ca94cfd755e103 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.528182 23879 tablet_replica.cc:333] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.528829 23879 raft_consensus.cc:2243] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.529320 23879 raft_consensus.cc:2272] T 7f99752364a34ef88c766999394fce3a P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.532495 23879 tablet_replica.cc:333] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.533313 23879 raft_consensus.cc:2243] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.534518 23879 raft_consensus.cc:2272] T d8c591c793c14148a28a7095ad7db608 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.537678 23879 tablet_replica.cc:333] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.538523 23879 raft_consensus.cc:2243] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.539646 23879 raft_consensus.cc:2272] T 3f112d6b795b47f2af4a725bc71441d5 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.542654 23879 tablet_replica.cc:333] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.543442 23879 raft_consensus.cc:2243] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.544595 23879 raft_consensus.cc:2272] T 3aaccd64e9ef4703af3eef217706d108 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.547732 23879 tablet_replica.cc:333] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.548504 23879 raft_consensus.cc:2243] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.549134 23879 raft_consensus.cc:2272] T f214242a6fb64a23b3bf338f9189e209 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.552287 23879 tablet_replica.cc:333] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.553120 23879 raft_consensus.cc:2243] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.554286 23879 raft_consensus.cc:2272] T e4c7b8290b2a448cb9acb35da128eb8e P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.557137 23879 tablet_replica.cc:333] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.557833 23879 raft_consensus.cc:2243] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.558365 23879 raft_consensus.cc:2272] T 45ffe4df6d544068be9090ac7db408a2 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.561419 23879 tablet_replica.cc:333] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.562203 23879 raft_consensus.cc:2243] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.562628 23879 raft_consensus.cc:2272] T a2283c016207489eb71580db11ee3a02 P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.563035 32184 consensus_peers.cc:597] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.565584 23879 tablet_replica.cc:333] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.566538 23879 raft_consensus.cc:2243] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.567126 23879 raft_consensus.cc:2272] T f8072e49f8e645f7b24c0f657e2d5c52 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.569347 23879 tablet_replica.cc:333] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.569976 23879 raft_consensus.cc:2243] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.570508 23879 raft_consensus.cc:2272] T e21e73e86f4b4b22ad881e5a80716ec7 P 13d67625d82d4304a0ebff87742a538d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.572721 23879 tablet_replica.cc:333] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.573271 23879 raft_consensus.cc:2243] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.574225 23879 raft_consensus.cc:2272] T 441e813540114eb4928246a962aaf360 P 13d67625d82d4304a0ebff87742a538d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.577023 23879 tablet_replica.cc:333] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.577605 23879 raft_consensus.cc:2243] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.578606 23879 raft_consensus.cc:2272] T e1e47eae61a3433591d82d8c67dcd74b P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.579519 32110 consensus_peers.cc:597] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.581394 23879 tablet_replica.cc:333] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d: stopping tablet replica
I20260709 12:23:29.582199 23879 raft_consensus.cc:2243] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.583292 23879 raft_consensus.cc:2272] T 62655659313345be94b5bdb515201711 P 13d67625d82d4304a0ebff87742a538d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.584848 32110 consensus_peers.cc:597] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.607060 32110 consensus_peers.cc:597] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.630632 32110 consensus_peers.cc:597] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.662293 32184 consensus_peers.cc:597] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.664991 32110 consensus_peers.cc:597] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.667984 23879 tablet_server.cc:196] TabletServer@127.23.81.194:0 shutdown complete.
W20260709 12:23:29.672477 32110 consensus_peers.cc:597] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.676426 32110 consensus_peers.cc:597] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.683848 32184 consensus_peers.cc:597] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.702771 32184 consensus_peers.cc:597] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.728175 32110 consensus_peers.cc:597] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.744292 32184 consensus_peers.cc:597] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.744881 32184 consensus_peers.cc:597] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.764571 32110 consensus_peers.cc:597] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.769608 23879 tablet_server.cc:179] TabletServer@127.23.81.195:0 shutting down...
W20260709 12:23:29.788496 32182 consensus_peers.cc:597] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 -> Peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Couldn't send request to peer c5524748d37141a1bca7d0cedaeb40f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.805253 32182 consensus_peers.cc:597] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 -> Peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Couldn't send request to peer c5524748d37141a1bca7d0cedaeb40f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:29.820808 32182 consensus_peers.cc:597] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 -> Peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Couldn't send request to peer c5524748d37141a1bca7d0cedaeb40f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.845165 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:29.846308 23879 tablet_replica.cc:333] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.847239 23879 raft_consensus.cc:2243] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.847780 23879 raft_consensus.cc:2272] T 12128bac871f458ea02ff3b811378a98 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.850277 23879 tablet_replica.cc:333] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.851090 23879 raft_consensus.cc:2243] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.851655 23879 raft_consensus.cc:2272] T 3c31ec08af4642a8a25265fcb3dd6c11 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.854472 23879 tablet_replica.cc:333] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
W20260709 12:23:29.854498 32182 consensus_peers.cc:597] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 -> Peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Couldn't send request to peer c5524748d37141a1bca7d0cedaeb40f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.855387 23879 raft_consensus.cc:2243] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.856197 23879 raft_consensus.cc:2272] T f80df47302fb41ccae5b05949d696d98 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.859014 23879 tablet_replica.cc:333] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.859722 23879 raft_consensus.cc:2243] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.860225 23879 raft_consensus.cc:2272] T a38d8cb74c1344a180ca94cfd755e103 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.862869 23879 tablet_replica.cc:333] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.863682 23879 raft_consensus.cc:2243] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.864207 23879 raft_consensus.cc:2272] T 6edffd8d7fac40d1b74f6a23d3517e8b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.864975 32184 consensus_peers.cc:597] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.866802 23879 tablet_replica.cc:333] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
W20260709 12:23:29.867327 32184 consensus_peers.cc:597] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 -> Peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Couldn't send request to peer 13d67625d82d4304a0ebff87742a538d. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.867758 23879 raft_consensus.cc:2243] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.868899 23879 raft_consensus.cc:2272] T 136a4f0e01594acc9dc1c8fdb8bd5ce2 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.871855 23879 tablet_replica.cc:333] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.872618 23879 raft_consensus.cc:2243] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.874140 23879 raft_consensus.cc:2272] T e99b876f266b452a8e5d9782c08a1616 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.876233 23879 tablet_replica.cc:333] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.876899 23879 raft_consensus.cc:2243] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.877362 23879 raft_consensus.cc:2272] T 19d55921a3ee4ee18232cdd3f94fcbb9 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.879283 23879 tablet_replica.cc:333] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.879784 23879 raft_consensus.cc:2243] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.880136 23879 raft_consensus.cc:2272] T 36f311ee508648669be858c85efab949 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.882241 23879 tablet_replica.cc:333] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.882740 23879 raft_consensus.cc:2243] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.883090 23879 raft_consensus.cc:2272] T 0ccc89be17b447c0bc6982d607a2983a P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.884840 23879 tablet_replica.cc:333] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.885367 23879 raft_consensus.cc:2243] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.886216 23879 raft_consensus.cc:2272] T 398afdbb52444496b0a87720c22f44a4 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.888988 23879 tablet_replica.cc:333] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.889798 23879 raft_consensus.cc:2243] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.890727 23879 raft_consensus.cc:2272] T 760cfc460de34e6bbe34af04b225d26f P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.893512 23879 tablet_replica.cc:333] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.894152 23879 raft_consensus.cc:2243] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.894624 23879 raft_consensus.cc:2272] T 88877f73a5e94a759151a9e87e1f9c6b P c5524748d37141a1bca7d0cedaeb40f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.896366 23879 tablet_replica.cc:333] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.896977 23879 raft_consensus.cc:2243] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.897780 23879 raft_consensus.cc:2272] T 89aa175b867642f79ec8ea8c4b4bb970 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.899634 23879 tablet_replica.cc:333] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.900203 23879 raft_consensus.cc:2243] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.900663 23879 raft_consensus.cc:2272] T e04a298de8bc48c795631812d4179057 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.902758 23879 tablet_replica.cc:333] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.903375 23879 raft_consensus.cc:2243] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.904142 23879 raft_consensus.cc:2272] T 737f0117f5e849cca1421fb53b5ccd31 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.905995 23879 tablet_replica.cc:333] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.906589 23879 raft_consensus.cc:2243] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.907011 23879 raft_consensus.cc:2272] T fe944fa4b5a547758fe6318ebe933804 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.909050 23879 tablet_replica.cc:333] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.909672 23879 raft_consensus.cc:2243] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.910110 23879 raft_consensus.cc:2272] T 535ba0401f8848e2a5f647e4ad5b1810 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.911962 23879 tablet_replica.cc:333] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.912454 23879 raft_consensus.cc:2243] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.912813 23879 raft_consensus.cc:2272] T 6473d98e1f49484c888a0fb622b9b083 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.914621 23879 tablet_replica.cc:333] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.915095 23879 raft_consensus.cc:2243] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.915844 23879 raft_consensus.cc:2272] T 3b058d5adbe84467b2bd4eb0a3ee9094 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.917841 23879 tablet_replica.cc:333] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.918606 23879 raft_consensus.cc:2243] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.919174 23879 raft_consensus.cc:2272] T 77f5edcc0d06488fb238c7ea0af75378 P c5524748d37141a1bca7d0cedaeb40f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.921865 23879 tablet_replica.cc:333] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.922714 23879 raft_consensus.cc:2243] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.923280 23879 raft_consensus.cc:2272] T 3aaccd64e9ef4703af3eef217706d108 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.925997 23879 tablet_replica.cc:333] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.926617 23879 raft_consensus.cc:2243] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.927062 23879 raft_consensus.cc:2272] T 63b94a9b9d1441438a95bedc11c7a96f P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.929577 23879 tablet_replica.cc:333] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.930272 23879 raft_consensus.cc:2243] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.930742 23879 raft_consensus.cc:2272] T 51e6e3a7239949adaa6b5dacaf6ded22 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:29.932065 32182 consensus_peers.cc:597] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 -> Peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Couldn't send request to peer c5524748d37141a1bca7d0cedaeb40f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.934093 23879 tablet_replica.cc:333] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.934767 23879 raft_consensus.cc:2243] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.935249 23879 raft_consensus.cc:2272] T 4e692c206a274e1fbd3fb6b4ef2358ec P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.937767 23879 tablet_replica.cc:333] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.938520 23879 raft_consensus.cc:2243] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.939469 23879 raft_consensus.cc:2272] T 95d960ac97c848b8be5d62f6f5175144 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.942129 23879 tablet_replica.cc:333] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.942920 23879 raft_consensus.cc:2243] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.943918 23879 raft_consensus.cc:2272] T e21e73e86f4b4b22ad881e5a80716ec7 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.946741 23879 tablet_replica.cc:333] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.947408 23879 raft_consensus.cc:2243] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.947908 23879 raft_consensus.cc:2272] T e1e47eae61a3433591d82d8c67dcd74b P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.950374 23879 tablet_replica.cc:333] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.950922 23879 raft_consensus.cc:2243] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.951339 23879 raft_consensus.cc:2272] T 62655659313345be94b5bdb515201711 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.953504 23879 tablet_replica.cc:333] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.954128 23879 raft_consensus.cc:2243] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.954879 23879 raft_consensus.cc:2272] T 30469d27ec5d450393d6116dbc4d0c7b P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.956940 23879 tablet_replica.cc:333] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.957509 23879 raft_consensus.cc:2243] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.957967 23879 raft_consensus.cc:2272] T e711714b08b04798b67a243e1267184f P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.959875 23879 tablet_replica.cc:333] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.960429 23879 raft_consensus.cc:2243] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.960875 23879 raft_consensus.cc:2272] T dae2aab0addf4c939688292e7118cbe0 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.962805 23879 tablet_replica.cc:333] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.963341 23879 raft_consensus.cc:2243] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.964184 23879 raft_consensus.cc:2272] T 9bafc1117fee410a852a9784f5ac967c P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.966279 23879 tablet_replica.cc:333] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.966796 23879 raft_consensus.cc:2243] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.967226 23879 raft_consensus.cc:2272] T e2e93bb1528747f2b573d12daa3b7fb0 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.969290 23879 tablet_replica.cc:333] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.969830 23879 raft_consensus.cc:2243] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.970326 23879 raft_consensus.cc:2272] T ff9e76032b934159855ba6bc924e9dd4 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.972347 23879 tablet_replica.cc:333] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.972898 23879 raft_consensus.cc:2243] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.973688 23879 raft_consensus.cc:2272] T 13aeab79371a4849b6886db4cc9205d1 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.975715 23879 tablet_replica.cc:333] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.976241 23879 raft_consensus.cc:2243] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.976694 23879 raft_consensus.cc:2272] T ab51a346acba496aa7601f0835510af0 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.978797 23879 tablet_replica.cc:333] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.979324 23879 raft_consensus.cc:2243] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.979732 23879 raft_consensus.cc:2272] T 9392ba9e91ca46f0ad3cdef6256aad0d P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.981566 23879 tablet_replica.cc:333] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.982151 23879 raft_consensus.cc:2243] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.982968 23879 raft_consensus.cc:2272] T f8072e49f8e645f7b24c0f657e2d5c52 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.984985 23879 tablet_replica.cc:333] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.985492 23879 raft_consensus.cc:2243] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.985947 23879 raft_consensus.cc:2272] T e4c7b8290b2a448cb9acb35da128eb8e P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.988016 23879 tablet_replica.cc:333] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.988513 23879 raft_consensus.cc:2243] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.989336 23879 raft_consensus.cc:2272] T 45ffe4df6d544068be9090ac7db408a2 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.991261 23879 tablet_replica.cc:333] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.991762 23879 raft_consensus.cc:2243] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:29.992633 23879 raft_consensus.cc:2272] T f214242a6fb64a23b3bf338f9189e209 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.994668 23879 tablet_replica.cc:333] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.995162 23879 raft_consensus.cc:2243] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.995592 23879 raft_consensus.cc:2272] T 4a35467eb315463dae6edfd61cdb4a79 P c5524748d37141a1bca7d0cedaeb40f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.998250 23879 tablet_replica.cc:333] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2: stopping tablet replica
I20260709 12:23:29.998710 23879 raft_consensus.cc:2243] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.999107 23879 raft_consensus.cc:2272] T 3f112d6b795b47f2af4a725bc71441d5 P c5524748d37141a1bca7d0cedaeb40f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.005551   662 raft_consensus.cc:493] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:30.006131   662 raft_consensus.cc:515] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
W20260709 12:23:30.006501 32182 consensus_peers.cc:597] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 -> Peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Couldn't send request to peer c5524748d37141a1bca7d0cedaeb40f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:30.008529   662 leader_election.cc:290] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
W20260709 12:23:30.012768 32182 leader_election.cc:336] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111)
W20260709 12:23:30.013478 32184 leader_election.cc:336] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111)
I20260709 12:23:30.013868 32184 leader_election.cc:304] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:30.014576   662 raft_consensus.cc:2749] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:30.028239 32182 consensus_peers.cc:597] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 -> Peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Couldn't send request to peer c5524748d37141a1bca7d0cedaeb40f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:30.076174 23879 tablet_server.cc:196] TabletServer@127.23.81.195:0 shutdown complete.
W20260709 12:23:30.097072 32182 consensus_peers.cc:597] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 -> Peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Couldn't send request to peer c5524748d37141a1bca7d0cedaeb40f2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.195:43745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:30.134003   662 raft_consensus.cc:493] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:30.134747   662 raft_consensus.cc:515] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:30.137220   662 leader_election.cc:290] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
W20260709 12:23:30.142915 32182 leader_election.cc:336] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111)
W20260709 12:23:30.144409 32184 leader_election.cc:336] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111)
I20260709 12:23:30.144874 32184 leader_election.cc:304] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:30.146288   662 raft_consensus.cc:2749] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:30.152592 32182 consensus_peers.cc:597] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 -> Peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Couldn't send request to peer c5524748d37141a1bca7d0cedaeb40f2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.195:43745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:30.161499 23879 tablet_server.cc:179] TabletServer@127.23.81.196:0 shutting down...
I20260709 12:23:30.207827   662 raft_consensus.cc:493] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:30.208392   662 raft_consensus.cc:515] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } } peers { permanent_uuid: "13d67625d82d4304a0ebff87742a538d" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 33135 } }
I20260709 12:23:30.214993   642 raft_consensus.cc:493] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:30.215641   642 raft_consensus.cc:515] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:30.218562   662 leader_election.cc:290] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023), 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135)
I20260709 12:23:30.218076   642 leader_election.cc:290] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
W20260709 12:23:30.224282 32184 leader_election.cc:336] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 13d67625d82d4304a0ebff87742a538d (127.23.81.194:33135): Network error: Client connection negotiation failed: client connection to 127.23.81.194:33135: connect: Connection refused (error 111)
W20260709 12:23:30.225688 32182 leader_election.cc:336] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Network error: Client connection negotiation failed: client connection to 127.23.81.195:43745: connect: Connection refused (error 111)
I20260709 12:23:30.226146 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:23:30.226397 32182 leader_election.cc:336] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111)
I20260709 12:23:30.226851 32182 leader_election.cc:304] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 13d67625d82d4304a0ebff87742a538d, 2c26adea8e3a48ce82a0abbd2fc17196
I20260709 12:23:30.227160 23879 tablet_replica.cc:333] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.227726   642 raft_consensus.cc:2749] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:30.227893 32182 leader_election.cc:336] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111)
I20260709 12:23:30.228226 23879 raft_consensus.cc:2243] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.228422 32182 leader_election.cc:304] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:30.229001 23879 raft_consensus.cc:2272] T f80df47302fb41ccae5b05949d696d98 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.229269   642 raft_consensus.cc:2749] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:30.231472 23879 tablet_replica.cc:333] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.232118 23879 raft_consensus.cc:2243] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.232509 23879 raft_consensus.cc:2272] T 12128bac871f458ea02ff3b811378a98 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.233456   642 raft_consensus.cc:493] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c26adea8e3a48ce82a0abbd2fc17196)
I20260709 12:23:30.233901   642 raft_consensus.cc:515] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5524748d37141a1bca7d0cedaeb40f2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 43745 } } peers { permanent_uuid: "68991541d4134b4f89800c972fdad372" member_type: VOTER last_known_addr { host: "127.23.81.196" port: 46375 } } peers { permanent_uuid: "2c26adea8e3a48ce82a0abbd2fc17196" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 41023 } }
I20260709 12:23:30.234892 23879 tablet_replica.cc:333] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.235594 23879 raft_consensus.cc:2243] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.235920   642 leader_election.cc:290] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745), 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023)
I20260709 12:23:30.236123 23879 raft_consensus.cc:2272] T e99b876f266b452a8e5d9782c08a1616 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.239315 23879 tablet_replica.cc:333] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372: stopping tablet replica
W20260709 12:23:30.240094 32182 leader_election.cc:336] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c5524748d37141a1bca7d0cedaeb40f2 (127.23.81.195:43745): Network error: Client connection negotiation failed: client connection to 127.23.81.195:43745: connect: Connection refused (error 111)
I20260709 12:23:30.240152 23879 raft_consensus.cc:2243] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:30.240770 32182 leader_election.cc:336] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2c26adea8e3a48ce82a0abbd2fc17196 (127.23.81.193:41023): Network error: Client connection negotiation failed: client connection to 127.23.81.193:41023: connect: Connection refused (error 111)
I20260709 12:23:30.240836 23879 raft_consensus.cc:2272] T e4c7b8290b2a448cb9acb35da128eb8e P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.241124 32182 leader_election.cc:304] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68991541d4134b4f89800c972fdad372; no voters: 2c26adea8e3a48ce82a0abbd2fc17196, c5524748d37141a1bca7d0cedaeb40f2
I20260709 12:23:30.241744   642 raft_consensus.cc:2749] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:30.243132 23879 tablet_replica.cc:333] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.243717 23879 raft_consensus.cc:2243] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.244108 23879 raft_consensus.cc:2272] T 0ccc89be17b447c0bc6982d607a2983a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.245818 23879 tablet_replica.cc:333] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.246417 23879 raft_consensus.cc:2243] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.247145 23879 raft_consensus.cc:2272] T 749cde1030064b6198575299b10620c5 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.248986 23879 tablet_replica.cc:333] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.249503 23879 raft_consensus.cc:2243] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.249876 23879 raft_consensus.cc:2272] T 95d960ac97c848b8be5d62f6f5175144 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.251663 23879 tablet_replica.cc:333] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.252163 23879 raft_consensus.cc:2243] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.252918 23879 raft_consensus.cc:2272] T a20c391002194c58ab7f13a5df063f55 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.254992 23879 tablet_replica.cc:333] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.255755 23879 raft_consensus.cc:2243] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.256611 23879 raft_consensus.cc:2272] T fb989fb1126c4cc18ed28296301844a2 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.259127 23879 tablet_replica.cc:333] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.259887 23879 raft_consensus.cc:2243] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.260476 23879 raft_consensus.cc:2272] T dc23d93569d44dd8a4bafcb504fc056a P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.262988 23879 tablet_replica.cc:333] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.263494 23879 raft_consensus.cc:2243] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.264189 23879 raft_consensus.cc:2272] T 6473d98e1f49484c888a0fb622b9b083 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.266261 23879 tablet_replica.cc:333] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.266793 23879 raft_consensus.cc:2243] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.267506 23879 raft_consensus.cc:2272] T 36f311ee508648669be858c85efab949 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.269567 23879 tablet_replica.cc:333] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.270195 23879 raft_consensus.cc:2243] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.270663 23879 raft_consensus.cc:2272] T 480a9699f3b4488980be9862ced447cb P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.272550 23879 tablet_replica.cc:333] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.273067 23879 raft_consensus.cc:2243] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.273414 23879 raft_consensus.cc:2272] T 19d55921a3ee4ee18232cdd3f94fcbb9 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.275290 23879 tablet_replica.cc:333] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.275804 23879 raft_consensus.cc:2243] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.276183 23879 raft_consensus.cc:2272] T 441e813540114eb4928246a962aaf360 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.278211 23879 tablet_replica.cc:333] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.278716 23879 raft_consensus.cc:2243] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.279103 23879 raft_consensus.cc:2272] T 88877f73a5e94a759151a9e87e1f9c6b P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.280833 23879 tablet_replica.cc:333] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.281327 23879 raft_consensus.cc:2243] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.281750 23879 raft_consensus.cc:2272] T 89aa175b867642f79ec8ea8c4b4bb970 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.283666 23879 tablet_replica.cc:333] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.284194 23879 raft_consensus.cc:2243] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.284564 23879 raft_consensus.cc:2272] T e04a298de8bc48c795631812d4179057 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.286504 23879 tablet_replica.cc:333] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.287034 23879 raft_consensus.cc:2243] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.287400 23879 raft_consensus.cc:2272] T 737f0117f5e849cca1421fb53b5ccd31 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.289361 23879 tablet_replica.cc:333] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.289880 23879 raft_consensus.cc:2243] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.290596 23879 raft_consensus.cc:2272] T 535ba0401f8848e2a5f647e4ad5b1810 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.292587 23879 tablet_replica.cc:333] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.293094 23879 raft_consensus.cc:2243] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.293776 23879 raft_consensus.cc:2272] T 4c9929922e1c4f3899055b92ea3f0774 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.295692 23879 tablet_replica.cc:333] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.296201 23879 raft_consensus.cc:2243] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.296658 23879 raft_consensus.cc:2272] T dae2aab0addf4c939688292e7118cbe0 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.298470 23879 tablet_replica.cc:333] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.298985 23879 raft_consensus.cc:2243] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.299676 23879 raft_consensus.cc:2272] T ba00ce5cdc6f4dbe8a36ecb3e82951e3 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.301578 23879 tablet_replica.cc:333] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.302095 23879 raft_consensus.cc:2243] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.302798 23879 raft_consensus.cc:2272] T e711714b08b04798b67a243e1267184f P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.304858 23879 tablet_replica.cc:333] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.305364 23879 raft_consensus.cc:2243] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.305723 23879 raft_consensus.cc:2272] T 77f5edcc0d06488fb238c7ea0af75378 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.307561 23879 tablet_replica.cc:333] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.308061 23879 raft_consensus.cc:2243] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.308454 23879 raft_consensus.cc:2272] T 3aaccd64e9ef4703af3eef217706d108 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.310256 23879 tablet_replica.cc:333] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.310746 23879 raft_consensus.cc:2243] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.311412 23879 raft_consensus.cc:2272] T 63b94a9b9d1441438a95bedc11c7a96f P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.313190 23879 tablet_replica.cc:333] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.313769 23879 raft_consensus.cc:2243] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.314189 23879 raft_consensus.cc:2272] T 97a7ca73ef254c8b9bbe684f81fa6af8 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.315896 23879 tablet_replica.cc:333] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.316380 23879 raft_consensus.cc:2243] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.316717 23879 raft_consensus.cc:2272] T 13aeab79371a4849b6886db4cc9205d1 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.318483 23879 tablet_replica.cc:333] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.318948 23879 raft_consensus.cc:2243] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.319643 23879 raft_consensus.cc:2272] T 9392ba9e91ca46f0ad3cdef6256aad0d P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.321375 23879 tablet_replica.cc:333] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.321847 23879 raft_consensus.cc:2243] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.322338 23879 raft_consensus.cc:2272] T a2283c016207489eb71580db11ee3a02 P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.324196 23879 tablet_replica.cc:333] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.324781 23879 raft_consensus.cc:2243] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.325228 23879 raft_consensus.cc:2272] T d663ad19f6a14af4b9a084536570893a P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.327169 23879 tablet_replica.cc:333] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.327719 23879 raft_consensus.cc:2243] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.328500 23879 raft_consensus.cc:2272] T 7a13a27f78154b4ebdf87e3009f09aa4 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.330427 23879 tablet_replica.cc:333] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.330955 23879 raft_consensus.cc:2243] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.331744 23879 raft_consensus.cc:2272] T e2e93bb1528747f2b573d12daa3b7fb0 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.333721 23879 tablet_replica.cc:333] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.334259 23879 raft_consensus.cc:2243] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.334674 23879 raft_consensus.cc:2272] T ff9e76032b934159855ba6bc924e9dd4 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.336565 23879 tablet_replica.cc:333] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.337080 23879 raft_consensus.cc:2243] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.337507 23879 raft_consensus.cc:2272] T 30469d27ec5d450393d6116dbc4d0c7b P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.339324 23879 tablet_replica.cc:333] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.339847 23879 raft_consensus.cc:2243] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.340293 23879 raft_consensus.cc:2272] T a0bbc7593a9a40acbab37a51e0269bef P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.342173 23879 tablet_replica.cc:333] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.342681 23879 raft_consensus.cc:2243] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.343086 23879 raft_consensus.cc:2272] T 4a35467eb315463dae6edfd61cdb4a79 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.344805 23879 tablet_replica.cc:333] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.345300 23879 raft_consensus.cc:2243] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.345713 23879 raft_consensus.cc:2272] T 3f112d6b795b47f2af4a725bc71441d5 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.347585 23879 tablet_replica.cc:333] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.348107 23879 raft_consensus.cc:2243] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.348536 23879 raft_consensus.cc:2272] T d8c591c793c14148a28a7095ad7db608 P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.350431 23879 tablet_replica.cc:333] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.350907 23879 raft_consensus.cc:2243] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.351337 23879 raft_consensus.cc:2272] T a38d8cb74c1344a180ca94cfd755e103 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.353196 23879 tablet_replica.cc:333] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.353688 23879 raft_consensus.cc:2243] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:30.354132 23879 raft_consensus.cc:2272] T 7f99752364a34ef88c766999394fce3a P 68991541d4134b4f89800c972fdad372 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.355896 23879 tablet_replica.cc:333] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.356364 23879 raft_consensus.cc:2243] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.357108 23879 raft_consensus.cc:2272] T 4e692c206a274e1fbd3fb6b4ef2358ec P 68991541d4134b4f89800c972fdad372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.358839 23879 tablet_replica.cc:333] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372: stopping tablet replica
I20260709 12:23:30.359283 23879 raft_consensus.cc:2243] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.360004 23879 raft_consensus.cc:2272] T 51e6e3a7239949adaa6b5dacaf6ded22 P 68991541d4134b4f89800c972fdad372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.425424 23879 tablet_server.cc:196] TabletServer@127.23.81.196:0 shutdown complete.
I20260709 12:23:30.489511 23879 master.cc:562] Master@127.23.81.254:34289 shutting down...
I20260709 12:23:30.516227 23879 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:30.516826 23879 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:30.517176 23879 tablet_replica.cc:333] T 00000000000000000000000000000000 P 903760ac998947c288b5e1e75acc13bc: stopping tablet replica
I20260709 12:23:30.540603 23879 master.cc:584] Master@127.23.81.254:34289 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (27991 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:23:30.633157 23879 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.81.254:38013
I20260709 12:23:30.634322 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:30.640434   669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:30.641032   668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:30.642326   671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:30.643124 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:30.644165 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:30.644368 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:30.644541 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599810644506 us; error 0 us; skew 500 ppm
I20260709 12:23:30.645112 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:30.647666 23879 webserver.cc:533] Webserver started at http://127.23.81.254:41593/ using document root <none> and password file <none>
I20260709 12:23:30.648190 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:30.648376 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:30.648674 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:30.649806 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/master-0-root/instance:
uuid: "cb98585be6f94e8fb0ce7bcbc665c759"
format_stamp: "Formatted at 2026-07-09 12:23:30 on dist-test-slave-mprf"
I20260709 12:23:30.654230 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:30.657461   676 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:30.658278 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:30.658591 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/master-0-root
uuid: "cb98585be6f94e8fb0ce7bcbc665c759"
format_stamp: "Formatted at 2026-07-09 12:23:30 on dist-test-slave-mprf"
I20260709 12:23:30.658883 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:30.684427 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:30.685695 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:30.724535 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.254:38013
I20260709 12:23:30.724656   727 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.254:38013 every 8 connection(s)
I20260709 12:23:30.728415   728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.739225   728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759: Bootstrap starting.
I20260709 12:23:30.744076   728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.748299   728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759: No bootstrap required, opened a new log
I20260709 12:23:30.750523   728 raft_consensus.cc:359] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb98585be6f94e8fb0ce7bcbc665c759" member_type: VOTER }
I20260709 12:23:30.750906   728 raft_consensus.cc:385] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.751083   728 raft_consensus.cc:740] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb98585be6f94e8fb0ce7bcbc665c759, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.751669   728 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb98585be6f94e8fb0ce7bcbc665c759" member_type: VOTER }
I20260709 12:23:30.752091   728 raft_consensus.cc:399] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:30.752280   728 raft_consensus.cc:493] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:30.752485   728 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.757175   728 raft_consensus.cc:515] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb98585be6f94e8fb0ce7bcbc665c759" member_type: VOTER }
I20260709 12:23:30.757674   728 leader_election.cc:304] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb98585be6f94e8fb0ce7bcbc665c759; no voters: 
I20260709 12:23:30.758822   728 leader_election.cc:290] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:30.759271   731 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.760691   731 raft_consensus.cc:697] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [term 1 LEADER]: Becoming Leader. State: Replica: cb98585be6f94e8fb0ce7bcbc665c759, State: Running, Role: LEADER
I20260709 12:23:30.761368   731 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb98585be6f94e8fb0ce7bcbc665c759" member_type: VOTER }
I20260709 12:23:30.762156   728 sys_catalog.cc:565] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:30.766234   732 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb98585be6f94e8fb0ce7bcbc665c759" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb98585be6f94e8fb0ce7bcbc665c759" member_type: VOTER } }
I20260709 12:23:30.766584   733 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb98585be6f94e8fb0ce7bcbc665c759. Latest consensus state: current_term: 1 leader_uuid: "cb98585be6f94e8fb0ce7bcbc665c759" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb98585be6f94e8fb0ce7bcbc665c759" member_type: VOTER } }
I20260709 12:23:30.766930   732 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:30.767117   733 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:30.769481   738 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:30.776029   738 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:30.777036 23879 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:30.784685   738 catalog_manager.cc:1383] Generated new cluster ID: ce2a0ffcc27444859aac1ddc7025172a
I20260709 12:23:30.785027   738 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:30.804774   738 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:30.806116   738 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:30.826458   738 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759: Generated new TSK 0
I20260709 12:23:30.827119   738 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:30.844125 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:30.850744   749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:30.851686   750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:30.854194   752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:30.854257 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:30.855399 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:30.855640 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:30.855813 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599810855792 us; error 0 us; skew 500 ppm
I20260709 12:23:30.856400 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:30.858729 23879 webserver.cc:533] Webserver started at http://127.23.81.193:42601/ using document root <none> and password file <none>
I20260709 12:23:30.859229 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:30.859439 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:30.859721 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:30.860826 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-0-root/instance:
uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
format_stamp: "Formatted at 2026-07-09 12:23:30 on dist-test-slave-mprf"
I20260709 12:23:30.865345 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:30.868914   757 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:30.869851 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:30.870175 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-0-root
uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
format_stamp: "Formatted at 2026-07-09 12:23:30 on dist-test-slave-mprf"
I20260709 12:23:30.870445 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:30.894428 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:30.895689 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:30.897140 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:30.899528 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:30.899708 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:30.900038 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:30.900206 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:30.941874 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.193:34325
I20260709 12:23:30.941983   819 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.193:34325 every 8 connection(s)
I20260709 12:23:30.947214 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:30.953958   824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:30.955300   825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:30.958590   827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:30.958931 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:30.960232 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:30.960481 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:30.960660 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599810960644 us; error 0 us; skew 500 ppm
I20260709 12:23:30.961315 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:30.964802 23879 webserver.cc:533] Webserver started at http://127.23.81.194:44331/ using document root <none> and password file <none>
I20260709 12:23:30.965315 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:30.965535 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:30.965662   820 heartbeater.cc:344] Connected to a master server at 127.23.81.254:38013
I20260709 12:23:30.965873 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:30.966156   820 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:30.967108   820 heartbeater.cc:507] Master 127.23.81.254:38013 requested a full tablet report, sending...
I20260709 12:23:30.967564 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-1-root/instance:
uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
format_stamp: "Formatted at 2026-07-09 12:23:30 on dist-test-slave-mprf"
I20260709 12:23:30.969483   693 ts_manager.cc:194] Registered new tserver with Master: ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325)
I20260709 12:23:30.971395   693 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53472
I20260709 12:23:30.973019 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:23:30.976603   832 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:30.977512 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:23:30.978127 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-1-root
uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
format_stamp: "Formatted at 2026-07-09 12:23:30 on dist-test-slave-mprf"
I20260709 12:23:30.978782 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:30.994902 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:30.996059 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:30.997457 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:30.999786 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:30.999963 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:31.000298 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:31.000463 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:31.042404 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.194:37483
I20260709 12:23:31.042510   894 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.194:37483 every 8 connection(s)
I20260709 12:23:31.047432 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:31.054925   898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:31.056488   899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:31.060628   901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:31.062197   895 heartbeater.cc:344] Connected to a master server at 127.23.81.254:38013
I20260709 12:23:31.062934   895 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:31.064070 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:31.064401   895 heartbeater.cc:507] Master 127.23.81.254:38013 requested a full tablet report, sending...
I20260709 12:23:31.066990 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:31.067268 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:31.067492 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599811067472 us; error 0 us; skew 500 ppm
I20260709 12:23:31.067595   693 ts_manager.cc:194] Registered new tserver with Master: 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:31.068246 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:31.069379   693 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53482
I20260709 12:23:31.071370 23879 webserver.cc:533] Webserver started at http://127.23.81.195:35917/ using document root <none> and password file <none>
I20260709 12:23:31.072098 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:31.072347 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:31.072619 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:31.073812 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-2-root/instance:
uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
format_stamp: "Formatted at 2026-07-09 12:23:31 on dist-test-slave-mprf"
I20260709 12:23:31.078397 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:31.081894   906 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:31.082784 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:23:31.083163 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-2-root
uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
format_stamp: "Formatted at 2026-07-09 12:23:31 on dist-test-slave-mprf"
I20260709 12:23:31.083493 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:31.107517 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:31.108863 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:31.110529 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:31.112901 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:31.113180 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:31.113444 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:31.113637 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:31.155218 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.195:33887
I20260709 12:23:31.155346   968 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.195:33887 every 8 connection(s)
I20260709 12:23:31.169229   969 heartbeater.cc:344] Connected to a master server at 127.23.81.254:38013
I20260709 12:23:31.169692   969 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:31.170513   969 heartbeater.cc:507] Master 127.23.81.254:38013 requested a full tablet report, sending...
I20260709 12:23:31.172632   693 ts_manager.cc:194] Registered new tserver with Master: 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:31.173053 23879 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014670376s
I20260709 12:23:31.174126   693 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53496
I20260709 12:23:31.200177   693 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53512:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:31.203254   693 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:31.290633   934 tablet_service.cc:1511] Processing CreateTablet for tablet 868ae757ae23436fa3b15835f9d556b5 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:31.292220   934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868ae757ae23436fa3b15835f9d556b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.294572   933 tablet_service.cc:1511] Processing CreateTablet for tablet 14c05c42eade4897a8a0fc30471677e4 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:31.294968   785 tablet_service.cc:1511] Processing CreateTablet for tablet 868ae757ae23436fa3b15835f9d556b5 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:31.295954   933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c05c42eade4897a8a0fc30471677e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.296361   785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868ae757ae23436fa3b15835f9d556b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.299806   860 tablet_service.cc:1511] Processing CreateTablet for tablet 868ae757ae23436fa3b15835f9d556b5 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:31.300189   859 tablet_service.cc:1511] Processing CreateTablet for tablet 14c05c42eade4897a8a0fc30471677e4 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:31.301306   860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868ae757ae23436fa3b15835f9d556b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.301036   784 tablet_service.cc:1511] Processing CreateTablet for tablet 14c05c42eade4897a8a0fc30471677e4 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:31.302044   859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c05c42eade4897a8a0fc30471677e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.302426   784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c05c42eade4897a8a0fc30471677e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.329716   984 tablet_bootstrap.cc:492] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79: Bootstrap starting.
I20260709 12:23:31.333920   783 tablet_service.cc:1511] Processing CreateTablet for tablet 912cb57dbae442dcb8c3fc3d9028dcd2 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:31.335441   783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 912cb57dbae442dcb8c3fc3d9028dcd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.335911   860 tablet_service.cc:1511] Processing CreateTablet for tablet 912cb57dbae442dcb8c3fc3d9028dcd2 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:31.337265   860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 912cb57dbae442dcb8c3fc3d9028dcd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.339649   985 tablet_bootstrap.cc:492] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d: Bootstrap starting.
I20260709 12:23:31.340224   933 tablet_service.cc:1511] Processing CreateTablet for tablet 912cb57dbae442dcb8c3fc3d9028dcd2 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:31.340324   782 tablet_service.cc:1511] Processing CreateTablet for tablet ac69a39998774d47b48667fea5943c70 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:31.341748   782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac69a39998774d47b48667fea5943c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.349061   984 tablet_bootstrap.cc:654] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.341748   933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 912cb57dbae442dcb8c3fc3d9028dcd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.358402   859 tablet_service.cc:1511] Processing CreateTablet for tablet ac69a39998774d47b48667fea5943c70 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:31.359853   859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac69a39998774d47b48667fea5943c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.360375   934 tablet_service.cc:1511] Processing CreateTablet for tablet ac69a39998774d47b48667fea5943c70 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:31.361752   934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac69a39998774d47b48667fea5943c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.364840   985 tablet_bootstrap.cc:654] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.373811   785 tablet_service.cc:1511] Processing CreateTablet for tablet 72fd4d4b79634debbff6d63f295df2f6 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:31.375473   785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fd4d4b79634debbff6d63f295df2f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.376935   860 tablet_service.cc:1511] Processing CreateTablet for tablet 72fd4d4b79634debbff6d63f295df2f6 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:31.378993   860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fd4d4b79634debbff6d63f295df2f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.379084   933 tablet_service.cc:1511] Processing CreateTablet for tablet 72fd4d4b79634debbff6d63f295df2f6 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:31.383160   784 tablet_service.cc:1511] Processing CreateTablet for tablet ccd7b5e0fdd24732bb045e65d98bfa26 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:31.384717   858 tablet_service.cc:1511] Processing CreateTablet for tablet ccd7b5e0fdd24732bb045e65d98bfa26 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:31.386667   784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd7b5e0fdd24732bb045e65d98bfa26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.387465   858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd7b5e0fdd24732bb045e65d98bfa26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.386667   933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fd4d4b79634debbff6d63f295df2f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.389678   986 tablet_bootstrap.cc:492] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:31.401664   932 tablet_service.cc:1511] Processing CreateTablet for tablet ccd7b5e0fdd24732bb045e65d98bfa26 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:31.403195   932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd7b5e0fdd24732bb045e65d98bfa26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.404701   985 tablet_bootstrap.cc:492] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d: No bootstrap required, opened a new log
I20260709 12:23:31.405273   985 ts_tablet_manager.cc:1403] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.012s
I20260709 12:23:31.408380   984 tablet_bootstrap.cc:492] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79: No bootstrap required, opened a new log
I20260709 12:23:31.408944   984 ts_tablet_manager.cc:1403] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.016s
I20260709 12:23:31.412194   984 raft_consensus.cc:359] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } } peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } }
I20260709 12:23:31.412926   984 raft_consensus.cc:385] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.413240   984 raft_consensus.cc:740] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.416213   985 raft_consensus.cc:359] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.416854   985 raft_consensus.cc:385] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.417126   985 raft_consensus.cc:740] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.417860   985 consensus_queue.cc:260] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.418785   986 tablet_bootstrap.cc:654] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.418355   984 consensus_queue.cc:260] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } } peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } }
I20260709 12:23:31.425834   782 tablet_service.cc:1511] Processing CreateTablet for tablet 02af04ade5d048c0ada291d2136cf8ee (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:31.427703   782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02af04ade5d048c0ada291d2136cf8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.428607   860 tablet_service.cc:1511] Processing CreateTablet for tablet 02af04ade5d048c0ada291d2136cf8ee (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:31.430044   860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02af04ade5d048c0ada291d2136cf8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.443979   783 tablet_service.cc:1511] Processing CreateTablet for tablet f7b3f8a235e34f91a239ff687e3af1b3 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:31.445468   783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b3f8a235e34f91a239ff687e3af1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.455180   934 tablet_service.cc:1511] Processing CreateTablet for tablet 02af04ade5d048c0ada291d2136cf8ee (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:31.461511   934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02af04ade5d048c0ada291d2136cf8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.462801   985 ts_tablet_manager.cc:1434] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent starting tablet: real 0.057s	user 0.016s	sys 0.006s
I20260709 12:23:31.463828   969 heartbeater.cc:499] Master 127.23.81.254:38013 was elected leader, sending a full tablet report...
I20260709 12:23:31.459793   858 tablet_service.cc:1511] Processing CreateTablet for tablet f7b3f8a235e34f91a239ff687e3af1b3 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:31.464756   985 tablet_bootstrap.cc:492] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d: Bootstrap starting.
I20260709 12:23:31.465680   858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b3f8a235e34f91a239ff687e3af1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.472857   986 tablet_bootstrap.cc:492] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2: No bootstrap required, opened a new log
I20260709 12:23:31.473605   895 heartbeater.cc:499] Master 127.23.81.254:38013 was elected leader, sending a full tablet report...
I20260709 12:23:31.475107   986 ts_tablet_manager.cc:1403] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.087s	user 0.005s	sys 0.032s
I20260709 12:23:31.474184   985 tablet_bootstrap.cc:654] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.481521   932 tablet_service.cc:1511] Processing CreateTablet for tablet f7b3f8a235e34f91a239ff687e3af1b3 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:31.483049   932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b3f8a235e34f91a239ff687e3af1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.474561   984 ts_tablet_manager.cc:1434] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent starting tablet: real 0.065s	user 0.018s	sys 0.015s
I20260709 12:23:31.484683   782 tablet_service.cc:1511] Processing CreateTablet for tablet 3b474ceef6f445e09552b2048f358034 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:31.485910   984 tablet_bootstrap.cc:492] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79: Bootstrap starting.
I20260709 12:23:31.486155   782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b474ceef6f445e09552b2048f358034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.493155   859 tablet_service.cc:1511] Processing CreateTablet for tablet 3b474ceef6f445e09552b2048f358034 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:31.494727   859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b474ceef6f445e09552b2048f358034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.478658   986 raft_consensus.cc:359] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.506424   986 raft_consensus.cc:385] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.506814   986 raft_consensus.cc:740] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.508059   984 tablet_bootstrap.cc:654] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.507725   986 consensus_queue.cc:260] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.516839   985 tablet_bootstrap.cc:492] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d: No bootstrap required, opened a new log
I20260709 12:23:31.517383   985 ts_tablet_manager.cc:1403] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.003s
I20260709 12:23:31.533217   820 heartbeater.cc:499] Master 127.23.81.254:38013 was elected leader, sending a full tablet report...
I20260709 12:23:31.534214   782 tablet_service.cc:1511] Processing CreateTablet for tablet 013d4aa6601944c6bee3b0fd346309c6 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:31.535597   782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 013d4aa6601944c6bee3b0fd346309c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.537585   985 raft_consensus.cc:359] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } } peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } }
I20260709 12:23:31.538509   985 raft_consensus.cc:385] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.538879   985 raft_consensus.cc:740] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.539042   932 tablet_service.cc:1511] Processing CreateTablet for tablet 013d4aa6601944c6bee3b0fd346309c6 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:31.539760   985 consensus_queue.cc:260] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } } peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } }
I20260709 12:23:31.540393   932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 013d4aa6601944c6bee3b0fd346309c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.544117   985 ts_tablet_manager.cc:1434] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
I20260709 12:23:31.545213   985 tablet_bootstrap.cc:492] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d: Bootstrap starting.
I20260709 12:23:31.547058   986 ts_tablet_manager.cc:1434] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.072s	user 0.001s	sys 0.013s
I20260709 12:23:31.548270   986 tablet_bootstrap.cc:492] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:31.550704   859 tablet_service.cc:1511] Processing CreateTablet for tablet 013d4aa6601944c6bee3b0fd346309c6 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:31.552129   859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 013d4aa6601944c6bee3b0fd346309c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.555657   986 tablet_bootstrap.cc:654] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.556375   984 tablet_bootstrap.cc:492] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79: No bootstrap required, opened a new log
I20260709 12:23:31.556946   984 ts_tablet_manager.cc:1403] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.012s
I20260709 12:23:31.560216   984 raft_consensus.cc:359] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.560967   984 raft_consensus.cc:385] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.561265   984 raft_consensus.cc:740] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.553085   985 tablet_bootstrap.cc:654] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.553454   934 tablet_service.cc:1511] Processing CreateTablet for tablet 3b474ceef6f445e09552b2048f358034 (DEFAULT_TABLE table=test-workload [id=676cff27cd1f404284a1975ac6f8808f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:31.562207   984 consensus_queue.cc:260] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.563993   934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b474ceef6f445e09552b2048f358034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:31.564937   984 ts_tablet_manager.cc:1434] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:31.573184   984 tablet_bootstrap.cc:492] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79: Bootstrap starting.
I20260709 12:23:31.580440   984 tablet_bootstrap.cc:654] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.587446   985 tablet_bootstrap.cc:492] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d: No bootstrap required, opened a new log
I20260709 12:23:31.588052   985 ts_tablet_manager.cc:1403] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.005s
I20260709 12:23:31.591164   985 raft_consensus.cc:359] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.595000   985 raft_consensus.cc:385] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.595808   985 raft_consensus.cc:740] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.596673   986 tablet_bootstrap.cc:492] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2: No bootstrap required, opened a new log
I20260709 12:23:31.597373   986 ts_tablet_manager.cc:1403] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.015s
I20260709 12:23:31.597393   985 consensus_queue.cc:260] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.600860   986 raft_consensus.cc:359] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.601786   986 raft_consensus.cc:385] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.602183   986 raft_consensus.cc:740] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.603135   986 consensus_queue.cc:260] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.604004   984 tablet_bootstrap.cc:492] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79: No bootstrap required, opened a new log
I20260709 12:23:31.604568   984 ts_tablet_manager.cc:1403] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.012s
I20260709 12:23:31.600862   985 ts_tablet_manager.cc:1434] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:23:31.607542   985 tablet_bootstrap.cc:492] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d: Bootstrap starting.
I20260709 12:23:31.608014   986 ts_tablet_manager.cc:1434] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:23:31.611029   986 tablet_bootstrap.cc:492] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:31.607630   984 raft_consensus.cc:359] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.614291   984 raft_consensus.cc:385] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.614697   984 raft_consensus.cc:740] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.615706   984 consensus_queue.cc:260] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.616840   985 tablet_bootstrap.cc:654] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.617512   986 tablet_bootstrap.cc:654] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.619730   984 ts_tablet_manager.cc:1434] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 12:23:31.620891   984 tablet_bootstrap.cc:492] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79: Bootstrap starting.
I20260709 12:23:31.627682   984 tablet_bootstrap.cc:654] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.629859   986 tablet_bootstrap.cc:492] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2: No bootstrap required, opened a new log
I20260709 12:23:31.629987   985 tablet_bootstrap.cc:492] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d: No bootstrap required, opened a new log
I20260709 12:23:31.630628   986 ts_tablet_manager.cc:1403] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 12:23:31.630702   985 ts_tablet_manager.cc:1403] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 12:23:31.633859   986 raft_consensus.cc:359] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } } peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } }
I20260709 12:23:31.634708   986 raft_consensus.cc:385] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.635106   986 raft_consensus.cc:740] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.634763   985 raft_consensus.cc:359] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.635601   985 raft_consensus.cc:385] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.635946   985 raft_consensus.cc:740] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.635929   986 consensus_queue.cc:260] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } } peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } }
I20260709 12:23:31.636735   984 tablet_bootstrap.cc:492] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79: No bootstrap required, opened a new log
I20260709 12:23:31.637372   984 ts_tablet_manager.cc:1403] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 12:23:31.636991   985 consensus_queue.cc:260] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.638470   986 ts_tablet_manager.cc:1434] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:31.639123   989 raft_consensus.cc:493] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.639642   986 tablet_bootstrap.cc:492] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:31.639647   989 raft_consensus.cc:515] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } } peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } }
I20260709 12:23:31.642307   985 ts_tablet_manager.cc:1434] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:23:31.643503   985 tablet_bootstrap.cc:492] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d: Bootstrap starting.
I20260709 12:23:31.644542   989 leader_election.cc:290] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:31.650339   985 tablet_bootstrap.cc:654] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.652009   984 raft_consensus.cc:359] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.656068   993 raft_consensus.cc:493] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.660743   993 raft_consensus.cc:515] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.656929   795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868ae757ae23436fa3b15835f9d556b5" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" is_pre_election: true
I20260709 12:23:31.662500   795 raft_consensus.cc:2468] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 0.
I20260709 12:23:31.663530   993 leader_election.cc:290] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:31.664140   908 leader_election.cc:304] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:31.665592   989 raft_consensus.cc:2804] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.666168   989 raft_consensus.cc:493] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.666693   989 raft_consensus.cc:3060] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.674566   984 raft_consensus.cc:385] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.680765   984 raft_consensus.cc:740] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.689410   986 tablet_bootstrap.cc:654] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.698992   869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4" candidate_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" is_pre_election: true
I20260709 12:23:31.685566   984 consensus_queue.cc:260] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.694463   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868ae757ae23436fa3b15835f9d556b5" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" is_pre_election: true
I20260709 12:23:31.700294   870 raft_consensus.cc:2468] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 0.
I20260709 12:23:31.695696   989 raft_consensus.cc:515] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } } peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } }
I20260709 12:23:31.702241   984 ts_tablet_manager.cc:1434] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent starting tablet: real 0.064s	user 0.003s	sys 0.005s
I20260709 12:23:31.704789   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868ae757ae23436fa3b15835f9d556b5" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:31.704936   795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868ae757ae23436fa3b15835f9d556b5" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:31.705411   870 raft_consensus.cc:3060] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.705883   795 raft_consensus.cc:3060] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.699709   869 raft_consensus.cc:2468] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef171ef037ed4c4aa096a9aa7f9e75a2 in term 0.
I20260709 12:23:31.708135   991 raft_consensus.cc:493] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.708688   991 raft_consensus.cc:515] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.716005   991 leader_election.cc:290] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:31.717056   758 leader_election.cc:304] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:31.718686   985 tablet_bootstrap.cc:492] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d: No bootstrap required, opened a new log
I20260709 12:23:31.719476   984 tablet_bootstrap.cc:492] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79: Bootstrap starting.
I20260709 12:23:31.720044   795 raft_consensus.cc:2468] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 1.
I20260709 12:23:31.721535   986 tablet_bootstrap.cc:492] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2: No bootstrap required, opened a new log
I20260709 12:23:31.723160   985 ts_tablet_manager.cc:1403] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.052s
I20260709 12:23:31.723546   989 leader_election.cc:290] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 1 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:31.724781   908 leader_election.cc:304] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:31.726913   989 raft_consensus.cc:2804] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.727119   985 raft_consensus.cc:359] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.727993   985 raft_consensus.cc:385] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.728328   985 raft_consensus.cc:740] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.729158   985 consensus_queue.cc:260] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.723832   986 ts_tablet_manager.cc:1403] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.003s
I20260709 12:23:31.723057   870 raft_consensus.cc:2468] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 1.
I20260709 12:23:31.722745   993 raft_consensus.cc:2804] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.733314   993 raft_consensus.cc:493] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.733711   993 raft_consensus.cc:3060] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.736718   986 raft_consensus.cc:359] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.737622   986 raft_consensus.cc:385] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.737944   986 raft_consensus.cc:740] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.738718   989 raft_consensus.cc:697] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 LEADER]: Becoming Leader. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:31.738838   986 consensus_queue.cc:260] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.740041   989 consensus_queue.cc:237] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } } peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } }
I20260709 12:23:31.742295   986 ts_tablet_manager.cc:1434] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:23:31.743448   986 tablet_bootstrap.cc:492] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:31.743767   944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4" candidate_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" is_pre_election: true
I20260709 12:23:31.744511   944 raft_consensus.cc:2468] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef171ef037ed4c4aa096a9aa7f9e75a2 in term 0.
I20260709 12:23:31.746182   984 tablet_bootstrap.cc:654] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.746609   944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912cb57dbae442dcb8c3fc3d9028dcd2" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" is_pre_election: true
I20260709 12:23:31.747274   944 raft_consensus.cc:2468] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 0.
I20260709 12:23:31.749367   833 leader_election.cc:304] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d; no voters: 
I20260709 12:23:31.750736   991 raft_consensus.cc:2804] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.751478   991 raft_consensus.cc:493] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.751893   991 raft_consensus.cc:3060] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.741915   993 raft_consensus.cc:515] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.754140   795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912cb57dbae442dcb8c3fc3d9028dcd2" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" is_pre_election: true
I20260709 12:23:31.755015   795 raft_consensus.cc:2468] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 0.
I20260709 12:23:31.755903   993 leader_election.cc:290] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [CANDIDATE]: Term 1 election: Requested vote from peers 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:31.761380   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4" candidate_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:31.761659   944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4" candidate_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:31.762143   870 raft_consensus.cc:3060] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.762343   944 raft_consensus.cc:3060] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.763728   985 ts_tablet_manager.cc:1434] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent starting tablet: real 0.040s	user 0.014s	sys 0.001s
I20260709 12:23:31.764842   985 tablet_bootstrap.cc:492] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d: Bootstrap starting.
I20260709 12:23:31.768239   944 raft_consensus.cc:2468] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef171ef037ed4c4aa096a9aa7f9e75a2 in term 1.
I20260709 12:23:31.769521   758 leader_election.cc:304] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:31.771322   985 tablet_bootstrap.cc:654] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.771374  1012 raft_consensus.cc:2804] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:23:31.772799   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:31.773023  1012 raft_consensus.cc:697] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 LEADER]: Becoming Leader. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Running, Role: LEADER
I20260709 12:23:31.773968  1012 consensus_queue.cc:237] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.775802   870 raft_consensus.cc:2468] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef171ef037ed4c4aa096a9aa7f9e75a2 in term 1.
I20260709 12:23:31.750728   986 tablet_bootstrap.cc:654] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.777379   985 tablet_bootstrap.cc:492] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d: No bootstrap required, opened a new log
I20260709 12:23:31.777390   984 tablet_bootstrap.cc:492] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79: No bootstrap required, opened a new log
I20260709 12:23:31.769642   991 raft_consensus.cc:515] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.771737   691 catalog_manager.cc:5697] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195). New cstate: current_term: 1 leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.778128   985 ts_tablet_manager.cc:1403] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:23:31.778250   984 ts_tablet_manager.cc:1403] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent bootstrapping tablet: real 0.059s	user 0.002s	sys 0.014s
I20260709 12:23:31.782171   985 raft_consensus.cc:359] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.782320   984 raft_consensus.cc:359] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.783058   985 raft_consensus.cc:385] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.783566   985 raft_consensus.cc:740] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.783504   795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912cb57dbae442dcb8c3fc3d9028dcd2" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:31.784351   795 raft_consensus.cc:3060] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.783463   984 raft_consensus.cc:385] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.784777   985 consensus_queue.cc:260] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.785243   984 raft_consensus.cc:740] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.787460   985 ts_tablet_manager.cc:1434] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:23:31.788538   985 tablet_bootstrap.cc:492] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d: Bootstrap starting.
I20260709 12:23:31.790544   984 consensus_queue.cc:260] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.793390   795 raft_consensus.cc:2468] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 1.
I20260709 12:23:31.793643   944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912cb57dbae442dcb8c3fc3d9028dcd2" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:31.795317   944 raft_consensus.cc:3060] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.793598   693 catalog_manager.cc:5697] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.794242   991 leader_election.cc:290] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:31.804723   834 leader_election.cc:304] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:31.808007   991 raft_consensus.cc:2804] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.808511   991 raft_consensus.cc:697] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:31.809922   985 tablet_bootstrap.cc:654] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.814774   944 raft_consensus.cc:2468] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 1.
I20260709 12:23:31.819464  1019 raft_consensus.cc:493] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.809394   991 consensus_queue.cc:237] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.823391   986 tablet_bootstrap.cc:492] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2: No bootstrap required, opened a new log
I20260709 12:23:31.824072   986 ts_tablet_manager.cc:1403] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.022s
I20260709 12:23:31.827411   984 ts_tablet_manager.cc:1434] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.005s
I20260709 12:23:31.827493   986 raft_consensus.cc:359] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.820003  1019 raft_consensus.cc:515] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.828752   984 tablet_bootstrap.cc:492] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79: Bootstrap starting.
I20260709 12:23:31.828797   985 tablet_bootstrap.cc:492] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d: No bootstrap required, opened a new log
I20260709 12:23:31.828929   986 raft_consensus.cc:385] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.832789   986 raft_consensus.cc:740] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.832163   795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fd4d4b79634debbff6d63f295df2f6" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" is_pre_election: true
I20260709 12:23:31.829777   985 ts_tablet_manager.cc:1403] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.002s
I20260709 12:23:31.836412   984 tablet_bootstrap.cc:654] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.836796   985 raft_consensus.cc:359] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.837635   985 raft_consensus.cc:385] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.837980   985 raft_consensus.cc:740] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.838832   985 consensus_queue.cc:260] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.841539   985 ts_tablet_manager.cc:1434] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260709 12:23:31.843034   986 consensus_queue.cc:260] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.844359   795 raft_consensus.cc:2468] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 0.
I20260709 12:23:31.849027   834 leader_election.cc:304] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:31.850168   991 raft_consensus.cc:2804] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.850637   991 raft_consensus.cc:493] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.851063  1019 leader_election.cc:290] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:31.852156   944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fd4d4b79634debbff6d63f295df2f6" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" is_pre_election: true
I20260709 12:23:31.852871   944 raft_consensus.cc:2468] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 0.
I20260709 12:23:31.852937   991 raft_consensus.cc:3060] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.853790   986 ts_tablet_manager.cc:1434] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:23:31.855248   986 tablet_bootstrap.cc:492] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:31.860940   991 raft_consensus.cc:515] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.864277   985 tablet_bootstrap.cc:492] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d: Bootstrap starting.
I20260709 12:23:31.867743   986 tablet_bootstrap.cc:654] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.868525   795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fd4d4b79634debbff6d63f295df2f6" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:31.869310   795 raft_consensus.cc:3060] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.872160   984 tablet_bootstrap.cc:492] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79: No bootstrap required, opened a new log
I20260709 12:23:31.872809   984 ts_tablet_manager.cc:1403] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent bootstrapping tablet: real 0.044s	user 0.031s	sys 0.008s
I20260709 12:23:31.876279   984 raft_consensus.cc:359] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.877136   984 raft_consensus.cc:385] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.877498   984 raft_consensus.cc:740] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.878386   691 catalog_manager.cc:5697] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.879670   795 raft_consensus.cc:2468] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 1.
I20260709 12:23:31.880053   986 tablet_bootstrap.cc:492] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2: No bootstrap required, opened a new log
I20260709 12:23:31.880883   986 ts_tablet_manager.cc:1403] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.014s
I20260709 12:23:31.878449   984 consensus_queue.cc:260] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.881062   834 leader_election.cc:304] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:31.882293  1019 raft_consensus.cc:2804] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.882754  1019 raft_consensus.cc:697] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:31.882992   984 ts_tablet_manager.cc:1434] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:23:31.883548  1019 consensus_queue.cc:237] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.884122   984 tablet_bootstrap.cc:492] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79: Bootstrap starting.
I20260709 12:23:31.884171   986 raft_consensus.cc:359] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.885062   986 raft_consensus.cc:385] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.885361   986 raft_consensus.cc:740] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.885793  1012 raft_consensus.cc:493] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.886304  1012 raft_consensus.cc:515] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.888912  1012 leader_election.cc:290] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:31.890895   944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac69a39998774d47b48667fea5943c70" candidate_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" is_pre_election: true
I20260709 12:23:31.891647   984 tablet_bootstrap.cc:654] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.891280   986 consensus_queue.cc:260] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.892061   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac69a39998774d47b48667fea5943c70" candidate_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" is_pre_election: true
I20260709 12:23:31.892752   870 raft_consensus.cc:2468] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef171ef037ed4c4aa096a9aa7f9e75a2 in term 0.
I20260709 12:23:31.893941   985 tablet_bootstrap.cc:654] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.897101   991 leader_election.cc:290] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:31.891647   944 raft_consensus.cc:2468] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef171ef037ed4c4aa096a9aa7f9e75a2 in term 0.
I20260709 12:23:31.896203   986 ts_tablet_manager.cc:1434] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:23:31.894284   758 leader_election.cc:304] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:31.896730   943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fd4d4b79634debbff6d63f295df2f6" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:31.901227  1012 raft_consensus.cc:2804] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.901602   943 raft_consensus.cc:3060] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.901628  1012 raft_consensus.cc:493] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.906883  1012 raft_consensus.cc:3060] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.908325   986 tablet_bootstrap.cc:492] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:31.917275  1012 raft_consensus.cc:515] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.920535   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac69a39998774d47b48667fea5943c70" candidate_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:31.921046   943 raft_consensus.cc:2468] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 1.
I20260709 12:23:31.921218   870 raft_consensus.cc:3060] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.925850   986 tablet_bootstrap.cc:654] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.930893   870 raft_consensus.cc:2468] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef171ef037ed4c4aa096a9aa7f9e75a2 in term 1.
I20260709 12:23:31.932298   758 leader_election.cc:304] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:31.933291   993 raft_consensus.cc:2804] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.933761   984 tablet_bootstrap.cc:492] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79: No bootstrap required, opened a new log
I20260709 12:23:31.934422   984 ts_tablet_manager.cc:1403] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.010s
I20260709 12:23:31.934458   993 raft_consensus.cc:697] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 LEADER]: Becoming Leader. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Running, Role: LEADER
I20260709 12:23:31.934342   985 tablet_bootstrap.cc:492] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d: No bootstrap required, opened a new log
I20260709 12:23:31.935622   993 consensus_queue.cc:237] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.936573   986 tablet_bootstrap.cc:492] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2: No bootstrap required, opened a new log
I20260709 12:23:31.936780   985 ts_tablet_manager.cc:1403] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.019s
I20260709 12:23:31.937129   986 ts_tablet_manager.cc:1403] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.001s
I20260709 12:23:31.937837   984 raft_consensus.cc:359] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.938658   984 raft_consensus.cc:385] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.938962   984 raft_consensus.cc:740] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.939630   985 raft_consensus.cc:359] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.940179  1012 leader_election.cc:290] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [CANDIDATE]: Term 1 election: Requested vote from peers 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:31.939998   986 raft_consensus.cc:359] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.940907   986 raft_consensus.cc:385] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.941305   986 raft_consensus.cc:740] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.930694   690 catalog_manager.cc:5697] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.941468   943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac69a39998774d47b48667fea5943c70" candidate_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:31.942250   986 consensus_queue.cc:260] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.942404   943 raft_consensus.cc:3060] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.940446   985 raft_consensus.cc:385] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.941033   984 consensus_queue.cc:260] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.944314   985 raft_consensus.cc:740] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.944744   986 ts_tablet_manager.cc:1434] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:31.945184   985 consensus_queue.cc:260] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.945837   986 tablet_bootstrap.cc:492] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:31.945997   984 ts_tablet_manager.cc:1434] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:23:31.947050   984 tablet_bootstrap.cc:492] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79: Bootstrap starting.
I20260709 12:23:31.951303   985 ts_tablet_manager.cc:1434] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:23:31.952374   985 tablet_bootstrap.cc:492] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d: Bootstrap starting.
I20260709 12:23:31.953321   986 tablet_bootstrap.cc:654] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.954690   984 tablet_bootstrap.cc:654] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.959224   985 tablet_bootstrap.cc:654] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.965135   986 tablet_bootstrap.cc:492] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2: No bootstrap required, opened a new log
I20260709 12:23:31.965770   986 ts_tablet_manager.cc:1403] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.004s
I20260709 12:23:31.965153   984 tablet_bootstrap.cc:492] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79: No bootstrap required, opened a new log
I20260709 12:23:31.966406   984 ts_tablet_manager.cc:1403] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:23:31.969188   984 raft_consensus.cc:359] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.969957   984 raft_consensus.cc:385] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.970301   984 raft_consensus.cc:740] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.970992   985 tablet_bootstrap.cc:492] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d: No bootstrap required, opened a new log
I20260709 12:23:31.971542   985 ts_tablet_manager.cc:1403] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:23:31.971174   984 consensus_queue.cc:260] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.971735   986 raft_consensus.cc:359] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.972649   986 raft_consensus.cc:385] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.972958   986 raft_consensus.cc:740] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.973507   984 ts_tablet_manager.cc:1434] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:31.974565   984 tablet_bootstrap.cc:492] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79: Bootstrap starting.
I20260709 12:23:31.974599   985 raft_consensus.cc:359] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.975493   985 raft_consensus.cc:385] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.975812   985 raft_consensus.cc:740] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.976488   985 consensus_queue.cc:260] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.978493   985 ts_tablet_manager.cc:1434] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:31.979477   985 tablet_bootstrap.cc:492] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d: Bootstrap starting.
I20260709 12:23:31.981462   984 tablet_bootstrap.cc:654] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.973877   986 consensus_queue.cc:260] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.985332   986 ts_tablet_manager.cc:1434] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:31.985522   985 tablet_bootstrap.cc:654] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.986454   986 tablet_bootstrap.cc:492] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:31.984947   693 catalog_manager.cc:5697] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.993175   984 tablet_bootstrap.cc:492] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79: No bootstrap required, opened a new log
I20260709 12:23:31.993757   984 ts_tablet_manager.cc:1403] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:23:31.994395   986 tablet_bootstrap.cc:654] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.996840   985 tablet_bootstrap.cc:492] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d: No bootstrap required, opened a new log
I20260709 12:23:31.996687   984 raft_consensus.cc:359] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:31.997455   984 raft_consensus.cc:385] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.997535   985 ts_tablet_manager.cc:1403] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:23:31.997936   984 raft_consensus.cc:740] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.999130   984 consensus_queue.cc:260] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.001561   985 raft_consensus.cc:359] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.002643   985 raft_consensus.cc:385] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.003043   985 raft_consensus.cc:740] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.004010   984 ts_tablet_manager.cc:1434] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:32.004029   985 consensus_queue.cc:260] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.005227   984 tablet_bootstrap.cc:492] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79: Bootstrap starting.
I20260709 12:23:32.006112   986 tablet_bootstrap.cc:492] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: No bootstrap required, opened a new log
I20260709 12:23:32.006652   986 ts_tablet_manager.cc:1403] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.001s
I20260709 12:23:32.006722   985 ts_tablet_manager.cc:1434] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:32.009104   986 raft_consensus.cc:359] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.009935   986 raft_consensus.cc:385] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.010291   986 raft_consensus.cc:740] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.011263   986 consensus_queue.cc:260] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.011938   984 tablet_bootstrap.cc:654] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.013605   986 ts_tablet_manager.cc:1434] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:32.014771   986 tablet_bootstrap.cc:492] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:32.016983  1011 raft_consensus.cc:493] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.017567  1011 raft_consensus.cc:515] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.024881  1011 leader_election.cc:290] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:32.026630   795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02af04ade5d048c0ada291d2136cf8ee" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" is_pre_election: true
I20260709 12:23:32.026746   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02af04ade5d048c0ada291d2136cf8ee" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" is_pre_election: true
I20260709 12:23:32.027457   795 raft_consensus.cc:2468] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 0.
I20260709 12:23:32.027777   870 raft_consensus.cc:2468] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 0.
I20260709 12:23:32.028772   908 leader_election.cc:304] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:32.029990  1011 raft_consensus.cc:2804] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.030392  1011 raft_consensus.cc:493] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.030710  1011 raft_consensus.cc:3060] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.033824   943 raft_consensus.cc:2468] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef171ef037ed4c4aa096a9aa7f9e75a2 in term 1.
I20260709 12:23:32.036326  1011 raft_consensus.cc:515] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.037549   984 tablet_bootstrap.cc:492] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79: No bootstrap required, opened a new log
I20260709 12:23:32.038211   984 ts_tablet_manager.cc:1403] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.014s
I20260709 12:23:32.039139   795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02af04ade5d048c0ada291d2136cf8ee" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:32.040601   795 raft_consensus.cc:3060] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.041164   984 raft_consensus.cc:359] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.041554   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02af04ade5d048c0ada291d2136cf8ee" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:32.041899   984 raft_consensus.cc:385] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.042164   870 raft_consensus.cc:3060] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.042219   984 raft_consensus.cc:740] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.042536   986 tablet_bootstrap.cc:654] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.043116   984 consensus_queue.cc:260] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.047375   991 raft_consensus.cc:493] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.047859   991 raft_consensus.cc:515] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.049996   870 raft_consensus.cc:2468] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 1.
I20260709 12:23:32.050149   991 leader_election.cc:290] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:32.052067   984 ts_tablet_manager.cc:1434] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:23:32.054013   943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" is_pre_election: true
I20260709 12:23:32.054771   794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" is_pre_election: true
I20260709 12:23:32.055361   943 raft_consensus.cc:2468] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 0.
I20260709 12:23:32.055583   794 raft_consensus.cc:2468] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 0.
I20260709 12:23:32.055903   986 tablet_bootstrap.cc:492] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2: No bootstrap required, opened a new log
I20260709 12:23:32.055958   907 leader_election.cc:304] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d; no voters: 
I20260709 12:23:32.056631   986 ts_tablet_manager.cc:1403] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.007s
I20260709 12:23:32.056473   833 leader_election.cc:304] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d; no voters: 
I20260709 12:23:32.057125   989 raft_consensus.cc:2804] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.057631   989 raft_consensus.cc:697] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 LEADER]: Becoming Leader. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:32.054754  1011 leader_election.cc:290] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 1 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:32.058514   989 consensus_queue.cc:237] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.059366   991 raft_consensus.cc:2804] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.059463   986 raft_consensus.cc:359] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.060268   986 raft_consensus.cc:385] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.060142   991 raft_consensus.cc:493] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.060581   986 raft_consensus.cc:740] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.060719   991 raft_consensus.cc:3060] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.054628   795 raft_consensus.cc:2468] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 1.
I20260709 12:23:32.061661  1011 raft_consensus.cc:493] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.061987  1019 raft_consensus.cc:493] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.062248  1011 raft_consensus.cc:515] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.062547  1019 raft_consensus.cc:515] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.064654  1019 leader_election.cc:290] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:32.065842   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3f8a235e34f91a239ff687e3af1b3" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" is_pre_election: true
I20260709 12:23:32.066533   870 raft_consensus.cc:2468] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 0.
I20260709 12:23:32.066601   794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3f8a235e34f91a239ff687e3af1b3" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" is_pre_election: true
I20260709 12:23:32.067276   794 raft_consensus.cc:2468] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 0.
I20260709 12:23:32.067735   907 leader_election.cc:304] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d; no voters: 
I20260709 12:23:32.068390   991 raft_consensus.cc:515] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.068634  1010 raft_consensus.cc:2804] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.069242  1010 raft_consensus.cc:493] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.069386   943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3f8a235e34f91a239ff687e3af1b3" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" is_pre_election: true
I20260709 12:23:32.069625  1010 raft_consensus.cc:3060] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.068527   834 leader_election.cc:304] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:32.070647   991 leader_election.cc:290] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:32.070981  1019 raft_consensus.cc:2804] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.071483  1019 raft_consensus.cc:493] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.071245   986 consensus_queue.cc:260] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.071851  1019 raft_consensus.cc:3060] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.073583   986 ts_tablet_manager.cc:1434] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:23:32.074421  1011 leader_election.cc:290] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:32.075803   944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:32.076087   795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3f8a235e34f91a239ff687e3af1b3" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" is_pre_election: true
I20260709 12:23:32.076434   944 raft_consensus.cc:3060] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.076797   795 raft_consensus.cc:2468] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 0.
I20260709 12:23:32.078511   794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:32.079126   794 raft_consensus.cc:3060] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.084254   944 raft_consensus.cc:2468] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 1.
I20260709 12:23:32.087554  1019 raft_consensus.cc:515] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.088938   833 leader_election.cc:304] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d; no voters: 
I20260709 12:23:32.087556  1010 raft_consensus.cc:515] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.090824   795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3f8a235e34f91a239ff687e3af1b3" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:32.091074   943 raft_consensus.cc:2393] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in current term 1: Already voted for candidate 8a0be3f1ce524d76a3d6c02656c3140d in this term.
I20260709 12:23:32.091508   795 raft_consensus.cc:3060] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.091893  1010 leader_election.cc:290] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 1 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:32.092672   942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3f8a235e34f91a239ff687e3af1b3" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:32.093546   942 raft_consensus.cc:2393] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in current term 1: Already voted for candidate 8a0be3f1ce524d76a3d6c02656c3140d in this term.
I20260709 12:23:32.094297   793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3f8a235e34f91a239ff687e3af1b3" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:32.095738  1019 leader_election.cc:290] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:32.094431   794 raft_consensus.cc:2468] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 1.
I20260709 12:23:32.096421  1019 raft_consensus.cc:2804] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.096361   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3f8a235e34f91a239ff687e3af1b3" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:32.097421   870 raft_consensus.cc:2393] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a0be3f1ce524d76a3d6c02656c3140d in current term 1: Already voted for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in this term.
I20260709 12:23:32.097870  1019 raft_consensus.cc:697] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:32.098572   907 leader_election.cc:304] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d; no voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2
I20260709 12:23:32.098927   795 raft_consensus.cc:2468] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 1.
I20260709 12:23:32.098876  1019 consensus_queue.cc:237] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.099895  1010 raft_consensus.cc:2749] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.100135   834 leader_election.cc:304] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 8a0be3f1ce524d76a3d6c02656c3140d
I20260709 12:23:32.101112   991 raft_consensus.cc:2804] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.101797   991 raft_consensus.cc:697] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:32.101601   691 catalog_manager.cc:5697] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195). New cstate: current_term: 1 leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.102711   991 consensus_queue.cc:237] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.111670   690 catalog_manager.cc:5697] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.123587   690 catalog_manager.cc:5697] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.136407  1012 raft_consensus.cc:493] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.136970  1012 raft_consensus.cc:515] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.138656  1012 leader_election.cc:290] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:32.139454   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" is_pre_election: true
I20260709 12:23:32.139737   944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" is_pre_election: true
I20260709 12:23:32.140105   870 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef171ef037ed4c4aa096a9aa7f9e75a2 in term 0.
I20260709 12:23:32.140419   944 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef171ef037ed4c4aa096a9aa7f9e75a2 in term 0.
I20260709 12:23:32.141149   758 leader_election.cc:304] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:32.141914  1012 raft_consensus.cc:2804] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.142299  1012 raft_consensus.cc:493] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.142602  1012 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.147501  1012 raft_consensus.cc:515] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.149154  1012 leader_election.cc:290] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [CANDIDATE]: Term 1 election: Requested vote from peers 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:32.149924   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:32.150168   944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:32.150599   870 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.150707   944 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.157681   870 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef171ef037ed4c4aa096a9aa7f9e75a2 in term 1.
I20260709 12:23:32.157681   944 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef171ef037ed4c4aa096a9aa7f9e75a2 in term 1.
I20260709 12:23:32.159080   758 leader_election.cc:304] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:32.159746  1012 raft_consensus.cc:2804] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.160238  1012 raft_consensus.cc:697] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 LEADER]: Becoming Leader. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Running, Role: LEADER
I20260709 12:23:32.160987  1012 consensus_queue.cc:237] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.168835   690 catalog_manager.cc:5697] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.172354   991 raft_consensus.cc:493] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.172928   991 raft_consensus.cc:515] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.175115   991 leader_election.cc:290] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:32.175820   795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013d4aa6601944c6bee3b0fd346309c6" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" is_pre_election: true
I20260709 12:23:32.176295   944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013d4aa6601944c6bee3b0fd346309c6" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" is_pre_election: true
I20260709 12:23:32.176553   795 raft_consensus.cc:2468] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 0.
I20260709 12:23:32.177062   944 raft_consensus.cc:2468] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 0.
I20260709 12:23:32.178114   834 leader_election.cc:304] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:32.178840   991 raft_consensus.cc:2804] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.179198   991 raft_consensus.cc:493] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.179486   991 raft_consensus.cc:3060] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.184465   991 raft_consensus.cc:515] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.186900   991 leader_election.cc:290] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:32.187264   795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013d4aa6601944c6bee3b0fd346309c6" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:32.187501   944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013d4aa6601944c6bee3b0fd346309c6" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:32.187920   795 raft_consensus.cc:3060] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.188064   944 raft_consensus.cc:3060] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.193567   795 raft_consensus.cc:2468] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 1.
I20260709 12:23:32.193647   944 raft_consensus.cc:2468] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 1.
I20260709 12:23:32.194896   833 leader_election.cc:304] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:32.195577   991 raft_consensus.cc:2804] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.196040   991 raft_consensus.cc:697] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:32.196761   991 consensus_queue.cc:237] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:32.204797   690 catalog_manager.cc:5697] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.224432  1012 consensus_queue.cc:1048] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.225226   991 consensus_queue.cc:1048] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.247073  1010 consensus_queue.cc:1048] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.251271  1032 consensus_queue.cc:1048] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.266261  1020 consensus_queue.cc:1048] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.289866  1011 consensus_queue.cc:1048] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.335458  1019 consensus_queue.cc:1048] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.346117  1019 consensus_queue.cc:1048] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.410619 23879 ts_manager.cc:295] Set tserver state for ef171ef037ed4c4aa096a9aa7f9e75a2 to MAINTENANCE_MODE
I20260709 12:23:32.411414 23879 tablet_server.cc:179] TabletServer@127.23.81.193:0 shutting down...
I20260709 12:23:32.431620 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:32.432529 23879 tablet_replica.cc:333] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2: stopping tablet replica
I20260709 12:23:32.433329 23879 raft_consensus.cc:2243] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.433907 23879 raft_consensus.cc:2272] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.436177 23879 tablet_replica.cc:333] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2: stopping tablet replica
I20260709 12:23:32.436805 23879 raft_consensus.cc:2243] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.437209 23879 raft_consensus.cc:2272] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.439201 23879 tablet_replica.cc:333] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2: stopping tablet replica
I20260709 12:23:32.439788 23879 raft_consensus.cc:2243] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.440233 23879 raft_consensus.cc:2272] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.442807 23879 tablet_replica.cc:333] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: stopping tablet replica
I20260709 12:23:32.443364 23879 raft_consensus.cc:2243] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.444095 23879 pending_rounds.cc:70] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Trying to abort 1 pending ops.
I20260709 12:23:32.444288  1012 consensus_queue.cc:1048] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.444320 23879 pending_rounds.cc:77] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624830618963968 op_type: NO_OP noop_request { }
I20260709 12:23:32.444967 23879 raft_consensus.cc:2889] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:32.445345 23879 raft_consensus.cc:2272] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.447991 23879 tablet_replica.cc:333] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2: stopping tablet replica
I20260709 12:23:32.448592 23879 raft_consensus.cc:2243] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.449065 23879 raft_consensus.cc:2272] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.451788 23879 tablet_replica.cc:333] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2: stopping tablet replica
I20260709 12:23:32.452565 23879 raft_consensus.cc:2243] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.453166 23879 raft_consensus.cc:2272] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.456262 23879 tablet_replica.cc:333] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2: stopping tablet replica
I20260709 12:23:32.457139 23879 raft_consensus.cc:2243] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:23:32.457785  1032 consensus_queue.cc:1175] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" responder_term: 1 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:32.459270 23879 raft_consensus.cc:2272] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.461683 23879 tablet_replica.cc:333] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2: stopping tablet replica
I20260709 12:23:32.462337 23879 raft_consensus.cc:2243] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.462740 23879 raft_consensus.cc:2272] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.464749 23879 tablet_replica.cc:333] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2: stopping tablet replica
I20260709 12:23:32.465269 23879 raft_consensus.cc:2243] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.466176 23879 raft_consensus.cc:2272] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.468273 23879 tablet_replica.cc:333] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2: stopping tablet replica
I20260709 12:23:32.468791 23879 raft_consensus.cc:2243] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.469210 23879 raft_consensus.cc:2272] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.500171 23879 tablet_server.cc:196] TabletServer@127.23.81.193:0 shutdown complete.
I20260709 12:23:32.570441  1019 consensus_queue.cc:1048] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:32.575523   834 consensus_peers.cc:597] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:32.586076   834 consensus_peers.cc:597] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.607914  1020 consensus_queue.cc:1048] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:32.647505   908 consensus_peers.cc:597] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.674739  1010 consensus_queue.cc:1048] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:32.748499   834 consensus_peers.cc:597] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.754897  1020 consensus_queue.cc:1048] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:32.770473   834 consensus_peers.cc:597] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:32.773911   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:32.806052   834 consensus_peers.cc:597] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:32.839624   908 consensus_peers.cc:597] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.663301  1070 raft_consensus.cc:493] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.663777  1070 raft_consensus.cc:515] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:33.665552  1070 leader_election.cc:290] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:33.666698   942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" is_pre_election: true
I20260709 12:23:33.667455   942 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 1.
I20260709 12:23:33.668598   833 leader_election.cc:304] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d; no voters: 
I20260709 12:23:33.669339  1070 raft_consensus.cc:2804] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:33.669353   834 leader_election.cc:336] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111)
I20260709 12:23:33.669691  1070 raft_consensus.cc:493] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.670131  1070 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.675735  1070 raft_consensus.cc:515] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:33.677590  1070 leader_election.cc:290] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:33.678733   942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:33.679335   942 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:33.681932   834 leader_election.cc:336] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111)
I20260709 12:23:33.686619   942 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 2.
I20260709 12:23:33.687995   833 leader_election.cc:304] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d; no voters: ef171ef037ed4c4aa096a9aa7f9e75a2
I20260709 12:23:33.688762  1070 raft_consensus.cc:2804] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:33.689118  1070 raft_consensus.cc:697] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:33.689774  1070 consensus_queue.cc:237] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:33.697414   689 catalog_manager.cc:5697] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 1 to 2, leader changed from ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193) to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.736660  1070 raft_consensus.cc:493] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef171ef037ed4c4aa096a9aa7f9e75a2)
I20260709 12:23:33.737278  1070 raft_consensus.cc:515] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:33.739099  1070 leader_election.cc:290] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:33.740198   942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" is_pre_election: true
W20260709 12:23:33.742633   834 leader_election.cc:336] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111)
I20260709 12:23:33.743047   834 leader_election.cc:304] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79; no voters: 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2
I20260709 12:23:33.743703  1019 raft_consensus.cc:2749] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:33.755776  1071 raft_consensus.cc:493] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef171ef037ed4c4aa096a9aa7f9e75a2)
I20260709 12:23:33.756297  1071 raft_consensus.cc:515] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:33.757910  1071 leader_election.cc:290] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:33.759099   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" is_pre_election: true
I20260709 12:23:33.759884   870 raft_consensus.cc:2468] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 1.
I20260709 12:23:33.761130   907 leader_election.cc:304] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d; no voters: 
I20260709 12:23:33.761986  1071 raft_consensus.cc:2804] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:33.762279   908 leader_election.cc:336] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111)
I20260709 12:23:33.762396  1071 raft_consensus.cc:493] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef171ef037ed4c4aa096a9aa7f9e75a2)
I20260709 12:23:33.762953  1071 raft_consensus.cc:3060] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.769611  1071 raft_consensus.cc:515] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:33.771427  1071 leader_election.cc:290] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:33.772619   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:33.773324   870 raft_consensus.cc:3060] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:33.774885   908 leader_election.cc:336] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111)
W20260709 12:23:33.775067   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:33.779078   870 raft_consensus.cc:2468] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 2.
I20260709 12:23:33.780180   907 leader_election.cc:304] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d; no voters: ef171ef037ed4c4aa096a9aa7f9e75a2
I20260709 12:23:33.781011  1071 raft_consensus.cc:2804] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:33.781435  1071 raft_consensus.cc:697] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Becoming Leader. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:33.782140  1071 consensus_queue.cc:237] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:33.789351   689 catalog_manager.cc:5697] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d reported cstate change: term changed from 1 to 2, leader changed from ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193) to 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195). New cstate: current_term: 2 leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:33.910614  1071 raft_consensus.cc:493] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.911156  1071 raft_consensus.cc:515] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:33.912894  1071 leader_election.cc:290] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:33.914176   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac69a39998774d47b48667fea5943c70" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" is_pre_election: true
W20260709 12:23:33.916889   908 leader_election.cc:336] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111)
I20260709 12:23:33.917325   908 leader_election.cc:304] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d; no voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2
I20260709 12:23:33.918056  1071 raft_consensus.cc:2749] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:33.956072  1019 raft_consensus.cc:493] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef171ef037ed4c4aa096a9aa7f9e75a2)
I20260709 12:23:33.956707  1019 raft_consensus.cc:515] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:33.958520  1019 leader_election.cc:290] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:33.959601   942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac69a39998774d47b48667fea5943c70" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" is_pre_election: true
W20260709 12:23:33.959789   834 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111) [suppressed 145 similar messages]
I20260709 12:23:33.960247   942 raft_consensus.cc:2468] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 1.
I20260709 12:23:33.961454   833 leader_election.cc:304] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d; no voters: 
I20260709 12:23:33.962162  1019 raft_consensus.cc:2804] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:33.962461  1019 raft_consensus.cc:493] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef171ef037ed4c4aa096a9aa7f9e75a2)
W20260709 12:23:33.962610   834 leader_election.cc:336] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111)
I20260709 12:23:33.962850  1019 raft_consensus.cc:3060] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.968075  1019 raft_consensus.cc:515] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:33.969820  1019 leader_election.cc:290] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:33.971045   942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac69a39998774d47b48667fea5943c70" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:33.971661   942 raft_consensus.cc:3060] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:33.973711   834 leader_election.cc:336] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111)
I20260709 12:23:33.976733   942 raft_consensus.cc:2468] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 2.
I20260709 12:23:33.977852   833 leader_election.cc:304] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d; no voters: ef171ef037ed4c4aa096a9aa7f9e75a2
I20260709 12:23:33.978590  1019 raft_consensus.cc:2804] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:33.979065  1019 raft_consensus.cc:697] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:33.979919  1019 consensus_queue.cc:237] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:33.987442   689 catalog_manager.cc:5697] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 1 to 2, leader changed from ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193) to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.176512   870 raft_consensus.cc:1275] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.177791  1071 consensus_queue.cc:1048] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:34.195815   908 consensus_peers.cc:597] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.222891   834 consensus_peers.cc:597] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:34.313977   942 raft_consensus.cc:1275] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:34.315598  1019 consensus_queue.cc:1048] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:34.534819   942 raft_consensus.cc:1275] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.536283  1070 consensus_queue.cc:1048] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:34.550804   834 consensus_peers.cc:597] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.776211   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:34.877533   834 consensus_peers.cc:597] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:35.045327   834 consensus_peers.cc:597] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:35.045876   834 consensus_peers.cc:597] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:35.129000   834 consensus_peers.cc:597] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:35.185304   908 consensus_peers.cc:597] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:35.269912   834 consensus_peers.cc:597] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:35.387190   908 consensus_peers.cc:597] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:35.777283   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:36.778473   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:36.824627   908 consensus_peers.cc:597] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.942096   834 consensus_peers.cc:597] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:37.121471   834 consensus_peers.cc:597] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:37.123754   834 consensus_peers.cc:597] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:37.298062   834 consensus_peers.cc:597] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:37.519134 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:37.525803  1087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.526381  1088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.533383   908 consensus_peers.cc:597] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:37.534726  1090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:37.535406 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:37.537030 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:37.537297 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:37.537520 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599817537502 us; error 0 us; skew 500 ppm
I20260709 12:23:37.538203 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:37.541671 23879 webserver.cc:533] Webserver started at http://127.23.81.193:42601/ using document root <none> and password file <none>
I20260709 12:23:37.542349 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:37.542594 23879 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:23:37.546626 23879 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:23:37.550894  1095 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:37.551738 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:23:37.552067 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-0-root
uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
format_stamp: "Formatted at 2026-07-09 12:23:30 on dist-test-slave-mprf"
I20260709 12:23:37.552412 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599468354575-23879-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:23:37.560456   834 consensus_peers.cc:597] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:37.564353   834 consensus_peers.cc:597] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:37.576926 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:37.578575 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:37.580741 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:37.586313  1102 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:23:37.639976 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:23:37.640328 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.055s	user 0.003s	sys 0.000s
I20260709 12:23:37.640661 23879 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:23:37.645568  1102 tablet_bootstrap.cc:492] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:37.659132  1102 tablet_bootstrap.cc:492] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:37.659976  1102 tablet_bootstrap.cc:492] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap complete.
I20260709 12:23:37.660585  1102 ts_tablet_manager.cc:1403] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 12:23:37.662859  1102 raft_consensus.cc:359] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } } peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } }
I20260709 12:23:37.663439  1102 raft_consensus.cc:740] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.664235  1102 consensus_queue.cc:260] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } } peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } }
I20260709 12:23:37.666525  1102 ts_tablet_manager.cc:1434] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:23:37.667411  1102 tablet_bootstrap.cc:492] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:37.682740  1102 tablet_bootstrap.cc:492] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:37.683575  1102 tablet_bootstrap.cc:492] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap complete.
I20260709 12:23:37.684227 23879 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:23:37.684197  1102 ts_tablet_manager.cc:1403] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.009s
I20260709 12:23:37.684783 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.044s	user 0.045s	sys 0.000s
I20260709 12:23:37.687250  1102 raft_consensus.cc:359] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.687970  1102 raft_consensus.cc:740] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.688717  1102 consensus_queue.cc:260] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.690563  1102 ts_tablet_manager.cc:1434] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:37.691376  1102 tablet_bootstrap.cc:492] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:37.704962  1102 tablet_bootstrap.cc:492] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:23:37.706032  1102 tablet_bootstrap.cc:492] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap complete.
I20260709 12:23:37.706843  1102 ts_tablet_manager.cc:1403] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:23:37.709029  1102 raft_consensus.cc:359] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.709762  1102 raft_consensus.cc:740] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.710506  1102 consensus_queue.cc:260] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.712666  1102 ts_tablet_manager.cc:1434] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:23:37.713515  1102 tablet_bootstrap.cc:492] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:37.725203  1102 tablet_bootstrap.cc:492] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:37.726105  1102 tablet_bootstrap.cc:492] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap complete.
I20260709 12:23:37.726832  1102 ts_tablet_manager.cc:1403] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:23:37.728705  1102 raft_consensus.cc:359] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.729233  1102 raft_consensus.cc:740] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.729933  1102 consensus_queue.cc:260] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.731590  1102 ts_tablet_manager.cc:1434] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:37.732261  1102 tablet_bootstrap.cc:492] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:37.747491  1102 tablet_bootstrap.cc:492] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:37.748588  1102 tablet_bootstrap.cc:492] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap complete.
I20260709 12:23:37.749272 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.193:34325
I20260709 12:23:37.749454  1102 ts_tablet_manager.cc:1403] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:23:37.749361  1164 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.193:34325 every 8 connection(s)
I20260709 12:23:37.752301  1102 raft_consensus.cc:359] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.753134  1102 raft_consensus.cc:740] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.754159  1102 consensus_queue.cc:260] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
W20260709 12:23:37.754437  1166 tablet.cc:2406] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:37.754824 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:37.755928  1102 ts_tablet_manager.cc:1434] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:37.756795  1102 tablet_bootstrap.cc:492] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:37.775434  1102 tablet_bootstrap.cc:492] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:37.776276  1102 tablet_bootstrap.cc:492] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap complete.
I20260709 12:23:37.776957  1102 ts_tablet_manager.cc:1403] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:23:37.779165  1102 raft_consensus.cc:359] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
W20260709 12:23:37.779495   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:37.779841  1102 raft_consensus.cc:740] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.780791  1102 consensus_queue.cc:260] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.782932  1102 ts_tablet_manager.cc:1434] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:37.783787  1102 tablet_bootstrap.cc:492] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:37.783775  1165 heartbeater.cc:344] Connected to a master server at 127.23.81.254:38013
I20260709 12:23:37.784499  1165 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:37.785462  1165 heartbeater.cc:507] Master 127.23.81.254:38013 requested a full tablet report, sending...
I20260709 12:23:37.788556   870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b474ceef6f445e09552b2048f358034"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
mode: GRACEFUL
new_leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:50324
I20260709 12:23:37.789319   870 raft_consensus.cc:606] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 LEADER]: Received request to transfer leadership to TS 8a0be3f1ce524d76a3d6c02656c3140d
I20260709 12:23:37.790907   689 ts_manager.cc:194] Re-registered known tserver with Master: ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325)
I20260709 12:23:37.792304   870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac69a39998774d47b48667fea5943c70"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
mode: GRACEFUL
new_leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:50324
I20260709 12:23:37.792862   870 raft_consensus.cc:606] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 LEADER]: Received request to transfer leadership to TS 8a0be3f1ce524d76a3d6c02656c3140d
I20260709 12:23:37.795511   870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
mode: GRACEFUL
new_leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:50324
I20260709 12:23:37.796030   870 raft_consensus.cc:606] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Received request to transfer leadership to TS 8a0be3f1ce524d76a3d6c02656c3140d
I20260709 12:23:37.797013  1102 tablet_bootstrap.cc:492] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:37.797114 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:37.797814 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:37.797982  1102 tablet_bootstrap.cc:492] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap complete.
I20260709 12:23:37.798832  1102 ts_tablet_manager.cc:1403] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 12:23:37.798548 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:37.801461  1102 raft_consensus.cc:359] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.802224  1102 raft_consensus.cc:740] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.802958  1102 consensus_queue.cc:260] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.803784   689 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33222
I20260709 12:23:37.804970  1102 ts_tablet_manager.cc:1434] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:37.805814  1102 tablet_bootstrap.cc:492] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:37.807365  1165 heartbeater.cc:499] Master 127.23.81.254:38013 was elected leader, sending a full tablet report...
I20260709 12:23:37.816958  1102 tablet_bootstrap.cc:492] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:37.817874  1102 tablet_bootstrap.cc:492] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap complete.
I20260709 12:23:37.818595  1102 ts_tablet_manager.cc:1403] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 12:23:37.820943  1102 raft_consensus.cc:359] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.821640  1102 raft_consensus.cc:740] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.822376  1102 consensus_queue.cc:260] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.824262  1102 ts_tablet_manager.cc:1434] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:37.825034  1102 tablet_bootstrap.cc:492] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:37.837973  1102 tablet_bootstrap.cc:492] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:37.838748  1102 tablet_bootstrap.cc:492] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap complete.
I20260709 12:23:37.839257  1102 ts_tablet_manager.cc:1403] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:23:37.840870  1102 raft_consensus.cc:359] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.841331  1102 raft_consensus.cc:740] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.841786  1102 consensus_queue.cc:260] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.843217  1102 ts_tablet_manager.cc:1434] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:37.844022  1102 tablet_bootstrap.cc:492] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap starting.
I20260709 12:23:37.852087  1175 raft_consensus.cc:993] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79: : Instructing follower 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:37.852658  1019 raft_consensus.cc:1081] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Signalling peer 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:37.854327   942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:51334
I20260709 12:23:37.855033   942 raft_consensus.cc:493] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:37.855547   942 raft_consensus.cc:3060] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:37.859037  1102 tablet_bootstrap.cc:492] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:37.860087  1102 tablet_bootstrap.cc:492] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2: Bootstrap complete.
I20260709 12:23:37.860759  1102 ts_tablet_manager.cc:1403] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:23:37.863010   942 raft_consensus.cc:515] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.863351  1102 raft_consensus.cc:359] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.863989  1102 raft_consensus.cc:740] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef171ef037ed4c4aa096a9aa7f9e75a2, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.864756  1102 consensus_queue.cc:260] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.865801   942 leader_election.cc:290] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:37.866828  1102 ts_tablet_manager.cc:1434] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:23:37.867997   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:37.868743   870 raft_consensus.cc:3055] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:37.869117   870 raft_consensus.cc:740] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:37.869988   870 consensus_queue.cc:260] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.871146   870 raft_consensus.cc:3060] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:37.881212   870 raft_consensus.cc:2468] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 2.
I20260709 12:23:37.881968  1139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:37.882346   907 leader_election.cc:304] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, 8a0be3f1ce524d76a3d6c02656c3140d; no voters: 
I20260709 12:23:37.882696  1139 raft_consensus.cc:3060] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:37.883270  1081 raft_consensus.cc:2804] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:37.884563  1081 raft_consensus.cc:697] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Becoming Leader. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:37.885425  1081 consensus_queue.cc:237] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:37.890524  1139 raft_consensus.cc:2468] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 2.
I20260709 12:23:37.893910   689 catalog_manager.cc:5697] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d reported cstate change: term changed from 1 to 2, leader changed from 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194) to 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195). New cstate: current_term: 2 leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:37.937284  1139 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:37.943660  1139 pending_rounds.cc:85] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Aborting all ops after (but not including) 0
I20260709 12:23:37.943869  1139 pending_rounds.cc:107] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:23:37.944137  1139 raft_consensus.cc:2889] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:37.998114  1175 raft_consensus.cc:993] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79: : Instructing follower 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:37.998586  1019 raft_consensus.cc:1081] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 LEADER]: Signalling peer 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:38.000226   942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b474ceef6f445e09552b2048f358034"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:51334
I20260709 12:23:38.000753   942 raft_consensus.cc:493] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:38.001068   942 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.006232   942 raft_consensus.cc:515] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:38.007860   942 leader_election.cc:290] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 3 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:38.008909  1139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:38.009012   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:38.009640  1139 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.009692   870 raft_consensus.cc:3055] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:38.010159   870 raft_consensus.cc:740] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:38.010905   870 consensus_queue.cc:260] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:38.011916   870 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.015162  1139 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 3.
I20260709 12:23:38.016352   908 leader_election.cc:304] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:38.017104  1081 raft_consensus.cc:2804] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:38.017577  1081 raft_consensus.cc:697] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 LEADER]: Becoming Leader. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:38.017704   870 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 3.
I20260709 12:23:38.018589  1081 consensus_queue.cc:237] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:38.026557   689 catalog_manager.cc:5697] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d reported cstate change: term changed from 2 to 3, leader changed from 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194) to 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195). New cstate: current_term: 3 leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.076175  1139 raft_consensus.cc:3060] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.088807  1175 raft_consensus.cc:993] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79: : Instructing follower 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:38.089309  1019 raft_consensus.cc:1081] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 LEADER]: Signalling peer 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:38.090821   942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac69a39998774d47b48667fea5943c70"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:51334
I20260709 12:23:38.091329   942 raft_consensus.cc:493] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:38.091651   942 raft_consensus.cc:3060] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.096966   942 raft_consensus.cc:515] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:38.098943   942 leader_election.cc:290] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 3 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:38.099647  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac69a39998774d47b48667fea5943c70" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:38.100255   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac69a39998774d47b48667fea5943c70" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:38.100378  1137 raft_consensus.cc:3060] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.100888   870 raft_consensus.cc:3055] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:38.101280   870 raft_consensus.cc:740] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:38.102192   870 consensus_queue.cc:260] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:38.103590   870 raft_consensus.cc:3060] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.108706  1137 raft_consensus.cc:2468] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 3.
I20260709 12:23:38.109990   908 leader_election.cc:304] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:38.111212  1081 raft_consensus.cc:2804] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:38.111078   870 raft_consensus.cc:2468] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 3.
I20260709 12:23:38.114619  1081 raft_consensus.cc:697] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 LEADER]: Becoming Leader. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:38.115468  1081 consensus_queue.cc:237] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:38.179004   689 catalog_manager.cc:5697] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d reported cstate change: term changed from 2 to 3, leader changed from 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194) to 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195). New cstate: current_term: 3 leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.264822  1137 raft_consensus.cc:3060] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.339093   870 raft_consensus.cc:1275] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:38.340332  1081 consensus_queue.cc:1048] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:38.356050  1137 raft_consensus.cc:1275] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:38.357635  1081 consensus_queue.cc:1048] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:38.404862   870 raft_consensus.cc:1275] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:38.406126  1081 consensus_queue.cc:1048] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:38.416496  1137 raft_consensus.cc:1275] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:38.418606  1178 consensus_queue.cc:1048] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:38.665377   870 raft_consensus.cc:1275] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:38.666625  1178 consensus_queue.cc:1048] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:38.676644  1137 raft_consensus.cc:1275] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:38.678540  1193 consensus_queue.cc:1048] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:23:38.780853   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:38.808007 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:38.829757   942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
mode: GRACEFUL
new_leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
 from {username='slave'} at 127.0.0.1:45266
I20260709 12:23:38.830407   942 raft_consensus.cc:606] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Received request to transfer leadership to TS 139bfe261dbe4f5d94ccdd7374b8ac79
I20260709 12:23:38.832751   942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b474ceef6f445e09552b2048f358034"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
mode: GRACEFUL
new_leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
 from {username='slave'} at 127.0.0.1:45266
I20260709 12:23:38.833156   942 raft_consensus.cc:606] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 LEADER]: Received request to transfer leadership to TS 139bfe261dbe4f5d94ccdd7374b8ac79
I20260709 12:23:38.834275 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:38.834810 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:38.835557 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:38.872404  1193 raft_consensus.cc:993] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d: : Instructing follower 139bfe261dbe4f5d94ccdd7374b8ac79 to start an election
I20260709 12:23:38.872895  1178 raft_consensus.cc:1081] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 LEADER]: Signalling peer 139bfe261dbe4f5d94ccdd7374b8ac79 to start an election
I20260709 12:23:38.874366   870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b474ceef6f445e09552b2048f358034"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
 from {username='slave'} at 127.0.0.1:34700
I20260709 12:23:38.874869   870 raft_consensus.cc:493] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:38.875110   870 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:38.882594   870 raft_consensus.cc:515] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:38.884126   870 leader_election.cc:290] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 4 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:38.885167  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:38.885480   942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:38.885883  1137 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:38.886096   942 raft_consensus.cc:3055] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:38.886523   942 raft_consensus.cc:740] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:38.887305   942 consensus_queue.cc:260] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:38.888247   942 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:38.892299  1137 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 4.
I20260709 12:23:38.893936   834 leader_election.cc:304] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:38.894731   942 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 4.
I20260709 12:23:38.894964  1204 raft_consensus.cc:2804] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:38.895509  1204 raft_consensus.cc:697] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:38.896636  1204 consensus_queue.cc:237] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:38.903311   689 catalog_manager.cc:5697] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 3 to 4, leader changed from 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195) to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.213864  1193 raft_consensus.cc:993] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d: : Instructing follower 139bfe261dbe4f5d94ccdd7374b8ac79 to start an election
I20260709 12:23:39.214349  1178 raft_consensus.cc:1081] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Signalling peer 139bfe261dbe4f5d94ccdd7374b8ac79 to start an election
I20260709 12:23:39.215862   870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
 from {username='slave'} at 127.0.0.1:34700
I20260709 12:23:39.216352   870 raft_consensus.cc:493] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.216670   870 raft_consensus.cc:3060] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.223027   870 raft_consensus.cc:515] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:39.224470   870 leader_election.cc:290] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 3 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:39.225562   942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:39.225543  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:39.226521   942 raft_consensus.cc:3055] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:39.226572  1137 raft_consensus.cc:3060] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.227005   942 raft_consensus.cc:740] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:39.228075   942 consensus_queue.cc:260] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:39.229521   942 raft_consensus.cc:3060] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.235708  1137 raft_consensus.cc:2468] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 3.
I20260709 12:23:39.237481   834 leader_election.cc:304] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:39.237790   942 raft_consensus.cc:2468] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 3.
I20260709 12:23:39.238592  1204 raft_consensus.cc:2804] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:39.239182  1204 raft_consensus.cc:697] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:39.240124  1204 consensus_queue.cc:237] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:39.247277   689 catalog_manager.cc:5697] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 2 to 3, leader changed from 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195) to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.386706   942 raft_consensus.cc:1275] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:39.388031  1203 consensus_queue.cc:1048] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:39.396698  1137 raft_consensus.cc:1275] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:39.398381  1213 consensus_queue.cc:1048] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:39.684569  1137 raft_consensus.cc:1275] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:39.685989  1213 consensus_queue.cc:1048] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:39.694766   942 raft_consensus.cc:1275] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:39.696385  1213 consensus_queue.cc:1048] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:23:39.781936   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:39.842621 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:39.850574   870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "013d4aa6601944c6bee3b0fd346309c6"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
mode: GRACEFUL
new_leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:50324
I20260709 12:23:39.851105   870 raft_consensus.cc:606] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Received request to transfer leadership to TS 8a0be3f1ce524d76a3d6c02656c3140d
I20260709 12:23:39.853571   870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b474ceef6f445e09552b2048f358034"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
mode: GRACEFUL
new_leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:50324
I20260709 12:23:39.854152   870 raft_consensus.cc:606] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 LEADER]: Received request to transfer leadership to TS 8a0be3f1ce524d76a3d6c02656c3140d
I20260709 12:23:39.856753   943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
mode: GRACEFUL
new_leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
 from {username='slave'} at 127.0.0.1:45266
I20260709 12:23:39.857434   943 raft_consensus.cc:606] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Received request to transfer leadership to TS 139bfe261dbe4f5d94ccdd7374b8ac79
I20260709 12:23:39.858707 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:39.859206 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:39.859792 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:39.965971  1203 raft_consensus.cc:993] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79: : Instructing follower 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:39.966483  1213 raft_consensus.cc:1081] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Signalling peer 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:39.968116   943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "013d4aa6601944c6bee3b0fd346309c6"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:51334
I20260709 12:23:39.968753   943 raft_consensus.cc:493] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.969033   943 raft_consensus.cc:3060] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.975620   943 raft_consensus.cc:515] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:39.977566   943 leader_election.cc:290] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:39.978430  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013d4aa6601944c6bee3b0fd346309c6" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:39.978785   870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013d4aa6601944c6bee3b0fd346309c6" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:39.979156  1137 raft_consensus.cc:3060] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.979385   870 raft_consensus.cc:3055] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.979759   870 raft_consensus.cc:740] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:39.980597   870 consensus_queue.cc:260] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:39.981536   870 raft_consensus.cc:3060] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.985226  1137 raft_consensus.cc:2468] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 2.
I20260709 12:23:39.986874   908 leader_election.cc:304] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:39.987732  1081 raft_consensus.cc:2804] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.988242  1081 raft_consensus.cc:697] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Becoming Leader. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:39.989256  1081 consensus_queue.cc:237] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:39.990767   870 raft_consensus.cc:2468] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 2.
I20260709 12:23:39.991663  1203 raft_consensus.cc:993] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79: : Instructing follower 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:39.992214  1204 raft_consensus.cc:1081] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 LEADER]: Signalling peer 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:39.992902  1219 raft_consensus.cc:993] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d: : Instructing follower 139bfe261dbe4f5d94ccdd7374b8ac79 to start an election
I20260709 12:23:39.993425  1219 raft_consensus.cc:1081] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Signalling peer 139bfe261dbe4f5d94ccdd7374b8ac79 to start an election
I20260709 12:23:39.994513   943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b474ceef6f445e09552b2048f358034"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:51334
I20260709 12:23:39.995132   943 raft_consensus.cc:493] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.995486   943 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:39.997058   870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
 from {username='slave'} at 127.0.0.1:34700
I20260709 12:23:39.997613   870 raft_consensus.cc:493] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.997958   870 raft_consensus.cc:3060] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.999215   689 catalog_manager.cc:5697] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d reported cstate change: term changed from 1 to 2, leader changed from 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194) to 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195). New cstate: current_term: 2 leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:40.002817   943 raft_consensus.cc:515] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:40.004988   870 raft_consensus.cc:515] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:40.006201  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:40.006306   869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:40.006861  1137 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:40.007428   870 leader_election.cc:290] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 3 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:40.005097   943 leader_election.cc:290] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 5 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:40.008564  1139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:40.009235  1139 raft_consensus.cc:3060] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.007057   869 raft_consensus.cc:3055] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:40.009938   869 raft_consensus.cc:740] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:40.010931   869 consensus_queue.cc:260] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:40.012244   869 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:40.020273   943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:40.020884   869 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 5.
I20260709 12:23:40.021230   943 raft_consensus.cc:3055] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:40.019289  1137 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 5.
I20260709 12:23:40.022260   943 raft_consensus.cc:740] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:40.023723   943 consensus_queue.cc:260] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:40.023869   908 leader_election.cc:304] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:40.025066  1081 raft_consensus.cc:2804] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:40.025630  1081 raft_consensus.cc:697] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 5 LEADER]: Becoming Leader. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:40.025688  1139 raft_consensus.cc:2468] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 3.
I20260709 12:23:40.026628  1081 consensus_queue.cc:237] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:40.027072   834 leader_election.cc:304] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:40.028162  1204 raft_consensus.cc:2804] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:40.028403   943 raft_consensus.cc:3060] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.028694  1204 raft_consensus.cc:697] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:40.029778  1204 consensus_queue.cc:237] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:40.036314   689 catalog_manager.cc:5697] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d reported cstate change: term changed from 4 to 5, leader changed from 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194) to 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195). New cstate: current_term: 5 leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:40.037963   943 raft_consensus.cc:2468] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 3.
I20260709 12:23:40.039619   691 catalog_manager.cc:5697] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 2 to 3, leader changed from 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195) to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.415841   869 raft_consensus.cc:1275] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.417192  1081 consensus_queue.cc:1048] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:40.426810  1137 raft_consensus.cc:1275] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.428529  1219 consensus_queue.cc:1048] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:40.488654   869 raft_consensus.cc:1275] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 5 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:40.489859  1219 consensus_queue.cc:1048] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:40.492251  1137 raft_consensus.cc:1275] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 5 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:40.493566  1219 consensus_queue.cc:1048] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:40.505748   943 raft_consensus.cc:1275] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:40.507359  1204 consensus_queue.cc:1048] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.518294  1137 raft_consensus.cc:1275] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:40.520758  1213 consensus_queue.cc:1048] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:23:40.782938   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:40.869558 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:40.877190   943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "013d4aa6601944c6bee3b0fd346309c6"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
mode: GRACEFUL
new_leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
 from {username='slave'} at 127.0.0.1:45266
I20260709 12:23:40.877878   943 raft_consensus.cc:606] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Received request to transfer leadership to TS 139bfe261dbe4f5d94ccdd7374b8ac79
I20260709 12:23:40.880501   943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac69a39998774d47b48667fea5943c70"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
mode: GRACEFUL
new_leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
 from {username='slave'} at 127.0.0.1:45266
I20260709 12:23:40.881084   943 raft_consensus.cc:606] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 LEADER]: Received request to transfer leadership to TS 139bfe261dbe4f5d94ccdd7374b8ac79
I20260709 12:23:40.883473   869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
mode: GRACEFUL
new_leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:50324
I20260709 12:23:40.884016   869 raft_consensus.cc:606] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 LEADER]: Received request to transfer leadership to TS 8a0be3f1ce524d76a3d6c02656c3140d
I20260709 12:23:40.885191 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:40.885690 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:40.886302 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:40.998613  1213 raft_consensus.cc:993] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79: : Instructing follower 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:40.999241  1204 raft_consensus.cc:1081] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 LEADER]: Signalling peer 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:41.000839   943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:51334
I20260709 12:23:41.001278   943 raft_consensus.cc:493] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:41.001595   943 raft_consensus.cc:3060] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.007994   943 raft_consensus.cc:515] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:41.009629   943 leader_election.cc:290] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 4 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:41.010433  1139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:41.010660   869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd7b5e0fdd24732bb045e65d98bfa26" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:41.011137  1139 raft_consensus.cc:3060] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.011466   869 raft_consensus.cc:3055] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:41.011780   869 raft_consensus.cc:740] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:41.012588   869 consensus_queue.cc:260] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:41.013588   869 raft_consensus.cc:3060] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.016868  1139 raft_consensus.cc:2468] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 4.
I20260709 12:23:41.018201   908 leader_election.cc:304] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:41.019120  1081 raft_consensus.cc:2804] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:41.019300   869 raft_consensus.cc:2468] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 4.
I20260709 12:23:41.019579  1081 raft_consensus.cc:697] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 LEADER]: Becoming Leader. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:41.020689  1081 consensus_queue.cc:237] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:41.027546   691 catalog_manager.cc:5697] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d reported cstate change: term changed from 3 to 4, leader changed from 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194) to 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195). New cstate: current_term: 4 leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.165483  1178 raft_consensus.cc:993] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d: : Instructing follower 139bfe261dbe4f5d94ccdd7374b8ac79 to start an election
I20260709 12:23:41.165992  1081 raft_consensus.cc:1081] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 LEADER]: Signalling peer 139bfe261dbe4f5d94ccdd7374b8ac79 to start an election
I20260709 12:23:41.167447   869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac69a39998774d47b48667fea5943c70"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
 from {username='slave'} at 127.0.0.1:34700
I20260709 12:23:41.167900   869 raft_consensus.cc:493] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:41.168166   869 raft_consensus.cc:3060] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.174906   869 raft_consensus.cc:515] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:41.176455   869 leader_election.cc:290] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 4 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:41.177369  1139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac69a39998774d47b48667fea5943c70" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:41.177541   943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac69a39998774d47b48667fea5943c70" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:41.178066  1139 raft_consensus.cc:3060] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.178236   943 raft_consensus.cc:3055] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:41.178690   943 raft_consensus.cc:740] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:41.179433   943 consensus_queue.cc:260] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:41.180509   943 raft_consensus.cc:3060] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.183471  1139 raft_consensus.cc:2468] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 4.
I20260709 12:23:41.184535   834 leader_election.cc:304] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:41.185261  1204 raft_consensus.cc:2804] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:41.185751  1204 raft_consensus.cc:697] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:41.186079   943 raft_consensus.cc:2468] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 4.
I20260709 12:23:41.186772  1204 consensus_queue.cc:237] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:41.193811   691 catalog_manager.cc:5697] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 3 to 4, leader changed from 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195) to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 4 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.428006  1178 raft_consensus.cc:993] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d: : Instructing follower 139bfe261dbe4f5d94ccdd7374b8ac79 to start an election
I20260709 12:23:41.428499  1081 raft_consensus.cc:1081] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Signalling peer 139bfe261dbe4f5d94ccdd7374b8ac79 to start an election
I20260709 12:23:41.430364   869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "013d4aa6601944c6bee3b0fd346309c6"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
 from {username='slave'} at 127.0.0.1:34700
I20260709 12:23:41.430902   869 raft_consensus.cc:493] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:41.431162   869 raft_consensus.cc:3060] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.436518   869 raft_consensus.cc:515] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:41.439091  1139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013d4aa6601944c6bee3b0fd346309c6" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:41.438578   869 leader_election.cc:290] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 3 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:41.439666   943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013d4aa6601944c6bee3b0fd346309c6" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:41.439954  1139 raft_consensus.cc:3060] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.440387   943 raft_consensus.cc:3055] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:41.440760   943 raft_consensus.cc:740] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:41.441567   943 consensus_queue.cc:260] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:41.442842   943 raft_consensus.cc:3060] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.446455  1139 raft_consensus.cc:2468] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 3.
I20260709 12:23:41.447486   834 leader_election.cc:304] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:41.448290  1204 raft_consensus.cc:2804] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:41.448655   943 raft_consensus.cc:2468] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 3.
I20260709 12:23:41.448782  1204 raft_consensus.cc:697] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:41.449667  1204 consensus_queue.cc:237] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:41.456023   869 raft_consensus.cc:1275] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:41.457223  1081 consensus_queue.cc:1048] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.456897   691 catalog_manager.cc:5697] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 2 to 3, leader changed from 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195) to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 3 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.469450  1139 raft_consensus.cc:1275] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:41.470921  1178 consensus_queue.cc:1048] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.671144  1139 raft_consensus.cc:1275] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:41.672463  1204 consensus_queue.cc:1048] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.677385   943 raft_consensus.cc:1275] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:41.684561  1248 consensus_queue.cc:1048] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:23:41.783877   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:41.892756 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:41.895869  1139 raft_consensus.cc:1275] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:41.897404  1247 consensus_queue.cc:1048] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.902654   869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
mode: GRACEFUL
new_leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:50324
I20260709 12:23:41.903335   869 raft_consensus.cc:606] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 LEADER]: Received request to transfer leadership to TS 8a0be3f1ce524d76a3d6c02656c3140d
I20260709 12:23:41.906314   943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b474ceef6f445e09552b2048f358034"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
mode: GRACEFUL
new_leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
 from {username='slave'} at 127.0.0.1:45266
I20260709 12:23:41.907006   943 raft_consensus.cc:606] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 5 LEADER]: Received request to transfer leadership to TS 139bfe261dbe4f5d94ccdd7374b8ac79
I20260709 12:23:41.907897   942 raft_consensus.cc:1275] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:41.909451  1204 consensus_queue.cc:1048] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.911146   869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "912cb57dbae442dcb8c3fc3d9028dcd2"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
mode: GRACEFUL
new_leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:50324
I20260709 12:23:41.911804   869 raft_consensus.cc:606] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Received request to transfer leadership to TS 8a0be3f1ce524d76a3d6c02656c3140d
I20260709 12:23:41.913199 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:41.913851 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:41.914626 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:41.958782  1204 raft_consensus.cc:993] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79: : Instructing follower 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:41.959299  1213 raft_consensus.cc:1081] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 LEADER]: Signalling peer 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:41.960992   943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:51334
I20260709 12:23:41.961589   943 raft_consensus.cc:493] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:41.962066   943 raft_consensus.cc:3060] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.968415   943 raft_consensus.cc:515] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:41.970041   943 leader_election.cc:290] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 4 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:41.970908  1139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:41.971143   869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c05c42eade4897a8a0fc30471677e4" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:41.971649  1139 raft_consensus.cc:3060] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.971897   869 raft_consensus.cc:3055] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:41.972295   869 raft_consensus.cc:740] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:41.973119   869 consensus_queue.cc:260] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:41.974283   869 raft_consensus.cc:3060] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.977468  1139 raft_consensus.cc:2468] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 4.
I20260709 12:23:41.978698   908 leader_election.cc:304] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:41.979635  1243 raft_consensus.cc:2804] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:41.980698  1243 raft_consensus.cc:697] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 LEADER]: Becoming Leader. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:41.980847   869 raft_consensus.cc:2468] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 4.
I20260709 12:23:41.981606  1243 consensus_queue.cc:237] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:41.988112   691 catalog_manager.cc:5697] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d reported cstate change: term changed from 3 to 4, leader changed from 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194) to 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195). New cstate: current_term: 4 leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:42.009850  1252 raft_consensus.cc:993] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d: : Instructing follower 139bfe261dbe4f5d94ccdd7374b8ac79 to start an election
I20260709 12:23:42.010316  1243 raft_consensus.cc:1081] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 5 LEADER]: Signalling peer 139bfe261dbe4f5d94ccdd7374b8ac79 to start an election
I20260709 12:23:42.011843   869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b474ceef6f445e09552b2048f358034"
dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
 from {username='slave'} at 127.0.0.1:34700
I20260709 12:23:42.012362   869 raft_consensus.cc:493] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:42.012673   869 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:42.017787   869 raft_consensus.cc:515] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:42.019425   869 leader_election.cc:290] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 6 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195:33887)
I20260709 12:23:42.020314  1139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:42.020620   943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b474ceef6f445e09552b2048f358034" candidate_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
I20260709 12:23:42.020876  1139 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:42.021251   943 raft_consensus.cc:3055] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:42.021533   943 raft_consensus.cc:740] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:42.022257   943 consensus_queue.cc:260] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:42.023180   943 raft_consensus.cc:3060] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:42.025938  1139 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 6.
I20260709 12:23:42.027101   834 leader_election.cc:304] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139bfe261dbe4f5d94ccdd7374b8ac79, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:42.027799  1213 raft_consensus.cc:2804] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:42.028285  1213 raft_consensus.cc:697] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 6 LEADER]: Becoming Leader. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:42.028394   943 raft_consensus.cc:2468] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 139bfe261dbe4f5d94ccdd7374b8ac79 in term 6.
I20260709 12:23:42.029201  1213 consensus_queue.cc:237] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:42.036183   691 catalog_manager.cc:5697] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 reported cstate change: term changed from 5 to 6, leader changed from 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195) to 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194). New cstate: current_term: 6 leader_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.379702  1213 raft_consensus.cc:993] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79: : Instructing follower 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:42.380259  1248 raft_consensus.cc:1081] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Signalling peer 8a0be3f1ce524d76a3d6c02656c3140d to start an election
I20260709 12:23:42.381920   943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "912cb57dbae442dcb8c3fc3d9028dcd2"
dest_uuid: "8a0be3f1ce524d76a3d6c02656c3140d"
 from {username='slave'} at 127.0.0.1:51334
I20260709 12:23:42.382534   943 raft_consensus.cc:493] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:42.382895   943 raft_consensus.cc:3060] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.388017   943 raft_consensus.cc:515] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:42.389637   943 leader_election.cc:290] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 election: Requested vote from peers ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325), 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483)
I20260709 12:23:42.390712   869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912cb57dbae442dcb8c3fc3d9028dcd2" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79"
I20260709 12:23:42.390669  1139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912cb57dbae442dcb8c3fc3d9028dcd2" candidate_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2"
I20260709 12:23:42.391558   869 raft_consensus.cc:3055] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.391574  1139 raft_consensus.cc:3060] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.392042   869 raft_consensus.cc:740] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 139bfe261dbe4f5d94ccdd7374b8ac79, State: Running, Role: LEADER
I20260709 12:23:42.393034   869 consensus_queue.cc:260] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:42.394472   869 raft_consensus.cc:3060] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.399546  1139 raft_consensus.cc:2468] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 2.
I20260709 12:23:42.400897   908 leader_election.cc:304] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0be3f1ce524d76a3d6c02656c3140d, ef171ef037ed4c4aa096a9aa7f9e75a2; no voters: 
I20260709 12:23:42.401933  1258 raft_consensus.cc:2804] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:42.401799   869 raft_consensus.cc:2468] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0be3f1ce524d76a3d6c02656c3140d in term 2.
I20260709 12:23:42.402609  1258 raft_consensus.cc:697] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Becoming Leader. State: Replica: 8a0be3f1ce524d76a3d6c02656c3140d, State: Running, Role: LEADER
I20260709 12:23:42.404017  1258 consensus_queue.cc:237] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } }
I20260709 12:23:42.404914  1139 raft_consensus.cc:1275] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:42.406405  1243 consensus_queue.cc:1048] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:42.413756   691 catalog_manager.cc:5697] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d reported cstate change: term changed from 1 to 2, leader changed from 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194) to 8a0be3f1ce524d76a3d6c02656c3140d (127.23.81.195). New cstate: current_term: 2 leader_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:42.419744   869 raft_consensus.cc:1275] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:42.422870  1261 consensus_queue.cc:1048] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:42.530593  1139 raft_consensus.cc:1275] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 6 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:42.531821  1248 consensus_queue.cc:1048] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:42.542510   943 raft_consensus.cc:1275] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 6 FOLLOWER]: Refusing update from remote peer 139bfe261dbe4f5d94ccdd7374b8ac79: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:42.544337  1213 consensus_queue.cc:1048] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0be3f1ce524d76a3d6c02656c3140d" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:23:43.521087   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:43.535319  1137 raft_consensus.cc:1275] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:43.539248   869 raft_consensus.cc:1275] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Refusing update from remote peer 8a0be3f1ce524d76a3d6c02656c3140d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:43.541599  1272 consensus_queue.cc:1048] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef171ef037ed4c4aa096a9aa7f9e75a2" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:43.545113  1273 consensus_queue.cc:1048] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [LEADER]: Connected to new peer: Peer: permanent_uuid: "139bfe261dbe4f5d94ccdd7374b8ac79" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:43.849606 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:43.881655 23879 tablet_server.cc:179] TabletServer@127.23.81.193:34325 shutting down...
W20260709 12:23:43.899550   908 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 77 similar messages]
W20260709 12:23:43.903132   908 consensus_peers.cc:597] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:43.910358 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:43.911330 23879 tablet_replica.cc:333] stopping tablet replica
W20260709 12:23:43.912029   834 consensus_peers.cc:597] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:43.912338 23879 raft_consensus.cc:2243] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.912953 23879 raft_consensus.cc:2272] T 912cb57dbae442dcb8c3fc3d9028dcd2 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.916311 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:43.916922 23879 raft_consensus.cc:2243] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.917441 23879 raft_consensus.cc:2272] T f7b3f8a235e34f91a239ff687e3af1b3 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.919646 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:43.920142 23879 raft_consensus.cc:2243] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.920543 23879 raft_consensus.cc:2272] T 013d4aa6601944c6bee3b0fd346309c6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.922891 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:43.923501 23879 raft_consensus.cc:2243] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.923907 23879 raft_consensus.cc:2272] T 14c05c42eade4897a8a0fc30471677e4 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.926488 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:43.927291 23879 raft_consensus.cc:2243] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.927847 23879 raft_consensus.cc:2272] T ccd7b5e0fdd24732bb045e65d98bfa26 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.930686 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:43.931169 23879 raft_consensus.cc:2243] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.931564 23879 raft_consensus.cc:2272] T 02af04ade5d048c0ada291d2136cf8ee P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.933795 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:43.934345 23879 raft_consensus.cc:2243] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.934772 23879 raft_consensus.cc:2272] T 3b474ceef6f445e09552b2048f358034 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.936841 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:43.937330 23879 raft_consensus.cc:2243] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.937680 23879 raft_consensus.cc:2272] T 72fd4d4b79634debbff6d63f295df2f6 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.940059 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:43.940533 23879 raft_consensus.cc:2243] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.940925 23879 raft_consensus.cc:2272] T ac69a39998774d47b48667fea5943c70 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.942965 23879 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:43.943533 23879 raft_consensus.cc:2243] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.944007 23879 raft_consensus.cc:2272] T 868ae757ae23436fa3b15835f9d556b5 P ef171ef037ed4c4aa096a9aa7f9e75a2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:43.947559   834 consensus_peers.cc:597] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:43.983330   834 consensus_peers.cc:597] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:44.025295   834 consensus_peers.cc:597] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:44.026717   908 consensus_peers.cc:597] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:44.040504   834 consensus_peers.cc:597] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:44.055375   908 consensus_peers.cc:597] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:44.093042   908 consensus_peers.cc:597] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:44.179349   908 consensus_peers.cc:597] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:44.473841  1161 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1820 after lost signal to thread 23882
W20260709 12:23:44.475121  1161 debug-util.cc:398] Leaking SignalData structure 0x7b08003025a0 after lost signal to thread 727
W20260709 12:23:44.476462  1161 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf3c0 after lost signal to thread 894
W20260709 12:23:44.477687  1161 debug-util.cc:398] Leaking SignalData structure 0x7b08003d4a60 after lost signal to thread 968
W20260709 12:23:44.522207   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:44.975288 23879 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1161)
W20260709 12:23:45.523480   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:45.975879 23879 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1161)
W20260709 12:23:46.375916   834 consensus_peers.cc:597] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:46.401891   834 consensus_peers.cc:597] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:46.409610   908 consensus_peers.cc:597] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:46.500559   834 consensus_peers.cc:597] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:46.524619   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:46.525444   834 consensus_peers.cc:597] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:46.543396   908 consensus_peers.cc:597] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:46.590833   834 consensus_peers.cc:597] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:46.633446   908 consensus_peers.cc:597] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:46.746450   908 consensus_peers.cc:597] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:46.749096   908 consensus_peers.cc:597] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer ef171ef037ed4c4aa096a9aa7f9e75a2 (127.23.81.193:34325): Couldn't send request to peer ef171ef037ed4c4aa096a9aa7f9e75a2. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:46.976411 23879 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1161)
I20260709 12:23:47.392544 23879 tablet_server.cc:196] TabletServer@127.23.81.193:34325 shutdown complete.
I20260709 12:23:47.419735 23879 tablet_server.cc:179] TabletServer@127.23.81.194:0 shutting down...
W20260709 12:23:47.433868   907 consensus_peers.cc:597] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483): Couldn't send request to peer 139bfe261dbe4f5d94ccdd7374b8ac79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:47.449419 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:47.450379 23879 tablet_replica.cc:333] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79: stopping tablet replica
I20260709 12:23:47.451165 23879 raft_consensus.cc:2243] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:47.451983 23879 raft_consensus.cc:2272] T 013d4aa6601944c6bee3b0fd346309c6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.454387 23879 tablet_replica.cc:333] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79: stopping tablet replica
I20260709 12:23:47.455027 23879 raft_consensus.cc:2243] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:47.455849 23879 raft_consensus.cc:2272] T f7b3f8a235e34f91a239ff687e3af1b3 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.458128 23879 tablet_replica.cc:333] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79: stopping tablet replica
I20260709 12:23:47.458717 23879 raft_consensus.cc:2243] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.459157 23879 raft_consensus.cc:2272] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.461424 23879 tablet_replica.cc:333] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79: stopping tablet replica
I20260709 12:23:47.462095 23879 raft_consensus.cc:2243] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:23:47.462883 23879 raft_consensus.cc:2272] T 3b474ceef6f445e09552b2048f358034 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.464908 23879 tablet_replica.cc:333] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79: stopping tablet replica
I20260709 12:23:47.465462 23879 raft_consensus.cc:2243] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.465945 23879 raft_consensus.cc:2272] T 02af04ade5d048c0ada291d2136cf8ee P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.468097 23879 tablet_replica.cc:333] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79: stopping tablet replica
I20260709 12:23:47.468643 23879 raft_consensus.cc:2243] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:47.469451 23879 raft_consensus.cc:2272] T 72fd4d4b79634debbff6d63f295df2f6 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.471763 23879 tablet_replica.cc:333] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79: stopping tablet replica
I20260709 12:23:47.472332 23879 raft_consensus.cc:2243] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:47.473107 23879 raft_consensus.cc:2272] T ac69a39998774d47b48667fea5943c70 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.475493 23879 tablet_replica.cc:333] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79: stopping tablet replica
I20260709 12:23:47.476022 23879 raft_consensus.cc:2243] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.476464 23879 raft_consensus.cc:2272] T ccd7b5e0fdd24732bb045e65d98bfa26 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.478466 23879 tablet_replica.cc:333] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79: stopping tablet replica
I20260709 12:23:47.479008 23879 raft_consensus.cc:2243] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.479480 23879 raft_consensus.cc:2272] T 14c05c42eade4897a8a0fc30471677e4 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.481571 23879 tablet_replica.cc:333] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79: stopping tablet replica
I20260709 12:23:47.482100 23879 raft_consensus.cc:2243] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.482549 23879 raft_consensus.cc:2272] T 868ae757ae23436fa3b15835f9d556b5 P 139bfe261dbe4f5d94ccdd7374b8ac79 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:47.491580   907 consensus_peers.cc:597] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483): Couldn't send request to peer 139bfe261dbe4f5d94ccdd7374b8ac79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:47.516311 23879 tablet_server.cc:196] TabletServer@127.23.81.194:0 shutdown complete.
W20260709 12:23:47.525906   741 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:47.541566 23879 tablet_server.cc:179] TabletServer@127.23.81.195:0 shutting down...
W20260709 12:23:47.574963   907 consensus_peers.cc:597] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d -> Peer 139bfe261dbe4f5d94ccdd7374b8ac79 (127.23.81.194:37483): Couldn't send request to peer 139bfe261dbe4f5d94ccdd7374b8ac79. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:37483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:47.577557 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:47.578400 23879 tablet_replica.cc:333] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d: stopping tablet replica
I20260709 12:23:47.579557 23879 raft_consensus.cc:2243] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.580286 23879 raft_consensus.cc:2272] T 013d4aa6601944c6bee3b0fd346309c6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.582664 23879 tablet_replica.cc:333] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d: stopping tablet replica
I20260709 12:23:47.583197 23879 raft_consensus.cc:2243] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.583639 23879 raft_consensus.cc:2272] T f7b3f8a235e34f91a239ff687e3af1b3 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.585778 23879 tablet_replica.cc:333] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d: stopping tablet replica
I20260709 12:23:47.586346 23879 raft_consensus.cc:2243] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:47.587085 23879 raft_consensus.cc:2272] T 14c05c42eade4897a8a0fc30471677e4 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.589211 23879 tablet_replica.cc:333] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d: stopping tablet replica
I20260709 12:23:47.589756 23879 raft_consensus.cc:2243] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:47.590551 23879 raft_consensus.cc:2272] T ccd7b5e0fdd24732bb045e65d98bfa26 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.592628 23879 tablet_replica.cc:333] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d: stopping tablet replica
I20260709 12:23:47.593272 23879 raft_consensus.cc:2243] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:47.594117 23879 raft_consensus.cc:2272] T 912cb57dbae442dcb8c3fc3d9028dcd2 P 8a0be3f1ce524d76a3d6c02656c3140d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.596140 23879 tablet_replica.cc:333] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d: stopping tablet replica
I20260709 12:23:47.596645 23879 raft_consensus.cc:2243] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:47.597458 23879 raft_consensus.cc:2272] T 868ae757ae23436fa3b15835f9d556b5 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.599576 23879 tablet_replica.cc:333] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d: stopping tablet replica
I20260709 12:23:47.600077 23879 raft_consensus.cc:2243] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.600441 23879 raft_consensus.cc:2272] T 3b474ceef6f445e09552b2048f358034 P 8a0be3f1ce524d76a3d6c02656c3140d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.602406 23879 tablet_replica.cc:333] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d: stopping tablet replica
I20260709 12:23:47.602941 23879 raft_consensus.cc:2243] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:47.603669 23879 raft_consensus.cc:2272] T 02af04ade5d048c0ada291d2136cf8ee P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.605638 23879 tablet_replica.cc:333] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d: stopping tablet replica
I20260709 12:23:47.606118 23879 raft_consensus.cc:2243] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.606496 23879 raft_consensus.cc:2272] T 72fd4d4b79634debbff6d63f295df2f6 P 8a0be3f1ce524d76a3d6c02656c3140d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.608470 23879 tablet_replica.cc:333] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d: stopping tablet replica
I20260709 12:23:47.608930 23879 raft_consensus.cc:2243] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.609283 23879 raft_consensus.cc:2272] T ac69a39998774d47b48667fea5943c70 P 8a0be3f1ce524d76a3d6c02656c3140d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.641187 23879 tablet_server.cc:196] TabletServer@127.23.81.195:0 shutdown complete.
I20260709 12:23:47.668694 23879 master.cc:562] Master@127.23.81.254:38013 shutting down...
I20260709 12:23:47.695550 23879 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:47.696157 23879 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.696506 23879 tablet_replica.cc:333] T 00000000000000000000000000000000 P cb98585be6f94e8fb0ce7bcbc665c759: stopping tablet replica
I20260709 12:23:47.717140 23879 master.cc:584] Master@127.23.81.254:38013 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (17127 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:23:47.760766 23879 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.81.254:43509
I20260709 12:23:47.761945 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:47.767669  1293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:47.767688  1294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:47.768688  1296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:47.770292 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:47.771399 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:47.771625 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:47.771759 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599827771739 us; error 0 us; skew 500 ppm
I20260709 12:23:47.772282 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:47.775221 23879 webserver.cc:533] Webserver started at http://127.23.81.254:46363/ using document root <none> and password file <none>
I20260709 12:23:47.775691 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:47.775849 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:47.776078 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:47.777172 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/master-0-root/instance:
uuid: "a584700081c4402288e241f4494c08a7"
format_stamp: "Formatted at 2026-07-09 12:23:47 on dist-test-slave-mprf"
I20260709 12:23:47.781538 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:23:47.785099  1301 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:47.785840 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:47.786216 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/master-0-root
uuid: "a584700081c4402288e241f4494c08a7"
format_stamp: "Formatted at 2026-07-09 12:23:47 on dist-test-slave-mprf"
I20260709 12:23:47.786509 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:47.813279 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:47.814697 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:47.853778 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.254:43509
I20260709 12:23:47.853879  1352 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.254:43509 every 8 connection(s)
I20260709 12:23:47.857729  1353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:47.869434  1353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7: Bootstrap starting.
I20260709 12:23:47.874471  1353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:47.878785  1353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7: No bootstrap required, opened a new log
I20260709 12:23:47.880909  1353 raft_consensus.cc:359] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a584700081c4402288e241f4494c08a7" member_type: VOTER }
I20260709 12:23:47.881312  1353 raft_consensus.cc:385] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:47.881495  1353 raft_consensus.cc:740] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a584700081c4402288e241f4494c08a7, State: Initialized, Role: FOLLOWER
I20260709 12:23:47.882103  1353 consensus_queue.cc:260] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a584700081c4402288e241f4494c08a7" member_type: VOTER }
I20260709 12:23:47.882524  1353 raft_consensus.cc:399] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:47.882714  1353 raft_consensus.cc:493] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:47.882920  1353 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:47.887830  1353 raft_consensus.cc:515] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a584700081c4402288e241f4494c08a7" member_type: VOTER }
I20260709 12:23:47.888386  1353 leader_election.cc:304] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a584700081c4402288e241f4494c08a7; no voters: 
I20260709 12:23:47.889504  1353 leader_election.cc:290] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:47.889860  1356 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:47.891315  1356 raft_consensus.cc:697] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [term 1 LEADER]: Becoming Leader. State: Replica: a584700081c4402288e241f4494c08a7, State: Running, Role: LEADER
I20260709 12:23:47.892004  1356 consensus_queue.cc:237] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a584700081c4402288e241f4494c08a7" member_type: VOTER }
I20260709 12:23:47.892531  1353 sys_catalog.cc:565] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:47.896504  1357 sys_catalog.cc:455] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a584700081c4402288e241f4494c08a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a584700081c4402288e241f4494c08a7" member_type: VOTER } }
I20260709 12:23:47.896974  1358 sys_catalog.cc:455] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a584700081c4402288e241f4494c08a7. Latest consensus state: current_term: 1 leader_uuid: "a584700081c4402288e241f4494c08a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a584700081c4402288e241f4494c08a7" member_type: VOTER } }
I20260709 12:23:47.897312  1357 sys_catalog.cc:458] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:47.897550  1358 sys_catalog.cc:458] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:47.903043  1362 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:47.911058  1362 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:47.912081 23879 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:47.919947  1362 catalog_manager.cc:1383] Generated new cluster ID: 10fce627c0d4468f92661d0bd1b06412
I20260709 12:23:47.920258  1362 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:47.940362  1362 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:47.941756  1362 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:47.956334  1362 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7: Generated new TSK 0
I20260709 12:23:47.957077  1362 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:47.979262 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:47.986083  1374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:47.986997  1375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:47.991664  1377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:47.991859 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:47.993997 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:47.994341 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:47.994483 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599827994470 us; error 0 us; skew 500 ppm
I20260709 12:23:47.995034 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:47.997431 23879 webserver.cc:533] Webserver started at http://127.23.81.193:33483/ using document root <none> and password file <none>
I20260709 12:23:47.997901 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:47.998170 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:47.998430 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:47.999588 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-0-root/instance:
uuid: "0ad823e97e4e4985975747d284a71e61"
format_stamp: "Formatted at 2026-07-09 12:23:47 on dist-test-slave-mprf"
I20260709 12:23:48.004635 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:48.008193  1382 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:48.009078 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:48.009341 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-0-root
uuid: "0ad823e97e4e4985975747d284a71e61"
format_stamp: "Formatted at 2026-07-09 12:23:47 on dist-test-slave-mprf"
I20260709 12:23:48.009591 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:48.037181 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:48.038637 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:48.040266 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:48.042686 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:48.042877 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:48.043219 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:48.043380 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:48.085662 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.193:33137
I20260709 12:23:48.085803  1444 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.193:33137 every 8 connection(s)
I20260709 12:23:48.091234 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:48.099164  1449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:48.100087  1450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:48.101085  1452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:48.102068 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:48.103587 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:48.103897 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:48.104113 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599828104095 us; error 0 us; skew 500 ppm
I20260709 12:23:48.104773 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:48.105414  1445 heartbeater.cc:344] Connected to a master server at 127.23.81.254:43509
I20260709 12:23:48.105834  1445 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:48.106732  1445 heartbeater.cc:507] Master 127.23.81.254:43509 requested a full tablet report, sending...
I20260709 12:23:48.107697 23879 webserver.cc:533] Webserver started at http://127.23.81.194:35385/ using document root <none> and password file <none>
I20260709 12:23:48.108433 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:48.108628 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:48.108943 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:48.109032  1318 ts_manager.cc:194] Registered new tserver with Master: 0ad823e97e4e4985975747d284a71e61 (127.23.81.193:33137)
I20260709 12:23:48.110308 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-1-root/instance:
uuid: "06b98d7c26004d1dbf59f26039844bd1"
format_stamp: "Formatted at 2026-07-09 12:23:48 on dist-test-slave-mprf"
I20260709 12:23:48.111433  1318 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52732
I20260709 12:23:48.115234 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:48.118789  1457 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:48.119601 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:48.119904 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-1-root
uuid: "06b98d7c26004d1dbf59f26039844bd1"
format_stamp: "Formatted at 2026-07-09 12:23:48 on dist-test-slave-mprf"
I20260709 12:23:48.120199 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:48.151831 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:48.153026 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:48.154539 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:48.156759 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:48.156991 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:48.157236 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:48.157413 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:48.229604 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.194:35199
I20260709 12:23:48.229719  1520 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.194:35199 every 8 connection(s)
I20260709 12:23:48.237301 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:48.247313  1524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:48.248469  1525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:48.250669  1527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:48.251969 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:48.253366 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:48.253676 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:48.253928 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599828253904 us; error 0 us; skew 500 ppm
I20260709 12:23:48.254084  1521 heartbeater.cc:344] Connected to a master server at 127.23.81.254:43509
I20260709 12:23:48.254575  1521 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:48.254666 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:48.255635  1521 heartbeater.cc:507] Master 127.23.81.254:43509 requested a full tablet report, sending...
I20260709 12:23:48.257995 23879 webserver.cc:533] Webserver started at http://127.23.81.195:35357/ using document root <none> and password file <none>
I20260709 12:23:48.258989 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:48.258968  1318 ts_manager.cc:194] Registered new tserver with Master: 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194:35199)
I20260709 12:23:48.259495 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:48.259999 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:48.261857  1318 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52746
I20260709 12:23:48.262341 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-2-root/instance:
uuid: "c8f58c088dbc45f983465564ed7fa17f"
format_stamp: "Formatted at 2026-07-09 12:23:48 on dist-test-slave-mprf"
I20260709 12:23:48.267812 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:48.271559  1532 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:48.272464 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:23:48.272799 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-2-root
uuid: "c8f58c088dbc45f983465564ed7fa17f"
format_stamp: "Formatted at 2026-07-09 12:23:48 on dist-test-slave-mprf"
I20260709 12:23:48.273100 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599468354575-23879-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:48.290441 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:48.291953 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:48.293725 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:48.296554 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:48.296857 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:48.297158 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:48.297370 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:48.344900 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.195:40459
I20260709 12:23:48.344993  1594 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.195:40459 every 8 connection(s)
I20260709 12:23:48.367390  1595 heartbeater.cc:344] Connected to a master server at 127.23.81.254:43509
I20260709 12:23:48.367870  1595 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:48.368901  1595 heartbeater.cc:507] Master 127.23.81.254:43509 requested a full tablet report, sending...
I20260709 12:23:48.371299  1318 ts_manager.cc:194] Registered new tserver with Master: c8f58c088dbc45f983465564ed7fa17f (127.23.81.195:40459)
I20260709 12:23:48.372005 23879 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.023146464s
I20260709 12:23:48.373374  1318 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52762
I20260709 12:23:48.403124  1318 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52766:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:48.405553  1318 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:48.460915  1485 tablet_service.cc:1511] Processing CreateTablet for tablet 327a7b2d2dea4d17855f2f74cc9ee671 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=afe631723a254f538eb2e50edaa7d557]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:48.463141  1485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327a7b2d2dea4d17855f2f74cc9ee671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.470714  1484 tablet_service.cc:1511] Processing CreateTablet for tablet 55b00f52275e406bb2533f2714af0c75 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=afe631723a254f538eb2e50edaa7d557]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:48.472508  1484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55b00f52275e406bb2533f2714af0c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.478672  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 327a7b2d2dea4d17855f2f74cc9ee671 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=afe631723a254f538eb2e50edaa7d557]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:48.480271  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327a7b2d2dea4d17855f2f74cc9ee671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.483691  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 55b00f52275e406bb2533f2714af0c75 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=afe631723a254f538eb2e50edaa7d557]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:48.484949  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55b00f52275e406bb2533f2714af0c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.496757  1410 tablet_service.cc:1511] Processing CreateTablet for tablet 327a7b2d2dea4d17855f2f74cc9ee671 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=afe631723a254f538eb2e50edaa7d557]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:48.498797  1410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327a7b2d2dea4d17855f2f74cc9ee671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.504384  1409 tablet_service.cc:1511] Processing CreateTablet for tablet 55b00f52275e406bb2533f2714af0c75 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=afe631723a254f538eb2e50edaa7d557]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:48.511482  1409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55b00f52275e406bb2533f2714af0c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.548879  1611 tablet_bootstrap.cc:492] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f: Bootstrap starting.
I20260709 12:23:48.543749  1610 tablet_bootstrap.cc:492] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1: Bootstrap starting.
I20260709 12:23:48.553283  1612 tablet_bootstrap.cc:492] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61: Bootstrap starting.
I20260709 12:23:48.561405  1611 tablet_bootstrap.cc:654] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:48.561645  1612 tablet_bootstrap.cc:654] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:48.561655  1610 tablet_bootstrap.cc:654] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:48.569290  1612 tablet_bootstrap.cc:492] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61: No bootstrap required, opened a new log
I20260709 12:23:48.569952  1612 ts_tablet_manager.cc:1403] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.010s
I20260709 12:23:48.573984  1612 raft_consensus.cc:359] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.575323  1612 raft_consensus.cc:385] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:48.575865  1612 raft_consensus.cc:740] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad823e97e4e4985975747d284a71e61, State: Initialized, Role: FOLLOWER
I20260709 12:23:48.576880  1612 consensus_queue.cc:260] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.580232  1445 heartbeater.cc:499] Master 127.23.81.254:43509 was elected leader, sending a full tablet report...
I20260709 12:23:48.580590  1612 ts_tablet_manager.cc:1434] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 12:23:48.581707  1612 tablet_bootstrap.cc:492] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61: Bootstrap starting.
I20260709 12:23:48.584470  1611 tablet_bootstrap.cc:492] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f: No bootstrap required, opened a new log
I20260709 12:23:48.585459  1611 ts_tablet_manager.cc:1403] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.005s
I20260709 12:23:48.589273  1612 tablet_bootstrap.cc:654] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:48.592577  1611 raft_consensus.cc:359] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.599334  1611 raft_consensus.cc:385] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:48.599763  1611 raft_consensus.cc:740] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8f58c088dbc45f983465564ed7fa17f, State: Initialized, Role: FOLLOWER
I20260709 12:23:48.601043  1611 consensus_queue.cc:260] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.602234  1610 tablet_bootstrap.cc:492] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1: No bootstrap required, opened a new log
I20260709 12:23:48.603711  1610 ts_tablet_manager.cc:1403] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1: Time spent bootstrapping tablet: real 0.060s	user 0.020s	sys 0.028s
I20260709 12:23:48.607890  1595 heartbeater.cc:499] Master 127.23.81.254:43509 was elected leader, sending a full tablet report...
I20260709 12:23:48.609076  1611 ts_tablet_manager.cc:1434] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f: Time spent starting tablet: real 0.023s	user 0.013s	sys 0.003s
I20260709 12:23:48.610503  1611 tablet_bootstrap.cc:492] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f: Bootstrap starting.
I20260709 12:23:48.611138  1612 tablet_bootstrap.cc:492] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61: No bootstrap required, opened a new log
I20260709 12:23:48.611811  1612 ts_tablet_manager.cc:1403] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.011s
I20260709 12:23:48.612700  1610 raft_consensus.cc:359] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } }
I20260709 12:23:48.613946  1610 raft_consensus.cc:385] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:48.614575  1610 raft_consensus.cc:740] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b98d7c26004d1dbf59f26039844bd1, State: Initialized, Role: FOLLOWER
I20260709 12:23:48.615183  1612 raft_consensus.cc:359] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } }
I20260709 12:23:48.616052  1612 raft_consensus.cc:385] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:48.615778  1610 consensus_queue.cc:260] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } }
I20260709 12:23:48.616386  1612 raft_consensus.cc:740] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad823e97e4e4985975747d284a71e61, State: Initialized, Role: FOLLOWER
I20260709 12:23:48.617257  1612 consensus_queue.cc:260] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } }
I20260709 12:23:48.639271  1521 heartbeater.cc:499] Master 127.23.81.254:43509 was elected leader, sending a full tablet report...
I20260709 12:23:48.639868  1610 ts_tablet_manager.cc:1434] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 12:23:48.640944  1610 tablet_bootstrap.cc:492] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1: Bootstrap starting.
I20260709 12:23:48.639348  1611 tablet_bootstrap.cc:654] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:48.647573  1612 ts_tablet_manager.cc:1434] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.016s
I20260709 12:23:48.649290  1610 tablet_bootstrap.cc:654] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:48.661087  1611 tablet_bootstrap.cc:492] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f: No bootstrap required, opened a new log
I20260709 12:23:48.661653  1611 ts_tablet_manager.cc:1403] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.033s
I20260709 12:23:48.662663  1610 tablet_bootstrap.cc:492] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1: No bootstrap required, opened a new log
I20260709 12:23:48.663264  1610 ts_tablet_manager.cc:1403] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 12:23:48.664860  1611 raft_consensus.cc:359] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } }
I20260709 12:23:48.665675  1611 raft_consensus.cc:385] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:48.665980  1611 raft_consensus.cc:740] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8f58c088dbc45f983465564ed7fa17f, State: Initialized, Role: FOLLOWER
I20260709 12:23:48.666226  1610 raft_consensus.cc:359] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.666997  1610 raft_consensus.cc:385] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:48.666842  1611 consensus_queue.cc:260] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } }
I20260709 12:23:48.667392  1610 raft_consensus.cc:740] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b98d7c26004d1dbf59f26039844bd1, State: Initialized, Role: FOLLOWER
I20260709 12:23:48.669262  1611 ts_tablet_manager.cc:1434] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 12:23:48.670099  1610 consensus_queue.cc:260] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.673007  1610 ts_tablet_manager.cc:1434] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:48.731541  1618 raft_consensus.cc:493] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.732185  1618 raft_consensus.cc:515] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } }
I20260709 12:23:48.734436  1618 leader_election.cc:290] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194:35199), 0ad823e97e4e4985975747d284a71e61 (127.23.81.193:33137)
I20260709 12:23:48.739094  1616 raft_consensus.cc:493] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.739744  1616 raft_consensus.cc:515] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.749079  1616 leader_election.cc:290] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194:35199), c8f58c088dbc45f983465564ed7fa17f (127.23.81.195:40459)
I20260709 12:23:48.749223  1495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327a7b2d2dea4d17855f2f74cc9ee671" candidate_uuid: "c8f58c088dbc45f983465564ed7fa17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b98d7c26004d1dbf59f26039844bd1" is_pre_election: true
I20260709 12:23:48.750289  1495 raft_consensus.cc:2468] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8f58c088dbc45f983465564ed7fa17f in term 0.
I20260709 12:23:48.750468  1420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327a7b2d2dea4d17855f2f74cc9ee671" candidate_uuid: "c8f58c088dbc45f983465564ed7fa17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad823e97e4e4985975747d284a71e61" is_pre_election: true
I20260709 12:23:48.751216  1420 raft_consensus.cc:2468] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8f58c088dbc45f983465564ed7fa17f in term 0.
I20260709 12:23:48.752529  1534 leader_election.cc:304] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b98d7c26004d1dbf59f26039844bd1, c8f58c088dbc45f983465564ed7fa17f; no voters: 
I20260709 12:23:48.753499  1618 raft_consensus.cc:2804] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:48.753862  1618 raft_consensus.cc:493] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.754282  1618 raft_consensus.cc:3060] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:48.761521  1495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55b00f52275e406bb2533f2714af0c75" candidate_uuid: "0ad823e97e4e4985975747d284a71e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b98d7c26004d1dbf59f26039844bd1" is_pre_election: true
I20260709 12:23:48.762455  1495 raft_consensus.cc:2468] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad823e97e4e4985975747d284a71e61 in term 0.
I20260709 12:23:48.763715  1618 raft_consensus.cc:515] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } }
I20260709 12:23:48.764061  1384 leader_election.cc:304] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b98d7c26004d1dbf59f26039844bd1, 0ad823e97e4e4985975747d284a71e61; no voters: 
I20260709 12:23:48.765187  1616 raft_consensus.cc:2804] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:48.765630  1616 raft_consensus.cc:493] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.766064  1616 raft_consensus.cc:3060] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:48.766667  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55b00f52275e406bb2533f2714af0c75" candidate_uuid: "0ad823e97e4e4985975747d284a71e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8f58c088dbc45f983465564ed7fa17f" is_pre_election: true
I20260709 12:23:48.767257  1618 leader_election.cc:290] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [CANDIDATE]: Term 1 election: Requested vote from peers 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194:35199), 0ad823e97e4e4985975747d284a71e61 (127.23.81.193:33137)
I20260709 12:23:48.767135  1420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327a7b2d2dea4d17855f2f74cc9ee671" candidate_uuid: "c8f58c088dbc45f983465564ed7fa17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad823e97e4e4985975747d284a71e61"
I20260709 12:23:48.767628  1570 raft_consensus.cc:2468] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad823e97e4e4985975747d284a71e61 in term 0.
I20260709 12:23:48.767974  1420 raft_consensus.cc:3060] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:48.767135  1495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327a7b2d2dea4d17855f2f74cc9ee671" candidate_uuid: "c8f58c088dbc45f983465564ed7fa17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b98d7c26004d1dbf59f26039844bd1"
I20260709 12:23:48.769057  1495 raft_consensus.cc:3060] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:48.774821  1616 raft_consensus.cc:515] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.777318  1616 leader_election.cc:290] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [CANDIDATE]: Term 1 election: Requested vote from peers 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194:35199), c8f58c088dbc45f983465564ed7fa17f (127.23.81.195:40459)
I20260709 12:23:48.777431  1420 raft_consensus.cc:2468] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8f58c088dbc45f983465564ed7fa17f in term 1.
I20260709 12:23:48.778534  1494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55b00f52275e406bb2533f2714af0c75" candidate_uuid: "0ad823e97e4e4985975747d284a71e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b98d7c26004d1dbf59f26039844bd1"
I20260709 12:23:48.778574  1495 raft_consensus.cc:2468] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8f58c088dbc45f983465564ed7fa17f in term 1.
I20260709 12:23:48.779182  1533 leader_election.cc:304] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad823e97e4e4985975747d284a71e61, c8f58c088dbc45f983465564ed7fa17f; no voters: 
I20260709 12:23:48.779383  1494 raft_consensus.cc:3060] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:48.780329  1618 raft_consensus.cc:2804] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:48.780333  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55b00f52275e406bb2533f2714af0c75" candidate_uuid: "0ad823e97e4e4985975747d284a71e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8f58c088dbc45f983465564ed7fa17f"
I20260709 12:23:48.781380  1570 raft_consensus.cc:3060] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:48.781899  1618 raft_consensus.cc:697] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 1 LEADER]: Becoming Leader. State: Replica: c8f58c088dbc45f983465564ed7fa17f, State: Running, Role: LEADER
I20260709 12:23:48.783046  1618 consensus_queue.cc:237] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } }
I20260709 12:23:48.791080  1494 raft_consensus.cc:2468] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad823e97e4e4985975747d284a71e61 in term 1.
I20260709 12:23:48.792418  1384 leader_election.cc:304] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b98d7c26004d1dbf59f26039844bd1, 0ad823e97e4e4985975747d284a71e61; no voters: 
I20260709 12:23:48.793313  1616 raft_consensus.cc:2804] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:48.793924  1316 catalog_manager.cc:5697] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f reported cstate change: term changed from 0 to 1, leader changed from <none> to c8f58c088dbc45f983465564ed7fa17f (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c8f58c088dbc45f983465564ed7fa17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:48.794971  1616 raft_consensus.cc:697] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad823e97e4e4985975747d284a71e61, State: Running, Role: LEADER
I20260709 12:23:48.795253  1570 raft_consensus.cc:2468] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad823e97e4e4985975747d284a71e61 in term 1.
I20260709 12:23:48.796188  1616 consensus_queue.cc:237] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.805701  1318 catalog_manager.cc:5697] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ad823e97e4e4985975747d284a71e61 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "0ad823e97e4e4985975747d284a71e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:48.893183  1318 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52778:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:48.895228  1318 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:48.921228  1410 tablet_service.cc:1511] Processing CreateTablet for tablet 59056a4bc2b34b0e9447af16b342eb9e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=43b219c4849e4eaea6028da060b2a33a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:48.922626  1410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59056a4bc2b34b0e9447af16b342eb9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.922493  1484 tablet_service.cc:1511] Processing CreateTablet for tablet 59056a4bc2b34b0e9447af16b342eb9e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=43b219c4849e4eaea6028da060b2a33a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:48.923888  1484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59056a4bc2b34b0e9447af16b342eb9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.924490  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 59056a4bc2b34b0e9447af16b342eb9e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=43b219c4849e4eaea6028da060b2a33a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:48.925815  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59056a4bc2b34b0e9447af16b342eb9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.927145  1485 tablet_service.cc:1511] Processing CreateTablet for tablet b3f96115ec894fbbbcba9270b949b298 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=43b219c4849e4eaea6028da060b2a33a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:48.928431  1485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f96115ec894fbbbcba9270b949b298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.936280  1409 tablet_service.cc:1511] Processing CreateTablet for tablet b3f96115ec894fbbbcba9270b949b298 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=43b219c4849e4eaea6028da060b2a33a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:48.937734  1409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f96115ec894fbbbcba9270b949b298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.940929  1612 tablet_bootstrap.cc:492] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61: Bootstrap starting.
I20260709 12:23:48.946473  1560 tablet_service.cc:1511] Processing CreateTablet for tablet b3f96115ec894fbbbcba9270b949b298 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=43b219c4849e4eaea6028da060b2a33a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:48.946919  1611 tablet_bootstrap.cc:492] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f: Bootstrap starting.
I20260709 12:23:48.948105  1612 tablet_bootstrap.cc:654] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:48.948120  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f96115ec894fbbbcba9270b949b298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.954468  1610 tablet_bootstrap.cc:492] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1: Bootstrap starting.
I20260709 12:23:48.957230  1612 tablet_bootstrap.cc:492] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61: No bootstrap required, opened a new log
I20260709 12:23:48.957852  1612 ts_tablet_manager.cc:1403] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 12:23:48.959774  1611 tablet_bootstrap.cc:654] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:48.960999  1612 raft_consensus.cc:359] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.961822  1612 raft_consensus.cc:385] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:48.962281  1612 raft_consensus.cc:740] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad823e97e4e4985975747d284a71e61, State: Initialized, Role: FOLLOWER
I20260709 12:23:48.962795  1610 tablet_bootstrap.cc:654] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:48.963048  1612 consensus_queue.cc:260] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.965451  1612 ts_tablet_manager.cc:1434] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:48.969429  1612 tablet_bootstrap.cc:492] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61: Bootstrap starting.
I20260709 12:23:48.981762  1612 tablet_bootstrap.cc:654] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:48.983353  1611 tablet_bootstrap.cc:492] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f: No bootstrap required, opened a new log
I20260709 12:23:48.983987  1611 ts_tablet_manager.cc:1403] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.001s
I20260709 12:23:48.988847  1612 tablet_bootstrap.cc:492] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61: No bootstrap required, opened a new log
I20260709 12:23:48.989491  1612 ts_tablet_manager.cc:1403] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:23:48.991875  1611 raft_consensus.cc:359] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.992828  1611 raft_consensus.cc:385] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:48.992686  1612 raft_consensus.cc:359] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.993343  1610 tablet_bootstrap.cc:492] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1: No bootstrap required, opened a new log
I20260709 12:23:48.993352  1611 raft_consensus.cc:740] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8f58c088dbc45f983465564ed7fa17f, State: Initialized, Role: FOLLOWER
I20260709 12:23:48.994227  1610 ts_tablet_manager.cc:1403] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1: Time spent bootstrapping tablet: real 0.040s	user 0.029s	sys 0.005s
I20260709 12:23:48.993526  1612 raft_consensus.cc:385] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:48.994706  1612 raft_consensus.cc:740] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad823e97e4e4985975747d284a71e61, State: Initialized, Role: FOLLOWER
I20260709 12:23:48.994908  1611 consensus_queue.cc:260] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.995441  1612 consensus_queue.cc:260] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.997299  1611 ts_tablet_manager.cc:1434] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:23:48.998394  1611 tablet_bootstrap.cc:492] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f: Bootstrap starting.
I20260709 12:23:48.997509  1610 raft_consensus.cc:359] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:48.999293  1610 raft_consensus.cc:385] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:48.999614  1610 raft_consensus.cc:740] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b98d7c26004d1dbf59f26039844bd1, State: Initialized, Role: FOLLOWER
I20260709 12:23:49.000188  1612 ts_tablet_manager.cc:1434] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:23:49.000443  1610 consensus_queue.cc:260] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.003543  1610 ts_tablet_manager.cc:1434] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:23:49.004734  1610 tablet_bootstrap.cc:492] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1: Bootstrap starting.
I20260709 12:23:49.012349  1610 tablet_bootstrap.cc:654] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:49.018152  1611 tablet_bootstrap.cc:654] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:49.018292  1610 tablet_bootstrap.cc:492] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1: No bootstrap required, opened a new log
I20260709 12:23:49.018921  1610 ts_tablet_manager.cc:1403] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:23:49.021720  1610 raft_consensus.cc:359] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.022459  1610 raft_consensus.cc:385] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:49.022712  1610 raft_consensus.cc:740] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b98d7c26004d1dbf59f26039844bd1, State: Initialized, Role: FOLLOWER
I20260709 12:23:49.023335  1610 consensus_queue.cc:260] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.023733  1611 tablet_bootstrap.cc:492] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f: No bootstrap required, opened a new log
I20260709 12:23:49.024308  1611 ts_tablet_manager.cc:1403] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.005s
I20260709 12:23:49.025290  1610 ts_tablet_manager.cc:1434] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:49.027359  1611 raft_consensus.cc:359] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.027938  1611 raft_consensus.cc:385] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:49.028198  1611 raft_consensus.cc:740] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8f58c088dbc45f983465564ed7fa17f, State: Initialized, Role: FOLLOWER
I20260709 12:23:49.028949  1611 consensus_queue.cc:260] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.031051  1611 ts_tablet_manager.cc:1434] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:49.071583  1616 raft_consensus.cc:493] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.072295  1616 raft_consensus.cc:515] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.074780  1616 leader_election.cc:290] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194:35199), c8f58c088dbc45f983465564ed7fa17f (127.23.81.195:40459)
I20260709 12:23:49.075556  1494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59056a4bc2b34b0e9447af16b342eb9e" candidate_uuid: "0ad823e97e4e4985975747d284a71e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b98d7c26004d1dbf59f26039844bd1" is_pre_election: true
I20260709 12:23:49.076174  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59056a4bc2b34b0e9447af16b342eb9e" candidate_uuid: "0ad823e97e4e4985975747d284a71e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8f58c088dbc45f983465564ed7fa17f" is_pre_election: true
I20260709 12:23:49.076202  1494 raft_consensus.cc:2468] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad823e97e4e4985975747d284a71e61 in term 0.
I20260709 12:23:49.076875  1570 raft_consensus.cc:2468] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad823e97e4e4985975747d284a71e61 in term 0.
I20260709 12:23:49.077555  1384 leader_election.cc:304] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b98d7c26004d1dbf59f26039844bd1, 0ad823e97e4e4985975747d284a71e61; no voters: 
I20260709 12:23:49.078653  1616 raft_consensus.cc:2804] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:49.078955  1616 raft_consensus.cc:493] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.079238  1616 raft_consensus.cc:3060] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:49.083503  1618 raft_consensus.cc:493] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.084056  1618 raft_consensus.cc:515] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.084923  1616 raft_consensus.cc:515] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.086179  1618 leader_election.cc:290] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad823e97e4e4985975747d284a71e61 (127.23.81.193:33137), 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194:35199)
I20260709 12:23:49.086975  1420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f96115ec894fbbbcba9270b949b298" candidate_uuid: "c8f58c088dbc45f983465564ed7fa17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad823e97e4e4985975747d284a71e61" is_pre_election: true
I20260709 12:23:49.087325  1494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f96115ec894fbbbcba9270b949b298" candidate_uuid: "c8f58c088dbc45f983465564ed7fa17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b98d7c26004d1dbf59f26039844bd1" is_pre_election: true
I20260709 12:23:49.087720  1420 raft_consensus.cc:2468] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8f58c088dbc45f983465564ed7fa17f in term 0.
I20260709 12:23:49.088035  1494 raft_consensus.cc:2468] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8f58c088dbc45f983465564ed7fa17f in term 0.
I20260709 12:23:49.088091  1495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59056a4bc2b34b0e9447af16b342eb9e" candidate_uuid: "0ad823e97e4e4985975747d284a71e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b98d7c26004d1dbf59f26039844bd1"
I20260709 12:23:49.088564  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59056a4bc2b34b0e9447af16b342eb9e" candidate_uuid: "0ad823e97e4e4985975747d284a71e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8f58c088dbc45f983465564ed7fa17f"
I20260709 12:23:49.088989  1495 raft_consensus.cc:3060] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:49.089231  1570 raft_consensus.cc:3060] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:49.089162  1533 leader_election.cc:304] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad823e97e4e4985975747d284a71e61, c8f58c088dbc45f983465564ed7fa17f; no voters: 
I20260709 12:23:49.090487  1618 raft_consensus.cc:2804] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:49.090847  1618 raft_consensus.cc:493] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.091179  1618 raft_consensus.cc:3060] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:49.094856  1616 leader_election.cc:290] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [CANDIDATE]: Term 1 election: Requested vote from peers 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194:35199), c8f58c088dbc45f983465564ed7fa17f (127.23.81.195:40459)
I20260709 12:23:49.095628  1495 raft_consensus.cc:2468] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad823e97e4e4985975747d284a71e61 in term 1.
I20260709 12:23:49.096810  1384 leader_election.cc:304] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b98d7c26004d1dbf59f26039844bd1, 0ad823e97e4e4985975747d284a71e61; no voters: 
I20260709 12:23:49.097257  1570 raft_consensus.cc:2468] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad823e97e4e4985975747d284a71e61 in term 1.
I20260709 12:23:49.097543  1616 raft_consensus.cc:2804] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:49.098970  1616 raft_consensus.cc:697] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad823e97e4e4985975747d284a71e61, State: Running, Role: LEADER
I20260709 12:23:49.099888  1616 consensus_queue.cc:237] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.100111  1618 raft_consensus.cc:515] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.102286  1618 leader_election.cc:290] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [CANDIDATE]: Term 1 election: Requested vote from peers 0ad823e97e4e4985975747d284a71e61 (127.23.81.193:33137), 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194:35199)
I20260709 12:23:49.103116  1420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f96115ec894fbbbcba9270b949b298" candidate_uuid: "c8f58c088dbc45f983465564ed7fa17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad823e97e4e4985975747d284a71e61"
I20260709 12:23:49.103819  1420 raft_consensus.cc:3060] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:49.104163  1495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f96115ec894fbbbcba9270b949b298" candidate_uuid: "c8f58c088dbc45f983465564ed7fa17f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b98d7c26004d1dbf59f26039844bd1"
I20260709 12:23:49.104877  1495 raft_consensus.cc:3060] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:49.108857  1315 catalog_manager.cc:5697] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ad823e97e4e4985975747d284a71e61 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "0ad823e97e4e4985975747d284a71e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.112011  1420 raft_consensus.cc:2468] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8f58c088dbc45f983465564ed7fa17f in term 1.
I20260709 12:23:49.112461  1495 raft_consensus.cc:2468] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8f58c088dbc45f983465564ed7fa17f in term 1.
I20260709 12:23:49.113369  1533 leader_election.cc:304] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad823e97e4e4985975747d284a71e61, c8f58c088dbc45f983465564ed7fa17f; no voters: 
I20260709 12:23:49.114246  1618 raft_consensus.cc:2804] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:49.114739  1618 raft_consensus.cc:697] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 1 LEADER]: Becoming Leader. State: Replica: c8f58c088dbc45f983465564ed7fa17f, State: Running, Role: LEADER
I20260709 12:23:49.115595  1618 consensus_queue.cc:237] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.123229  1315 catalog_manager.cc:5697] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f reported cstate change: term changed from 0 to 1, leader changed from <none> to c8f58c088dbc45f983465564ed7fa17f (127.23.81.195). New cstate: current_term: 1 leader_uuid: "c8f58c088dbc45f983465564ed7fa17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:49.145694  1570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "327a7b2d2dea4d17855f2f74cc9ee671"
dest_uuid: "c8f58c088dbc45f983465564ed7fa17f"
mode: GRACEFUL
new_leader_uuid: "0ad823e97e4e4985975747d284a71e61"
 from {username='slave'} at 127.0.0.1:37548
I20260709 12:23:49.146385  1570 raft_consensus.cc:606] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 1 LEADER]: Received request to transfer leadership to TS 0ad823e97e4e4985975747d284a71e61
I20260709 12:23:49.160320  1420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55b00f52275e406bb2533f2714af0c75"
dest_uuid: "0ad823e97e4e4985975747d284a71e61"
mode: GRACEFUL
new_leader_uuid: "06b98d7c26004d1dbf59f26039844bd1"
 from {username='slave'} at 127.0.0.1:46004
I20260709 12:23:49.160840  1420 raft_consensus.cc:606] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 1 LEADER]: Received request to transfer leadership to TS 06b98d7c26004d1dbf59f26039844bd1
I20260709 12:23:49.164572  1618 consensus_queue.cc:1048] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:49.171792  1570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3f96115ec894fbbbcba9270b949b298"
dest_uuid: "c8f58c088dbc45f983465564ed7fa17f"
mode: GRACEFUL
new_leader_uuid: "0ad823e97e4e4985975747d284a71e61"
 from {username='slave'} at 127.0.0.1:37548
I20260709 12:23:49.172468  1570 raft_consensus.cc:606] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 1 LEADER]: Received request to transfer leadership to TS 0ad823e97e4e4985975747d284a71e61
I20260709 12:23:49.180907  1646 consensus_queue.cc:1048] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:49.194139  1618 raft_consensus.cc:993] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f: : Instructing follower 0ad823e97e4e4985975747d284a71e61 to start an election
I20260709 12:23:49.194689  1646 raft_consensus.cc:1081] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 1 LEADER]: Signalling peer 0ad823e97e4e4985975747d284a71e61 to start an election
I20260709 12:23:49.196442  1420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "327a7b2d2dea4d17855f2f74cc9ee671"
dest_uuid: "0ad823e97e4e4985975747d284a71e61"
 from {username='slave'} at 127.0.0.1:45998
I20260709 12:23:49.197391  1420 raft_consensus.cc:493] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:49.197727  1420 raft_consensus.cc:3060] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.204087  1420 raft_consensus.cc:515] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } }
I20260709 12:23:49.207064  1495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327a7b2d2dea4d17855f2f74cc9ee671" candidate_uuid: "0ad823e97e4e4985975747d284a71e61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06b98d7c26004d1dbf59f26039844bd1"
I20260709 12:23:49.207257  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327a7b2d2dea4d17855f2f74cc9ee671" candidate_uuid: "0ad823e97e4e4985975747d284a71e61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8f58c088dbc45f983465564ed7fa17f"
I20260709 12:23:49.207696  1495 raft_consensus.cc:3060] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.207966  1570 raft_consensus.cc:3055] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:49.208388  1570 raft_consensus.cc:740] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8f58c088dbc45f983465564ed7fa17f, State: Running, Role: LEADER
I20260709 12:23:49.209233  1570 consensus_queue.cc:260] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } }
I20260709 12:23:49.210405  1570 raft_consensus.cc:3060] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.213963  1420 leader_election.cc:290] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [CANDIDATE]: Term 2 election: Requested vote from peers 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194:35199), c8f58c088dbc45f983465564ed7fa17f (127.23.81.195:40459)
I20260709 12:23:49.216181  1495 raft_consensus.cc:2468] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad823e97e4e4985975747d284a71e61 in term 2.
I20260709 12:23:49.217306  1384 leader_election.cc:304] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b98d7c26004d1dbf59f26039844bd1, 0ad823e97e4e4985975747d284a71e61; no voters: 
I20260709 12:23:49.218142  1616 raft_consensus.cc:2804] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:49.218320  1570 raft_consensus.cc:2468] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad823e97e4e4985975747d284a71e61 in term 2.
I20260709 12:23:49.218665  1616 raft_consensus.cc:697] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 2 LEADER]: Becoming Leader. State: Replica: 0ad823e97e4e4985975747d284a71e61, State: Running, Role: LEADER
I20260709 12:23:49.219589  1616 consensus_queue.cc:237] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } }
I20260709 12:23:49.226327  1616 consensus_queue.cc:1048] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:49.226325  1316 catalog_manager.cc:5697] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 reported cstate change: term changed from 1 to 2, leader changed from c8f58c088dbc45f983465564ed7fa17f (127.23.81.195) to 0ad823e97e4e4985975747d284a71e61 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "0ad823e97e4e4985975747d284a71e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:49.245785  1652 consensus_queue.cc:1048] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:49.255280  1628 raft_consensus.cc:993] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61: : Instructing follower 06b98d7c26004d1dbf59f26039844bd1 to start an election
I20260709 12:23:49.255802  1652 raft_consensus.cc:1081] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 1 LEADER]: Signalling peer 06b98d7c26004d1dbf59f26039844bd1 to start an election
I20260709 12:23:49.257300  1495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55b00f52275e406bb2533f2714af0c75"
dest_uuid: "06b98d7c26004d1dbf59f26039844bd1"
 from {username='slave'} at 127.0.0.1:42884
I20260709 12:23:49.257900  1495 raft_consensus.cc:493] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:49.258399  1495 raft_consensus.cc:3060] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.264802  1495 raft_consensus.cc:515] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.267448  1495 leader_election.cc:290] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 0ad823e97e4e4985975747d284a71e61 (127.23.81.193:33137), c8f58c088dbc45f983465564ed7fa17f (127.23.81.195:40459)
I20260709 12:23:49.280246  1420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55b00f52275e406bb2533f2714af0c75" candidate_uuid: "06b98d7c26004d1dbf59f26039844bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ad823e97e4e4985975747d284a71e61"
I20260709 12:23:49.280853  1420 raft_consensus.cc:3055] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:49.281203  1420 raft_consensus.cc:740] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ad823e97e4e4985975747d284a71e61, State: Running, Role: LEADER
I20260709 12:23:49.282099  1420 consensus_queue.cc:260] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.283480  1420 raft_consensus.cc:3060] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.290477  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55b00f52275e406bb2533f2714af0c75" candidate_uuid: "06b98d7c26004d1dbf59f26039844bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8f58c088dbc45f983465564ed7fa17f"
I20260709 12:23:49.291184  1570 raft_consensus.cc:3060] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.291520  1420 raft_consensus.cc:2468] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b98d7c26004d1dbf59f26039844bd1 in term 2.
I20260709 12:23:49.292964  1458 leader_election.cc:304] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b98d7c26004d1dbf59f26039844bd1, 0ad823e97e4e4985975747d284a71e61; no voters: 
I20260709 12:23:49.293968  1619 raft_consensus.cc:2804] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:49.295202  1619 raft_consensus.cc:697] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 LEADER]: Becoming Leader. State: Replica: 06b98d7c26004d1dbf59f26039844bd1, State: Running, Role: LEADER
I20260709 12:23:49.296078  1619 consensus_queue.cc:237] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.298344  1570 raft_consensus.cc:2468] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b98d7c26004d1dbf59f26039844bd1 in term 2.
I20260709 12:23:49.302506  1315 catalog_manager.cc:5697] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 reported cstate change: term changed from 1 to 2, leader changed from 0ad823e97e4e4985975747d284a71e61 (127.23.81.193) to 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "06b98d7c26004d1dbf59f26039844bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.497004  1628 consensus_queue.cc:1048] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:49.503140  1646 consensus_queue.cc:1048] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:49.509253  1651 consensus_queue.cc:1048] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:49.527139  1646 consensus_queue.cc:1048] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:49.535501  1626 raft_consensus.cc:993] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f: : Instructing follower 0ad823e97e4e4985975747d284a71e61 to start an election
I20260709 12:23:49.536005  1646 raft_consensus.cc:1081] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 1 LEADER]: Signalling peer 0ad823e97e4e4985975747d284a71e61 to start an election
I20260709 12:23:49.537778  1420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3f96115ec894fbbbcba9270b949b298"
dest_uuid: "0ad823e97e4e4985975747d284a71e61"
 from {username='slave'} at 127.0.0.1:45998
I20260709 12:23:49.538484  1420 raft_consensus.cc:493] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:49.538913  1420 raft_consensus.cc:3060] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.544301  1420 raft_consensus.cc:515] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.545996  1420 leader_election.cc:290] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [CANDIDATE]: Term 2 election: Requested vote from peers 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194:35199), c8f58c088dbc45f983465564ed7fa17f (127.23.81.195:40459)
I20260709 12:23:49.546998  1495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f96115ec894fbbbcba9270b949b298" candidate_uuid: "0ad823e97e4e4985975747d284a71e61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06b98d7c26004d1dbf59f26039844bd1"
I20260709 12:23:49.547158  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f96115ec894fbbbcba9270b949b298" candidate_uuid: "0ad823e97e4e4985975747d284a71e61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8f58c088dbc45f983465564ed7fa17f"
I20260709 12:23:49.547789  1495 raft_consensus.cc:3060] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.547842  1570 raft_consensus.cc:3055] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:49.548329  1570 raft_consensus.cc:740] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8f58c088dbc45f983465564ed7fa17f, State: Running, Role: LEADER
I20260709 12:23:49.549145  1570 consensus_queue.cc:260] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.550223  1570 raft_consensus.cc:3060] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.553500  1495 raft_consensus.cc:2468] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad823e97e4e4985975747d284a71e61 in term 2.
I20260709 12:23:49.554756  1384 leader_election.cc:304] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b98d7c26004d1dbf59f26039844bd1, 0ad823e97e4e4985975747d284a71e61; no voters: 
I20260709 12:23:49.555536  1651 raft_consensus.cc:2804] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:49.555764  1570 raft_consensus.cc:2468] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad823e97e4e4985975747d284a71e61 in term 2.
I20260709 12:23:49.556159  1651 raft_consensus.cc:697] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 2 LEADER]: Becoming Leader. State: Replica: 0ad823e97e4e4985975747d284a71e61, State: Running, Role: LEADER
I20260709 12:23:49.557042  1651 consensus_queue.cc:237] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.563671  1316 catalog_manager.cc:5697] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 reported cstate change: term changed from 1 to 2, leader changed from c8f58c088dbc45f983465564ed7fa17f (127.23.81.195) to 0ad823e97e4e4985975747d284a71e61 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "0ad823e97e4e4985975747d284a71e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.628890  1495 raft_consensus.cc:1275] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Refusing update from remote peer 0ad823e97e4e4985975747d284a71e61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:49.630285  1651 consensus_queue.cc:1048] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.641372  1570 raft_consensus.cc:1275] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Refusing update from remote peer 0ad823e97e4e4985975747d284a71e61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:49.643019  1616 consensus_queue.cc:1048] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.661716 23879 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:23:49.663306 23879 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:23:49.663654 23879 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:23:49.675714  1420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59056a4bc2b34b0e9447af16b342eb9e"
dest_uuid: "0ad823e97e4e4985975747d284a71e61"
mode: GRACEFUL
new_leader_uuid: "c8f58c088dbc45f983465564ed7fa17f"
 from {username='slave'} at 127.0.0.1:46014
I20260709 12:23:49.676262  1420 raft_consensus.cc:606] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 1 LEADER]: Received request to transfer leadership to TS c8f58c088dbc45f983465564ed7fa17f
I20260709 12:23:49.677294 23879 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:23:49.879413  1570 raft_consensus.cc:1275] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Refusing update from remote peer 06b98d7c26004d1dbf59f26039844bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:49.880878  1619 consensus_queue.cc:1048] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.893563  1420 raft_consensus.cc:1275] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Refusing update from remote peer 06b98d7c26004d1dbf59f26039844bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:49.896214  1663 consensus_queue.cc:1048] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.904461  1628 raft_consensus.cc:993] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61: : Instructing follower c8f58c088dbc45f983465564ed7fa17f to start an election
I20260709 12:23:49.905017  1651 raft_consensus.cc:1081] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 1 LEADER]: Signalling peer c8f58c088dbc45f983465564ed7fa17f to start an election
I20260709 12:23:49.906566  1570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59056a4bc2b34b0e9447af16b342eb9e"
dest_uuid: "c8f58c088dbc45f983465564ed7fa17f"
 from {username='slave'} at 127.0.0.1:37532
I20260709 12:23:49.907120  1570 raft_consensus.cc:493] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:49.907469  1570 raft_consensus.cc:3060] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.914237  1570 raft_consensus.cc:515] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.916453  1570 leader_election.cc:290] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [CANDIDATE]: Term 2 election: Requested vote from peers 0ad823e97e4e4985975747d284a71e61 (127.23.81.193:33137), 06b98d7c26004d1dbf59f26039844bd1 (127.23.81.194:35199)
I20260709 12:23:49.917227  1420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59056a4bc2b34b0e9447af16b342eb9e" candidate_uuid: "c8f58c088dbc45f983465564ed7fa17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ad823e97e4e4985975747d284a71e61"
I20260709 12:23:49.917518  1495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59056a4bc2b34b0e9447af16b342eb9e" candidate_uuid: "c8f58c088dbc45f983465564ed7fa17f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06b98d7c26004d1dbf59f26039844bd1"
I20260709 12:23:49.917919  1420 raft_consensus.cc:3055] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:49.918102  1495 raft_consensus.cc:3060] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.918349  1420 raft_consensus.cc:740] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ad823e97e4e4985975747d284a71e61, State: Running, Role: LEADER
I20260709 12:23:49.919242  1420 consensus_queue.cc:260] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.920499  1420 raft_consensus.cc:3060] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.925848  1495 raft_consensus.cc:2468] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8f58c088dbc45f983465564ed7fa17f in term 2.
I20260709 12:23:49.927364  1534 leader_election.cc:304] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b98d7c26004d1dbf59f26039844bd1, c8f58c088dbc45f983465564ed7fa17f; no voters: 
I20260709 12:23:49.927556  1420 raft_consensus.cc:2468] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8f58c088dbc45f983465564ed7fa17f in term 2.
I20260709 12:23:49.928155  1646 raft_consensus.cc:2804] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:49.928673  1646 raft_consensus.cc:697] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 2 LEADER]: Becoming Leader. State: Replica: c8f58c088dbc45f983465564ed7fa17f, State: Running, Role: LEADER
I20260709 12:23:49.929500  1646 consensus_queue.cc:237] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } }
I20260709 12:23:49.935782  1317 catalog_manager.cc:5697] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f reported cstate change: term changed from 1 to 2, leader changed from 0ad823e97e4e4985975747d284a71e61 (127.23.81.193) to c8f58c088dbc45f983465564ed7fa17f (127.23.81.195). New cstate: current_term: 2 leader_uuid: "c8f58c088dbc45f983465564ed7fa17f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad823e97e4e4985975747d284a71e61" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:50.004120  1570 raft_consensus.cc:1275] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Refusing update from remote peer 0ad823e97e4e4985975747d284a71e61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:50.005463  1651 consensus_queue.cc:1048] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8f58c088dbc45f983465564ed7fa17f" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 40459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:50.014211  1495 raft_consensus.cc:1275] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Refusing update from remote peer 0ad823e97e4e4985975747d284a71e61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:50.016002  1651 consensus_queue.cc:1048] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b98d7c26004d1dbf59f26039844bd1" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:50.033223 23879 tablet_server.cc:179] TabletServer@127.23.81.193:0 shutting down...
I20260709 12:23:50.064864 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:50.065549 23879 tablet_replica.cc:333] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61: stopping tablet replica
I20260709 12:23:50.066174 23879 raft_consensus.cc:2243] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:50.066952 23879 raft_consensus.cc:2272] T b3f96115ec894fbbbcba9270b949b298 P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.069176 23879 tablet_replica.cc:333] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61: stopping tablet replica
I20260709 12:23:50.069679 23879 raft_consensus.cc:2243] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.070016 23879 raft_consensus.cc:2272] T 59056a4bc2b34b0e9447af16b342eb9e P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.072572 23879 tablet_replica.cc:333] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61: stopping tablet replica
I20260709 12:23:50.073048 23879 raft_consensus.cc:2243] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:50.073764 23879 raft_consensus.cc:2272] T 327a7b2d2dea4d17855f2f74cc9ee671 P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.076136 23879 tablet_replica.cc:333] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61: stopping tablet replica
I20260709 12:23:50.076797 23879 raft_consensus.cc:2243] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.077236 23879 raft_consensus.cc:2272] T 55b00f52275e406bb2533f2714af0c75 P 0ad823e97e4e4985975747d284a71e61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.101085 23879 tablet_server.cc:196] TabletServer@127.23.81.193:0 shutdown complete.
I20260709 12:23:50.116524 23879 tablet_server.cc:179] TabletServer@127.23.81.194:0 shutting down...
I20260709 12:23:50.140072 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:50.140841 23879 tablet_replica.cc:333] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1: stopping tablet replica
I20260709 12:23:50.141458 23879 raft_consensus.cc:2243] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.141924 23879 raft_consensus.cc:2272] T 59056a4bc2b34b0e9447af16b342eb9e P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.144517 23879 tablet_replica.cc:333] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1: stopping tablet replica
I20260709 12:23:50.145089 23879 raft_consensus.cc:2243] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.145527 23879 raft_consensus.cc:2272] T b3f96115ec894fbbbcba9270b949b298 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.147787 23879 tablet_replica.cc:333] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1: stopping tablet replica
I20260709 12:23:50.148299 23879 raft_consensus.cc:2243] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:50.149112 23879 raft_consensus.cc:2272] T 55b00f52275e406bb2533f2714af0c75 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.151396 23879 tablet_replica.cc:333] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1: stopping tablet replica
I20260709 12:23:50.151894 23879 raft_consensus.cc:2243] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.152320 23879 raft_consensus.cc:2272] T 327a7b2d2dea4d17855f2f74cc9ee671 P 06b98d7c26004d1dbf59f26039844bd1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.176393 23879 tablet_server.cc:196] TabletServer@127.23.81.194:0 shutdown complete.
I20260709 12:23:50.189852 23879 tablet_server.cc:179] TabletServer@127.23.81.195:0 shutting down...
I20260709 12:23:50.207823 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:50.208487 23879 tablet_replica.cc:333] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f: stopping tablet replica
I20260709 12:23:50.209079 23879 raft_consensus.cc:2243] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.209568 23879 raft_consensus.cc:2272] T b3f96115ec894fbbbcba9270b949b298 P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.211831 23879 tablet_replica.cc:333] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f: stopping tablet replica
I20260709 12:23:50.212383 23879 raft_consensus.cc:2243] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:50.213001 23879 pending_rounds.cc:70] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f: Trying to abort 1 pending ops.
I20260709 12:23:50.213186 23879 pending_rounds.cc:77] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305624903398780928 op_type: NO_OP noop_request { }
I20260709 12:23:50.213500 23879 raft_consensus.cc:2889] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:50.213785 23879 raft_consensus.cc:2272] T 59056a4bc2b34b0e9447af16b342eb9e P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.215986 23879 tablet_replica.cc:333] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f: stopping tablet replica
I20260709 12:23:50.216533 23879 raft_consensus.cc:2243] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.216975 23879 raft_consensus.cc:2272] T 327a7b2d2dea4d17855f2f74cc9ee671 P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.219135 23879 tablet_replica.cc:333] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f: stopping tablet replica
I20260709 12:23:50.219652 23879 raft_consensus.cc:2243] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.220078 23879 raft_consensus.cc:2272] T 55b00f52275e406bb2533f2714af0c75 P c8f58c088dbc45f983465564ed7fa17f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.237689 23879 tablet_server.cc:196] TabletServer@127.23.81.195:0 shutdown complete.
I20260709 12:23:50.249929 23879 master.cc:562] Master@127.23.81.254:43509 shutting down...
I20260709 12:23:50.267802 23879 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:50.268347 23879 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.268632 23879 tablet_replica.cc:333] T 00000000000000000000000000000000 P a584700081c4402288e241f4494c08a7: stopping tablet replica
I20260709 12:23:50.289219 23879 master.cc:584] Master@127.23.81.254:43509 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2564 ms)
[----------] 6 tests from LeaderRebalancerTest (361803 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:23:50.325409 23879 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.81.254:39121
I20260709 12:23:50.326567 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:50.331634  1665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:50.331929  1666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:50.333071  1668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:50.334314 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:50.335148 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:50.335315 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:50.335500 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599830335468 us; error 0 us; skew 500 ppm
I20260709 12:23:50.336069 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:50.338435 23879 webserver.cc:533] Webserver started at http://127.23.81.254:41781/ using document root <none> and password file <none>
I20260709 12:23:50.338958 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:50.339166 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:50.339437 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:50.340525 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/master-0-root/instance:
uuid: "39cb72b92e7e4cd5b85eef65518aea48"
format_stamp: "Formatted at 2026-07-09 12:23:50 on dist-test-slave-mprf"
I20260709 12:23:50.345103 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:23:50.348690  1673 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:50.349591 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:23:50.349851 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/master-0-root
uuid: "39cb72b92e7e4cd5b85eef65518aea48"
format_stamp: "Formatted at 2026-07-09 12:23:50 on dist-test-slave-mprf"
I20260709 12:23:50.350361 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:50.372859 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:50.373996 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:50.412302 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.254:39121
I20260709 12:23:50.412403  1724 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.254:39121 every 8 connection(s)
I20260709 12:23:50.416492  1725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:50.427457  1725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48: Bootstrap starting.
I20260709 12:23:50.432572  1725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:50.436767  1725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48: No bootstrap required, opened a new log
I20260709 12:23:50.438968  1725 raft_consensus.cc:359] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39cb72b92e7e4cd5b85eef65518aea48" member_type: VOTER }
I20260709 12:23:50.439407  1725 raft_consensus.cc:385] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:50.439643  1725 raft_consensus.cc:740] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39cb72b92e7e4cd5b85eef65518aea48, State: Initialized, Role: FOLLOWER
I20260709 12:23:50.440289  1725 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39cb72b92e7e4cd5b85eef65518aea48" member_type: VOTER }
I20260709 12:23:50.440759  1725 raft_consensus.cc:399] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:50.440984  1725 raft_consensus.cc:493] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:50.441257  1725 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:50.446097  1725 raft_consensus.cc:515] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39cb72b92e7e4cd5b85eef65518aea48" member_type: VOTER }
I20260709 12:23:50.446627  1725 leader_election.cc:304] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39cb72b92e7e4cd5b85eef65518aea48; no voters: 
I20260709 12:23:50.447749  1725 leader_election.cc:290] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:50.448104  1728 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:50.449528  1728 raft_consensus.cc:697] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [term 1 LEADER]: Becoming Leader. State: Replica: 39cb72b92e7e4cd5b85eef65518aea48, State: Running, Role: LEADER
I20260709 12:23:50.450266  1728 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39cb72b92e7e4cd5b85eef65518aea48" member_type: VOTER }
I20260709 12:23:50.450757  1725 sys_catalog.cc:565] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:50.453411  1729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39cb72b92e7e4cd5b85eef65518aea48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39cb72b92e7e4cd5b85eef65518aea48" member_type: VOTER } }
I20260709 12:23:50.453573  1730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39cb72b92e7e4cd5b85eef65518aea48. Latest consensus state: current_term: 1 leader_uuid: "39cb72b92e7e4cd5b85eef65518aea48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39cb72b92e7e4cd5b85eef65518aea48" member_type: VOTER } }
I20260709 12:23:50.454327  1730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:50.454981  1729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:50.458364  1734 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:50.466454  1734 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:50.467479 23879 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:50.475589  1734 catalog_manager.cc:1383] Generated new cluster ID: 92db06cabbc247f6b3c4737ad4c1150e
I20260709 12:23:50.475901  1734 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:50.494204  1734 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:50.495539  1734 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:50.511488  1734 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48: Generated new TSK 0
I20260709 12:23:50.512113  1734 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:50.534991 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:50.541225  1746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:50.542500  1747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:50.544488 23879 server_base.cc:1061] running on GCE node
W20260709 12:23:50.544589  1749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:50.545712 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:50.545904 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:50.546227 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599830546205 us; error 0 us; skew 500 ppm
I20260709 12:23:50.546782 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:50.549233 23879 webserver.cc:533] Webserver started at http://127.23.81.193:36807/ using document root <none> and password file <none>
I20260709 12:23:50.549769 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:50.549983 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:50.550345 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:50.551541 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-0-root/instance:
uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
format_stamp: "Formatted at 2026-07-09 12:23:50 on dist-test-slave-mprf"
I20260709 12:23:50.556412 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:23:50.560019  1754 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:50.560811 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:50.561126 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-0-root
uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
format_stamp: "Formatted at 2026-07-09 12:23:50 on dist-test-slave-mprf"
I20260709 12:23:50.561468 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:50.583736 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:50.584950 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:50.586436 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:50.588876 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:50.589107 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:50.589359 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:50.589545 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:50.628932 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.193:46839
I20260709 12:23:50.629115  1816 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.193:46839 every 8 connection(s)
I20260709 12:23:50.634176 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:50.641129  1821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:50.643484  1822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:50.646080  1824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:50.646437 23879 server_base.cc:1061] running on GCE node
I20260709 12:23:50.646936  1817 heartbeater.cc:344] Connected to a master server at 127.23.81.254:39121
I20260709 12:23:50.647465  1817 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:50.647917 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:50.648307 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:50.648358  1817 heartbeater.cc:507] Master 127.23.81.254:39121 requested a full tablet report, sending...
I20260709 12:23:50.648624 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599830648602 us; error 0 us; skew 500 ppm
I20260709 12:23:50.649542 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:50.651681  1690 ts_manager.cc:194] Registered new tserver with Master: 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839)
I20260709 12:23:50.653276 23879 webserver.cc:533] Webserver started at http://127.23.81.194:34463/ using document root <none> and password file <none>
I20260709 12:23:50.653836  1690 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42316
I20260709 12:23:50.653841 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:50.654438 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:50.654733 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:50.656075 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-1-root/instance:
uuid: "d17bb92572974f0f967e6aa2337d5226"
format_stamp: "Formatted at 2026-07-09 12:23:50 on dist-test-slave-mprf"
I20260709 12:23:50.660802 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:23:50.664538  1829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:50.665386 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:50.665730 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-1-root
uuid: "d17bb92572974f0f967e6aa2337d5226"
format_stamp: "Formatted at 2026-07-09 12:23:50 on dist-test-slave-mprf"
I20260709 12:23:50.666057 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:50.683583 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:50.684774 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:50.686398 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:50.688943 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:50.689179 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:50.689450 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:50.689638 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:50.731086 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.194:38463
I20260709 12:23:50.731197  1891 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.194:38463 every 8 connection(s)
I20260709 12:23:50.736384 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:50.743818  1895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:50.744622  1896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:50.747898 23879 server_base.cc:1061] running on GCE node
W20260709 12:23:50.749073  1899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:50.749807  1892 heartbeater.cc:344] Connected to a master server at 127.23.81.254:39121
I20260709 12:23:50.750268  1892 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:50.750341 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:50.750661 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:50.750864 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599830750845 us; error 0 us; skew 500 ppm
I20260709 12:23:50.751220  1892 heartbeater.cc:507] Master 127.23.81.254:39121 requested a full tablet report, sending...
I20260709 12:23:50.751689 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:50.753718  1690 ts_manager.cc:194] Registered new tserver with Master: d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:50.754737 23879 webserver.cc:533] Webserver started at http://127.23.81.195:42393/ using document root <none> and password file <none>
I20260709 12:23:50.755421 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:50.755676 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:50.755674  1690 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42320
I20260709 12:23:50.756271 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:50.757784 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-2-root/instance:
uuid: "ec496778059d40cbb4afab0fe1a51a76"
format_stamp: "Formatted at 2026-07-09 12:23:50 on dist-test-slave-mprf"
I20260709 12:23:50.763130 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:50.766737  1903 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:50.767843 23879 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:23:50.768227 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-2-root
uuid: "ec496778059d40cbb4afab0fe1a51a76"
format_stamp: "Formatted at 2026-07-09 12:23:50 on dist-test-slave-mprf"
I20260709 12:23:50.768510 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599468354575-23879-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:50.790685 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:50.791818 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:50.793465 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:50.796010 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:50.796259 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:50.796512 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:50.796690 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:50.851475 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.195:39753
I20260709 12:23:50.851598  1965 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.195:39753 every 8 connection(s)
I20260709 12:23:50.867512  1966 heartbeater.cc:344] Connected to a master server at 127.23.81.254:39121
I20260709 12:23:50.867977  1966 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:50.868750  1966 heartbeater.cc:507] Master 127.23.81.254:39121 requested a full tablet report, sending...
I20260709 12:23:50.870877  1690 ts_manager.cc:194] Registered new tserver with Master: ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:50.871026 23879 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013820583s
I20260709 12:23:50.872357  1690 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42328
I20260709 12:23:50.896221  1690 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42340:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:50.898878  1690 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:50.971151  1782 tablet_service.cc:1511] Processing CreateTablet for tablet b53e2171173a416d9ed5d38a64f1c20f (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:50.972620  1782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53e2171173a416d9ed5d38a64f1c20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:50.975634  1857 tablet_service.cc:1511] Processing CreateTablet for tablet b53e2171173a416d9ed5d38a64f1c20f (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:50.975651  1856 tablet_service.cc:1511] Processing CreateTablet for tablet e7ad485b1679492097b0af78d231b9a0 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:50.976715  1855 tablet_service.cc:1511] Processing CreateTablet for tablet dd534ab8d78c432d9565c336eef7ebd7 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:50.977246  1857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53e2171173a416d9ed5d38a64f1c20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:50.978113  1855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd534ab8d78c432d9565c336eef7ebd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:50.979364  1854 tablet_service.cc:1511] Processing CreateTablet for tablet 0a5692423e8146c2aa5a7d110d2e5b1f (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:50.980770  1856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ad485b1679492097b0af78d231b9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:50.982738  1853 tablet_service.cc:1511] Processing CreateTablet for tablet 3337d6a9deb54745a42082d8b90cfd78 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:50.984169  1853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3337d6a9deb54745a42082d8b90cfd78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:50.987038  1854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a5692423e8146c2aa5a7d110d2e5b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:50.991264  1780 tablet_service.cc:1511] Processing CreateTablet for tablet dd534ab8d78c432d9565c336eef7ebd7 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:50.991532  1852 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae14d40a9e84e2aa8475d25c7012814 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:50.992830  1780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd534ab8d78c432d9565c336eef7ebd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:50.993093  1852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae14d40a9e84e2aa8475d25c7012814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:50.992954  1781 tablet_service.cc:1511] Processing CreateTablet for tablet e7ad485b1679492097b0af78d231b9a0 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:50.994437  1931 tablet_service.cc:1511] Processing CreateTablet for tablet b53e2171173a416d9ed5d38a64f1c20f (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:50.995116  1779 tablet_service.cc:1511] Processing CreateTablet for tablet 0a5692423e8146c2aa5a7d110d2e5b1f (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:50.995224  1851 tablet_service.cc:1511] Processing CreateTablet for tablet 6350cb1eb71940c28679038777d2da89 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:50.995916  1931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53e2171173a416d9ed5d38a64f1c20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:50.996668  1851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6350cb1eb71940c28679038777d2da89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:50.997254  1778 tablet_service.cc:1511] Processing CreateTablet for tablet 3337d6a9deb54745a42082d8b90cfd78 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:50.999253  1777 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae14d40a9e84e2aa8475d25c7012814 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:51.000510  1928 tablet_service.cc:1511] Processing CreateTablet for tablet 0a5692423e8146c2aa5a7d110d2e5b1f (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:51.001442  1776 tablet_service.cc:1511] Processing CreateTablet for tablet 6350cb1eb71940c28679038777d2da89 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:51.001579  1930 tablet_service.cc:1511] Processing CreateTablet for tablet e7ad485b1679492097b0af78d231b9a0 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:51.001948  1928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a5692423e8146c2aa5a7d110d2e5b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.001720  1925 tablet_service.cc:1511] Processing CreateTablet for tablet 6350cb1eb71940c28679038777d2da89 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:51.003062  1930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ad485b1679492097b0af78d231b9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.003402  1926 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae14d40a9e84e2aa8475d25c7012814 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:51.003978  1925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6350cb1eb71940c28679038777d2da89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.004832  1926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae14d40a9e84e2aa8475d25c7012814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.005134  1778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3337d6a9deb54745a42082d8b90cfd78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.006523  1779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a5692423e8146c2aa5a7d110d2e5b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.007166  1927 tablet_service.cc:1511] Processing CreateTablet for tablet 3337d6a9deb54745a42082d8b90cfd78 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:51.007241  1929 tablet_service.cc:1511] Processing CreateTablet for tablet dd534ab8d78c432d9565c336eef7ebd7 (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:51.007967  1781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ad485b1679492097b0af78d231b9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.008196  1927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3337d6a9deb54745a42082d8b90cfd78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.008836  1929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd534ab8d78c432d9565c336eef7ebd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.009498  1777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae14d40a9e84e2aa8475d25c7012814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.011044  1776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6350cb1eb71940c28679038777d2da89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.003868  1775 tablet_service.cc:1511] Processing CreateTablet for tablet 7da0ef84d5cd4ef9bc143bcdd41205db (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:51.012100  1775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da0ef84d5cd4ef9bc143bcdd41205db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.031648  1850 tablet_service.cc:1511] Processing CreateTablet for tablet 7da0ef84d5cd4ef9bc143bcdd41205db (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:51.033635  1850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da0ef84d5cd4ef9bc143bcdd41205db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.052807  1924 tablet_service.cc:1511] Processing CreateTablet for tablet 7da0ef84d5cd4ef9bc143bcdd41205db (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:51.054375  1924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da0ef84d5cd4ef9bc143bcdd41205db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.060194  1774 tablet_service.cc:1511] Processing CreateTablet for tablet 204ebd8e8f934d47bdde4570ab093dbd (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:51.061774  1774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 204ebd8e8f934d47bdde4570ab093dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.064793  1849 tablet_service.cc:1511] Processing CreateTablet for tablet 204ebd8e8f934d47bdde4570ab093dbd (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:51.066244  1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 204ebd8e8f934d47bdde4570ab093dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.097687  1923 tablet_service.cc:1511] Processing CreateTablet for tablet 204ebd8e8f934d47bdde4570ab093dbd (DEFAULT_TABLE table=test-workload [id=e2c8d08d700741399f5d93283df66364]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:51.099294  1923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 204ebd8e8f934d47bdde4570ab093dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.125344  1982 tablet_bootstrap.cc:492] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:51.160470  1982 tablet_bootstrap.cc:654] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.168926  1981 tablet_bootstrap.cc:492] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:51.170193  1983 tablet_bootstrap.cc:492] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:51.177587  1983 tablet_bootstrap.cc:654] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.197032  1983 tablet_bootstrap.cc:492] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:51.197557  1983 ts_tablet_manager.cc:1403] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.015s
I20260709 12:23:51.197572  1981 tablet_bootstrap.cc:654] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.200736  1982 tablet_bootstrap.cc:492] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:51.200502  1983 raft_consensus.cc:359] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.201288  1982 ts_tablet_manager.cc:1403] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.022s
I20260709 12:23:51.201310  1983 raft_consensus.cc:385] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.201903  1983 raft_consensus.cc:740] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.202847  1983 consensus_queue.cc:260] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.205574  1982 raft_consensus.cc:359] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.206395  1892 heartbeater.cc:499] Master 127.23.81.254:39121 was elected leader, sending a full tablet report...
I20260709 12:23:51.206408  1982 raft_consensus.cc:385] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.206988  1982 raft_consensus.cc:740] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.208163  1981 tablet_bootstrap.cc:492] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:51.207903  1982 consensus_queue.cc:260] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.208792  1981 ts_tablet_manager.cc:1403] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.040s	user 0.005s	sys 0.012s
I20260709 12:23:51.210196  1983 ts_tablet_manager.cc:1434] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 12:23:51.211236  1983 tablet_bootstrap.cc:492] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:51.212066  1981 raft_consensus.cc:359] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.212869  1981 raft_consensus.cc:385] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.213228  1981 raft_consensus.cc:740] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.214231  1981 consensus_queue.cc:260] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.216394  1966 heartbeater.cc:499] Master 127.23.81.254:39121 was elected leader, sending a full tablet report...
I20260709 12:23:51.217556  1982 ts_tablet_manager.cc:1434] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.010s
I20260709 12:23:51.218653  1982 tablet_bootstrap.cc:492] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:51.219585  1983 tablet_bootstrap.cc:654] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.226956  1982 tablet_bootstrap.cc:654] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.239123  1982 tablet_bootstrap.cc:492] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:51.239717  1982 ts_tablet_manager.cc:1403] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:23:51.242846  1982 raft_consensus.cc:359] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.243568  1982 raft_consensus.cc:385] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.243865  1982 raft_consensus.cc:740] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.244894  1982 consensus_queue.cc:260] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.247418  1982 ts_tablet_manager.cc:1434] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:23:51.248600  1982 tablet_bootstrap.cc:492] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:51.255079  1982 tablet_bootstrap.cc:654] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.266656  1982 tablet_bootstrap.cc:492] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:51.267179  1982 ts_tablet_manager.cc:1403] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:23:51.270258  1982 raft_consensus.cc:359] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.271291  1982 raft_consensus.cc:385] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.271580  1982 raft_consensus.cc:740] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.272467  1982 consensus_queue.cc:260] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.273869  1817 heartbeater.cc:499] Master 127.23.81.254:39121 was elected leader, sending a full tablet report...
I20260709 12:23:51.275085  1982 ts_tablet_manager.cc:1434] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:51.275271  1981 ts_tablet_manager.cc:1434] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.066s	user 0.029s	sys 0.030s
I20260709 12:23:51.276237  1982 tablet_bootstrap.cc:492] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:51.276962  1981 tablet_bootstrap.cc:492] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:51.283492  1982 tablet_bootstrap.cc:654] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.293792  1981 tablet_bootstrap.cc:654] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.294656  1983 tablet_bootstrap.cc:492] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:51.295215  1983 ts_tablet_manager.cc:1403] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.084s	user 0.027s	sys 0.052s
I20260709 12:23:51.298907  1982 tablet_bootstrap.cc:492] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:51.298662  1983 raft_consensus.cc:359] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.299500  1982 ts_tablet_manager.cc:1403] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 12:23:51.299675  1983 raft_consensus.cc:385] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.300127  1983 raft_consensus.cc:740] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.301414  1983 consensus_queue.cc:260] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.302733  1982 raft_consensus.cc:359] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.303546  1982 raft_consensus.cc:385] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.303861  1982 raft_consensus.cc:740] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.304840  1982 consensus_queue.cc:260] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.308130  1983 ts_tablet_manager.cc:1434] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:23:51.309592  1983 tablet_bootstrap.cc:492] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:51.309877  1982 ts_tablet_manager.cc:1434] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:23:51.311002  1982 tablet_bootstrap.cc:492] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:51.317077  1982 tablet_bootstrap.cc:654] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.317833  1983 tablet_bootstrap.cc:654] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.320811  1981 tablet_bootstrap.cc:492] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:51.321468  1981 ts_tablet_manager.cc:1403] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.010s
I20260709 12:23:51.330462  1983 tablet_bootstrap.cc:492] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:51.331056  1983 ts_tablet_manager.cc:1403] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:23:51.330811  1981 raft_consensus.cc:359] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.331717  1981 raft_consensus.cc:385] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.332080  1981 raft_consensus.cc:740] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.333006  1981 consensus_queue.cc:260] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.334079  1983 raft_consensus.cc:359] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.334838  1983 raft_consensus.cc:385] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.335132  1983 raft_consensus.cc:740] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.336081  1981 ts_tablet_manager.cc:1434] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:23:51.336139  1983 consensus_queue.cc:260] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.337215  1981 tablet_bootstrap.cc:492] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:51.338925  1983 ts_tablet_manager.cc:1434] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:23:51.340030  1983 tablet_bootstrap.cc:492] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:51.343325  1982 tablet_bootstrap.cc:492] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:51.343905  1982 ts_tablet_manager.cc:1403] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.011s
I20260709 12:23:51.344902  1981 tablet_bootstrap.cc:654] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.346238  1983 tablet_bootstrap.cc:654] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.347012  1982 raft_consensus.cc:359] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.347774  1982 raft_consensus.cc:385] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.348079  1982 raft_consensus.cc:740] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.348939  1982 consensus_queue.cc:260] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.354053  1982 ts_tablet_manager.cc:1434] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:23:51.355098  1982 tablet_bootstrap.cc:492] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:51.355940  1983 tablet_bootstrap.cc:492] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:51.356226  1988 raft_consensus.cc:493] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.356720  1983 ts_tablet_manager.cc:1403] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.011s
I20260709 12:23:51.356794  1988 raft_consensus.cc:515] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.360169  1983 raft_consensus.cc:359] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.361454  1983 raft_consensus.cc:385] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.361856  1983 raft_consensus.cc:740] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.364084  1983 consensus_queue.cc:260] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.365399  1981 tablet_bootstrap.cc:492] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:51.365978  1981 ts_tablet_manager.cc:1403] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.000s
I20260709 12:23:51.369069  1981 raft_consensus.cc:359] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.369818  1981 raft_consensus.cc:385] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.370143  1981 raft_consensus.cc:740] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.370393  1983 ts_tablet_manager.cc:1434] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:23:51.371510  1983 tablet_bootstrap.cc:492] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:51.370898  1981 consensus_queue.cc:260] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.374589  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53e2171173a416d9ed5d38a64f1c20f" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:51.375334  1792 raft_consensus.cc:2468] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:51.375412  1988 leader_election.cc:290] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:51.375278  1981 ts_tablet_manager.cc:1434] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:51.376883  1904 leader_election.cc:304] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:51.377662  1981 tablet_bootstrap.cc:492] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:51.377804  1988 raft_consensus.cc:2804] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:51.378264  1988 raft_consensus.cc:493] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.378372  1983 tablet_bootstrap.cc:654] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.378645  1988 raft_consensus.cc:3060] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.379086  1989 raft_consensus.cc:493] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.379634  1989 raft_consensus.cc:515] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.392609  1989 leader_election.cc:290] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.408905  1988 raft_consensus.cc:515] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.411556  1981 tablet_bootstrap.cc:654] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.412230  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53e2171173a416d9ed5d38a64f1c20f" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:51.412928  1792 raft_consensus.cc:3060] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.420154  1792 raft_consensus.cc:2468] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:51.421661  1904 leader_election.cc:304] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:51.424912  1982 tablet_bootstrap.cc:654] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.439378  1988 leader_election.cc:290] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:51.444691  1987 raft_consensus.cc:493] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.445364  1987 raft_consensus.cc:515] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.446012  1988 raft_consensus.cc:2804] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:51.447093  1988 raft_consensus.cc:697] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Leader. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:51.447952  1988 consensus_queue.cc:237] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.450146  1987 leader_election.cc:290] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.461987  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3337d6a9deb54745a42082d8b90cfd78" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
W20260709 12:23:51.462206  1738 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:51.462842  1983 tablet_bootstrap.cc:492] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:51.464427  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3337d6a9deb54745a42082d8b90cfd78" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:51.464483  1983 ts_tablet_manager.cc:1403] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.045s
I20260709 12:23:51.462901  1941 raft_consensus.cc:2468] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 0.
I20260709 12:23:51.466866  1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53e2171173a416d9ed5d38a64f1c20f" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:51.467109  1866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53e2171173a416d9ed5d38a64f1c20f" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:51.469216  1755 leader_election.cc:304] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:51.470211  1989 raft_consensus.cc:2804] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:51.470614  1989 raft_consensus.cc:493] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.471029  1989 raft_consensus.cc:3060] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:51.471866  1756 leader_election.cc:343] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:51.473145  1905 leader_election.cc:343] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:51.472963  1689 catalog_manager.cc:5697] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "ec496778059d40cbb4afab0fe1a51a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:51.475028  1905 leader_election.cc:343] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:51.476003  1982 tablet_bootstrap.cc:492] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:51.476563  1982 ts_tablet_manager.cc:1403] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.006s
I20260709 12:23:51.480165  1981 tablet_bootstrap.cc:492] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:51.480736  1981 ts_tablet_manager.cc:1403] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.003s
I20260709 12:23:51.482477  1989 raft_consensus.cc:515] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.483659  1981 raft_consensus.cc:359] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.484424  1981 raft_consensus.cc:385] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.484705  1981 raft_consensus.cc:740] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.485563  1866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3337d6a9deb54745a42082d8b90cfd78" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:51.470227  1983 raft_consensus.cc:359] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
W20260709 12:23:51.487316  1756 leader_election.cc:343] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:51.487874  1983 raft_consensus.cc:385] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.488943  1983 raft_consensus.cc:740] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.486317  1982 raft_consensus.cc:359] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.489912  1982 raft_consensus.cc:385] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.491406  1982 raft_consensus.cc:740] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.492461  1982 consensus_queue.cc:260] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.498160  1982 ts_tablet_manager.cc:1434] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:23:51.494686  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3337d6a9deb54745a42082d8b90cfd78" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:51.498411  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:51.498901  1941 raft_consensus.cc:3060] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.499676  1982 tablet_bootstrap.cc:492] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
W20260709 12:23:51.500242  1830 leader_election.cc:343] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:51.505162  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:51.489985  1983 consensus_queue.cc:260] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.506157  1940 raft_consensus.cc:2468] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 0.
I20260709 12:23:51.507287  1982 tablet_bootstrap.cc:654] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.508018  1983 ts_tablet_manager.cc:1434] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:23:51.509423  1830 leader_election.cc:304] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 52eb7d01f58f41e5b4af98bcc2f0a92a
I20260709 12:23:51.510469  1941 raft_consensus.cc:2468] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 1.
I20260709 12:23:51.510955  1987 raft_consensus.cc:2804] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:51.511462  1987 raft_consensus.cc:493] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.511826  1987 raft_consensus.cc:3060] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.512254  1755 leader_election.cc:304] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: d17bb92572974f0f967e6aa2337d5226
I20260709 12:23:51.519716  1983 tablet_bootstrap.cc:492] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:51.495198  1989 leader_election.cc:290] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 election: Requested vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.490561  1981 consensus_queue.cc:260] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.524314  1989 raft_consensus.cc:2804] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:51.524942  1989 raft_consensus.cc:697] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 LEADER]: Becoming Leader. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Running, Role: LEADER
I20260709 12:23:51.530978  1987 raft_consensus.cc:515] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.533315  1983 tablet_bootstrap.cc:654] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.532289  1989 consensus_queue.cc:237] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.536038  1987 leader_election.cc:290] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.538834  2015 raft_consensus.cc:493] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.537556  1981 ts_tablet_manager.cc:1434] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.008s
I20260709 12:23:51.540822  1981 tablet_bootstrap.cc:492] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:51.543875  1982 tablet_bootstrap.cc:492] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:51.544149  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:51.544610  1982 ts_tablet_manager.cc:1403] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.009s
I20260709 12:23:51.539402  2015 raft_consensus.cc:515] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.546682  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:51.547302  1941 raft_consensus.cc:3060] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.547952  2015 leader_election.cc:290] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.549619  2015 raft_consensus.cc:493] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.550194  2015 raft_consensus.cc:515] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.549394  1982 raft_consensus.cc:359] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
W20260709 12:23:51.549489  1830 leader_election.cc:343] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:51.551762  1982 raft_consensus.cc:385] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.552848  1982 raft_consensus.cc:740] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.553172  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6350cb1eb71940c28679038777d2da89" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:51.553853  1940 raft_consensus.cc:2468] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 0.
I20260709 12:23:51.555226  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6350cb1eb71940c28679038777d2da89" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:51.555541  1830 leader_election.cc:304] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:51.555886  1792 raft_consensus.cc:2468] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 0.
I20260709 12:23:51.556433  1987 raft_consensus.cc:2804] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:51.557006  1987 raft_consensus.cc:493] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.554757  1982 consensus_queue.cc:260] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.557344  1987 raft_consensus.cc:3060] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.557497  1988 raft_consensus.cc:493] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.557863  1981 tablet_bootstrap.cc:654] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.558126  1988 raft_consensus.cc:515] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.559032  1982 ts_tablet_manager.cc:1434] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.007s
I20260709 12:23:51.561415  2015 leader_election.cc:290] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.561513  1866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad485b1679492097b0af78d231b9a0" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:51.561975  1988 leader_election.cc:290] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:51.562321  1866 raft_consensus.cc:2468] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:51.563683  2015 raft_consensus.cc:493] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.563910  1905 leader_election.cc:304] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:51.564159  2015 raft_consensus.cc:515] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.564879  1988 raft_consensus.cc:2804] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:51.565260  1988 raft_consensus.cc:493] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.565623  1988 raft_consensus.cc:3060] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.566361  2015 leader_election.cc:290] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.568878  1941 raft_consensus.cc:2468] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 1.
I20260709 12:23:51.571939  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5692423e8146c2aa5a7d110d2e5b1f" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:51.572026  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad485b1679492097b0af78d231b9a0" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:51.574728  1988 raft_consensus.cc:515] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.575441  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5692423e8146c2aa5a7d110d2e5b1f" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
W20260709 12:23:51.576876  1904 leader_election.cc:343] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:51.577661  1983 tablet_bootstrap.cc:492] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:51.578231  1983 ts_tablet_manager.cc:1403] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.001s
I20260709 12:23:51.578368  1866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad485b1679492097b0af78d231b9a0" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:51.579018  1866 raft_consensus.cc:3060] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.579439  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad485b1679492097b0af78d231b9a0" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
W20260709 12:23:51.580742  1904 leader_election.cc:343] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:51.582664  1981 tablet_bootstrap.cc:492] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:51.582587  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da0ef84d5cd4ef9bc143bcdd41205db" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:51.583294  1981 ts_tablet_manager.cc:1403] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.005s
I20260709 12:23:51.584574  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da0ef84d5cd4ef9bc143bcdd41205db" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:51.585237  1940 raft_consensus.cc:2468] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 0.
I20260709 12:23:51.583375  1792 raft_consensus.cc:2468] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 0.
I20260709 12:23:51.586553  1987 raft_consensus.cc:515] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.586512  1981 raft_consensus.cc:359] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.581508  1983 raft_consensus.cc:359] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.587834  1981 raft_consensus.cc:385] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.587998  1983 raft_consensus.cc:385] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.588204  1981 raft_consensus.cc:740] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.588382  1983 raft_consensus.cc:740] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.589169  1981 consensus_queue.cc:260] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.587175  1866 raft_consensus.cc:2468] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:51.589622  1987 leader_election.cc:290] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.586645  1830 leader_election.cc:304] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 52eb7d01f58f41e5b4af98bcc2f0a92a
I20260709 12:23:51.591235  1905 leader_election.cc:304] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 52eb7d01f58f41e5b4af98bcc2f0a92a
I20260709 12:23:51.591881  1987 raft_consensus.cc:2804] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:51.592259  1981 ts_tablet_manager.cc:1434] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:23:51.592278  2005 raft_consensus.cc:2804] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:51.592711  1987 raft_consensus.cc:697] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Becoming Leader. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Running, Role: LEADER
I20260709 12:23:51.593590  1981 tablet_bootstrap.cc:492] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:51.594525  1987 consensus_queue.cc:237] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
W20260709 12:23:51.593464  1830 leader_election.cc:343] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:51.597414  1689 catalog_manager.cc:5697] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a reported cstate change: term changed from 0 to 1, leader changed from <none> to 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193). New cstate: current_term: 1 leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:51.598780  1830 leader_election.cc:304] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:51.599640  2015 raft_consensus.cc:2804] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:51.600023  2015 raft_consensus.cc:493] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.560154  1982 tablet_bootstrap.cc:492] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:51.589242  1988 leader_election.cc:290] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:51.589231  1983 consensus_queue.cc:260] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.600329  2015 raft_consensus.cc:3060] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:51.607810  1830 leader_election.cc:343] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:51.608414  1830 leader_election.cc:304] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226; no voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76
I20260709 12:23:51.611389  1981 tablet_bootstrap.cc:654] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.615000  1987 raft_consensus.cc:2749] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:51.615257  2005 raft_consensus.cc:697] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Leader. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:51.616562  2005 consensus_queue.cc:237] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.613905  1982 tablet_bootstrap.cc:654] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.621999  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6350cb1eb71940c28679038777d2da89" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:51.623425  2015 raft_consensus.cc:515] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.626526  1792 raft_consensus.cc:3060] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.629046  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6350cb1eb71940c28679038777d2da89" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:51.629696  1941 raft_consensus.cc:3060] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.631323  2015 leader_election.cc:290] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.633538  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da0ef84d5cd4ef9bc143bcdd41205db" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:51.634243  1791 raft_consensus.cc:3060] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.634045  1689 catalog_manager.cc:5697] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 reported cstate change: term changed from 0 to 1, leader changed from <none> to d17bb92572974f0f967e6aa2337d5226 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "d17bb92572974f0f967e6aa2337d5226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:51.633574  1983 ts_tablet_manager.cc:1434] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.055s	user 0.013s	sys 0.015s
I20260709 12:23:51.638806  1983 tablet_bootstrap.cc:492] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:51.642882  1941 raft_consensus.cc:2468] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 1.
I20260709 12:23:51.659065  1830 leader_election.cc:304] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:51.659744  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da0ef84d5cd4ef9bc143bcdd41205db" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:51.660691  1941 raft_consensus.cc:3060] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.664559  1791 raft_consensus.cc:2468] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 1.
I20260709 12:23:51.660660  2015 raft_consensus.cc:2804] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:51.669723  2015 raft_consensus.cc:697] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Becoming Leader. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Running, Role: LEADER
I20260709 12:23:51.669929  1981 tablet_bootstrap.cc:492] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:51.670562  1981 ts_tablet_manager.cc:1403] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.077s	user 0.027s	sys 0.010s
I20260709 12:23:51.671135  2015 consensus_queue.cc:237] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.672643  1687 catalog_manager.cc:5697] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "ec496778059d40cbb4afab0fe1a51a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:51.674749  1792 raft_consensus.cc:2468] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 1.
I20260709 12:23:51.675129  1941 raft_consensus.cc:2468] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 1.
I20260709 12:23:51.674319  1981 raft_consensus.cc:359] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.676136  1830 leader_election.cc:304] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: 
I20260709 12:23:51.677448  1981 raft_consensus.cc:385] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.682345  1983 tablet_bootstrap.cc:654] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.682556  1981 raft_consensus.cc:740] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.682819  2022 raft_consensus.cc:2804] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:51.683372  2022 raft_consensus.cc:697] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Becoming Leader. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Running, Role: LEADER
I20260709 12:23:51.683527  1981 consensus_queue.cc:260] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.679563  1982 tablet_bootstrap.cc:492] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:51.684333  2022 consensus_queue.cc:237] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.685127  1982 ts_tablet_manager.cc:1403] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.125s	user 0.020s	sys 0.017s
I20260709 12:23:51.688269  1982 raft_consensus.cc:359] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.688993  1982 raft_consensus.cc:385] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.689288  1982 raft_consensus.cc:740] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.689967  1982 consensus_queue.cc:260] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.692160  1982 ts_tablet_manager.cc:1434] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:51.692018  1689 catalog_manager.cc:5697] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 reported cstate change: term changed from 0 to 1, leader changed from <none> to d17bb92572974f0f967e6aa2337d5226 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "d17bb92572974f0f967e6aa2337d5226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:51.696136  1983 tablet_bootstrap.cc:492] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:51.696770  1983 ts_tablet_manager.cc:1403] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.002s
I20260709 12:23:51.699944  1983 raft_consensus.cc:359] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.700755  1983 raft_consensus.cc:385] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.704972  1983 raft_consensus.cc:740] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.702001  2015 raft_consensus.cc:493] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.705967  1983 consensus_queue.cc:260] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.706436  2015 raft_consensus.cc:515] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.708635  2015 leader_election.cc:290] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.708863  1983 ts_tablet_manager.cc:1434] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:23:51.704643  1982 tablet_bootstrap.cc:492] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:51.710245  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53e2171173a416d9ed5d38a64f1c20f" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:51.711153  1792 raft_consensus.cc:2393] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d17bb92572974f0f967e6aa2337d5226 in current term 1: Already voted for candidate ec496778059d40cbb4afab0fe1a51a76 in this term.
I20260709 12:23:51.711148  1983 tablet_bootstrap.cc:492] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:51.711817  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53e2171173a416d9ed5d38a64f1c20f" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:51.713493  1830 leader_election.cc:304] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226; no voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76
I20260709 12:23:51.714460  1981 ts_tablet_manager.cc:1434] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.003s
I20260709 12:23:51.714788  2015 raft_consensus.cc:3060] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.716634  1982 tablet_bootstrap.cc:654] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.720808  1981 tablet_bootstrap.cc:492] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:51.723636  2015 raft_consensus.cc:2749] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:51.725663  1690 catalog_manager.cc:5697] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 reported cstate change: term changed from 0 to 1, leader changed from <none> to d17bb92572974f0f967e6aa2337d5226 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "d17bb92572974f0f967e6aa2337d5226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:51.728689  1982 tablet_bootstrap.cc:492] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:51.729269  1982 ts_tablet_manager.cc:1403] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.005s
I20260709 12:23:51.730464  1983 tablet_bootstrap.cc:654] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.733637  1981 tablet_bootstrap.cc:654] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.735093  1982 raft_consensus.cc:359] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.735941  1982 raft_consensus.cc:385] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.736292  1982 raft_consensus.cc:740] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.737128  1982 consensus_queue.cc:260] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.739396  1982 ts_tablet_manager.cc:1434] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:51.742861  1983 tablet_bootstrap.cc:492] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:51.743420  1983 ts_tablet_manager.cc:1403] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.008s
I20260709 12:23:51.746580  1981 tablet_bootstrap.cc:492] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:51.747159  1981 ts_tablet_manager.cc:1403] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.002s
I20260709 12:23:51.747385  1983 raft_consensus.cc:359] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.749612  1981 raft_consensus.cc:359] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.750128  1983 raft_consensus.cc:385] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.750322  1981 raft_consensus.cc:385] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.750571  1983 raft_consensus.cc:740] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.750589  1989 raft_consensus.cc:493] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.750706  1981 raft_consensus.cc:740] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.751391  1989 raft_consensus.cc:515] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.751579  1983 consensus_queue.cc:260] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.751864  1981 consensus_queue.cc:260] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.753837  1983 ts_tablet_manager.cc:1434] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:23:51.755014  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5692423e8146c2aa5a7d110d2e5b1f" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:51.755625  1981 ts_tablet_manager.cc:1434] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:51.755728  1941 raft_consensus.cc:2468] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 0.
I20260709 12:23:51.756364  1983 tablet_bootstrap.cc:492] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:51.756852  1981 tablet_bootstrap.cc:492] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:51.757864  1866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5692423e8146c2aa5a7d110d2e5b1f" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:51.758569  1866 raft_consensus.cc:2468] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 0.
I20260709 12:23:51.763360  1983 tablet_bootstrap.cc:654] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.763700  1981 tablet_bootstrap.cc:654] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.764708  1756 leader_election.cc:304] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: 
I20260709 12:23:51.765815  2014 raft_consensus.cc:2804] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:51.766206  2014 raft_consensus.cc:493] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.766543  2014 raft_consensus.cc:3060] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.771361  1989 leader_election.cc:290] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.776839  2014 raft_consensus.cc:515] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.779803  2014 leader_election.cc:290] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 election: Requested vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.780668  1866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5692423e8146c2aa5a7d110d2e5b1f" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:51.781414  1866 raft_consensus.cc:3060] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.783242  1983 tablet_bootstrap.cc:492] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:51.783267  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5692423e8146c2aa5a7d110d2e5b1f" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:51.784159  1983 ts_tablet_manager.cc:1403] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.007s
I20260709 12:23:51.784061  1981 tablet_bootstrap.cc:492] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:51.784137  1941 raft_consensus.cc:3060] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.785247  1981 ts_tablet_manager.cc:1403] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.008s
I20260709 12:23:51.787892  1983 raft_consensus.cc:359] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.788224  1981 raft_consensus.cc:359] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.788803  1983 raft_consensus.cc:385] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.788998  1981 raft_consensus.cc:385] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.789335  1983 raft_consensus.cc:740] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.789359  1981 raft_consensus.cc:740] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.789851  1866 raft_consensus.cc:2468] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 1.
I20260709 12:23:51.790573  1983 consensus_queue.cc:260] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.790679  1981 consensus_queue.cc:260] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.791270  1756 leader_election.cc:304] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: 
I20260709 12:23:51.792232  2014 raft_consensus.cc:2804] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:51.792688  2014 raft_consensus.cc:697] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 LEADER]: Becoming Leader. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Running, Role: LEADER
I20260709 12:23:51.793103  1941 raft_consensus.cc:2468] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 1.
I20260709 12:23:51.793532  2014 consensus_queue.cc:237] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.795835  1981 ts_tablet_manager.cc:1434] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.007s
I20260709 12:23:51.796811  1981 tablet_bootstrap.cc:492] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:51.800365  1983 ts_tablet_manager.cc:1434] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:23:51.804554  1981 tablet_bootstrap.cc:654] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:51.807601  1689 catalog_manager.cc:5697] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a reported cstate change: term changed from 0 to 1, leader changed from <none> to 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193). New cstate: current_term: 1 leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:51.809578  1981 tablet_bootstrap.cc:492] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:51.810160  1981 ts_tablet_manager.cc:1403] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:23:51.812294  1981 raft_consensus.cc:359] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.812989  1981 raft_consensus.cc:385] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:51.813262  1981 raft_consensus.cc:740] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:51.813884  1981 consensus_queue.cc:260] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.815848  1981 ts_tablet_manager.cc:1434] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:51.879473  2014 raft_consensus.cc:493] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.880077  2014 raft_consensus.cc:515] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.881930  2014 leader_election.cc:290] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.882743  1866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad485b1679492097b0af78d231b9a0" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:51.882995  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad485b1679492097b0af78d231b9a0" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:51.883515  1866 raft_consensus.cc:2393] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in current term 1: Already voted for candidate ec496778059d40cbb4afab0fe1a51a76 in this term.
I20260709 12:23:51.884495  1756 leader_election.cc:304] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a; no voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76
I20260709 12:23:51.885161  2014 raft_consensus.cc:3060] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.892009  2014 raft_consensus.cc:2749] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:51.899008  2005 consensus_queue.cc:1048] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:51.912451  2020 consensus_queue.cc:1048] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:51.933111  2015 raft_consensus.cc:493] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.933712  2015 raft_consensus.cc:515] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.935506  2015 leader_election.cc:290] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.936367  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae14d40a9e84e2aa8475d25c7012814" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:51.936601  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae14d40a9e84e2aa8475d25c7012814" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:51.937032  1792 raft_consensus.cc:2468] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 0.
I20260709 12:23:51.937281  1941 raft_consensus.cc:2468] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 0.
I20260709 12:23:51.938138  1830 leader_election.cc:304] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: 
I20260709 12:23:51.938812  2015 raft_consensus.cc:2804] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:51.939116  2015 raft_consensus.cc:493] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.939458  2015 raft_consensus.cc:3060] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.944710  2020 raft_consensus.cc:493] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.945132  2015 raft_consensus.cc:515] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.945367  2020 raft_consensus.cc:515] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.947486  2015 leader_election.cc:290] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.947528  2020 leader_election.cc:290] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:51.948717  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204ebd8e8f934d47bdde4570ab093dbd" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:51.949582  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae14d40a9e84e2aa8475d25c7012814" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:51.948796  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae14d40a9e84e2aa8475d25c7012814" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:51.949996  1792 raft_consensus.cc:2468] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:51.950120  1867 raft_consensus.cc:3060] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.950307  1941 raft_consensus.cc:3060] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.950424  1791 raft_consensus.cc:3060] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.951473  1904 leader_election.cc:304] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:51.949007  1866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204ebd8e8f934d47bdde4570ab093dbd" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:51.952467  2020 raft_consensus.cc:2804] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:51.953130  1866 raft_consensus.cc:2468] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:51.953541  2020 raft_consensus.cc:493] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.955705  2020 raft_consensus.cc:3060] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.958841  1941 raft_consensus.cc:2468] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 1.
I20260709 12:23:51.958875  1791 raft_consensus.cc:2468] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 1.
I20260709 12:23:51.960350  1830 leader_election.cc:304] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: 
I20260709 12:23:51.961303  2014 consensus_queue.cc:1048] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:51.961831  2015 raft_consensus.cc:2804] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:51.962373  2015 raft_consensus.cc:697] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Becoming Leader. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Running, Role: LEADER
I20260709 12:23:51.963248  2015 consensus_queue.cc:237] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.963862  2020 raft_consensus.cc:515] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.966917  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204ebd8e8f934d47bdde4570ab093dbd" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:51.967326  2020 leader_election.cc:290] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:51.967490  1791 raft_consensus.cc:3060] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.968647  1866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204ebd8e8f934d47bdde4570ab093dbd" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:51.970677  1866 raft_consensus.cc:3060] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:51.974720  1687 catalog_manager.cc:5697] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 reported cstate change: term changed from 0 to 1, leader changed from <none> to d17bb92572974f0f967e6aa2337d5226 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "d17bb92572974f0f967e6aa2337d5226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:51.977766  1791 raft_consensus.cc:2468] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:51.978945  1904 leader_election.cc:304] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:51.979923  2020 raft_consensus.cc:2804] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:51.979707  2014 consensus_queue.cc:1048] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:51.980794  2020 raft_consensus.cc:697] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Leader. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:51.981793  2020 consensus_queue.cc:237] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.983886  2014 raft_consensus.cc:493] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.984483  2014 raft_consensus.cc:515] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:51.987574  1866 raft_consensus.cc:2468] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:51.989661  2014 leader_election.cc:290] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:51.990514  1866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:51.991498  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:51.992359  1940 raft_consensus.cc:2393] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in current term 1: Already voted for candidate d17bb92572974f0f967e6aa2337d5226 in this term.
I20260709 12:23:51.996578  1756 leader_election.cc:304] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a; no voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76
I20260709 12:23:51.997488  2014 raft_consensus.cc:3060] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:52.000078  1687 catalog_manager.cc:5697] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "ec496778059d40cbb4afab0fe1a51a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:52.003144  2014 raft_consensus.cc:2749] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:52.061581  2015 consensus_queue.cc:1048] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:52.073920  1987 consensus_queue.cc:1048] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:52.084643  1987 consensus_queue.cc:1048] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:52.091370  1987 consensus_queue.cc:1048] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:52.097280  2022 consensus_queue.cc:1048] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:52.117552  1987 consensus_queue.cc:1048] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:52.137876  1941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b53e2171173a416d9ed5d38a64f1c20f"
dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
mode: GRACEFUL
new_leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
 from {username='slave'} at 127.0.0.1:52122
I20260709 12:23:52.138567  1941 raft_consensus.cc:606] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Received request to transfer leadership to TS 52eb7d01f58f41e5b4af98bcc2f0a92a
I20260709 12:23:52.145298  1941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ad485b1679492097b0af78d231b9a0"
dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
mode: GRACEFUL
new_leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
 from {username='slave'} at 127.0.0.1:52122
I20260709 12:23:52.145812  1941 raft_consensus.cc:606] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Received request to transfer leadership to TS 52eb7d01f58f41e5b4af98bcc2f0a92a
I20260709 12:23:52.159834  1866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7"
dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
mode: GRACEFUL
new_leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
 from {username='slave'} at 127.0.0.1:42002
I20260709 12:23:52.160431  1866 raft_consensus.cc:606] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Received request to transfer leadership to TS 52eb7d01f58f41e5b4af98bcc2f0a92a
I20260709 12:23:52.177244  1791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3337d6a9deb54745a42082d8b90cfd78"
dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
mode: GRACEFUL
new_leader_uuid: "d17bb92572974f0f967e6aa2337d5226"
 from {username='slave'} at 127.0.0.1:50576
I20260709 12:23:52.177809  1791 raft_consensus.cc:606] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 LEADER]: Received request to transfer leadership to TS d17bb92572974f0f967e6aa2337d5226
I20260709 12:23:52.222685  2020 consensus_queue.cc:1048] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:52.229679  2005 raft_consensus.cc:993] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76: : Instructing follower 52eb7d01f58f41e5b4af98bcc2f0a92a to start an election
I20260709 12:23:52.230257  1988 raft_consensus.cc:1081] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Signalling peer 52eb7d01f58f41e5b4af98bcc2f0a92a to start an election
I20260709 12:23:52.231940  1792 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7ad485b1679492097b0af78d231b9a0"
dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
 from {username='slave'} at 127.0.0.1:50544
I20260709 12:23:52.232542  1792 raft_consensus.cc:493] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:52.232928  1792 raft_consensus.cc:3060] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.235296  2005 consensus_queue.cc:1048] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:52.240360  1792 raft_consensus.cc:515] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:52.241925  1791 raft_consensus.cc:1240] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Rejecting Update request from peer ec496778059d40cbb4afab0fe1a51a76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:52.244307  1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad485b1679492097b0af78d231b9a0" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:52.245123  1792 leader_election.cc:290] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 2 election: Requested vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:52.245369  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad485b1679492097b0af78d231b9a0" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:52.246121  1941 raft_consensus.cc:3055] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:52.246500  1941 raft_consensus.cc:740] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:52.247365  1941 consensus_queue.cc:260] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:52.248327  1941 raft_consensus.cc:3060] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:52.251304  2005 consensus_queue.cc:1175] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ec496778059d40cbb4afab0fe1a51a76 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:52.255549  1941 raft_consensus.cc:2468] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 2.
I20260709 12:23:52.256697  1755 leader_election.cc:304] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: d17bb92572974f0f967e6aa2337d5226
I20260709 12:23:52.257529  2014 raft_consensus.cc:2804] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:52.257937  2014 raft_consensus.cc:697] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Becoming Leader. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Running, Role: LEADER
I20260709 12:23:52.258801  2014 consensus_queue.cc:237] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:52.265949  1690 catalog_manager.cc:5697] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a reported cstate change: term changed from 1 to 2, leader changed from ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195) to 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193). New cstate: current_term: 2 leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:52.355072  2014 consensus_queue.cc:1048] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:52.366700  2020 raft_consensus.cc:993] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76: : Instructing follower 52eb7d01f58f41e5b4af98bcc2f0a92a to start an election
I20260709 12:23:52.367192  2020 raft_consensus.cc:1081] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Signalling peer 52eb7d01f58f41e5b4af98bcc2f0a92a to start an election
I20260709 12:23:52.367343  2014 consensus_queue.cc:1048] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:52.369827  1792 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b53e2171173a416d9ed5d38a64f1c20f"
dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
 from {username='slave'} at 127.0.0.1:50544
I20260709 12:23:52.370443  1792 raft_consensus.cc:493] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:52.370824  1792 raft_consensus.cc:3060] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.380131  2020 consensus_queue.cc:1048] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:52.380344  1792 raft_consensus.cc:515] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:52.383102  1792 leader_election.cc:290] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 2 election: Requested vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:52.383838  1866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53e2171173a416d9ed5d38a64f1c20f" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:52.384490  1866 raft_consensus.cc:3060] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.388406  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53e2171173a416d9ed5d38a64f1c20f" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:52.389318  1941 raft_consensus.cc:3055] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:52.389731  1941 raft_consensus.cc:740] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:52.390832  1941 consensus_queue.cc:260] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:52.392681  1941 raft_consensus.cc:3060] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.393345  1866 raft_consensus.cc:2468] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 2.
I20260709 12:23:52.397344  2005 consensus_queue.cc:1048] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:52.400769  2014 raft_consensus.cc:993] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a: : Instructing follower d17bb92572974f0f967e6aa2337d5226 to start an election
I20260709 12:23:52.401360  2014 raft_consensus.cc:1081] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 LEADER]: Signalling peer d17bb92572974f0f967e6aa2337d5226 to start an election
I20260709 12:23:52.403607  1865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3337d6a9deb54745a42082d8b90cfd78"
dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
 from {username='slave'} at 127.0.0.1:41992
I20260709 12:23:52.404311  1865 raft_consensus.cc:493] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:52.404839  1865 raft_consensus.cc:3060] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.406677  1941 raft_consensus.cc:2468] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 2.
I20260709 12:23:52.408483  1755 leader_election.cc:304] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:52.409528  1989 raft_consensus.cc:2804] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:52.410080  1989 raft_consensus.cc:697] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Becoming Leader. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Running, Role: LEADER
I20260709 12:23:52.410959  1989 consensus_queue.cc:237] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:52.419318  1865 raft_consensus.cc:515] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:52.421550  1690 catalog_manager.cc:5697] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a reported cstate change: term changed from 1 to 2, leader changed from ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195) to 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193). New cstate: current_term: 2 leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:52.422257  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3337d6a9deb54745a42082d8b90cfd78" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:52.422631  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3337d6a9deb54745a42082d8b90cfd78" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:52.423072  1791 raft_consensus.cc:3055] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:52.423260  1941 raft_consensus.cc:3060] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.423448  1791 raft_consensus.cc:740] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Running, Role: LEADER
I20260709 12:23:52.424398  1791 consensus_queue.cc:260] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:52.425575  1791 raft_consensus.cc:3060] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.426175  1865 leader_election.cc:290] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 2 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:52.431267  1941 raft_consensus.cc:2468] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 2.
I20260709 12:23:52.432600  1830 leader_election.cc:304] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:52.433418  1791 raft_consensus.cc:2468] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 2.
I20260709 12:23:52.433435  2022 raft_consensus.cc:2804] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:52.434237  2022 raft_consensus.cc:697] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [term 2 LEADER]: Becoming Leader. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Running, Role: LEADER
I20260709 12:23:52.435115  2022 consensus_queue.cc:237] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:52.441128  1690 catalog_manager.cc:5697] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 reported cstate change: term changed from 1 to 2, leader changed from 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193) to d17bb92572974f0f967e6aa2337d5226 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "d17bb92572974f0f967e6aa2337d5226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:52.459762  2022 consensus_queue.cc:1048] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:52.471760  2022 consensus_queue.cc:1048] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:52.624281  2015 raft_consensus.cc:993] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226: : Instructing follower 52eb7d01f58f41e5b4af98bcc2f0a92a to start an election
I20260709 12:23:52.624743  2022 raft_consensus.cc:1081] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Signalling peer 52eb7d01f58f41e5b4af98bcc2f0a92a to start an election
I20260709 12:23:52.626233  1791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7"
dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
 from {username='slave'} at 127.0.0.1:50560
I20260709 12:23:52.626737  1791 raft_consensus.cc:493] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:52.627043  1791 raft_consensus.cc:3060] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.633601  1791 raft_consensus.cc:515] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:52.635553  1791 leader_election.cc:290] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 2 election: Requested vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:52.636250  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:52.636999  1865 raft_consensus.cc:3055] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:52.636719  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:52.637420  1865 raft_consensus.cc:740] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Running, Role: LEADER
I20260709 12:23:52.637995  1941 raft_consensus.cc:3060] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.638559  1865 consensus_queue.cc:260] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:52.640065  1865 raft_consensus.cc:3060] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.641913  1940 raft_consensus.cc:1275] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Refusing update from remote peer 52eb7d01f58f41e5b4af98bcc2f0a92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:52.643569  1989 consensus_queue.cc:1048] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.645012  1941 raft_consensus.cc:2468] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 2.
I20260709 12:23:52.646245  1755 leader_election.cc:304] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:52.647022  1989 raft_consensus.cc:2804] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:52.647471  1989 raft_consensus.cc:697] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Becoming Leader. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Running, Role: LEADER
I20260709 12:23:52.648209  1865 raft_consensus.cc:2468] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 2.
I20260709 12:23:52.648322  1989 consensus_queue.cc:237] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:52.660022  1865 raft_consensus.cc:3060] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.663347  1687 catalog_manager.cc:5697] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a reported cstate change: term changed from 1 to 2, leader changed from d17bb92572974f0f967e6aa2337d5226 (127.23.81.194) to 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193). New cstate: current_term: 2 leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:52.667461  1865 raft_consensus.cc:1275] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Refusing update from remote peer 52eb7d01f58f41e5b4af98bcc2f0a92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:52.670164  1989 consensus_queue.cc:1048] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.816804  1865 raft_consensus.cc:1275] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Refusing update from remote peer 52eb7d01f58f41e5b4af98bcc2f0a92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:52.818264  1989 consensus_queue.cc:1048] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.827008  1940 raft_consensus.cc:1275] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Refusing update from remote peer 52eb7d01f58f41e5b4af98bcc2f0a92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:52.828411  1989 consensus_queue.cc:1048] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.915920  1940 raft_consensus.cc:1275] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Refusing update from remote peer d17bb92572974f0f967e6aa2337d5226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:52.917312  2022 consensus_queue.cc:1048] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.925283  1791 raft_consensus.cc:1275] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Refusing update from remote peer d17bb92572974f0f967e6aa2337d5226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:52.927081  2022 consensus_queue.cc:1048] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:53.165572  1940 raft_consensus.cc:1275] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Refusing update from remote peer 52eb7d01f58f41e5b4af98bcc2f0a92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:53.166983  1989 consensus_queue.cc:1048] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:53.178413  1865 raft_consensus.cc:1275] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Refusing update from remote peer 52eb7d01f58f41e5b4af98bcc2f0a92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:53.180166  2014 consensus_queue.cc:1048] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.226119  1690 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42342:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:55.228418  1690 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:55.279201  1777 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0ec4ba9e3a4d9cbf618356a9c38c59 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:55.280578  1777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0ec4ba9e3a4d9cbf618356a9c38c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.280354  1853 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0ec4ba9e3a4d9cbf618356a9c38c59 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:55.283834  1926 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0ec4ba9e3a4d9cbf618356a9c38c59 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:55.285437  1926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0ec4ba9e3a4d9cbf618356a9c38c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.287557  1852 tablet_service.cc:1511] Processing CreateTablet for tablet 7c1a2e56cecf4e38996722158f558c83 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:55.294584  1781 tablet_service.cc:1511] Processing CreateTablet for tablet 7c1a2e56cecf4e38996722158f558c83 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:55.296072  1781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1a2e56cecf4e38996722158f558c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.296370  1928 tablet_service.cc:1511] Processing CreateTablet for tablet c985e8fbc66e4639b58195c121f87064 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:55.297713  1928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c985e8fbc66e4639b58195c121f87064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.300642  1774 tablet_service.cc:1511] Processing CreateTablet for tablet c985e8fbc66e4639b58195c121f87064 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:55.302150  1774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c985e8fbc66e4639b58195c121f87064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.305610  1930 tablet_service.cc:1511] Processing CreateTablet for tablet bcf34f0950744055ae62c5549345ebea (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:55.307035  1930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcf34f0950744055ae62c5549345ebea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.314548  1849 tablet_service.cc:1511] Processing CreateTablet for tablet c985e8fbc66e4639b58195c121f87064 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:55.314980  1854 tablet_service.cc:1511] Processing CreateTablet for tablet 0c0527b2b59c417e911b3c8cf84097c3 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:55.286247  1923 tablet_service.cc:1511] Processing CreateTablet for tablet 7c1a2e56cecf4e38996722158f558c83 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:55.316792  1851 tablet_service.cc:1511] Processing CreateTablet for tablet bcf34f0950744055ae62c5549345ebea (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:55.317600  1923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1a2e56cecf4e38996722158f558c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.318903  1925 tablet_service.cc:1511] Processing CreateTablet for tablet 0c0527b2b59c417e911b3c8cf84097c3 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:55.320226  1925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c0527b2b59c417e911b3c8cf84097c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.320538  1780 tablet_service.cc:1511] Processing CreateTablet for tablet bcf34f0950744055ae62c5549345ebea (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:55.323596  1779 tablet_service.cc:1511] Processing CreateTablet for tablet 0c0527b2b59c417e911b3c8cf84097c3 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:55.326697  1782 tablet_service.cc:1511] Processing CreateTablet for tablet 736ca23d551a4ef1961d8bbae514ee17 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:55.326999  1775 tablet_service.cc:1511] Processing CreateTablet for tablet c15ac382d7774eb2859836cf196b742e (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:55.329228  1929 tablet_service.cc:1511] Processing CreateTablet for tablet 736ca23d551a4ef1961d8bbae514ee17 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:55.329700  1857 tablet_service.cc:1511] Processing CreateTablet for tablet 736ca23d551a4ef1961d8bbae514ee17 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:55.330730  1929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736ca23d551a4ef1961d8bbae514ee17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.286255  1853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0ec4ba9e3a4d9cbf618356a9c38c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.332332  1852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1a2e56cecf4e38996722158f558c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.333068  1857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736ca23d551a4ef1961d8bbae514ee17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.335850  1854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c0527b2b59c417e911b3c8cf84097c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.321883  1780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcf34f0950744055ae62c5549345ebea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.338352  1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c985e8fbc66e4639b58195c121f87064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.338644  1779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c0527b2b59c417e911b3c8cf84097c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.342376  1782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736ca23d551a4ef1961d8bbae514ee17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.343001  1775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15ac382d7774eb2859836cf196b742e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.345240  1851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcf34f0950744055ae62c5549345ebea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.375013  1850 tablet_service.cc:1511] Processing CreateTablet for tablet c15ac382d7774eb2859836cf196b742e (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:55.376477  1850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15ac382d7774eb2859836cf196b742e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.381283  1926 tablet_service.cc:1511] Processing CreateTablet for tablet c15ac382d7774eb2859836cf196b742e (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:55.382748  1926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15ac382d7774eb2859836cf196b742e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.394397  1856 tablet_service.cc:1511] Processing CreateTablet for tablet 3c2553309c4a4329be077a4382773b09 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:55.395836  1856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c2553309c4a4329be077a4382773b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.399135  1927 tablet_service.cc:1511] Processing CreateTablet for tablet 3c2553309c4a4329be077a4382773b09 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:55.401331  1927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c2553309c4a4329be077a4382773b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.401477  1776 tablet_service.cc:1511] Processing CreateTablet for tablet 3c2553309c4a4329be077a4382773b09 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:55.402954  1776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c2553309c4a4329be077a4382773b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.406332  1855 tablet_service.cc:1511] Processing CreateTablet for tablet 7f29ef435a564d638d769c7a8b74c3a9 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:55.407699  1855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f29ef435a564d638d769c7a8b74c3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.409734  2084 tablet_bootstrap.cc:492] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:55.420162  1775 tablet_service.cc:1511] Processing CreateTablet for tablet 7f29ef435a564d638d769c7a8b74c3a9 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:55.421669  1775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f29ef435a564d638d769c7a8b74c3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.435629  2083 tablet_bootstrap.cc:492] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:55.438318  2084 tablet_bootstrap.cc:654] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.438570  1926 tablet_service.cc:1511] Processing CreateTablet for tablet 7f29ef435a564d638d769c7a8b74c3a9 (DEFAULT_TABLE table=soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:55.439774  1926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f29ef435a564d638d769c7a8b74c3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.488651  2085 tablet_bootstrap.cc:492] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:55.498637  2083 tablet_bootstrap.cc:654] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.507526  2084 tablet_bootstrap.cc:492] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:55.508113  2085 tablet_bootstrap.cc:654] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.508134  2084 ts_tablet_manager.cc:1403] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.099s	user 0.005s	sys 0.012s
W20260709 12:23:55.509328  1738 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:55.511559  2083 tablet_bootstrap.cc:492] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:55.512226  2083 ts_tablet_manager.cc:1403] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.005s
I20260709 12:23:55.513818  2084 raft_consensus.cc:359] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.515061  2084 raft_consensus.cc:385] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.515173  2083 raft_consensus.cc:359] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.515465  2084 raft_consensus.cc:740] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.515941  2083 raft_consensus.cc:385] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.516288  2083 raft_consensus.cc:740] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.516876  2085 tablet_bootstrap.cc:492] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:55.516536  2084 consensus_queue.cc:260] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.517416  2085 ts_tablet_manager.cc:1403] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 12:23:55.517014  2083 consensus_queue.cc:260] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.519546  2083 ts_tablet_manager.cc:1434] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:55.520606  2085 raft_consensus.cc:359] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.521317  2085 raft_consensus.cc:385] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.521610  2085 raft_consensus.cc:740] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.522228  2083 tablet_bootstrap.cc:492] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:55.522451  2085 consensus_queue.cc:260] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.522723  2084 ts_tablet_manager.cc:1434] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:23:55.524830  2085 ts_tablet_manager.cc:1434] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:23:55.527026  2084 tablet_bootstrap.cc:492] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:55.527071  2085 tablet_bootstrap.cc:492] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:55.530619  2083 tablet_bootstrap.cc:654] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.534807  2085 tablet_bootstrap.cc:654] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.543140  2083 tablet_bootstrap.cc:492] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:55.543751  2083 ts_tablet_manager.cc:1403] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:23:55.544575  2085 tablet_bootstrap.cc:492] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:55.545145  2085 ts_tablet_manager.cc:1403] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.009s
I20260709 12:23:55.548202  2083 raft_consensus.cc:359] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.549105  2083 raft_consensus.cc:385] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.549408  2083 raft_consensus.cc:740] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.550218  2083 consensus_queue.cc:260] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.551630  2084 tablet_bootstrap.cc:654] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.553267  2085 raft_consensus.cc:359] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.554097  2085 raft_consensus.cc:385] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.554418  2085 raft_consensus.cc:740] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.554545  2083 ts_tablet_manager.cc:1434] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:23:55.555733  2083 tablet_bootstrap.cc:492] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:55.556206  2085 consensus_queue.cc:260] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.558763  2085 ts_tablet_manager.cc:1434] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:23:55.559819  2085 tablet_bootstrap.cc:492] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:55.563560  2083 tablet_bootstrap.cc:654] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.566720  2085 tablet_bootstrap.cc:654] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.574735  2085 tablet_bootstrap.cc:492] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:55.575260  2085 ts_tablet_manager.cc:1403] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:23:55.577795  2005 raft_consensus.cc:493] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.578490  2085 raft_consensus.cc:359] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.578585  2005 raft_consensus.cc:515] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.579705  2085 raft_consensus.cc:385] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.580199  2085 raft_consensus.cc:740] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.581204  2085 consensus_queue.cc:260] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.582103  2005 leader_election.cc:290] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:55.583601  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:55.584052  2085 ts_tablet_manager.cc:1434] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:55.584317  1865 raft_consensus.cc:2468] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:55.585314  2085 tablet_bootstrap.cc:492] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:55.585748  2084 tablet_bootstrap.cc:492] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:55.586355  2084 ts_tablet_manager.cc:1403] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.008s
I20260709 12:23:55.586135  1905 leader_election.cc:304] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:55.587332  2005 raft_consensus.cc:2804] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:55.587742  2005 raft_consensus.cc:493] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.588109  2005 raft_consensus.cc:3060] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.592681  2085 tablet_bootstrap.cc:654] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.592221  2084 raft_consensus.cc:359] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.593856  2084 raft_consensus.cc:385] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.594347  2084 raft_consensus.cc:740] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.595299  2084 consensus_queue.cc:260] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.601061  2084 ts_tablet_manager.cc:1434] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:23:55.601987  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:55.602380  2084 tablet_bootstrap.cc:492] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:55.608552  2083 tablet_bootstrap.cc:492] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:55.609263  2083 ts_tablet_manager.cc:1403] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.005s
W20260709 12:23:55.609081  1904 leader_election.cc:343] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.613104  2083 raft_consensus.cc:359] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.613951  2083 raft_consensus.cc:385] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.614426  2083 raft_consensus.cc:740] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.615267  2083 consensus_queue.cc:260] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.616863  2005 raft_consensus.cc:515] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.620501  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:55.621184  2084 tablet_bootstrap.cc:654] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:55.622416  1904 leader_election.cc:343] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.625119  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:55.625984  1865 raft_consensus.cc:3060] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.638178  2005 leader_election.cc:290] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:55.637698  1865 raft_consensus.cc:2468] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:55.646934  2083 ts_tablet_manager.cc:1434] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.037s	user 0.019s	sys 0.018s
I20260709 12:23:55.647434  1905 leader_election.cc:304] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 52eb7d01f58f41e5b4af98bcc2f0a92a
I20260709 12:23:55.648048  2083 tablet_bootstrap.cc:492] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:55.650527  2096 raft_consensus.cc:2804] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:55.651568  2096 raft_consensus.cc:697] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Leader. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:55.652801  2096 consensus_queue.cc:237] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.655821  2083 tablet_bootstrap.cc:654] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.660054  2085 tablet_bootstrap.cc:492] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:55.660987  2085 ts_tablet_manager.cc:1403] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.031s
I20260709 12:23:55.668025  2085 raft_consensus.cc:359] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.668748  2083 tablet_bootstrap.cc:492] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:55.669366  2083 ts_tablet_manager.cc:1403] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:23:55.671473  2072 raft_consensus.cc:493] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.671361  1689 catalog_manager.cc:5697] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "ec496778059d40cbb4afab0fe1a51a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.672030  2072 raft_consensus.cc:515] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.672654  2083 raft_consensus.cc:359] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.673399  2083 raft_consensus.cc:385] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.668810  2085 raft_consensus.cc:385] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.673741  2083 raft_consensus.cc:740] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.673952  2085 raft_consensus.cc:740] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.674737  2083 consensus_queue.cc:260] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.674829  2085 consensus_queue.cc:260] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.675315  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0527b2b59c417e911b3c8cf84097c3" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
W20260709 12:23:55.676901  1830 leader_election.cc:343] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.677309  2083 ts_tablet_manager.cc:1434] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:55.678416  2083 tablet_bootstrap.cc:492] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:55.679302  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0527b2b59c417e911b3c8cf84097c3" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:55.679982  1940 raft_consensus.cc:2468] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 0.
I20260709 12:23:55.681360  1830 leader_election.cc:304] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 52eb7d01f58f41e5b4af98bcc2f0a92a
I20260709 12:23:55.677815  2072 leader_election.cc:290] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:55.682998  2072 raft_consensus.cc:2804] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:55.683346  2072 raft_consensus.cc:493] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.683713  2072 raft_consensus.cc:3060] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.684172  2085 ts_tablet_manager.cc:1434] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.003s
I20260709 12:23:55.685271  2085 tablet_bootstrap.cc:492] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:55.685843  2083 tablet_bootstrap.cc:654] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.686785  2084 tablet_bootstrap.cc:492] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:55.687336  2084 ts_tablet_manager.cc:1403] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.026s
I20260709 12:23:55.691578  2094 raft_consensus.cc:493] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.692265  2094 raft_consensus.cc:515] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.696014  2094 leader_election.cc:290] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:55.696013  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0ec4ba9e3a4d9cbf618356a9c38c59" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:55.696370  2085 tablet_bootstrap.cc:654] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:55.697628  1756 leader_election.cc:343] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.698738  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0ec4ba9e3a4d9cbf618356a9c38c59" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:55.699510  2083 tablet_bootstrap.cc:492] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:55.699448  1940 raft_consensus.cc:2468] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 0.
I20260709 12:23:55.700232  2083 ts_tablet_manager.cc:1403] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.002s
I20260709 12:23:55.700902  1755 leader_election.cc:304] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: d17bb92572974f0f967e6aa2337d5226
I20260709 12:23:55.702278  2094 raft_consensus.cc:2804] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:55.702690  2094 raft_consensus.cc:493] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.703080  2094 raft_consensus.cc:3060] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.702783  2072 raft_consensus.cc:515] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.705076  2072 leader_election.cc:290] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:55.706544  2084 raft_consensus.cc:359] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.707080  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0527b2b59c417e911b3c8cf84097c3" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:55.707346  2084 raft_consensus.cc:385] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.707770  2084 raft_consensus.cc:740] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.707989  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0527b2b59c417e911b3c8cf84097c3" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:55.709017  1940 raft_consensus.cc:3060] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.709192  2084 consensus_queue.cc:260] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
W20260709 12:23:55.712879  1830 leader_election.cc:343] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.714468  2084 ts_tablet_manager.cc:1434] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 12:23:55.714183  2094 raft_consensus.cc:515] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.714882  2083 raft_consensus.cc:359] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.715827  2084 tablet_bootstrap.cc:492] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:55.716153  2083 raft_consensus.cc:385] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.716547  2083 raft_consensus.cc:740] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.717348  2083 consensus_queue.cc:260] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.720763  2083 ts_tablet_manager.cc:1434] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:23:55.721944  2083 tablet_bootstrap.cc:492] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:55.722370  2094 leader_election.cc:290] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 election: Requested vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:55.723697  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0ec4ba9e3a4d9cbf618356a9c38c59" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:55.725441  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0ec4ba9e3a4d9cbf618356a9c38c59" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:55.726161  1941 raft_consensus.cc:3060] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.726800  2084 tablet_bootstrap.cc:654] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.729315  1940 raft_consensus.cc:2468] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 1.
W20260709 12:23:55.730930  1756 leader_election.cc:343] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.735567  1830 leader_election.cc:304] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 52eb7d01f58f41e5b4af98bcc2f0a92a
I20260709 12:23:55.737015  2072 raft_consensus.cc:2804] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:55.737560  2072 raft_consensus.cc:697] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Becoming Leader. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Running, Role: LEADER
I20260709 12:23:55.738567  2083 tablet_bootstrap.cc:654] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.739540  1941 raft_consensus.cc:2468] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 1.
I20260709 12:23:55.738567  2072 consensus_queue.cc:237] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.741361  1755 leader_election.cc:304] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: d17bb92572974f0f967e6aa2337d5226
I20260709 12:23:55.743011  2094 raft_consensus.cc:2804] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:55.743659  2094 raft_consensus.cc:697] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 LEADER]: Becoming Leader. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Running, Role: LEADER
I20260709 12:23:55.744709  2094 consensus_queue.cc:237] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.756544  2085 tablet_bootstrap.cc:492] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:55.757118  2085 ts_tablet_manager.cc:1403] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.072s	user 0.007s	sys 0.023s
I20260709 12:23:55.757174  2084 tablet_bootstrap.cc:492] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:55.757772  2084 ts_tablet_manager.cc:1403] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.018s
I20260709 12:23:55.760501  2085 raft_consensus.cc:359] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.761288  2084 raft_consensus.cc:359] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.761363  2085 raft_consensus.cc:385] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.762121  2084 raft_consensus.cc:385] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.762202  2085 raft_consensus.cc:740] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.762460  2084 raft_consensus.cc:740] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.763192  2085 consensus_queue.cc:260] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.763504  2084 consensus_queue.cc:260] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.765744  2085 ts_tablet_manager.cc:1434] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:23:55.766232  2084 ts_tablet_manager.cc:1434] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:23:55.768064  2085 tablet_bootstrap.cc:492] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:55.766338  2094 raft_consensus.cc:493] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.768193  1687 catalog_manager.cc:5697] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a reported cstate change: term changed from 0 to 1, leader changed from <none> to 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193). New cstate: current_term: 1 leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.769622  2094 raft_consensus.cc:515] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.771804  2094 leader_election.cc:290] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:55.772719  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ca23d551a4ef1961d8bbae514ee17" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:55.773466  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ca23d551a4ef1961d8bbae514ee17" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
W20260709 12:23:55.774724  1756 leader_election.cc:343] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:55.775270  1755 leader_election.cc:343] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.775731  1755 leader_election.cc:304] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a; no voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76
I20260709 12:23:55.776887  2070 raft_consensus.cc:2749] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:55.775745  2094 raft_consensus.cc:493] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.776944  1689 catalog_manager.cc:5697] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 reported cstate change: term changed from 0 to 1, leader changed from <none> to d17bb92572974f0f967e6aa2337d5226 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "d17bb92572974f0f967e6aa2337d5226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.778162  2094 raft_consensus.cc:515] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.768162  2084 tablet_bootstrap.cc:492] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:55.782063  2085 tablet_bootstrap.cc:654] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.782837  2083 tablet_bootstrap.cc:492] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:55.785203  2083 ts_tablet_manager.cc:1403] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.063s	user 0.022s	sys 0.001s
I20260709 12:23:55.788586  2084 tablet_bootstrap.cc:654] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.789819  2083 raft_consensus.cc:359] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.790799  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c985e8fbc66e4639b58195c121f87064" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:55.791064  2083 raft_consensus.cc:385] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.791574  1865 raft_consensus.cc:2468] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 0.
I20260709 12:23:55.791679  2083 raft_consensus.cc:740] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.793038  2083 consensus_queue.cc:260] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.795542  1756 leader_election.cc:304] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: 
I20260709 12:23:55.796083  2083 ts_tablet_manager.cc:1434] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:23:55.796619  2070 raft_consensus.cc:2804] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:55.797046  2070 raft_consensus.cc:493] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.797359  2083 tablet_bootstrap.cc:492] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:55.797401  2070 raft_consensus.cc:3060] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.804905  2083 tablet_bootstrap.cc:654] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.808758  2094 leader_election.cc:290] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:55.809407  2070 raft_consensus.cc:515] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.810745  2005 raft_consensus.cc:493] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.811121  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c985e8fbc66e4639b58195c121f87064" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:55.811298  2005 raft_consensus.cc:515] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.813611  2005 leader_election.cc:290] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:55.813845  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c985e8fbc66e4639b58195c121f87064" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:55.814693  2072 raft_consensus.cc:493] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.815205  2072 raft_consensus.cc:515] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.816259  2070 leader_election.cc:290] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 election: Requested vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:55.817327  2072 leader_election.cc:290] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:55.818733  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c985e8fbc66e4639b58195c121f87064" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:55.819820  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c985e8fbc66e4639b58195c121f87064" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:55.819943  1941 raft_consensus.cc:2468] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 0.
I20260709 12:23:55.820458  1865 raft_consensus.cc:3060] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.821264  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1a2e56cecf4e38996722158f558c83" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:55.821506  1791 raft_consensus.cc:2393] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec496778059d40cbb4afab0fe1a51a76 in current term 1: Already voted for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in this term.
I20260709 12:23:55.822845  1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c985e8fbc66e4639b58195c121f87064" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:55.822052  2072 raft_consensus.cc:493] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.823937  2072 raft_consensus.cc:515] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
W20260709 12:23:55.822853  1830 leader_election.cc:343] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.826143  2072 leader_election.cc:290] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:55.827011  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15ac382d7774eb2859836cf196b742e" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:55.827811  1791 raft_consensus.cc:2468] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 0.
I20260709 12:23:55.829944  1830 leader_election.cc:304] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: 
I20260709 12:23:55.830397  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1a2e56cecf4e38996722158f558c83" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
W20260709 12:23:55.831590  1830 leader_election.cc:343] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.830169  2085 tablet_bootstrap.cc:492] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:55.832051  1865 raft_consensus.cc:2468] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 1.
I20260709 12:23:55.832288  2072 raft_consensus.cc:2804] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:55.832058  1830 leader_election.cc:304] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226; no voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76
I20260709 12:23:55.832522  2085 ts_tablet_manager.cc:1403] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.014s
I20260709 12:23:55.833250  2101 raft_consensus.cc:2749] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:55.833632  1756 leader_election.cc:304] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: ec496778059d40cbb4afab0fe1a51a76
I20260709 12:23:55.834824  2070 raft_consensus.cc:2804] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:55.834738  1904 leader_election.cc:304] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec496778059d40cbb4afab0fe1a51a76; no voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226
I20260709 12:23:55.836087  2070 raft_consensus.cc:697] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 LEADER]: Becoming Leader. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Running, Role: LEADER
I20260709 12:23:55.837221  2084 tablet_bootstrap.cc:492] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:55.837325  2070 consensus_queue.cc:237] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.838317  2005 raft_consensus.cc:3060] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.837538  2085 raft_consensus.cc:359] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.838963  2085 raft_consensus.cc:385] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.839668  2085 raft_consensus.cc:740] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.840826  2085 consensus_queue.cc:260] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.832916  2072 raft_consensus.cc:493] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.842198  2072 raft_consensus.cc:3060] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.851202  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15ac382d7774eb2859836cf196b742e" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:55.851887  1941 raft_consensus.cc:2468] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 0.
I20260709 12:23:55.837854  2084 ts_tablet_manager.cc:1403] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.001s
I20260709 12:23:55.849787  2005 raft_consensus.cc:2749] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:55.857401  1689 catalog_manager.cc:5697] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a reported cstate change: term changed from 0 to 1, leader changed from <none> to 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193). New cstate: current_term: 1 leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.857779  2084 raft_consensus.cc:359] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.858641  2084 raft_consensus.cc:385] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.858944  2084 raft_consensus.cc:740] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.859542  2084 consensus_queue.cc:260] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.861977  2084 ts_tablet_manager.cc:1434] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:55.862445  2083 tablet_bootstrap.cc:492] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:55.862998  2084 tablet_bootstrap.cc:492] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:55.863379  2085 ts_tablet_manager.cc:1434] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.005s
I20260709 12:23:55.866242  2072 raft_consensus.cc:515] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.863016  2083 ts_tablet_manager.cc:1403] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.012s
I20260709 12:23:55.870692  2084 tablet_bootstrap.cc:654] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.871582  2083 raft_consensus.cc:359] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.872313  2083 raft_consensus.cc:385] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.872617  2083 raft_consensus.cc:740] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.873345  2083 consensus_queue.cc:260] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.875762  2083 ts_tablet_manager.cc:1434] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:55.876632  2085 tablet_bootstrap.cc:492] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:55.878082  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15ac382d7774eb2859836cf196b742e" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:55.878762  1791 raft_consensus.cc:3060] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.883273  2084 tablet_bootstrap.cc:492] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:55.883863  2084 ts_tablet_manager.cc:1403] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 12:23:55.884173  2085 tablet_bootstrap.cc:654] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.876675  2083 tablet_bootstrap.cc:492] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:55.886974  2084 raft_consensus.cc:359] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.887472  1791 raft_consensus.cc:2468] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 1.
I20260709 12:23:55.887760  2084 raft_consensus.cc:385] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.888134  2084 raft_consensus.cc:740] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.889009  1830 leader_election.cc:304] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: 
I20260709 12:23:55.889982  2101 raft_consensus.cc:2804] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:55.890486  2101 raft_consensus.cc:697] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Becoming Leader. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Running, Role: LEADER
I20260709 12:23:55.890760  2072 leader_election.cc:290] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:55.891287  2101 consensus_queue.cc:237] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.892123  2084 consensus_queue.cc:260] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.893334  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15ac382d7774eb2859836cf196b742e" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:55.893770  2083 tablet_bootstrap.cc:654] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.894904  2084 ts_tablet_manager.cc:1434] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:23:55.893898  1941 raft_consensus.cc:3060] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.903548  2083 tablet_bootstrap.cc:492] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:55.904516  2083 ts_tablet_manager.cc:1403] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 12:23:55.907841  1941 raft_consensus.cc:2468] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 1.
I20260709 12:23:55.908450  2083 raft_consensus.cc:359] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.909459  2083 raft_consensus.cc:385] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.909823  2083 raft_consensus.cc:740] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.912367  2084 tablet_bootstrap.cc:492] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:55.910802  2083 consensus_queue.cc:260] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.916422  2083 ts_tablet_manager.cc:1434] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:23:55.917383  2083 tablet_bootstrap.cc:492] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76: Bootstrap starting.
I20260709 12:23:55.923666  2083 tablet_bootstrap.cc:654] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.937107  2084 tablet_bootstrap.cc:654] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.944387  2085 tablet_bootstrap.cc:492] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:55.944943  2085 ts_tablet_manager.cc:1403] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.024s
I20260709 12:23:55.946648  2084 tablet_bootstrap.cc:492] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:55.947314  2084 ts_tablet_manager.cc:1403] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.004s
I20260709 12:23:55.948311  2083 tablet_bootstrap.cc:492] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76: No bootstrap required, opened a new log
I20260709 12:23:55.948180  2085 raft_consensus.cc:359] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.948921  2083 ts_tablet_manager.cc:1403] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.012s
I20260709 12:23:55.949081  2085 raft_consensus.cc:385] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.949419  2085 raft_consensus.cc:740] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.950284  2085 consensus_queue.cc:260] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.950938  2084 raft_consensus.cc:359] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.951967  2084 raft_consensus.cc:385] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.952471  2084 raft_consensus.cc:740] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.952133  2083 raft_consensus.cc:359] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.953085  2083 raft_consensus.cc:385] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.953090  2085 ts_tablet_manager.cc:1434] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:23:55.953486  2083 raft_consensus.cc:740] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.952732  1689 catalog_manager.cc:5697] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 reported cstate change: term changed from 0 to 1, leader changed from <none> to d17bb92572974f0f967e6aa2337d5226 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "d17bb92572974f0f967e6aa2337d5226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.953544  2084 consensus_queue.cc:260] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.954356  2085 tablet_bootstrap.cc:492] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:55.954264  2083 consensus_queue.cc:260] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.956544  2083 ts_tablet_manager.cc:1434] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:23:55.963007  2085 tablet_bootstrap.cc:654] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.964082  2084 ts_tablet_manager.cc:1434] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:55.965281  2084 tablet_bootstrap.cc:492] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:55.973989  2084 tablet_bootstrap.cc:654] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.975930  2085 tablet_bootstrap.cc:492] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:55.976565  2085 ts_tablet_manager.cc:1403] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:23:55.979578  2084 tablet_bootstrap.cc:492] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:55.979308  2085 raft_consensus.cc:359] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.980063  2085 raft_consensus.cc:385] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.980187  2084 ts_tablet_manager.cc:1403] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:23:55.980430  2085 raft_consensus.cc:740] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.981226  2085 consensus_queue.cc:260] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.983425  2085 ts_tablet_manager.cc:1434] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:23:55.983131  2084 raft_consensus.cc:359] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.983877  2084 raft_consensus.cc:385] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.984169  2084 raft_consensus.cc:740] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.984398  2085 tablet_bootstrap.cc:492] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226: Bootstrap starting.
I20260709 12:23:55.984836  2084 consensus_queue.cc:260] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:55.986984  2084 ts_tablet_manager.cc:1434] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:55.988005  2084 tablet_bootstrap.cc:492] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Bootstrap starting.
I20260709 12:23:55.990363  2085 tablet_bootstrap.cc:654] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.994539  2084 tablet_bootstrap.cc:654] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.002663  2085 tablet_bootstrap.cc:492] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226: No bootstrap required, opened a new log
I20260709 12:23:56.002862  2084 tablet_bootstrap.cc:492] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a: No bootstrap required, opened a new log
I20260709 12:23:56.003216  2085 ts_tablet_manager.cc:1403] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:23:56.003491  2084 ts_tablet_manager.cc:1403] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:23:56.006304  2084 raft_consensus.cc:359] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.006551  2085 raft_consensus.cc:359] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.006932  2084 raft_consensus.cc:385] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.007294  2085 raft_consensus.cc:385] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.007378  2084 raft_consensus.cc:740] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.007615  2085 raft_consensus.cc:740] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.008091  2084 consensus_queue.cc:260] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.008414  2085 consensus_queue.cc:260] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.010417  2084 ts_tablet_manager.cc:1434] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:56.010521  2085 ts_tablet_manager.cc:1434] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:56.028394  2005 raft_consensus.cc:493] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.029035  2005 raft_consensus.cc:515] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.031010  2005 leader_election.cc:290] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:56.031828  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c2553309c4a4329be077a4382773b09" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:56.032354  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c2553309c4a4329be077a4382773b09" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:56.032651  1791 raft_consensus.cc:2468] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:56.033107  1865 raft_consensus.cc:2468] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:56.033946  1904 leader_election.cc:304] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:56.035006  2005 raft_consensus.cc:2804] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.035462  2005 raft_consensus.cc:493] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.035792  2005 raft_consensus.cc:3060] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.042412  2005 raft_consensus.cc:515] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.044171  2005 leader_election.cc:290] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:56.045128  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c2553309c4a4329be077a4382773b09" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:56.045128  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c2553309c4a4329be077a4382773b09" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:56.046097  1791 raft_consensus.cc:3060] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.046141  1865 raft_consensus.cc:3060] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.053756  1791 raft_consensus.cc:2468] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:56.053756  1865 raft_consensus.cc:2468] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:56.055346  1905 leader_election.cc:304] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:56.056219  2005 raft_consensus.cc:2804] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.056658  2005 raft_consensus.cc:697] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Leader. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:56.057308  2005 consensus_queue.cc:237] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.064898  1687 catalog_manager.cc:5697] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "ec496778059d40cbb4afab0fe1a51a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.067095  2005 raft_consensus.cc:493] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.067741  2005 raft_consensus.cc:515] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.070574  2005 leader_election.cc:290] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:56.070997  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f29ef435a564d638d769c7a8b74c3a9" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:56.071372  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f29ef435a564d638d769c7a8b74c3a9" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:56.071761  1791 raft_consensus.cc:2468] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:56.072106  1865 raft_consensus.cc:2468] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:56.072974  1904 leader_election.cc:304] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:56.074254  2005 raft_consensus.cc:2804] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.074635  2005 raft_consensus.cc:493] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.074975  2005 raft_consensus.cc:3060] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.081347  2005 raft_consensus.cc:515] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.083920  2005 leader_election.cc:290] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:56.084134  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f29ef435a564d638d769c7a8b74c3a9" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:56.084877  1791 raft_consensus.cc:3060] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.086110  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f29ef435a564d638d769c7a8b74c3a9" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:56.086787  1865 raft_consensus.cc:3060] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.092698  1791 raft_consensus.cc:2468] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:56.094202  1865 raft_consensus.cc:2468] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:56.094290  1904 leader_election.cc:304] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:56.095479  2005 raft_consensus.cc:2804] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.095980  2005 raft_consensus.cc:697] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Leader. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:56.096833  2005 consensus_queue.cc:237] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.103893  1687 catalog_manager.cc:5697] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "ec496778059d40cbb4afab0fe1a51a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.109467  2101 raft_consensus.cc:493] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.110157  2101 raft_consensus.cc:515] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.112485  2101 leader_election.cc:290] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:56.114604  1791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0ec4ba9e3a4d9cbf618356a9c38c59" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:56.115263  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0ec4ba9e3a4d9cbf618356a9c38c59" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:56.116050  1941 raft_consensus.cc:2393] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d17bb92572974f0f967e6aa2337d5226 in current term 1: Already voted for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in this term.
I20260709 12:23:56.117007  1830 leader_election.cc:304] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226; no voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76
I20260709 12:23:56.117794  2101 raft_consensus.cc:3060] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.123948  2101 raft_consensus.cc:2749] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:56.131562  2070 consensus_queue.cc:1048] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.135749  2070 raft_consensus.cc:493] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.136260  2070 raft_consensus.cc:515] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.138345  2005 raft_consensus.cc:493] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.138541  2070 leader_election.cc:290] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:56.139027  1791 raft_consensus.cc:3060] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.138938  2005 raft_consensus.cc:515] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.140506  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec496778059d40cbb4afab0fe1a51a76" is_pre_election: true
I20260709 12:23:56.141224  2005 leader_election.cc:290] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:56.141794  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1a2e56cecf4e38996722158f558c83" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:56.142513  1792 raft_consensus.cc:2468] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:56.143899  1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:56.145071  1867 raft_consensus.cc:2393] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in current term 1: Already voted for candidate ec496778059d40cbb4afab0fe1a51a76 in this term.
I20260709 12:23:56.146697  1756 leader_election.cc:304] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a; no voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76
I20260709 12:23:56.149098  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1a2e56cecf4e38996722158f558c83" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:56.150283  1865 raft_consensus.cc:2468] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:56.150523  2070 raft_consensus.cc:3060] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.143899  1904 leader_election.cc:304] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:56.149212  2101 consensus_queue.cc:1048] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:23:56.152854  2005 raft_consensus.cc:2804] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.153249  2005 raft_consensus.cc:493] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.153614  2005 raft_consensus.cc:3060] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.155716  2094 consensus_queue.cc:1048] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:56.163288  2005 raft_consensus.cc:515] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.166393  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1a2e56cecf4e38996722158f558c83" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:56.167114  1792 raft_consensus.cc:3060] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.172664  2070 raft_consensus.cc:2749] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:56.174971  1792 raft_consensus.cc:2468] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:56.175153  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1a2e56cecf4e38996722158f558c83" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:56.175750  1865 raft_consensus.cc:3060] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.176291  1904 leader_election.cc:304] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:56.177237  2096 raft_consensus.cc:2804] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.185233  1865 raft_consensus.cc:2468] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:56.186154  2005 leader_election.cc:290] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:56.192160  2072 consensus_queue.cc:1048] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.198196  2005 consensus_queue.cc:1048] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:56.207131  2137 raft_consensus.cc:493] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.205490  2134 consensus_queue.cc:1048] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:56.207784  2137 raft_consensus.cc:515] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.211266  1790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ca23d551a4ef1961d8bbae514ee17" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" is_pre_election: true
I20260709 12:23:56.212021  1790 raft_consensus.cc:2468] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:56.221062  2137 leader_election.cc:290] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:56.224303  1904 leader_election.cc:304] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:56.225682  2096 raft_consensus.cc:697] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Leader. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:56.226881  2096 consensus_queue.cc:237] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.228783  2005 raft_consensus.cc:2804] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.229187  2005 raft_consensus.cc:493] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.229548  2005 raft_consensus.cc:3060] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.235597  1865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ca23d551a4ef1961d8bbae514ee17" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226" is_pre_election: true
I20260709 12:23:56.236356  1865 raft_consensus.cc:2468] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 0.
I20260709 12:23:56.244184  2005 raft_consensus.cc:515] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.247766  2005 leader_election.cc:290] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:23:56.248874  1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ca23d551a4ef1961d8bbae514ee17" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:56.249354  1790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ca23d551a4ef1961d8bbae514ee17" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:56.249573  1867 raft_consensus.cc:3060] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.249997  1790 raft_consensus.cc:3060] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.256402  1690 catalog_manager.cc:5697] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "ec496778059d40cbb4afab0fe1a51a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.260604  1867 raft_consensus.cc:2468] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:56.261883  1790 raft_consensus.cc:2468] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 1.
I20260709 12:23:56.261906  1905 leader_election.cc:304] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:23:56.263281  2005 raft_consensus.cc:2804] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.263945  2005 raft_consensus.cc:697] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Leader. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:56.264762  2005 consensus_queue.cc:237] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.277046  1687 catalog_manager.cc:5697] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "ec496778059d40cbb4afab0fe1a51a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.362730  2070 consensus_queue.cc:1048] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.372503  2094 consensus_queue.cc:1048] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.428596  2072 consensus_queue.cc:1048] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.438243  1941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c1a2e56cecf4e38996722158f558c83"
dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
mode: GRACEFUL
new_leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
 from {username='slave'} at 127.0.0.1:52122
I20260709 12:23:56.438879  1941 raft_consensus.cc:606] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Received request to transfer leadership to TS 52eb7d01f58f41e5b4af98bcc2f0a92a
I20260709 12:23:56.441646  2101 consensus_queue.cc:1048] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.458158  1940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea"
dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
mode: GRACEFUL
new_leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
 from {username='slave'} at 127.0.0.1:52122
I20260709 12:23:56.458758  1940 raft_consensus.cc:606] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Received request to transfer leadership to TS 52eb7d01f58f41e5b4af98bcc2f0a92a
I20260709 12:23:56.466773  1940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "736ca23d551a4ef1961d8bbae514ee17"
dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
mode: GRACEFUL
new_leader_uuid: "d17bb92572974f0f967e6aa2337d5226"
 from {username='slave'} at 127.0.0.1:52122
I20260709 12:23:56.467299  1940 raft_consensus.cc:606] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Received request to transfer leadership to TS d17bb92572974f0f967e6aa2337d5226
I20260709 12:23:56.474886  1940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c2553309c4a4329be077a4382773b09"
dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
mode: GRACEFUL
new_leader_uuid: "d17bb92572974f0f967e6aa2337d5226"
 from {username='slave'} at 127.0.0.1:52122
I20260709 12:23:56.475435  1940 raft_consensus.cc:606] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Received request to transfer leadership to TS d17bb92572974f0f967e6aa2337d5226
I20260709 12:23:56.503285  2005 consensus_queue.cc:1048] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.516255  2005 consensus_queue.cc:1048] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.550740  2005 consensus_queue.cc:1048] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.558120  2137 raft_consensus.cc:993] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76: : Instructing follower d17bb92572974f0f967e6aa2337d5226 to start an election
I20260709 12:23:56.558656  2096 raft_consensus.cc:1081] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Signalling peer d17bb92572974f0f967e6aa2337d5226 to start an election
I20260709 12:23:56.560978  1865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c2553309c4a4329be077a4382773b09"
dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
 from {username='slave'} at 127.0.0.1:41980
I20260709 12:23:56.561559  1865 raft_consensus.cc:493] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:56.561957  1865 raft_consensus.cc:3060] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.564658  2096 consensus_queue.cc:1048] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.569559  1865 raft_consensus.cc:515] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.571062  1867 raft_consensus.cc:1240] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Rejecting Update request from peer ec496778059d40cbb4afab0fe1a51a76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:56.572916  1792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c2553309c4a4329be077a4382773b09" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:56.573657  1792 raft_consensus.cc:3060] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.574051  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c2553309c4a4329be077a4382773b09" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:56.574790  1940 raft_consensus.cc:3055] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:56.575115  1940 raft_consensus.cc:740] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:56.575470  1865 leader_election.cc:290] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 2 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:56.575973  1940 consensus_queue.cc:260] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.577214  1940 raft_consensus.cc:3060] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.581859  1792 raft_consensus.cc:2468] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 2.
I20260709 12:23:56.583204  1830 leader_election.cc:304] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: 
I20260709 12:23:56.583511  1940 raft_consensus.cc:2468] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 2.
I20260709 12:23:56.584101  2101 raft_consensus.cc:2804] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:56.584662  2101 raft_consensus.cc:697] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 2 LEADER]: Becoming Leader. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Running, Role: LEADER
I20260709 12:23:56.585567  2101 consensus_queue.cc:237] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.593713  1690 catalog_manager.cc:5697] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 reported cstate change: term changed from 1 to 2, leader changed from ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195) to d17bb92572974f0f967e6aa2337d5226 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "d17bb92572974f0f967e6aa2337d5226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.710762  2005 consensus_queue.cc:1048] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.721521  2096 consensus_queue.cc:1048] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.730854  2134 raft_consensus.cc:993] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76: : Instructing follower d17bb92572974f0f967e6aa2337d5226 to start an election
I20260709 12:23:56.731397  2134 raft_consensus.cc:1081] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Signalling peer d17bb92572974f0f967e6aa2337d5226 to start an election
I20260709 12:23:56.733282  2134 raft_consensus.cc:993] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76: : Instructing follower 52eb7d01f58f41e5b4af98bcc2f0a92a to start an election
I20260709 12:23:56.733719  2135 raft_consensus.cc:1081] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Signalling peer 52eb7d01f58f41e5b4af98bcc2f0a92a to start an election
I20260709 12:23:56.733781  1865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "736ca23d551a4ef1961d8bbae514ee17"
dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
 from {username='slave'} at 127.0.0.1:41980
I20260709 12:23:56.734490  1865 raft_consensus.cc:493] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:56.734959  1865 raft_consensus.cc:3060] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.735778  1792 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea"
dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
 from {username='slave'} at 127.0.0.1:50544
I20260709 12:23:56.736400  1792 raft_consensus.cc:493] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:56.736716  1792 raft_consensus.cc:3060] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.740319  1865 raft_consensus.cc:515] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.742071  1792 raft_consensus.cc:515] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.742949  1790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ca23d551a4ef1961d8bbae514ee17" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:23:56.743273  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ca23d551a4ef1961d8bbae514ee17" candidate_uuid: "d17bb92572974f0f967e6aa2337d5226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:56.743623  1790 raft_consensus.cc:3060] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.744050  1940 raft_consensus.cc:3055] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:56.745994  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:56.745303  1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:56.746690  1941 raft_consensus.cc:3055] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:56.746122  1940 raft_consensus.cc:740] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:56.747165  1941 raft_consensus.cc:740] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:56.747901  1940 consensus_queue.cc:260] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.746726  1867 raft_consensus.cc:3060] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.742108  1865 leader_election.cc:290] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 2 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:56.747901  1941 consensus_queue.cc:260] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.744643  1792 leader_election.cc:290] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 2 election: Requested vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:56.749351  1941 raft_consensus.cc:3060] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.751031  1940 raft_consensus.cc:3060] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.751063  1790 raft_consensus.cc:2468] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 2.
I20260709 12:23:56.754070  1830 leader_election.cc:304] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: 
I20260709 12:23:56.754946  2101 raft_consensus.cc:2804] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:56.755455  2101 raft_consensus.cc:697] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 2 LEADER]: Becoming Leader. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Running, Role: LEADER
I20260709 12:23:56.756327  2101 consensus_queue.cc:237] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.756762  1867 raft_consensus.cc:2468] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 2.
I20260709 12:23:56.758016  1756 leader_election.cc:304] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: 
I20260709 12:23:56.758986  2094 raft_consensus.cc:2804] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:56.759440  2094 raft_consensus.cc:697] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Becoming Leader. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Running, Role: LEADER
I20260709 12:23:56.760258  2094 consensus_queue.cc:237] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.762218  1941 raft_consensus.cc:2468] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 2.
I20260709 12:23:56.763022  1940 raft_consensus.cc:2468] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17bb92572974f0f967e6aa2337d5226 in term 2.
I20260709 12:23:56.767565  1690 catalog_manager.cc:5697] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 reported cstate change: term changed from 1 to 2, leader changed from ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195) to d17bb92572974f0f967e6aa2337d5226 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "d17bb92572974f0f967e6aa2337d5226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.773747  1689 catalog_manager.cc:5697] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a reported cstate change: term changed from 1 to 2, leader changed from ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195) to 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193). New cstate: current_term: 2 leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.802341  2135 consensus_queue.cc:1048] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.812835  2096 consensus_queue.cc:1048] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.823673  2096 raft_consensus.cc:993] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76: : Instructing follower 52eb7d01f58f41e5b4af98bcc2f0a92a to start an election
I20260709 12:23:56.824177  2135 raft_consensus.cc:1081] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Signalling peer 52eb7d01f58f41e5b4af98bcc2f0a92a to start an election
I20260709 12:23:56.825863  1792 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c1a2e56cecf4e38996722158f558c83"
dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
 from {username='slave'} at 127.0.0.1:50544
I20260709 12:23:56.826550  1792 raft_consensus.cc:493] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:56.826931  1792 raft_consensus.cc:3060] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.832325  1792 raft_consensus.cc:515] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.834403  1792 leader_election.cc:290] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 2 election: Requested vote from peers d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463), ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753)
I20260709 12:23:56.835338  1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1a2e56cecf4e38996722158f558c83" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:23:56.835846  1940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1a2e56cecf4e38996722158f558c83" candidate_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
I20260709 12:23:56.836047  1867 raft_consensus.cc:3060] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.836746  1940 raft_consensus.cc:3055] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:56.837105  1940 raft_consensus.cc:740] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:23:56.837927  1940 consensus_queue.cc:260] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.839265  1940 raft_consensus.cc:3060] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.843272  1867 raft_consensus.cc:2468] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 2.
I20260709 12:23:56.844422  1756 leader_election.cc:304] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, d17bb92572974f0f967e6aa2337d5226; no voters: 
I20260709 12:23:56.845127  2094 raft_consensus.cc:2804] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:56.845592  2094 raft_consensus.cc:697] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Becoming Leader. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Running, Role: LEADER
I20260709 12:23:56.845678  1940 raft_consensus.cc:2468] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52eb7d01f58f41e5b4af98bcc2f0a92a in term 2.
I20260709 12:23:56.846498  2094 consensus_queue.cc:237] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:23:56.853128  1690 catalog_manager.cc:5697] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a reported cstate change: term changed from 1 to 2, leader changed from ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195) to 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193). New cstate: current_term: 2 leader_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.024883  1941 raft_consensus.cc:1275] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Refusing update from remote peer d17bb92572974f0f967e6aa2337d5226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.026190  2101 consensus_queue.cc:1048] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.034881  1792 raft_consensus.cc:1275] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Refusing update from remote peer d17bb92572974f0f967e6aa2337d5226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.036235  2101 consensus_queue.cc:1048] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.192934  1867 raft_consensus.cc:1275] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Refusing update from remote peer 52eb7d01f58f41e5b4af98bcc2f0a92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.194353  2094 consensus_queue.cc:1048] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.202943  1941 raft_consensus.cc:1275] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Refusing update from remote peer 52eb7d01f58f41e5b4af98bcc2f0a92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.204545  2094 consensus_queue.cc:1048] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.292847  1867 raft_consensus.cc:1275] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Refusing update from remote peer 52eb7d01f58f41e5b4af98bcc2f0a92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.294618  2094 consensus_queue.cc:1048] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.296475  1941 raft_consensus.cc:1275] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Refusing update from remote peer d17bb92572974f0f967e6aa2337d5226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.297768  2101 consensus_queue.cc:1048] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.303365  1940 raft_consensus.cc:1275] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Refusing update from remote peer 52eb7d01f58f41e5b4af98bcc2f0a92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.304946  2155 consensus_queue.cc:1048] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.310659  1792 raft_consensus.cc:1275] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Refusing update from remote peer d17bb92572974f0f967e6aa2337d5226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.314414  2101 consensus_queue.cc:1048] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.481840  1687 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42342:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:23:59.506644  1687 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42342:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:23:59.555626 23879 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:23:59.704816  2170 log.cc:927] Time spent T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Append to log took a long time: real 0.056s	user 0.002s	sys 0.000s
W20260709 12:23:59.794140  2180 log.cc:927] Time spent T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:23:59.845911  2189 log.cc:927] Time spent T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:23:59.869563  2186 log.cc:927] Time spent T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
W20260709 12:23:59.872941  2184 log.cc:927] Time spent T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:23:59.902184  2204 tablet.cc:1724] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:59.913687  2203 tablet.cc:1724] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:59.915107  2200 tablet.cc:1724] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:59.906729  2193 log.cc:927] Time spent T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:23:59.926177  1893 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:736ca23d551a4ef1961d8bbae514ee17)
W20260709 12:23:59.935657  2197 log.cc:927] Time spent T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 12:23:59.940316  2215 tablet.cc:1724] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:59.948009  2195 log.cc:927] Time spent T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:23:59.955884  1866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c0527b2b59c417e911b3c8cf84097c3"
dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
mode: GRACEFUL
new_leader_uuid: "ec496778059d40cbb4afab0fe1a51a76"
 from {username='slave'} at 127.0.0.1:49388
I20260709 12:23:59.957023  1866 raft_consensus.cc:606] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Received request to transfer leadership to TS ec496778059d40cbb4afab0fe1a51a76
I20260709 12:23:59.998509  2222 tablet.cc:1724] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:00.000259  1893 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:736ca23d551a4ef1961d8bbae514ee17)
W20260709 12:24:00.007169  1893 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:736ca23d551a4ef1961d8bbae514ee17)
I20260709 12:24:00.010331  2213 tablet.cc:1724] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.110625  2217 tablet.cc:1724] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.112730  2200 tablet.cc:1724] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:00.122720  1830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:46839, user_credentials={real_user=slave}} blocked reactor thread for 73505.4us
I20260709 12:24:00.126556  2221 tablet.cc:1724] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.123139  2219 tablet.cc:1724] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:00.131937  1755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:39753, user_credentials={real_user=slave}} blocked reactor thread for 84860.5us
I20260709 12:24:00.135253  2223 tablet.cc:1724] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.154878  2201 raft_consensus.cc:993] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226: : Instructing follower ec496778059d40cbb4afab0fe1a51a76 to start an election
I20260709 12:24:00.155707  2201 raft_consensus.cc:1081] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Signalling peer ec496778059d40cbb4afab0fe1a51a76 to start an election
I20260709 12:24:00.114727  2210 tablet.cc:1724] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.162868  2224 tablet.cc:1724] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.166188  1935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c0527b2b59c417e911b3c8cf84097c3"
dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
 from {username='slave'} at 127.0.0.1:52120
I20260709 12:24:00.167065  1935 raft_consensus.cc:493] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:00.167601  1935 raft_consensus.cc:3060] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.170960  2221 tablet.cc:1724] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.187340  1935 raft_consensus.cc:515] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:24:00.200331  1789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0527b2b59c417e911b3c8cf84097c3" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:24:00.201742  1789 raft_consensus.cc:3060] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.216456  2203 tablet.cc:1724] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.228247  2200 tablet.cc:1724] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.232091  1789 raft_consensus.cc:2468] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 2.
I20260709 12:24:00.233733  1904 leader_election.cc:304] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:24:00.234760  2135 raft_consensus.cc:2804] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:00.235280  2135 raft_consensus.cc:697] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 2 LEADER]: Becoming Leader. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:24:00.236289  2135 consensus_queue.cc:237] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:24:00.239773  2222 tablet.cc:1724] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.246619  1690 catalog_manager.cc:5697] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 reported cstate change: term changed from 1 to 2, leader changed from d17bb92572974f0f967e6aa2337d5226 (127.23.81.194) to ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "ec496778059d40cbb4afab0fe1a51a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:00.221534  1935 leader_election.cc:290] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 2 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:24:00.253360  1789 raft_consensus.cc:1240] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Rejecting Update request from peer d17bb92572974f0f967e6aa2337d5226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:00.250149  2204 tablet.cc:1724] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.249168  2224 tablet.cc:1724] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.258455  1861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0527b2b59c417e911b3c8cf84097c3" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:24:00.260171  2210 tablet.cc:1724] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.252774  2221 tablet.cc:1724] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.262104  2223 tablet.cc:1724] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.268707  2202 consensus_queue.cc:1059] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:00.266377  1861 raft_consensus.cc:3055] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:00.270639  1861 raft_consensus.cc:740] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Running, Role: LEADER
I20260709 12:24:00.273877  2200 tablet.cc:1724] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.275367  2215 tablet.cc:1724] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.251420  1690 catalog_manager.cc:5789] TS ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195:39753) does not have the latest schema for tablet 0c0527b2b59c417e911b3c8cf84097c3 (table soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96]). Expected version 1 got 0
I20260709 12:24:00.283550  1861 consensus_queue.cc:260] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:24:00.291226  1861 raft_consensus.cc:3060] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.295939  2203 tablet.cc:1724] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.303043  2210 tablet.cc:1724] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:00.315040  1789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea"
dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
mode: GRACEFUL
new_leader_uuid: "ec496778059d40cbb4afab0fe1a51a76"
 from {username='slave'} at 127.0.0.1:39854
I20260709 12:24:00.316072  1789 raft_consensus.cc:606] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Received request to transfer leadership to TS ec496778059d40cbb4afab0fe1a51a76
I20260709 12:24:00.318377 23879 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:24:00.319041 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:00.323966  1861 raft_consensus.cc:2468] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 2.
W20260709 12:24:00.324622  2201 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:24:00.351709  1861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6350cb1eb71940c28679038777d2da89"
dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
mode: GRACEFUL
new_leader_uuid: "ec496778059d40cbb4afab0fe1a51a76"
 from {username='slave'} at 127.0.0.1:49388
I20260709 12:24:00.352607  1861 raft_consensus.cc:606] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Received request to transfer leadership to TS ec496778059d40cbb4afab0fe1a51a76
I20260709 12:24:00.353646  1689 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48: soft_deleted_table [id=522b5dbd920e4d6488fe46c468626a96] alter complete (version 1)
I20260709 12:24:00.358683  1789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7"
dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
mode: GRACEFUL
new_leader_uuid: "ec496778059d40cbb4afab0fe1a51a76"
 from {username='slave'} at 127.0.0.1:39854
I20260709 12:24:00.359385  1789 raft_consensus.cc:606] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Received request to transfer leadership to TS ec496778059d40cbb4afab0fe1a51a76
I20260709 12:24:00.360751 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:00.361367 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:00.368304  2199 raft_consensus.cc:993] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a: : Instructing follower ec496778059d40cbb4afab0fe1a51a76 to start an election
I20260709 12:24:00.368978  2192 raft_consensus.cc:1081] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Signalling peer ec496778059d40cbb4afab0fe1a51a76 to start an election
I20260709 12:24:00.370397  1935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7"
dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
 from {username='slave'} at 127.0.0.1:52116
I20260709 12:24:00.370837  1935 raft_consensus.cc:493] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:00.371179  1935 raft_consensus.cc:3060] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.376415  1935 raft_consensus.cc:515] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:24:00.378147  1935 leader_election.cc:290] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 3 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:24:00.379264  1789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:24:00.379415  1861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd534ab8d78c432d9565c336eef7ebd7" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:24:00.379899  1789 raft_consensus.cc:3055] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:00.380030  1861 raft_consensus.cc:3060] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.380195  1789 raft_consensus.cc:740] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Running, Role: LEADER
I20260709 12:24:00.381093  1789 consensus_queue.cc:260] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:24:00.382205  1789 raft_consensus.cc:3060] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.385581  1861 raft_consensus.cc:2468] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 3.
I20260709 12:24:00.386940  1905 leader_election.cc:304] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:24:00.387537  1789 raft_consensus.cc:2468] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 3.
I20260709 12:24:00.387691  2135 raft_consensus.cc:2804] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:00.388293  2135 raft_consensus.cc:697] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 3 LEADER]: Becoming Leader. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:24:00.389290  2135 consensus_queue.cc:237] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:24:00.397203  1689 catalog_manager.cc:5697] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 reported cstate change: term changed from 2 to 3, leader changed from 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193) to ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "ec496778059d40cbb4afab0fe1a51a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:00.576807  2199 raft_consensus.cc:993] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a: : Instructing follower ec496778059d40cbb4afab0fe1a51a76 to start an election
I20260709 12:24:00.577284  2192 raft_consensus.cc:1081] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Signalling peer ec496778059d40cbb4afab0fe1a51a76 to start an election
I20260709 12:24:00.578765  1935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea"
dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
 from {username='slave'} at 127.0.0.1:52116
I20260709 12:24:00.579267  1935 raft_consensus.cc:493] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:00.579581  1935 raft_consensus.cc:3060] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.585359  1935 raft_consensus.cc:515] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:24:00.587121  1935 leader_election.cc:290] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 3 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:24:00.588063  1789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:24:00.588266  1861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcf34f0950744055ae62c5549345ebea" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:24:00.588784  1789 raft_consensus.cc:3055] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:00.588814  1861 raft_consensus.cc:3060] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.589336  1789 raft_consensus.cc:740] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 52eb7d01f58f41e5b4af98bcc2f0a92a, State: Running, Role: LEADER
I20260709 12:24:00.590266  1789 consensus_queue.cc:260] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:24:00.591662  1789 raft_consensus.cc:3060] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.597137  1861 raft_consensus.cc:2468] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 3.
I20260709 12:24:00.598614  1905 leader_election.cc:304] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d17bb92572974f0f967e6aa2337d5226, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:24:00.599234  1789 raft_consensus.cc:2468] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 3.
I20260709 12:24:00.599363  2135 raft_consensus.cc:2804] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:00.599996  2135 raft_consensus.cc:697] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 3 LEADER]: Becoming Leader. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:24:00.600765  2135 consensus_queue.cc:237] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:24:00.607432  1689 catalog_manager.cc:5697] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 reported cstate change: term changed from 2 to 3, leader changed from 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193) to ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "ec496778059d40cbb4afab0fe1a51a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:00.703039  2157 raft_consensus.cc:993] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226: : Instructing follower ec496778059d40cbb4afab0fe1a51a76 to start an election
I20260709 12:24:00.703619  2201 raft_consensus.cc:1081] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Signalling peer ec496778059d40cbb4afab0fe1a51a76 to start an election
I20260709 12:24:00.705368  1935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6350cb1eb71940c28679038777d2da89"
dest_uuid: "ec496778059d40cbb4afab0fe1a51a76"
 from {username='slave'} at 127.0.0.1:52120
I20260709 12:24:00.705868  1935 raft_consensus.cc:493] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:00.706230  1935 raft_consensus.cc:3060] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.712322  1935 raft_consensus.cc:515] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:24:00.714516  1935 leader_election.cc:290] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 2 election: Requested vote from peers 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839), d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463)
I20260709 12:24:00.715720  1789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6350cb1eb71940c28679038777d2da89" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a"
I20260709 12:24:00.716374  1861 raft_consensus.cc:1275] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Refusing update from remote peer ec496778059d40cbb4afab0fe1a51a76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:00.716395  1864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6350cb1eb71940c28679038777d2da89" candidate_uuid: "ec496778059d40cbb4afab0fe1a51a76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d17bb92572974f0f967e6aa2337d5226"
I20260709 12:24:00.716881  1789 raft_consensus.cc:3060] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.717296  1864 raft_consensus.cc:3055] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:00.717638  1864 raft_consensus.cc:740] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d17bb92572974f0f967e6aa2337d5226, State: Running, Role: LEADER
I20260709 12:24:00.718370  2135 consensus_queue.cc:1048] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:00.718564  1864 consensus_queue.cc:260] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:24:00.720266  1864 raft_consensus.cc:3060] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.728029  1789 raft_consensus.cc:2468] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 2.
I20260709 12:24:00.729786  1904 leader_election.cc:304] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52eb7d01f58f41e5b4af98bcc2f0a92a, ec496778059d40cbb4afab0fe1a51a76; no voters: 
I20260709 12:24:00.730788  2135 raft_consensus.cc:2804] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:00.738930  2135 raft_consensus.cc:697] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 2 LEADER]: Becoming Leader. State: Replica: ec496778059d40cbb4afab0fe1a51a76, State: Running, Role: LEADER
I20260709 12:24:00.739377  1864 raft_consensus.cc:2468] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec496778059d40cbb4afab0fe1a51a76 in term 2.
I20260709 12:24:00.740206  2135 consensus_queue.cc:237] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } }
I20260709 12:24:00.744827  1789 raft_consensus.cc:1275] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Refusing update from remote peer ec496778059d40cbb4afab0fe1a51a76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:00.753472  2233 consensus_queue.cc:1048] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:00.770527  2224 tablet.cc:1724] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:00.798978  1905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.194:38463, user_credentials={real_user=slave}} blocked reactor thread for 54863.9us
I20260709 12:24:00.809065  1689 catalog_manager.cc:5697] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 reported cstate change: term changed from 1 to 2, leader changed from d17bb92572974f0f967e6aa2337d5226 (127.23.81.194) to ec496778059d40cbb4afab0fe1a51a76 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "ec496778059d40cbb4afab0fe1a51a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec496778059d40cbb4afab0fe1a51a76" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 39753 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:00.897567  1864 raft_consensus.cc:1275] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 3 FOLLOWER]: Refusing update from remote peer ec496778059d40cbb4afab0fe1a51a76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:00.898854  2135 consensus_queue.cc:1048] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:00.908783  1788 raft_consensus.cc:1275] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 3 FOLLOWER]: Refusing update from remote peer ec496778059d40cbb4afab0fe1a51a76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:00.910874  2235 consensus_queue.cc:1048] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:01.121166  1864 raft_consensus.cc:1275] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 3 FOLLOWER]: Refusing update from remote peer ec496778059d40cbb4afab0fe1a51a76: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:01.122543  2237 consensus_queue.cc:1048] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:01.130788  1788 raft_consensus.cc:1275] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 3 FOLLOWER]: Refusing update from remote peer ec496778059d40cbb4afab0fe1a51a76: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:01.132668  2237 consensus_queue.cc:1048] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:01.133594  1867 raft_consensus.cc:1275] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Refusing update from remote peer ec496778059d40cbb4afab0fe1a51a76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:01.135179  2237 consensus_queue.cc:1048] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17bb92572974f0f967e6aa2337d5226" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.154196  1789 raft_consensus.cc:1275] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Refusing update from remote peer ec496778059d40cbb4afab0fe1a51a76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:01.155781  2135 consensus_queue.cc:1048] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52eb7d01f58f41e5b4af98bcc2f0a92a" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.362469 23879 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:01.367718 23879 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:01.368269 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:01.373406 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:01.373852 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:02.540252 23879 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:02.545218 23879 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:02.545692 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:02.550666 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:02.551102 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:24:03.039206  1813 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6c40 after lost signal to thread 23882
W20260709 12:24:03.040297  1813 debug-util.cc:398] Leaking SignalData structure 0x7b0800324fc0 after lost signal to thread 1724
W20260709 12:24:03.041399  1813 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9820 after lost signal to thread 1816
W20260709 12:24:03.042380  1813 debug-util.cc:398] Leaking SignalData structure 0x7b0800322320 after lost signal to thread 1891
W20260709 12:24:03.043331  1813 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6fa0 after lost signal to thread 1965
I20260709 12:24:03.552219 23879 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:03.557600 23879 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:03.558147 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:03.565192 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:03.565877 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:04.567039 23879 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:04.572849 23879 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:04.573304 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:04.577984 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:04.578548 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:05.579563 23879 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:05.585604 23879 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:05.586238 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:05.591301 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:05.591740 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:06.592707 23879 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:06.597929 23879 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:06.598461 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:06.604095 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:06.604595 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:07.605585 23879 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:07.610903 23879 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:07.611393 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:07.616016 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:07.616463 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:08.617803 23879 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:08.625830 23879 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:08.626307 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:08.635321 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:08.635883 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:09.637122 23879 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:09.642766 23879 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:09.643147 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:09.648249 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:09.648609 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:10.709692 23879 tablet_server.cc:179] TabletServer@127.23.81.193:0 shutting down...
I20260709 12:24:10.750589 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:24:10.751096  1904 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 76 similar messages]
I20260709 12:24:10.751631 23879 tablet_replica.cc:333] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.753187 23879 raft_consensus.cc:2243] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.754273 23879 raft_consensus.cc:2272] T 7f29ef435a564d638d769c7a8b74c3a9 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:10.754837  1904 consensus_peers.cc:597] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 -> Peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Couldn't send request to peer 52eb7d01f58f41e5b4af98bcc2f0a92a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:10.757287 23879 tablet_replica.cc:333] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.758008 23879 raft_consensus.cc:2243] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:10.758972 23879 raft_consensus.cc:2272] T 7c1a2e56cecf4e38996722158f558c83 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.761605 23879 tablet_replica.cc:333] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.762252 23879 raft_consensus.cc:2243] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.762893 23879 raft_consensus.cc:2272] T 736ca23d551a4ef1961d8bbae514ee17 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.765852 23879 tablet_replica.cc:333] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.766798 23879 raft_consensus.cc:2243] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.767813 23879 raft_consensus.cc:2272] T 3c2553309c4a4329be077a4382773b09 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:10.769150  1904 consensus_peers.cc:597] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 -> Peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Couldn't send request to peer 52eb7d01f58f41e5b4af98bcc2f0a92a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:10.770709  1904 consensus_peers.cc:597] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 -> Peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Couldn't send request to peer 52eb7d01f58f41e5b4af98bcc2f0a92a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:10.771755 23879 tablet_replica.cc:333] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.772560 23879 raft_consensus.cc:2243] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.773101 23879 raft_consensus.cc:2272] T 8ae14d40a9e84e2aa8475d25c7012814 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.776021 23879 tablet_replica.cc:333] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.776796 23879 raft_consensus.cc:2243] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.777316 23879 raft_consensus.cc:2272] T 204ebd8e8f934d47bdde4570ab093dbd P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.779803 23879 tablet_replica.cc:333] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.780474 23879 raft_consensus.cc:2243] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:10.781368 23879 raft_consensus.cc:2272] T 0a5692423e8146c2aa5a7d110d2e5b1f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.784106 23879 tablet_replica.cc:333] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.784947 23879 raft_consensus.cc:2243] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.785703 23879 raft_consensus.cc:2272] T 3337d6a9deb54745a42082d8b90cfd78 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:10.788496  1830 consensus_peers.cc:597] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 -> Peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Couldn't send request to peer 52eb7d01f58f41e5b4af98bcc2f0a92a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:10.788919 23879 tablet_replica.cc:333] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.789637 23879 raft_consensus.cc:2243] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.790570 23879 raft_consensus.cc:2272] T 0c0527b2b59c417e911b3c8cf84097c3 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.793416 23879 tablet_replica.cc:333] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.794224 23879 raft_consensus.cc:2243] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.794764 23879 raft_consensus.cc:2272] T dd534ab8d78c432d9565c336eef7ebd7 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.797298 23879 tablet_replica.cc:333] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.798259 23879 raft_consensus.cc:2243] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:10.799357 23879 raft_consensus.cc:2272] T c985e8fbc66e4639b58195c121f87064 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.802668 23879 tablet_replica.cc:333] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.803221 23879 raft_consensus.cc:2243] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.803812 23879 raft_consensus.cc:2272] T 6350cb1eb71940c28679038777d2da89 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.806269 23879 tablet_replica.cc:333] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.806847 23879 raft_consensus.cc:2243] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.807384 23879 raft_consensus.cc:2272] T 7da0ef84d5cd4ef9bc143bcdd41205db P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.809947 23879 tablet_replica.cc:333] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.810549 23879 raft_consensus.cc:2243] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.811121 23879 raft_consensus.cc:2272] T c15ac382d7774eb2859836cf196b742e P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.813591 23879 tablet_replica.cc:333] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.814301 23879 raft_consensus.cc:2243] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:10.815202 23879 raft_consensus.cc:2272] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.817732 23879 tablet_replica.cc:333] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.818373 23879 raft_consensus.cc:2243] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:10.819576 23879 raft_consensus.cc:2272] T e7ad485b1679492097b0af78d231b9a0 P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.822431 23879 tablet_replica.cc:333] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.822922 23879 raft_consensus.cc:2243] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.823356 23879 raft_consensus.cc:2272] T bcf34f0950744055ae62c5549345ebea P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.826072 23879 tablet_replica.cc:333] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a: stopping tablet replica
I20260709 12:24:10.826539 23879 raft_consensus.cc:2243] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:10.827509 23879 raft_consensus.cc:2272] T b53e2171173a416d9ed5d38a64f1c20f P 52eb7d01f58f41e5b4af98bcc2f0a92a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.894797 23879 tablet_server.cc:196] TabletServer@127.23.81.193:0 shutdown complete.
I20260709 12:24:10.938752 23879 tablet_server.cc:179] TabletServer@127.23.81.194:0 shutting down...
I20260709 12:24:10.971261 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:10.972059 23879 tablet_replica.cc:333] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:10.972983 23879 raft_consensus.cc:2243] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.973613 23879 raft_consensus.cc:2272] T 7f29ef435a564d638d769c7a8b74c3a9 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.976087 23879 tablet_replica.cc:333] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:10.976778 23879 raft_consensus.cc:2243] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:10.977717 23879 raft_consensus.cc:2272] T 736ca23d551a4ef1961d8bbae514ee17 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.980247 23879 tablet_replica.cc:333] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:10.980916 23879 raft_consensus.cc:2243] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.981501 23879 raft_consensus.cc:2272] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.984619 23879 tablet_replica.cc:333] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:10.985385 23879 raft_consensus.cc:2243] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:10.986486 23879 raft_consensus.cc:2272] T c15ac382d7774eb2859836cf196b742e P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.988906 23879 tablet_replica.cc:333] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:10.989503 23879 raft_consensus.cc:2243] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.990152 23879 raft_consensus.cc:2272] T dd534ab8d78c432d9565c336eef7ebd7 P d17bb92572974f0f967e6aa2337d5226 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.993217 23879 tablet_replica.cc:333] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:10.994136 23879 raft_consensus.cc:2243] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.995007 23879 raft_consensus.cc:2272] T 0c0527b2b59c417e911b3c8cf84097c3 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:10.996589  1830 consensus_peers.cc:597] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 -> Peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Couldn't send request to peer 52eb7d01f58f41e5b4af98bcc2f0a92a. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:10.997756 23879 tablet_replica.cc:333] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:10.998517 23879 raft_consensus.cc:2243] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:10.999393 23879 raft_consensus.cc:2272] T 3c2553309c4a4329be077a4382773b09 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.001683 23879 tablet_replica.cc:333] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:11.002367 23879 raft_consensus.cc:2243] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.003276 23879 raft_consensus.cc:2272] T 8ae14d40a9e84e2aa8475d25c7012814 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.005584 23879 tablet_replica.cc:333] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:11.006251 23879 raft_consensus.cc:2243] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.006757 23879 raft_consensus.cc:2272] T 204ebd8e8f934d47bdde4570ab093dbd P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.009138 23879 tablet_replica.cc:333] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:11.009754 23879 raft_consensus.cc:2243] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.010273 23879 raft_consensus.cc:2272] T 0a5692423e8146c2aa5a7d110d2e5b1f P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.012722 23879 tablet_replica.cc:333] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:11.013324 23879 raft_consensus.cc:2243] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.013893 23879 raft_consensus.cc:2272] T bcf34f0950744055ae62c5549345ebea P d17bb92572974f0f967e6aa2337d5226 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.016808 23879 tablet_replica.cc:333] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:11.017460 23879 raft_consensus.cc:2243] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.018091 23879 raft_consensus.cc:2272] T b53e2171173a416d9ed5d38a64f1c20f P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:11.020776  1904 consensus_peers.cc:597] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 -> Peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Couldn't send request to peer 52eb7d01f58f41e5b4af98bcc2f0a92a. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.021152 23879 tablet_replica.cc:333] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:11.021852 23879 raft_consensus.cc:2243] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.022379 23879 raft_consensus.cc:2272] T e7ad485b1679492097b0af78d231b9a0 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.024746 23879 tablet_replica.cc:333] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:11.025318 23879 raft_consensus.cc:2243] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.025825 23879 raft_consensus.cc:2272] T 7c1a2e56cecf4e38996722158f558c83 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.028317 23879 tablet_replica.cc:333] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:11.028868 23879 raft_consensus.cc:2243] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.029793 23879 raft_consensus.cc:2272] T 3337d6a9deb54745a42082d8b90cfd78 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.032276 23879 tablet_replica.cc:333] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:11.032820 23879 raft_consensus.cc:2243] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.033449 23879 raft_consensus.cc:2272] T c985e8fbc66e4639b58195c121f87064 P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.036213 23879 tablet_replica.cc:333] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:11.036779 23879 raft_consensus.cc:2243] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.037776 23879 raft_consensus.cc:2272] T 7da0ef84d5cd4ef9bc143bcdd41205db P d17bb92572974f0f967e6aa2337d5226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.040345 23879 tablet_replica.cc:333] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226: stopping tablet replica
I20260709 12:24:11.040908 23879 raft_consensus.cc:2243] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.041450 23879 raft_consensus.cc:2272] T 6350cb1eb71940c28679038777d2da89 P d17bb92572974f0f967e6aa2337d5226 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.092310 23879 tablet_server.cc:196] TabletServer@127.23.81.194:0 shutdown complete.
I20260709 12:24:11.134390 23879 tablet_server.cc:179] TabletServer@127.23.81.195:0 shutting down...
I20260709 12:24:11.163733 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:11.164659 23879 tablet_replica.cc:333] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.165782 23879 raft_consensus.cc:2243] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.166544 23879 raft_consensus.cc:2272] T 7c1a2e56cecf4e38996722158f558c83 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:11.167906  1905 consensus_peers.cc:597] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 -> Peer d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463): Couldn't send request to peer d17bb92572974f0f967e6aa2337d5226. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:38463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.169312 23879 tablet_replica.cc:333] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.170277 23879 raft_consensus.cc:2243] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.171212 23879 raft_consensus.cc:2272] T 7f29ef435a564d638d769c7a8b74c3a9 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:11.173966  1905 consensus_peers.cc:597] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 -> Peer d17bb92572974f0f967e6aa2337d5226 (127.23.81.194:38463): Couldn't send request to peer d17bb92572974f0f967e6aa2337d5226. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:38463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.174011 23879 tablet_replica.cc:333] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.174883 23879 raft_consensus.cc:2243] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.175427 23879 raft_consensus.cc:2272] T 736ca23d551a4ef1961d8bbae514ee17 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.178009 23879 tablet_replica.cc:333] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.178714 23879 raft_consensus.cc:2243] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.179378 23879 raft_consensus.cc:2272] T c15ac382d7774eb2859836cf196b742e P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:11.181632  1904 consensus_peers.cc:597] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 -> Peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Couldn't send request to peer 52eb7d01f58f41e5b4af98bcc2f0a92a. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.182199 23879 tablet_replica.cc:333] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.182875 23879 raft_consensus.cc:2243] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.183405 23879 raft_consensus.cc:2272] T 1d0ec4ba9e3a4d9cbf618356a9c38c59 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.185698 23879 tablet_replica.cc:333] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.186380 23879 raft_consensus.cc:2243] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.186872 23879 raft_consensus.cc:2272] T b53e2171173a416d9ed5d38a64f1c20f P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.189232 23879 tablet_replica.cc:333] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.189816 23879 raft_consensus.cc:2243] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.190807 23879 raft_consensus.cc:2272] T bcf34f0950744055ae62c5549345ebea P ec496778059d40cbb4afab0fe1a51a76 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.194222 23879 tablet_replica.cc:333] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.195073 23879 raft_consensus.cc:2243] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.196167 23879 raft_consensus.cc:2272] T 6350cb1eb71940c28679038777d2da89 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.199294 23879 tablet_replica.cc:333] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
W20260709 12:24:11.199553  1904 consensus_peers.cc:597] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 -> Peer 52eb7d01f58f41e5b4af98bcc2f0a92a (127.23.81.193:46839): Couldn't send request to peer 52eb7d01f58f41e5b4af98bcc2f0a92a. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:46839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.200105 23879 raft_consensus.cc:2243] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.200615 23879 raft_consensus.cc:2272] T 7da0ef84d5cd4ef9bc143bcdd41205db P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.202869 23879 tablet_replica.cc:333] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.203507 23879 raft_consensus.cc:2243] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.204006 23879 raft_consensus.cc:2272] T c985e8fbc66e4639b58195c121f87064 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.206300 23879 tablet_replica.cc:333] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.206810 23879 raft_consensus.cc:2243] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.207278 23879 raft_consensus.cc:2272] T 3c2553309c4a4329be077a4382773b09 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.209276 23879 tablet_replica.cc:333] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.209782 23879 raft_consensus.cc:2243] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.210276 23879 raft_consensus.cc:2272] T 8ae14d40a9e84e2aa8475d25c7012814 P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.212232 23879 tablet_replica.cc:333] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.212697 23879 raft_consensus.cc:2243] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.213059 23879 raft_consensus.cc:2272] T 0a5692423e8146c2aa5a7d110d2e5b1f P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.215152 23879 tablet_replica.cc:333] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.215590 23879 raft_consensus.cc:2243] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.216403 23879 raft_consensus.cc:2272] T 204ebd8e8f934d47bdde4570ab093dbd P ec496778059d40cbb4afab0fe1a51a76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.218647 23879 tablet_replica.cc:333] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.219123 23879 raft_consensus.cc:2243] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.219555 23879 raft_consensus.cc:2272] T 3337d6a9deb54745a42082d8b90cfd78 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.221598 23879 tablet_replica.cc:333] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.222059 23879 raft_consensus.cc:2243] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.222836 23879 raft_consensus.cc:2272] T 0c0527b2b59c417e911b3c8cf84097c3 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.224892 23879 tablet_replica.cc:333] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.225430 23879 raft_consensus.cc:2243] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.226289 23879 raft_consensus.cc:2272] T dd534ab8d78c432d9565c336eef7ebd7 P ec496778059d40cbb4afab0fe1a51a76 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.228361 23879 tablet_replica.cc:333] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76: stopping tablet replica
I20260709 12:24:11.228868 23879 raft_consensus.cc:2243] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.229341 23879 raft_consensus.cc:2272] T e7ad485b1679492097b0af78d231b9a0 P ec496778059d40cbb4afab0fe1a51a76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.269858 23879 tablet_server.cc:196] TabletServer@127.23.81.195:0 shutdown complete.
I20260709 12:24:11.311048 23879 master.cc:562] Master@127.23.81.254:39121 shutting down...
I20260709 12:24:11.334304 23879 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.334924 23879 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.335287 23879 tablet_replica.cc:333] T 00000000000000000000000000000000 P 39cb72b92e7e4cd5b85eef65518aea48: stopping tablet replica
I20260709 12:24:11.355566 23879 master.cc:584] Master@127.23.81.254:39121 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21085 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:24:11.411840 23879 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.81.254:40391
I20260709 12:24:11.412994 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:11.419021  2277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:11.419152  2276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:11.419732  2279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:11.421861 23879 server_base.cc:1061] running on GCE node
I20260709 12:24:11.422968 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:11.423151 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:11.423273 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599851423252 us; error 0 us; skew 500 ppm
I20260709 12:24:11.423735 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:11.426148 23879 webserver.cc:533] Webserver started at http://127.23.81.254:36401/ using document root <none> and password file <none>
I20260709 12:24:11.426601 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:11.426756 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:11.426976 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:11.428099 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/master-0-root/instance:
uuid: "1e73b82b4cb444938def94c3da7d0694"
format_stamp: "Formatted at 2026-07-09 12:24:11 on dist-test-slave-mprf"
I20260709 12:24:11.432677 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:24:11.436111  2284 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:11.436870 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:24:11.437171 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/master-0-root
uuid: "1e73b82b4cb444938def94c3da7d0694"
format_stamp: "Formatted at 2026-07-09 12:24:11 on dist-test-slave-mprf"
I20260709 12:24:11.437459 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:11.451821 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:11.453071 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:11.492169 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.254:40391
I20260709 12:24:11.492292  2335 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.254:40391 every 8 connection(s)
I20260709 12:24:11.496136  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:11.508340  2336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694: Bootstrap starting.
I20260709 12:24:11.513386  2336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.517732  2336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694: No bootstrap required, opened a new log
I20260709 12:24:11.520058  2336 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e73b82b4cb444938def94c3da7d0694" member_type: VOTER }
I20260709 12:24:11.520490  2336 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.520677  2336 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e73b82b4cb444938def94c3da7d0694, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.521169  2336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e73b82b4cb444938def94c3da7d0694" member_type: VOTER }
I20260709 12:24:11.521602  2336 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:11.521786  2336 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:11.522008  2336 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.526922  2336 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e73b82b4cb444938def94c3da7d0694" member_type: VOTER }
I20260709 12:24:11.527422  2336 leader_election.cc:304] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e73b82b4cb444938def94c3da7d0694; no voters: 
I20260709 12:24:11.528507  2336 leader_election.cc:290] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:11.528894  2339 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:11.530393  2339 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [term 1 LEADER]: Becoming Leader. State: Replica: 1e73b82b4cb444938def94c3da7d0694, State: Running, Role: LEADER
I20260709 12:24:11.531090  2339 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e73b82b4cb444938def94c3da7d0694" member_type: VOTER }
I20260709 12:24:11.531656  2336 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:11.536866  2340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e73b82b4cb444938def94c3da7d0694" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e73b82b4cb444938def94c3da7d0694" member_type: VOTER } }
I20260709 12:24:11.537313  2341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e73b82b4cb444938def94c3da7d0694. Latest consensus state: current_term: 1 leader_uuid: "1e73b82b4cb444938def94c3da7d0694" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e73b82b4cb444938def94c3da7d0694" member_type: VOTER } }
I20260709 12:24:11.537827  2340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:11.537999  2341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:11.540195  2347 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:11.545244  2347 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:11.547649 23879 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:11.554388  2347 catalog_manager.cc:1383] Generated new cluster ID: 8d59b8830b2e45988484c929f428ac2f
I20260709 12:24:11.554708  2347 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:11.572404  2347 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:11.573810  2347 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:11.589624  2347 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694: Generated new TSK 0
I20260709 12:24:11.590436  2347 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:11.614198 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:11.620550  2357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:11.621685  2358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:11.624074  2360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:11.624492 23879 server_base.cc:1061] running on GCE node
I20260709 12:24:11.625546 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:11.625777 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:11.625944 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599851625923 us; error 0 us; skew 500 ppm
I20260709 12:24:11.626528 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:11.628880 23879 webserver.cc:533] Webserver started at http://127.23.81.193:40685/ using document root <none> and password file <none>
I20260709 12:24:11.629372 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:11.629588 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:11.629854 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:11.631007 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-0-root/instance:
uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
format_stamp: "Formatted at 2026-07-09 12:24:11 on dist-test-slave-mprf"
I20260709 12:24:11.635545 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:24:11.639142  2365 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:11.640172 23879 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:24:11.640515 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-0-root
uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
format_stamp: "Formatted at 2026-07-09 12:24:11 on dist-test-slave-mprf"
I20260709 12:24:11.640827 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:11.653287 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:11.654561 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:11.656167 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:11.658599 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:11.658838 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:11.659080 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:11.659283 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:11.700691 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.193:40369
I20260709 12:24:11.700820  2427 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.193:40369 every 8 connection(s)
I20260709 12:24:11.705545 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:11.714453  2432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:11.717507  2433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:11.719377  2435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:11.720167 23879 server_base.cc:1061] running on GCE node
I20260709 12:24:11.720522  2428 heartbeater.cc:344] Connected to a master server at 127.23.81.254:40391
I20260709 12:24:11.720963  2428 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:11.721302 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:11.721607 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:11.721791 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599851721767 us; error 0 us; skew 500 ppm
I20260709 12:24:11.721786  2428 heartbeater.cc:507] Master 127.23.81.254:40391 requested a full tablet report, sending...
I20260709 12:24:11.722476 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:11.724426  2301 ts_manager.cc:194] Registered new tserver with Master: 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369)
I20260709 12:24:11.725193 23879 webserver.cc:533] Webserver started at http://127.23.81.194:46835/ using document root <none> and password file <none>
I20260709 12:24:11.725754 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:11.725945 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:11.726277 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:11.726492  2301 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50904
I20260709 12:24:11.727990 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-1-root/instance:
uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
format_stamp: "Formatted at 2026-07-09 12:24:11 on dist-test-slave-mprf"
I20260709 12:24:11.733301 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:24:11.736785  2440 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:11.737593 23879 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:24:11.737912 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-1-root
uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
format_stamp: "Formatted at 2026-07-09 12:24:11 on dist-test-slave-mprf"
I20260709 12:24:11.738243 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:11.760891 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:11.762229 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:11.763756 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:11.766005 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:11.766304 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:11.766551 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:11.766731 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:11.807334 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.194:41397
I20260709 12:24:11.807446  2502 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.194:41397 every 8 connection(s)
I20260709 12:24:11.812484 23879 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:11.820298  2506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:11.821915  2507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:11.823599  2509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:11.824831 23879 server_base.cc:1061] running on GCE node
I20260709 12:24:11.825815 23879 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:11.826041 23879 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:11.826292 23879 hybrid_clock.cc:648] HybridClock initialized: now 1783599851826274 us; error 0 us; skew 500 ppm
I20260709 12:24:11.826383  2503 heartbeater.cc:344] Connected to a master server at 127.23.81.254:40391
I20260709 12:24:11.826915  2503 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:11.827065 23879 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:11.827878  2503 heartbeater.cc:507] Master 127.23.81.254:40391 requested a full tablet report, sending...
I20260709 12:24:11.830255  2301 ts_manager.cc:194] Registered new tserver with Master: 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:11.830367 23879 webserver.cc:533] Webserver started at http://127.23.81.195:43983/ using document root <none> and password file <none>
I20260709 12:24:11.831012 23879 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:11.831211 23879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:11.831494 23879 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:11.832000  2301 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50920
I20260709 12:24:11.832718 23879 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-2-root/instance:
uuid: "89bec6b331e948f8887a900fd6e2f2a2"
format_stamp: "Formatted at 2026-07-09 12:24:11 on dist-test-slave-mprf"
I20260709 12:24:11.837437 23879 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 12:24:11.841148  2514 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:11.842214 23879 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:24:11.842535 23879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-2-root
uuid: "89bec6b331e948f8887a900fd6e2f2a2"
format_stamp: "Formatted at 2026-07-09 12:24:11 on dist-test-slave-mprf"
I20260709 12:24:11.842877 23879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1ONa1H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599468354575-23879-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:11.860639 23879 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:11.861927 23879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:11.863554 23879 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:11.865995 23879 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:11.866266 23879 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:11.866601 23879 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:11.866781 23879 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:11.910971 23879 rpc_server.cc:307] RPC server started. Bound to: 127.23.81.195:37271
I20260709 12:24:11.911113  2576 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.81.195:37271 every 8 connection(s)
I20260709 12:24:11.925586  2577 heartbeater.cc:344] Connected to a master server at 127.23.81.254:40391
I20260709 12:24:11.926113  2577 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:11.926833  2577 heartbeater.cc:507] Master 127.23.81.254:40391 requested a full tablet report, sending...
I20260709 12:24:11.928964  2301 ts_manager.cc:194] Registered new tserver with Master: 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:11.929575 23879 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014910953s
I20260709 12:24:11.930773  2301 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50934
I20260709 12:24:11.957842  2301 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50942:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:11.960645  2301 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:12.032428  2393 tablet_service.cc:1511] Processing CreateTablet for tablet 5180abfc159d43548a5b72463e7c3669 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:12.034008  2393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5180abfc159d43548a5b72463e7c3669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.047853  2542 tablet_service.cc:1511] Processing CreateTablet for tablet 5180abfc159d43548a5b72463e7c3669 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:12.049401  2542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5180abfc159d43548a5b72463e7c3669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.077840  2592 tablet_bootstrap.cc:492] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:12.078555  2392 tablet_service.cc:1511] Processing CreateTablet for tablet e7b926463d414499a35891b198c473b4 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:12.079668  2541 tablet_service.cc:1511] Processing CreateTablet for tablet e7b926463d414499a35891b198c473b4 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:12.080183  2392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b926463d414499a35891b198c473b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.080067  2540 tablet_service.cc:1511] Processing CreateTablet for tablet e0e7206dcbb7483081bd72c656d730bd (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:12.081173  2541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b926463d414499a35891b198c473b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.082363  2539 tablet_service.cc:1511] Processing CreateTablet for tablet bd3fa2e843c74b9d8e75db6561e7647f (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:12.083823  2539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3fa2e843c74b9d8e75db6561e7647f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.087347  2538 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1e7d759e47415cbb2d3aca0b65857c (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:12.088904  2538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1e7d759e47415cbb2d3aca0b65857c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.091280  2537 tablet_service.cc:1511] Processing CreateTablet for tablet 37092d742c0b4647add3a5ee5cb37a21 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:12.092763  2537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37092d742c0b4647add3a5ee5cb37a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.094637  2391 tablet_service.cc:1511] Processing CreateTablet for tablet bd3fa2e843c74b9d8e75db6561e7647f (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:12.096134  2391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3fa2e843c74b9d8e75db6561e7647f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.097827  2461 tablet_service.cc:1511] Processing CreateTablet for tablet cbb697b1aa1d4a8f801036a36ab7bbc0 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:12.099354  2461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb697b1aa1d4a8f801036a36ab7bbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.099118  2389 tablet_service.cc:1511] Processing CreateTablet for tablet 37092d742c0b4647add3a5ee5cb37a21 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:12.100512  2389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37092d742c0b4647add3a5ee5cb37a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.103740  2388 tablet_service.cc:1511] Processing CreateTablet for tablet 9b3b288fb92c4a78b7dd1d7e5e100970 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:12.104349  2468 tablet_service.cc:1511] Processing CreateTablet for tablet 5180abfc159d43548a5b72463e7c3669 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:12.105825  2388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3b288fb92c4a78b7dd1d7e5e100970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.097905  2390 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1e7d759e47415cbb2d3aca0b65857c (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:12.108203  2462 tablet_service.cc:1511] Processing CreateTablet for tablet 9b3b288fb92c4a78b7dd1d7e5e100970 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:12.109807  2387 tablet_service.cc:1511] Processing CreateTablet for tablet cbb697b1aa1d4a8f801036a36ab7bbc0 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:12.109944  2466 tablet_service.cc:1511] Processing CreateTablet for tablet e0e7206dcbb7483081bd72c656d730bd (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:12.105912  2468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5180abfc159d43548a5b72463e7c3669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.111250  2464 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1e7d759e47415cbb2d3aca0b65857c (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:12.127653  2464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1e7d759e47415cbb2d3aca0b65857c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.128445  2462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3b288fb92c4a78b7dd1d7e5e100970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.112183  2467 tablet_service.cc:1511] Processing CreateTablet for tablet e7b926463d414499a35891b198c473b4 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:12.130426  2467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b926463d414499a35891b198c473b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.109982  2463 tablet_service.cc:1511] Processing CreateTablet for tablet 37092d742c0b4647add3a5ee5cb37a21 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:12.118646  2390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1e7d759e47415cbb2d3aca0b65857c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.135708  2463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37092d742c0b4647add3a5ee5cb37a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.120764  2465 tablet_service.cc:1511] Processing CreateTablet for tablet bd3fa2e843c74b9d8e75db6561e7647f (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:12.121932  2540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e7206dcbb7483081bd72c656d730bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.124569  2535 tablet_service.cc:1511] Processing CreateTablet for tablet cbb697b1aa1d4a8f801036a36ab7bbc0 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:12.147962  2535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb697b1aa1d4a8f801036a36ab7bbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.123299  2536 tablet_service.cc:1511] Processing CreateTablet for tablet 9b3b288fb92c4a78b7dd1d7e5e100970 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:12.151868  2536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3b288fb92c4a78b7dd1d7e5e100970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.152419  2592 tablet_bootstrap.cc:654] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.154417  2466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e7206dcbb7483081bd72c656d730bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.158568  2465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3fa2e843c74b9d8e75db6561e7647f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.162389  2387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb697b1aa1d4a8f801036a36ab7bbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.187312  2389 tablet_service.cc:1511] Processing CreateTablet for tablet 36cd355e7fcd404f963a5eb70e70db65 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:12.178820  2393 tablet_service.cc:1511] Processing CreateTablet for tablet e0e7206dcbb7483081bd72c656d730bd (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:12.188845  2389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36cd355e7fcd404f963a5eb70e70db65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.195145  2393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e7206dcbb7483081bd72c656d730bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.197137  2592 tablet_bootstrap.cc:492] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:12.198462  2592 ts_tablet_manager.cc:1403] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.121s	user 0.011s	sys 0.004s
I20260709 12:24:12.202248  2460 tablet_service.cc:1511] Processing CreateTablet for tablet 36cd355e7fcd404f963a5eb70e70db65 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:12.204212  2460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36cd355e7fcd404f963a5eb70e70db65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.207568  2593 tablet_bootstrap.cc:492] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:12.208324  2592 raft_consensus.cc:359] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.209177  2592 raft_consensus.cc:385] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.209501  2592 raft_consensus.cc:740] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.210506  2592 consensus_queue.cc:260] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.225054  2593 tablet_bootstrap.cc:654] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.237383  2540 tablet_service.cc:1511] Processing CreateTablet for tablet 36cd355e7fcd404f963a5eb70e70db65 (DEFAULT_TABLE table=test-workload [id=c66483f989c24588aeb3c1d62512e758]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:12.251297  2540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36cd355e7fcd404f963a5eb70e70db65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.279145  2598 tablet_bootstrap.cc:492] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:12.293574  2598 tablet_bootstrap.cc:654] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.306941  2592 ts_tablet_manager.cc:1434] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.012s
I20260709 12:24:12.307834  2428 heartbeater.cc:499] Master 127.23.81.254:40391 was elected leader, sending a full tablet report...
I20260709 12:24:12.308195  2592 tablet_bootstrap.cc:492] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:12.325947  2592 tablet_bootstrap.cc:654] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.326122  2595 raft_consensus.cc:493] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.326884  2595 raft_consensus.cc:515] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.345633  2593 tablet_bootstrap.cc:492] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:12.346369  2593 ts_tablet_manager.cc:1403] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.139s	user 0.034s	sys 0.038s
I20260709 12:24:12.339736  2595 leader_election.cc:290] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.350482  2593 raft_consensus.cc:359] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.366596  2593 raft_consensus.cc:385] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.367085  2593 raft_consensus.cc:740] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.368185  2593 consensus_queue.cc:260] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.371137  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5180abfc159d43548a5b72463e7c3669" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:12.374588  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5180abfc159d43548a5b72463e7c3669" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:12.375386  2552 raft_consensus.cc:2468] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 0.
W20260709 12:24:12.375434  2368 leader_election.cc:343] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.377030  2369 leader_election.cc:304] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:12.378008  2595 raft_consensus.cc:2804] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.379213  2595 raft_consensus.cc:493] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.379750  2595 raft_consensus.cc:3060] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.389459  2577 heartbeater.cc:499] Master 127.23.81.254:40391 was elected leader, sending a full tablet report...
I20260709 12:24:12.387847  2595 raft_consensus.cc:515] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.389976  2593 ts_tablet_manager.cc:1434] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.012s
I20260709 12:24:12.391137  2593 tablet_bootstrap.cc:492] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:12.391141  2598 tablet_bootstrap.cc:492] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:12.391741  2595 leader_election.cc:290] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Requested vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.391810  2598 ts_tablet_manager.cc:1403] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.113s	user 0.028s	sys 0.028s
I20260709 12:24:12.393554  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5180abfc159d43548a5b72463e7c3669" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
W20260709 12:24:12.395226  2368 leader_election.cc:343] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.396934  2598 raft_consensus.cc:359] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.397644  2593 tablet_bootstrap.cc:654] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.397845  2598 raft_consensus.cc:385] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.398237  2598 raft_consensus.cc:740] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.399052  2598 consensus_queue.cc:260] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.401610  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5180abfc159d43548a5b72463e7c3669" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:12.402314  2552 raft_consensus.cc:3060] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.403887  2592 tablet_bootstrap.cc:492] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:12.404625  2592 ts_tablet_manager.cc:1403] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.097s	user 0.020s	sys 0.009s
I20260709 12:24:12.408819  2592 raft_consensus.cc:359] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.410877  2503 heartbeater.cc:499] Master 127.23.81.254:40391 was elected leader, sending a full tablet report...
I20260709 12:24:12.415735  2552 raft_consensus.cc:2468] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 1.
W20260709 12:24:12.415977  2578 tablet.cc:2406] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:24:12.409857  2592 raft_consensus.cc:385] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.417903  2592 raft_consensus.cc:740] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.418990  2592 consensus_queue.cc:260] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.420958  2369 leader_election.cc:304] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:12.421947  2598 ts_tablet_manager.cc:1434] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:24:12.423265  2598 tablet_bootstrap.cc:492] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:12.424088  2592 ts_tablet_manager.cc:1434] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 12:24:12.427289  2597 raft_consensus.cc:2804] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:12.437767  2593 tablet_bootstrap.cc:492] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:12.438540  2593 ts_tablet_manager.cc:1403] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.019s
I20260709 12:24:12.439646  2598 tablet_bootstrap.cc:654] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.442198  2593 raft_consensus.cc:359] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.443910  2593 raft_consensus.cc:385] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.442544  2597 raft_consensus.cc:697] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Becoming Leader. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:12.442503  2592 tablet_bootstrap.cc:492] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:12.444352  2593 raft_consensus.cc:740] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.444960  2597 consensus_queue.cc:237] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.446383  2593 consensus_queue.cc:260] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.453545  2592 tablet_bootstrap.cc:654] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.456981  2598 tablet_bootstrap.cc:492] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:12.457618  2598 ts_tablet_manager.cc:1403] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 12:24:12.458643  2593 ts_tablet_manager.cc:1434] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.005s
I20260709 12:24:12.460934  2598 raft_consensus.cc:359] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.461768  2598 raft_consensus.cc:385] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.462064  2598 raft_consensus.cc:740] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.463229  2593 tablet_bootstrap.cc:492] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:12.465592  2598 consensus_queue.cc:260] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.469763  2598 ts_tablet_manager.cc:1434] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:24:12.470870  2598 tablet_bootstrap.cc:492] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:12.475155  2593 tablet_bootstrap.cc:654] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.477607  2598 tablet_bootstrap.cc:654] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.476824  2301 catalog_manager.cc:5697] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:12.483837  2592 tablet_bootstrap.cc:492] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:12.484401  2592 ts_tablet_manager.cc:1403] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.004s
I20260709 12:24:12.487449  2593 tablet_bootstrap.cc:492] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:12.487548  2592 raft_consensus.cc:359] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.488317  2598 tablet_bootstrap.cc:492] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:12.488386  2593 ts_tablet_manager.cc:1403] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.005s
I20260709 12:24:12.488611  2592 raft_consensus.cc:385] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.489293  2592 raft_consensus.cc:740] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.489377  2598 ts_tablet_manager.cc:1403] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.002s
I20260709 12:24:12.490200  2592 consensus_queue.cc:260] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.492143  2593 raft_consensus.cc:359] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.492617  2592 ts_tablet_manager.cc:1434] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:24:12.492961  2593 raft_consensus.cc:385] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.493336  2593 raft_consensus.cc:740] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.493747  2592 tablet_bootstrap.cc:492] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:12.493196  2598 raft_consensus.cc:359] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.494266  2598 raft_consensus.cc:385] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.494638  2598 raft_consensus.cc:740] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.494531  2593 consensus_queue.cc:260] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.495635  2598 consensus_queue.cc:260] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.498095  2598 ts_tablet_manager.cc:1434] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:24:12.499132  2598 tablet_bootstrap.cc:492] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:12.499310  2593 ts_tablet_manager.cc:1434] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260709 12:24:12.500443  2593 tablet_bootstrap.cc:492] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:12.505882  2598 tablet_bootstrap.cc:654] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.513664  2593 tablet_bootstrap.cc:654] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.518848  2593 tablet_bootstrap.cc:492] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:12.519322  2593 ts_tablet_manager.cc:1403] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 12:24:12.520358  2592 tablet_bootstrap.cc:654] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.522017  2593 raft_consensus.cc:359] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.522699  2593 raft_consensus.cc:385] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.522935  2593 raft_consensus.cc:740] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.523658  2593 consensus_queue.cc:260] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.523921  2598 tablet_bootstrap.cc:492] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:12.524832  2598 ts_tablet_manager.cc:1403] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.007s
I20260709 12:24:12.525795  2593 ts_tablet_manager.cc:1434] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:12.527585  2593 tablet_bootstrap.cc:492] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:12.528770  2598 raft_consensus.cc:359] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.529703  2598 raft_consensus.cc:385] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.530153  2598 raft_consensus.cc:740] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.531034  2598 consensus_queue.cc:260] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.533803  2598 ts_tablet_manager.cc:1434] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 12:24:12.533855  2593 tablet_bootstrap.cc:654] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.535048  2598 tablet_bootstrap.cc:492] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:12.542421  2598 tablet_bootstrap.cc:654] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:12.544937  2349 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:12.545894  2597 raft_consensus.cc:493] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.546563  2597 raft_consensus.cc:515] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.549938  2597 leader_election.cc:290] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.550077  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:12.550616  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:12.551415  2592 tablet_bootstrap.cc:492] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
W20260709 12:24:12.551771  2368 leader_election.cc:343] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.552086  2592 ts_tablet_manager.cc:1403] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.007s
W20260709 12:24:12.552443  2369 leader_election.cc:343] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.552891  2369 leader_election.cc:304] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3; no voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2
I20260709 12:24:12.553757  2597 raft_consensus.cc:2749] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:12.555346  2592 raft_consensus.cc:359] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.556003  2593 tablet_bootstrap.cc:492] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:12.556177  2592 raft_consensus.cc:385] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.556396  2598 tablet_bootstrap.cc:492] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:12.556615  2593 ts_tablet_manager.cc:1403] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.003s
I20260709 12:24:12.556576  2592 raft_consensus.cc:740] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.557051  2598 ts_tablet_manager.cc:1403] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 12:24:12.557583  2592 consensus_queue.cc:260] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.559938  2592 ts_tablet_manager.cc:1434] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:24:12.559938  2593 raft_consensus.cc:359] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.560290  2598 raft_consensus.cc:359] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.560817  2593 raft_consensus.cc:385] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.561020  2592 tablet_bootstrap.cc:492] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:12.561071  2598 raft_consensus.cc:385] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.561170  2593 raft_consensus.cc:740] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.561774  2598 raft_consensus.cc:740] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.562453  2593 consensus_queue.cc:260] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.562731  2598 consensus_queue.cc:260] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.566937  2593 ts_tablet_manager.cc:1434] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:24:12.566973  2598 ts_tablet_manager.cc:1434] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:24:12.568135  2593 tablet_bootstrap.cc:492] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:12.568256  2598 tablet_bootstrap.cc:492] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:12.568398  2592 tablet_bootstrap.cc:654] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.575609  2598 tablet_bootstrap.cc:654] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.576565  2593 tablet_bootstrap.cc:654] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.587276  2598 tablet_bootstrap.cc:492] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:12.587821  2598 ts_tablet_manager.cc:1403] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:24:12.589677  2593 tablet_bootstrap.cc:492] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:12.590505  2593 ts_tablet_manager.cc:1403] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.007s
I20260709 12:24:12.590932  2598 raft_consensus.cc:359] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.591806  2598 raft_consensus.cc:385] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.592123  2598 raft_consensus.cc:740] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.593143  2598 consensus_queue.cc:260] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.594692  2593 raft_consensus.cc:359] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.595548  2593 raft_consensus.cc:385] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.595840  2593 raft_consensus.cc:740] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.596710  2593 consensus_queue.cc:260] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.597158  2592 tablet_bootstrap.cc:492] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:12.597853  2592 ts_tablet_manager.cc:1403] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.015s
I20260709 12:24:12.600065  2598 ts_tablet_manager.cc:1434] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:24:12.601475  2592 raft_consensus.cc:359] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.602432  2592 raft_consensus.cc:385] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.602841  2592 raft_consensus.cc:740] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.603228  2593 ts_tablet_manager.cc:1434] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 12:24:12.603941  2592 consensus_queue.cc:260] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.606973  2598 tablet_bootstrap.cc:492] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:12.608965  2593 tablet_bootstrap.cc:492] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:12.609632  2592 ts_tablet_manager.cc:1434] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:24:12.610811  2592 tablet_bootstrap.cc:492] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:12.616333  2593 tablet_bootstrap.cc:654] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.617386  2592 tablet_bootstrap.cc:654] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.624456  2598 tablet_bootstrap.cc:654] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.630249  2592 tablet_bootstrap.cc:492] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:12.630273  2593 tablet_bootstrap.cc:492] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:12.630789  2592 ts_tablet_manager.cc:1403] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 12:24:12.630949  2593 ts_tablet_manager.cc:1403] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 12:24:12.631570  2598 tablet_bootstrap.cc:492] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:12.632123  2598 ts_tablet_manager.cc:1403] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 12:24:12.633422  2592 raft_consensus.cc:359] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.634147  2592 raft_consensus.cc:385] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.634579  2592 raft_consensus.cc:740] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.634155  2593 raft_consensus.cc:359] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.635221  2593 raft_consensus.cc:385] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.635088  2598 raft_consensus.cc:359] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.635687  2593 raft_consensus.cc:740] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.635267  2592 consensus_queue.cc:260] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.635897  2598 raft_consensus.cc:385] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.636240  2598 raft_consensus.cc:740] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.636593  2593 consensus_queue.cc:260] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.637552  2592 ts_tablet_manager.cc:1434] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:12.638532  2592 tablet_bootstrap.cc:492] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:12.639092  2598 consensus_queue.cc:260] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.642095  2598 ts_tablet_manager.cc:1434] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:24:12.641909  2593 ts_tablet_manager.cc:1434] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:24:12.643190  2593 tablet_bootstrap.cc:492] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:12.643190  2598 tablet_bootstrap.cc:492] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:12.645958  2592 tablet_bootstrap.cc:654] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.648080  2597 raft_consensus.cc:493] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.657701  2598 tablet_bootstrap.cc:654] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.657773  2597 raft_consensus.cc:515] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.660935  2597 leader_election.cc:290] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.661588  2593 tablet_bootstrap.cc:654] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.661706  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3b288fb92c4a78b7dd1d7e5e100970" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:12.662453  2478 raft_consensus.cc:2468] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 0.
I20260709 12:24:12.662721  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3b288fb92c4a78b7dd1d7e5e100970" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:12.663389  2552 raft_consensus.cc:2468] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 0.
I20260709 12:24:12.663714  2368 leader_election.cc:304] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:12.664665  2597 raft_consensus.cc:2804] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.665025  2597 raft_consensus.cc:493] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.665333  2597 raft_consensus.cc:3060] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.673223  2597 raft_consensus.cc:515] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.677340  2592 tablet_bootstrap.cc:492] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:12.677019  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3b288fb92c4a78b7dd1d7e5e100970" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:12.678143  2478 raft_consensus.cc:3060] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.678176  2592 ts_tablet_manager.cc:1403] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.008s
I20260709 12:24:12.678234  2597 leader_election.cc:290] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Requested vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.679378  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3b288fb92c4a78b7dd1d7e5e100970" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:12.679999  2604 raft_consensus.cc:493] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.680034  2552 raft_consensus.cc:3060] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.680869  2604 raft_consensus.cc:515] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.683952  2593 tablet_bootstrap.cc:492] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:12.684641  2593 ts_tablet_manager.cc:1403] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.008s
I20260709 12:24:12.686789  2604 leader_election.cc:290] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.687595  2604 raft_consensus.cc:493] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.692513  2604 raft_consensus.cc:515] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.694001  2598 tablet_bootstrap.cc:492] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:12.693790  2593 raft_consensus.cc:359] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.694599  2593 raft_consensus.cc:385] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.694604  2598 ts_tablet_manager.cc:1403] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.052s	user 0.004s	sys 0.023s
I20260709 12:24:12.694986  2593 raft_consensus.cc:740] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.695263  2592 raft_consensus.cc:359] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.696092  2592 raft_consensus.cc:385] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.695922  2593 consensus_queue.cc:260] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.696511  2592 raft_consensus.cc:740] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.694816  2604 leader_election.cc:290] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.697750  2598 raft_consensus.cc:359] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.698527  2598 raft_consensus.cc:385] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.698843  2598 raft_consensus.cc:740] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.698170  2592 consensus_queue.cc:260] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.699505  2598 consensus_queue.cc:260] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.701094  2592 ts_tablet_manager.cc:1434] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.007s
I20260709 12:24:12.706950  2593 ts_tablet_manager.cc:1434] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.003s
I20260709 12:24:12.711016  2593 tablet_bootstrap.cc:492] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:12.711519  2598 ts_tablet_manager.cc:1434] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:24:12.719475  2552 raft_consensus.cc:2468] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 1.
I20260709 12:24:12.721242  2598 tablet_bootstrap.cc:492] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:12.725914  2592 tablet_bootstrap.cc:492] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:12.726341  2369 leader_election.cc:304] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:12.727595  2593 tablet_bootstrap.cc:654] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.727859  2597 raft_consensus.cc:2804] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:12.728379  2597 raft_consensus.cc:697] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Becoming Leader. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:12.729326  2597 consensus_queue.cc:237] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.733081  2598 tablet_bootstrap.cc:654] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.733435  2595 raft_consensus.cc:493] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.735072  2595 raft_consensus.cc:515] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.737341  2595 leader_election.cc:290] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.742769  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37092d742c0b4647add3a5ee5cb37a21" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:12.743614  2552 raft_consensus.cc:2468] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 0.
I20260709 12:24:12.743813  2478 raft_consensus.cc:2468] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 1.
I20260709 12:24:12.747762  2369 leader_election.cc:304] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:12.748775  2595 raft_consensus.cc:2804] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.749158  2595 raft_consensus.cc:493] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.749483  2595 raft_consensus.cc:3060] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.751051  2626 raft_consensus.cc:493] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.755071  2626 raft_consensus.cc:515] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.757592  2626 leader_election.cc:290] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.758462  2477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37092d742c0b4647add3a5ee5cb37a21" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:12.759331  2477 raft_consensus.cc:2468] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 0.
I20260709 12:24:12.765360  2595 raft_consensus.cc:515] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.766301  2403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cd355e7fcd404f963a5eb70e70db65" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:12.766666  2402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37092d742c0b4647add3a5ee5cb37a21" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:12.767217  2592 tablet_bootstrap.cc:654] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.768921  2403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1e7d759e47415cbb2d3aca0b65857c" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
W20260709 12:24:12.769388  2443 leader_election.cc:343] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.769799  2403 raft_consensus.cc:2468] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:12.771656  2443 leader_election.cc:304] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:12.771929  2593 tablet_bootstrap.cc:492] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:12.772536  2593 ts_tablet_manager.cc:1403] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.018s
I20260709 12:24:12.772560  2626 raft_consensus.cc:2804] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.773116  2626 raft_consensus.cc:493] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.773471  2626 raft_consensus.cc:3060] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.774467  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cd355e7fcd404f963a5eb70e70db65" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:12.775199  2552 raft_consensus.cc:2468] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:12.775751  2593 raft_consensus.cc:359] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.776407  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37092d742c0b4647add3a5ee5cb37a21" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:12.777209  2551 raft_consensus.cc:2468] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:12.778404  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1e7d759e47415cbb2d3aca0b65857c" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:12.777493  2300 catalog_manager.cc:5697] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:12.779204  2550 raft_consensus.cc:2468] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:12.781456  2444 leader_election.cc:304] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 13e53d4d46f44702bdf15f3f2be8cca3
I20260709 12:24:12.782513  2604 raft_consensus.cc:2804] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.782330  2626 raft_consensus.cc:515] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.782924  2604 raft_consensus.cc:493] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.783279  2604 raft_consensus.cc:3060] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.785614  2403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1e7d759e47415cbb2d3aca0b65857c" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:12.786361  2403 raft_consensus.cc:3060] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.788654  2444 leader_election.cc:304] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:12.776470  2593 raft_consensus.cc:385] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.790506  2593 raft_consensus.cc:740] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.790665  2402 raft_consensus.cc:2393] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in current term 1: Already voted for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in this term.
I20260709 12:24:12.791575  2593 consensus_queue.cc:260] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.796033  2626 leader_election.cc:290] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.796828  2626 raft_consensus.cc:2804] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.797240  2626 raft_consensus.cc:493] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.797559  2626 raft_consensus.cc:3060] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.806528  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1e7d759e47415cbb2d3aca0b65857c" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:12.807578  2550 raft_consensus.cc:3060] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.820365  2550 raft_consensus.cc:2468] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:12.821944  2403 raft_consensus.cc:2468] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:12.822345  2444 leader_election.cc:304] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:12.824298  2634 raft_consensus.cc:2804] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:12.827517  2593 ts_tablet_manager.cc:1434] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.001s
I20260709 12:24:12.827603  2603 raft_consensus.cc:493] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.828903  2603 raft_consensus.cc:515] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.836100  2595 leader_election.cc:290] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Requested vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.837800  2477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37092d742c0b4647add3a5ee5cb37a21" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:12.847905  2603 leader_election.cc:290] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:12.833256  2604 raft_consensus.cc:515] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.850263  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37092d742c0b4647add3a5ee5cb37a21" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:12.850992  2550 raft_consensus.cc:3060] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.852319  2597 consensus_queue.cc:1048] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:12.855189  2604 leader_election.cc:290] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.856222  2403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cd355e7fcd404f963a5eb70e70db65" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
W20260709 12:24:12.861286  2443 leader_election.cc:343] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.862504  2598 tablet_bootstrap.cc:492] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:12.864789  2598 ts_tablet_manager.cc:1403] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.152s	user 0.032s	sys 0.029s
I20260709 12:24:12.870404  2626 raft_consensus.cc:515] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.872661  2477 raft_consensus.cc:2393] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 13e53d4d46f44702bdf15f3f2be8cca3 in current term 1: Already voted for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in this term.
I20260709 12:24:12.873240  2592 tablet_bootstrap.cc:492] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:12.874074  2592 ts_tablet_manager.cc:1403] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.148s	user 0.031s	sys 0.033s
I20260709 12:24:12.866283  2604 raft_consensus.cc:493] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.878906  2598 raft_consensus.cc:359] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.877132  2403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37092d742c0b4647add3a5ee5cb37a21" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:12.881088  2598 raft_consensus.cc:385] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.877234  2592 raft_consensus.cc:359] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.876989  2626 leader_election.cc:290] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.867465  2634 raft_consensus.cc:697] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:12.881824  2598 raft_consensus.cc:740] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.881903  2592 raft_consensus.cc:385] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.882876  2592 raft_consensus.cc:740] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.882231  2604 raft_consensus.cc:515] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.883795  2592 consensus_queue.cc:260] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.883474  2598 consensus_queue.cc:260] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.886672  2598 ts_tablet_manager.cc:1434] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:24:12.888063  2403 raft_consensus.cc:2393] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in current term 1: Already voted for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in this term.
I20260709 12:24:12.892539  2592 ts_tablet_manager.cc:1434] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:24:12.892704  2604 leader_election.cc:290] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.893601  2592 tablet_bootstrap.cc:492] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:12.899411  2592 tablet_bootstrap.cc:654] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.899778  2550 raft_consensus.cc:2468] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 1.
I20260709 12:24:12.901271  2403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:12.901340  2369 leader_election.cc:304] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:12.902196  2403 raft_consensus.cc:2468] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:12.903023  2597 raft_consensus.cc:2804] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:12.903474  2443 leader_election.cc:304] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:12.903774  2597 raft_consensus.cc:697] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Becoming Leader. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:12.905011  2597 consensus_queue.cc:237] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.905318  2626 raft_consensus.cc:2804] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.908998  2626 raft_consensus.cc:493] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.909817  2626 raft_consensus.cc:3060] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.903900  2634 consensus_queue.cc:237] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.918267  2604 raft_consensus.cc:493] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.919028  2604 raft_consensus.cc:515] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.922482  2403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb697b1aa1d4a8f801036a36ab7bbc0" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:12.923135  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cd355e7fcd404f963a5eb70e70db65" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:12.923282  2403 raft_consensus.cc:2468] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:12.923825  2550 raft_consensus.cc:3060] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.924602  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37092d742c0b4647add3a5ee5cb37a21" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:12.925475  2551 raft_consensus.cc:2393] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in current term 1: Already voted for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in this term.
I20260709 12:24:12.925266  2443 leader_election.cc:304] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:12.926334  2635 raft_consensus.cc:493] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.926425  2637 raft_consensus.cc:2804] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.926983  2637 raft_consensus.cc:493] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.926900  2635 raft_consensus.cc:515] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.927838  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:12.928447  2604 leader_election.cc:290] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.928568  2551 raft_consensus.cc:2468] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:12.932235  2444 leader_election.cc:304] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2
I20260709 12:24:12.927582  2637 raft_consensus.cc:3060] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.934208  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb697b1aa1d4a8f801036a36ab7bbc0" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:12.934470  2604 raft_consensus.cc:2749] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:12.935087  2551 raft_consensus.cc:2468] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:12.938287  2403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e7206dcbb7483081bd72c656d730bd" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:12.939080  2403 raft_consensus.cc:2468] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:12.929704  2635 leader_election.cc:290] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.940706  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e7206dcbb7483081bd72c656d730bd" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:12.941524  2551 raft_consensus.cc:2468] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:12.941588  2477 raft_consensus.cc:3060] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.944401  2444 leader_election.cc:304] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:12.939306  2626 raft_consensus.cc:515] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.945359  2634 raft_consensus.cc:2804] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.945562  2550 raft_consensus.cc:2468] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:12.945762  2634 raft_consensus.cc:493] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.946426  2634 raft_consensus.cc:3060] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.946972  2592 tablet_bootstrap.cc:492] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:12.948544  2592 ts_tablet_manager.cc:1403] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.002s
I20260709 12:24:12.950969  2402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:12.951300  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b926463d414499a35891b198c473b4" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:12.951738  2402 raft_consensus.cc:3060] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.951998  2401 raft_consensus.cc:2468] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 0.
I20260709 12:24:12.947845  2626 leader_election.cc:290] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.953888  2444 leader_election.cc:304] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 13e53d4d46f44702bdf15f3f2be8cca3
I20260709 12:24:12.955461  2626 raft_consensus.cc:2804] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:12.956256  2517 leader_election.cc:304] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:12.956518  2635 raft_consensus.cc:493] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.952778  2637 raft_consensus.cc:515] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.957038  2635 raft_consensus.cc:515] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.958058  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b926463d414499a35891b198c473b4" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:12.958740  2478 raft_consensus.cc:2468] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 0.
I20260709 12:24:12.959220  2635 leader_election.cc:290] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.959863  2603 raft_consensus.cc:2804] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.960292  2603 raft_consensus.cc:493] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.960649  2603 raft_consensus.cc:3060] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.957700  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:12.962427  2550 raft_consensus.cc:3060] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.963470  2402 raft_consensus.cc:2468] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:12.951690  2592 raft_consensus.cc:359] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.964427  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b926463d414499a35891b198c473b4" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:12.964788  2592 raft_consensus.cc:385] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.965193  2592 raft_consensus.cc:740] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.965576  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb697b1aa1d4a8f801036a36ab7bbc0" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:12.956224  2626 raft_consensus.cc:697] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:12.965204  2400 raft_consensus.cc:2468] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:12.968065  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b926463d414499a35891b198c473b4" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:12.967193  2443 leader_election.cc:304] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:12.972730  2550 raft_consensus.cc:2468] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:12.955047  2301 catalog_manager.cc:5697] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:12.973141  2443 leader_election.cc:304] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:12.969261  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb697b1aa1d4a8f801036a36ab7bbc0" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:12.975796  2604 raft_consensus.cc:493] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.967384  2592 consensus_queue.cc:260] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.976987  2552 raft_consensus.cc:3060] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.976814  2604 raft_consensus.cc:515] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.968227  2637 leader_election.cc:290] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.978580  2637 raft_consensus.cc:2804] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.978955  2637 raft_consensus.cc:493] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.978839  2603 raft_consensus.cc:515] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.979446  2637 raft_consensus.cc:3060] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.973453  2635 raft_consensus.cc:2804] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:12.980152  2551 raft_consensus.cc:2393] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in current term 1: Already voted for candidate 89bec6b331e948f8887a900fd6e2f2a2 in this term.
I20260709 12:24:12.980175  2635 raft_consensus.cc:697] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:12.981160  2604 leader_election.cc:290] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.981386  2635 consensus_queue.cc:237] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.965970  2634 raft_consensus.cc:515] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.966240  2401 raft_consensus.cc:3060] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.984345  2634 leader_election.cc:290] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:12.972885  2626 consensus_queue.cc:237] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:12.986169  2592 ts_tablet_manager.cc:1434] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.003s
I20260709 12:24:12.987679  2603 leader_election.cc:290] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:12.993072  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5180abfc159d43548a5b72463e7c3669" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:12.994899  2595 consensus_queue.cc:1048] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:12.996819  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b926463d414499a35891b198c473b4" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:12.997498  2400 raft_consensus.cc:3060] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.999475  2403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5180abfc159d43548a5b72463e7c3669" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:13.003504  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b926463d414499a35891b198c473b4" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:13.003739  2444 leader_election.cc:304] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2
I20260709 12:24:13.005997  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e7206dcbb7483081bd72c656d730bd" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:13.006709  2551 raft_consensus.cc:3060] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.007973  2300 catalog_manager.cc:5697] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.010703  2400 raft_consensus.cc:2468] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 1.
I20260709 12:24:13.013441  2517 leader_election.cc:304] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:13.010519  2402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e7206dcbb7483081bd72c656d730bd" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:13.015324  2603 raft_consensus.cc:2804] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:13.015944  2551 raft_consensus.cc:2468] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:13.018404  2444 leader_election.cc:304] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:13.018213  2637 raft_consensus.cc:515] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.020141  2604 raft_consensus.cc:2804] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:13.020879  2478 raft_consensus.cc:2393] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89bec6b331e948f8887a900fd6e2f2a2 in current term 1: Already voted for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in this term.
I20260709 12:24:13.018767  2402 raft_consensus.cc:3060] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.023082  2637 leader_election.cc:290] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:13.022969  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b926463d414499a35891b198c473b4" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:13.023504  2604 raft_consensus.cc:697] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:13.024295  2400 raft_consensus.cc:2393] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in current term 1: Already voted for candidate 89bec6b331e948f8887a900fd6e2f2a2 in this term.
I20260709 12:24:13.024420  2604 consensus_queue.cc:237] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.028604  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b926463d414499a35891b198c473b4" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:13.036101  2402 raft_consensus.cc:2468] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:13.020632  2401 raft_consensus.cc:2468] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:13.039335  2443 leader_election.cc:304] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:13.041004  2637 raft_consensus.cc:2804] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:13.041653  2637 raft_consensus.cc:697] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:13.042760  2637 consensus_queue.cc:237] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.044795  2552 raft_consensus.cc:2468] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:13.065682  2603 raft_consensus.cc:697] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 LEADER]: Becoming Leader. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Running, Role: LEADER
I20260709 12:24:13.067126  2634 raft_consensus.cc:2749] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:13.066995  2603 consensus_queue.cc:237] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.073235  2444 leader_election.cc:304] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2
I20260709 12:24:13.074784  2637 raft_consensus.cc:2749] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:13.074221  2301 catalog_manager.cc:5697] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.076256  2301 catalog_manager.cc:5697] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.076867  2300 catalog_manager.cc:5697] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "89bec6b331e948f8887a900fd6e2f2a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:13.077895  2301 catalog_manager.cc:5697] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.096021  2301 catalog_manager.cc:5697] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.130110  2597 consensus_queue.cc:1048] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.141615  2606 consensus_queue.cc:1048] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:13.282186  2551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7b926463d414499a35891b198c473b4"
dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
mode: GRACEFUL
new_leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
 from {username='slave'} at 127.0.0.1:54164
I20260709 12:24:13.283085  2551 raft_consensus.cc:606] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 LEADER]: Received request to transfer leadership to TS 13e53d4d46f44702bdf15f3f2be8cca3
I20260709 12:24:13.283742  2606 raft_consensus.cc:493] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.284425  2606 raft_consensus.cc:515] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.287829  2606 leader_election.cc:290] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:13.288076  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cd355e7fcd404f963a5eb70e70db65" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:13.288638  2477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cd355e7fcd404f963a5eb70e70db65" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:13.289821  2551 raft_consensus.cc:2393] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13e53d4d46f44702bdf15f3f2be8cca3 in current term 1: Already voted for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in this term.
I20260709 12:24:13.290973  2369 leader_election.cc:304] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3; no voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2
I20260709 12:24:13.291844  2606 raft_consensus.cc:3060] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.299163  2606 raft_consensus.cc:2749] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:13.300714  2477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0e7206dcbb7483081bd72c656d730bd"
dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
mode: GRACEFUL
new_leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
 from {username='slave'} at 127.0.0.1:58612
I20260709 12:24:13.301280  2477 raft_consensus.cc:606] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Received request to transfer leadership to TS 13e53d4d46f44702bdf15f3f2be8cca3
I20260709 12:24:13.306546  2477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f"
dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
mode: GRACEFUL
new_leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
 from {username='slave'} at 127.0.0.1:58612
I20260709 12:24:13.307049  2477 raft_consensus.cc:606] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Received request to transfer leadership to TS 13e53d4d46f44702bdf15f3f2be8cca3
I20260709 12:24:13.322687  2402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37092d742c0b4647add3a5ee5cb37a21"
dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
mode: GRACEFUL
new_leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
 from {username='slave'} at 127.0.0.1:57800
I20260709 12:24:13.323338  2402 raft_consensus.cc:606] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Received request to transfer leadership to TS 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:13.325269  2606 consensus_queue.cc:1048] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.328950  2402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b3b288fb92c4a78b7dd1d7e5e100970"
dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
mode: GRACEFUL
new_leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
 from {username='slave'} at 127.0.0.1:57800
I20260709 12:24:13.329630  2402 raft_consensus.cc:606] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Received request to transfer leadership to TS 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:13.337455  2595 consensus_queue.cc:1048] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.345427  2478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36cd355e7fcd404f963a5eb70e70db65"
dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
mode: GRACEFUL
new_leader_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
 from {username='slave'} at 127.0.0.1:58612
I20260709 12:24:13.345999  2478 raft_consensus.cc:606] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Received request to transfer leadership to TS 89bec6b331e948f8887a900fd6e2f2a2
I20260709 12:24:13.353343  2597 raft_consensus.cc:993] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3: : Instructing follower 61018e6aad40475ea3d9ce1c4ec8bd48 to start an election
I20260709 12:24:13.353842  2595 raft_consensus.cc:1081] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Signalling peer 61018e6aad40475ea3d9ce1c4ec8bd48 to start an election
I20260709 12:24:13.355450  2477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37092d742c0b4647add3a5ee5cb37a21"
dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
 from {username='slave'} at 127.0.0.1:58588
I20260709 12:24:13.355979  2477 raft_consensus.cc:493] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:13.356374  2477 raft_consensus.cc:3060] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.361547  2477 raft_consensus.cc:515] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.363768  2477 leader_election.cc:290] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 2 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:13.364148  2402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37092d742c0b4647add3a5ee5cb37a21" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:13.364373  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37092d742c0b4647add3a5ee5cb37a21" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:13.364825  2402 raft_consensus.cc:3055] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:13.364954  2551 raft_consensus.cc:3060] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.365240  2402 raft_consensus.cc:740] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:13.366215  2402 consensus_queue.cc:260] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.367239  2402 raft_consensus.cc:3060] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.371411  2551 raft_consensus.cc:2468] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 2.
I20260709 12:24:13.372550  2444 leader_election.cc:304] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:13.373113  2402 raft_consensus.cc:2468] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 2.
I20260709 12:24:13.373281  2637 raft_consensus.cc:2804] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:13.373864  2637 raft_consensus.cc:697] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:13.374702  2637 consensus_queue.cc:237] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.381220  2299 catalog_manager.cc:5697] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 1 to 2, leader changed from 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193) to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.396585  2637 consensus_queue.cc:1048] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.403725  2634 raft_consensus.cc:993] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48: : Instructing follower 13e53d4d46f44702bdf15f3f2be8cca3 to start an election
I20260709 12:24:13.404225  2604 raft_consensus.cc:1081] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Signalling peer 13e53d4d46f44702bdf15f3f2be8cca3 to start an election
I20260709 12:24:13.406785  2401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f"
dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
 from {username='slave'} at 127.0.0.1:57786
I20260709 12:24:13.407476  2401 raft_consensus.cc:493] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:13.407881  2401 raft_consensus.cc:3060] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.409992  2634 consensus_queue.cc:1048] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:13.418975  2401 raft_consensus.cc:515] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.423257  2604 consensus_queue.cc:1048] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.425918  2477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:13.426630  2477 raft_consensus.cc:3055] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:13.426975  2477 raft_consensus.cc:740] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:13.432431  2477 consensus_queue.cc:260] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.434268  2477 raft_consensus.cc:3060] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.434667  2634 consensus_queue.cc:1048] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.439285  2634 consensus_queue.cc:1048] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.443123  2401 leader_election.cc:290] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 2 election: Requested vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:13.443434  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:13.444111  2551 raft_consensus.cc:3060] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.449681  2477 raft_consensus.cc:2468] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 2.
I20260709 12:24:13.450906  2368 leader_election.cc:304] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:13.452056  2606 raft_consensus.cc:2804] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:13.452564  2606 raft_consensus.cc:697] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Becoming Leader. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:13.453286  2637 raft_consensus.cc:993] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48: : Instructing follower 89bec6b331e948f8887a900fd6e2f2a2 to start an election
I20260709 12:24:13.453780  2646 raft_consensus.cc:993] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48: : Instructing follower 13e53d4d46f44702bdf15f3f2be8cca3 to start an election
I20260709 12:24:13.454246  2646 raft_consensus.cc:1081] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Signalling peer 13e53d4d46f44702bdf15f3f2be8cca3 to start an election
I20260709 12:24:13.454766  2637 raft_consensus.cc:1081] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Signalling peer 89bec6b331e948f8887a900fd6e2f2a2 to start an election
I20260709 12:24:13.457569  2551 raft_consensus.cc:2468] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 2.
I20260709 12:24:13.461712  2402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0e7206dcbb7483081bd72c656d730bd"
dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
 from {username='slave'} at 127.0.0.1:57786
I20260709 12:24:13.462621  2402 raft_consensus.cc:493] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:13.463048  2402 raft_consensus.cc:3060] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.465543  2603 consensus_queue.cc:1048] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.467837  2552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36cd355e7fcd404f963a5eb70e70db65"
dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
 from {username='slave'} at 127.0.0.1:54156
I20260709 12:24:13.468508  2552 raft_consensus.cc:493] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:13.468906  2552 raft_consensus.cc:3060] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.471977  2402 raft_consensus.cc:515] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.453388  2606 consensus_queue.cc:237] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.475162  2402 leader_election.cc:290] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 2 election: Requested vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:13.475431  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e7206dcbb7483081bd72c656d730bd" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:13.476073  2550 raft_consensus.cc:3060] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.483182  2646 consensus_queue.cc:1048] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:13.484369  2477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e7206dcbb7483081bd72c656d730bd" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:13.475353  2552 raft_consensus.cc:515] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.484539  2550 raft_consensus.cc:2468] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 2.
I20260709 12:24:13.487138  2477 raft_consensus.cc:3055] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:13.488241  2477 raft_consensus.cc:740] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:13.489547  2369 leader_election.cc:304] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:13.490209  2552 leader_election.cc:290] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 2 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:13.490687  2549 raft_consensus.cc:1240] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Rejecting Update request from peer 61018e6aad40475ea3d9ce1c4ec8bd48 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:13.491488  2597 raft_consensus.cc:2804] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:13.489817  2477 consensus_queue.cc:260] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.493059  2597 raft_consensus.cc:697] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Becoming Leader. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:13.493253  2477 raft_consensus.cc:3060] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.494046  2597 consensus_queue.cc:237] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.494792  2637 consensus_queue.cc:1048] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.495270  2551 raft_consensus.cc:1240] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Rejecting Update request from peer 61018e6aad40475ea3d9ce1c4ec8bd48 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:13.493278  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cd355e7fcd404f963a5eb70e70db65" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:13.496759  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cd355e7fcd404f963a5eb70e70db65" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:13.496896  2401 raft_consensus.cc:3060] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.503364  2478 raft_consensus.cc:3055] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:13.503778  2478 raft_consensus.cc:740] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:13.504317  2648 raft_consensus.cc:993] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2: : Instructing follower 13e53d4d46f44702bdf15f3f2be8cca3 to start an election
I20260709 12:24:13.504580  2478 consensus_queue.cc:260] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.505683  2478 raft_consensus.cc:3060] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.505102  2603 raft_consensus.cc:1081] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 LEADER]: Signalling peer 13e53d4d46f44702bdf15f3f2be8cca3 to start an election
I20260709 12:24:13.507794  2301 catalog_manager.cc:5697] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 reported cstate change: term changed from 1 to 2, leader changed from 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194) to 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.516038  2477 raft_consensus.cc:2468] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 2.
I20260709 12:24:13.518908  2400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7b926463d414499a35891b198c473b4"
dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
 from {username='slave'} at 127.0.0.1:57798
I20260709 12:24:13.519522  2400 raft_consensus.cc:493] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:13.519898  2400 raft_consensus.cc:3060] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.521821  2401 raft_consensus.cc:2468] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 2.
I20260709 12:24:13.522689  2402 raft_consensus.cc:1240] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Rejecting Update request from peer 61018e6aad40475ea3d9ce1c4ec8bd48 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:24:13.523967  2517 leader_election.cc:304] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:13.530761  2603 raft_consensus.cc:2804] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:13.530825  2646 consensus_queue.cc:1048] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:13.531450  2400 raft_consensus.cc:515] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.531920  2603 raft_consensus.cc:697] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 LEADER]: Becoming Leader. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Running, Role: LEADER
I20260709 12:24:13.533576  2603 consensus_queue.cc:237] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.541747  2477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b926463d414499a35891b198c473b4" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:13.542181  2603 consensus_queue.cc:1048] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.542728  2477 raft_consensus.cc:3060] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.548034  2301 catalog_manager.cc:5697] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 reported cstate change: term changed from 1 to 2, leader changed from 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194) to 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.551223  2477 raft_consensus.cc:2468] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 2.
I20260709 12:24:13.548982  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b926463d414499a35891b198c473b4" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:13.549531  2400 leader_election.cc:290] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 2 election: Requested vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:13.552245  2476 raft_consensus.cc:1240] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Rejecting Update request from peer 89bec6b331e948f8887a900fd6e2f2a2 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:24:13.552326  2551 raft_consensus.cc:3055] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:13.552953  2551 raft_consensus.cc:740] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Running, Role: LEADER
I20260709 12:24:13.553984  2551 consensus_queue.cc:260] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.554586  2368 leader_election.cc:304] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:13.555124  2551 raft_consensus.cc:3060] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.555546  2597 raft_consensus.cc:2804] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:13.556041  2478 raft_consensus.cc:2468] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 2.
I20260709 12:24:13.556069  2597 raft_consensus.cc:697] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Becoming Leader. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:13.557384  2597 consensus_queue.cc:237] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.563372  2551 raft_consensus.cc:2468] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 2.
I20260709 12:24:13.568172  2635 consensus_queue.cc:1048] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.577553  2301 catalog_manager.cc:5697] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 reported cstate change: term changed from 1 to 2, leader changed from 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194) to 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "89bec6b331e948f8887a900fd6e2f2a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:13.586406  2299 catalog_manager.cc:5697] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 reported cstate change: term changed from 1 to 2, leader changed from 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195) to 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.699435  2597 raft_consensus.cc:993] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3: : Instructing follower 61018e6aad40475ea3d9ce1c4ec8bd48 to start an election
I20260709 12:24:13.699908  2595 raft_consensus.cc:1081] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Signalling peer 61018e6aad40475ea3d9ce1c4ec8bd48 to start an election
I20260709 12:24:13.701572  2477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b3b288fb92c4a78b7dd1d7e5e100970"
dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
 from {username='slave'} at 127.0.0.1:58588
I20260709 12:24:13.702251  2477 raft_consensus.cc:493] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:13.702631  2477 raft_consensus.cc:3060] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.708283  2477 raft_consensus.cc:515] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.709854  2477 leader_election.cc:290] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 2 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:13.710925  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3b288fb92c4a78b7dd1d7e5e100970" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:13.711063  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3b288fb92c4a78b7dd1d7e5e100970" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:13.711741  2400 raft_consensus.cc:3055] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:13.711833  2551 raft_consensus.cc:3060] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.712172  2400 raft_consensus.cc:740] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:13.712957  2400 consensus_queue.cc:260] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.713824  2400 raft_consensus.cc:3060] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.718526  2551 raft_consensus.cc:2468] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 2.
I20260709 12:24:13.719029  2400 raft_consensus.cc:2468] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 2.
I20260709 12:24:13.719266  2549 raft_consensus.cc:1240] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Rejecting Update request from peer 13e53d4d46f44702bdf15f3f2be8cca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:13.719990  2444 leader_election.cc:304] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:13.721218  2635 raft_consensus.cc:2804] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:13.721563  2635 raft_consensus.cc:697] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:13.722379  2635 consensus_queue.cc:237] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:13.728530  2301 catalog_manager.cc:5697] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 1 to 2, leader changed from 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193) to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.766201  2549 raft_consensus.cc:1275] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Refusing update from remote peer 61018e6aad40475ea3d9ce1c4ec8bd48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:13.767524  2635 consensus_queue.cc:1048] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:13.775084  2400 raft_consensus.cc:1275] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Refusing update from remote peer 61018e6aad40475ea3d9ce1c4ec8bd48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:13.776500  2646 consensus_queue.cc:1048] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:13.914600  2477 raft_consensus.cc:1275] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Refusing update from remote peer 89bec6b331e948f8887a900fd6e2f2a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:13.915777  2603 consensus_queue.cc:1048] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:13.924188  2400 raft_consensus.cc:1275] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Refusing update from remote peer 89bec6b331e948f8887a900fd6e2f2a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:13.925789  2603 consensus_queue.cc:1048] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:13.948937  2549 raft_consensus.cc:1275] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Refusing update from remote peer 13e53d4d46f44702bdf15f3f2be8cca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:13.950449  2595 consensus_queue.cc:1048] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:13.958808  2477 raft_consensus.cc:1275] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Refusing update from remote peer 13e53d4d46f44702bdf15f3f2be8cca3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:13.961510  2606 consensus_queue.cc:1048] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:14.097942  2477 raft_consensus.cc:1275] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Refusing update from remote peer 13e53d4d46f44702bdf15f3f2be8cca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:14.099279  2606 consensus_queue.cc:1048] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:14.104064  2549 raft_consensus.cc:1275] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Refusing update from remote peer 13e53d4d46f44702bdf15f3f2be8cca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:14.105571  2597 consensus_queue.cc:1048] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:14.114253  2477 raft_consensus.cc:1275] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Refusing update from remote peer 13e53d4d46f44702bdf15f3f2be8cca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:14.115640  2597 consensus_queue.cc:1048] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:14.119175  2549 raft_consensus.cc:1275] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Refusing update from remote peer 13e53d4d46f44702bdf15f3f2be8cca3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:14.120636  2597 consensus_queue.cc:1048] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:14.165230  2549 raft_consensus.cc:1275] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Refusing update from remote peer 61018e6aad40475ea3d9ce1c4ec8bd48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:14.166579  2646 consensus_queue.cc:1048] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:14.175354  2400 raft_consensus.cc:1275] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Refusing update from remote peer 61018e6aad40475ea3d9ce1c4ec8bd48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:14.177162  2635 consensus_queue.cc:1048] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:16.382910  2301 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50950:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:16.384979  2301 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:16.435945  2390 tablet_service.cc:1511] Processing CreateTablet for tablet 3c019c3264cc4e79aa6922758acf533c (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:16.437286  2390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c019c3264cc4e79aa6922758acf533c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.437249  2461 tablet_service.cc:1511] Processing CreateTablet for tablet 3c019c3264cc4e79aa6922758acf533c (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:16.438712  2461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c019c3264cc4e79aa6922758acf533c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.441591  2389 tablet_service.cc:1511] Processing CreateTablet for tablet 935539cb010b4b83bf378e5809b0b185 (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:16.443068  2389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935539cb010b4b83bf378e5809b0b185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.443197  2465 tablet_service.cc:1511] Processing CreateTablet for tablet 935539cb010b4b83bf378e5809b0b185 (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:16.444651  2465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935539cb010b4b83bf378e5809b0b185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.456840  2535 tablet_service.cc:1511] Processing CreateTablet for tablet 3c019c3264cc4e79aa6922758acf533c (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:16.458792  2535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c019c3264cc4e79aa6922758acf533c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.463641  2688 tablet_bootstrap.cc:492] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:16.468320  2464 tablet_service.cc:1511] Processing CreateTablet for tablet ccd5513dc2504c068f6bf49b626d02fb (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:16.469805  2464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd5513dc2504c068f6bf49b626d02fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.472594  2539 tablet_service.cc:1511] Processing CreateTablet for tablet 935539cb010b4b83bf378e5809b0b185 (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:16.473320  2540 tablet_service.cc:1511] Processing CreateTablet for tablet ccd5513dc2504c068f6bf49b626d02fb (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:16.473941  2539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935539cb010b4b83bf378e5809b0b185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.474612  2540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd5513dc2504c068f6bf49b626d02fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.476202  2393 tablet_service.cc:1511] Processing CreateTablet for tablet 824a47f60dcb4a13927ea2c67d65f16d (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:16.477478  2393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824a47f60dcb4a13927ea2c67d65f16d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.478994  2463 tablet_service.cc:1511] Processing CreateTablet for tablet 824a47f60dcb4a13927ea2c67d65f16d (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:16.480306  2463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824a47f60dcb4a13927ea2c67d65f16d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.480907  2536 tablet_service.cc:1511] Processing CreateTablet for tablet 824a47f60dcb4a13927ea2c67d65f16d (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:16.482240  2536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824a47f60dcb4a13927ea2c67d65f16d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.483052  2387 tablet_service.cc:1511] Processing CreateTablet for tablet 4a98d48a27ce4466adbf463c69a34a6c (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:16.484304  2387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a98d48a27ce4466adbf463c69a34a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.488088  2467 tablet_service.cc:1511] Processing CreateTablet for tablet 4a98d48a27ce4466adbf463c69a34a6c (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:16.489435  2467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a98d48a27ce4466adbf463c69a34a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.491773  2538 tablet_service.cc:1511] Processing CreateTablet for tablet 4a98d48a27ce4466adbf463c69a34a6c (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:16.493764  2538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a98d48a27ce4466adbf463c69a34a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.505079  2392 tablet_service.cc:1511] Processing CreateTablet for tablet 1ceb8e78aced4beeae0131227449c8ff (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:16.506685  2392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ceb8e78aced4beeae0131227449c8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.508737  2465 tablet_service.cc:1511] Processing CreateTablet for tablet 1ceb8e78aced4beeae0131227449c8ff (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:16.469435  2390 tablet_service.cc:1511] Processing CreateTablet for tablet ccd5513dc2504c068f6bf49b626d02fb (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:16.510810  2465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ceb8e78aced4beeae0131227449c8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.514173  2390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd5513dc2504c068f6bf49b626d02fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.532370  2537 tablet_service.cc:1511] Processing CreateTablet for tablet 1ceb8e78aced4beeae0131227449c8ff (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:16.549528  2465 tablet_service.cc:1511] Processing CreateTablet for tablet 7db54a1e320346578df152c8180c521a (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:16.550932  2537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ceb8e78aced4beeae0131227449c8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.550932  2465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db54a1e320346578df152c8180c521a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.529771  2688 tablet_bootstrap.cc:654] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.548914  2388 tablet_service.cc:1511] Processing CreateTablet for tablet 7db54a1e320346578df152c8180c521a (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:16.557018  2388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db54a1e320346578df152c8180c521a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.572679  2542 tablet_service.cc:1511] Processing CreateTablet for tablet 7db54a1e320346578df152c8180c521a (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:16.574316  2542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db54a1e320346578df152c8180c521a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.583791  2393 tablet_service.cc:1511] Processing CreateTablet for tablet a61835c7ef64498da226d783703e02ef (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:16.589668  2393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61835c7ef64498da226d783703e02ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.589911  2467 tablet_service.cc:1511] Processing CreateTablet for tablet a61835c7ef64498da226d783703e02ef (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:16.590171  2391 tablet_service.cc:1511] Processing CreateTablet for tablet 6fac7a1824d04cfca38581b65273e283 (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:16.591516  2391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fac7a1824d04cfca38581b65273e283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.592839  2689 tablet_bootstrap.cc:492] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:16.593145  2536 tablet_service.cc:1511] Processing CreateTablet for tablet a61835c7ef64498da226d783703e02ef (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:16.599610  2464 tablet_service.cc:1511] Processing CreateTablet for tablet 6fac7a1824d04cfca38581b65273e283 (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:16.600205  2536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61835c7ef64498da226d783703e02ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.603212  2539 tablet_service.cc:1511] Processing CreateTablet for tablet 6fac7a1824d04cfca38581b65273e283 (DEFAULT_TABLE table=soft_deleted_table [id=572e0b9f83a348498c706f524039caa7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 12:24:16.608958  2349 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:16.611061  2688 tablet_bootstrap.cc:492] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:16.611898  2688 ts_tablet_manager.cc:1403] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.149s	user 0.016s	sys 0.000s
I20260709 12:24:16.617416  2688 raft_consensus.cc:359] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.618307  2688 raft_consensus.cc:385] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.618691  2688 raft_consensus.cc:740] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.617873  2539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fac7a1824d04cfca38581b65273e283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.622426  2688 consensus_queue.cc:260] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.624213  2467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61835c7ef64498da226d783703e02ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.633656  2464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fac7a1824d04cfca38581b65273e283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.640138  2692 tablet_bootstrap.cc:492] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:16.703469  2688 ts_tablet_manager.cc:1434] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.000s
I20260709 12:24:16.710670  2688 tablet_bootstrap.cc:492] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:16.713025  2689 tablet_bootstrap.cc:654] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.730544  2692 tablet_bootstrap.cc:654] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:16.743206  2443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.193:40369, user_credentials={real_user=slave}} blocked reactor thread for 90453.2us
I20260709 12:24:16.753720  2689 tablet_bootstrap.cc:492] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:16.754431  2689 ts_tablet_manager.cc:1403] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.162s	user 0.009s	sys 0.015s
I20260709 12:24:16.757871  2689 raft_consensus.cc:359] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.758836  2689 raft_consensus.cc:385] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.759223  2689 raft_consensus.cc:740] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.760094  2689 consensus_queue.cc:260] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.762593  2692 tablet_bootstrap.cc:492] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:16.763027  2689 ts_tablet_manager.cc:1434] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:24:16.763262  2692 ts_tablet_manager.cc:1403] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.003s
I20260709 12:24:16.764314  2689 tablet_bootstrap.cc:492] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:16.765543  2688 tablet_bootstrap.cc:654] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.766716  2692 raft_consensus.cc:359] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.767608  2692 raft_consensus.cc:385] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.767964  2692 raft_consensus.cc:740] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.769009  2692 consensus_queue.cc:260] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.771759  2692 ts_tablet_manager.cc:1434] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:16.773305  2689 tablet_bootstrap.cc:654] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.775452  2692 tablet_bootstrap.cc:492] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:16.777483  2688 tablet_bootstrap.cc:492] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:16.778129  2688 ts_tablet_manager.cc:1403] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.068s	user 0.004s	sys 0.015s
I20260709 12:24:16.784797  2692 tablet_bootstrap.cc:654] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.785475  2689 tablet_bootstrap.cc:492] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:16.786159  2689 ts_tablet_manager.cc:1403] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.001s
I20260709 12:24:16.781234  2688 raft_consensus.cc:359] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.788160  2688 raft_consensus.cc:385] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.788544  2688 raft_consensus.cc:740] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.789394  2688 consensus_queue.cc:260] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.789930  2689 raft_consensus.cc:359] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.790824  2689 raft_consensus.cc:385] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.791181  2689 raft_consensus.cc:740] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.791347  2688 ts_tablet_manager.cc:1434] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:24:16.792054  2689 consensus_queue.cc:260] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.792536  2688 tablet_bootstrap.cc:492] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:16.794926  2689 ts_tablet_manager.cc:1434] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:24:16.796015  2689 tablet_bootstrap.cc:492] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:16.799952  2688 tablet_bootstrap.cc:654] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.803052  2689 tablet_bootstrap.cc:654] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.804968  2692 tablet_bootstrap.cc:492] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:16.805553  2692 ts_tablet_manager.cc:1403] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 12:24:16.808882  2692 raft_consensus.cc:359] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.809651  2692 raft_consensus.cc:385] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.810005  2692 raft_consensus.cc:740] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.810945  2688 tablet_bootstrap.cc:492] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:16.811376  2689 tablet_bootstrap.cc:492] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:16.810873  2692 consensus_queue.cc:260] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.811463  2688 ts_tablet_manager.cc:1403] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:24:16.812028  2689 ts_tablet_manager.cc:1403] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.006s
I20260709 12:24:16.813844  2692 ts_tablet_manager.cc:1434] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:24:16.814934  2692 tablet_bootstrap.cc:492] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:16.815279  2688 raft_consensus.cc:359] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.815563  2689 raft_consensus.cc:359] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.816154  2688 raft_consensus.cc:385] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.816366  2689 raft_consensus.cc:385] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.816576  2688 raft_consensus.cc:740] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.816787  2689 raft_consensus.cc:740] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.817488  2688 consensus_queue.cc:260] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.817747  2689 consensus_queue.cc:260] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.820391  2689 ts_tablet_manager.cc:1434] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:16.822310  2692 tablet_bootstrap.cc:654] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.823762  2688 ts_tablet_manager.cc:1434] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:24:16.824870  2688 tablet_bootstrap.cc:492] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:16.827036  2603 raft_consensus.cc:493] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.827595  2603 raft_consensus.cc:515] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.829844  2689 tablet_bootstrap.cc:492] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:16.832398  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd5513dc2504c068f6bf49b626d02fb" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:16.840205  2689 tablet_bootstrap.cc:654] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.833045  2477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd5513dc2504c068f6bf49b626d02fb" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:16.833348  2635 raft_consensus.cc:493] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.842546  2688 tablet_bootstrap.cc:654] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.842377  2635 raft_consensus.cc:515] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.844688  2635 leader_election.cc:290] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:16.838907  2694 raft_consensus.cc:493] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.845718  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935539cb010b4b83bf378e5809b0b185" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:16.846658  2400 raft_consensus.cc:2468] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:16.845758  2694 raft_consensus.cc:515] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.829969  2603 leader_election.cc:290] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:16.855542  2688 tablet_bootstrap.cc:492] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:16.854805  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c019c3264cc4e79aa6922758acf533c" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:16.856170  2401 raft_consensus.cc:2468] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
W20260709 12:24:16.847986  2517 leader_election.cc:343] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:16.857331  2517 leader_election.cc:343] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:16.857472  2443 leader_election.cc:304] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:16.858584  2688 ts_tablet_manager.cc:1403] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.009s
I20260709 12:24:16.858911  2443 leader_election.cc:304] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:16.857795  2517 leader_election.cc:304] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89bec6b331e948f8887a900fd6e2f2a2; no voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:16.861502  2549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935539cb010b4b83bf378e5809b0b185" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:16.861889  2688 raft_consensus.cc:359] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.862860  2688 raft_consensus.cc:385] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.864012  2688 raft_consensus.cc:740] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
W20260709 12:24:16.865064  2444 leader_election.cc:343] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:16.865108  2688 consensus_queue.cc:260] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.863817  2549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c019c3264cc4e79aa6922758acf533c" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:16.867889  2693 raft_consensus.cc:2804] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:16.868484  2693 raft_consensus.cc:493] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.868911  2693 raft_consensus.cc:3060] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.870812  2688 ts_tablet_manager.cc:1434] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:24:16.871887  2688 tablet_bootstrap.cc:492] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:16.876688  2635 raft_consensus.cc:2804] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:16.877676  2635 raft_consensus.cc:493] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.878436  2635 raft_consensus.cc:3060] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.884837  2688 tablet_bootstrap.cc:654] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.855595  2694 leader_election.cc:290] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:16.886219  2603 raft_consensus.cc:2749] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:16.888692  2444 leader_election.cc:343] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:16.896458  2688 tablet_bootstrap.cc:492] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:16.897275  2688 ts_tablet_manager.cc:1403] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.012s
I20260709 12:24:16.896489  2693 raft_consensus.cc:515] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.900207  2692 tablet_bootstrap.cc:492] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:16.900738  2688 raft_consensus.cc:359] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.900974  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935539cb010b4b83bf378e5809b0b185" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:16.900781  2692 ts_tablet_manager.cc:1403] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.011s
I20260709 12:24:16.901876  2401 raft_consensus.cc:3060] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.903589  2635 raft_consensus.cc:515] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.904804  2692 raft_consensus.cc:359] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.905552  2692 raft_consensus.cc:385] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.905758  2635 leader_election.cc:290] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:16.905839  2692 raft_consensus.cc:740] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.906783  2692 consensus_queue.cc:260] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.901546  2688 raft_consensus.cc:385] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.907445  2549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c019c3264cc4e79aa6922758acf533c" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:16.907923  2688 raft_consensus.cc:740] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.908772  2688 consensus_queue.cc:260] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.909241  2692 ts_tablet_manager.cc:1434] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:16.909632  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c019c3264cc4e79aa6922758acf533c" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:16.910130  2689 tablet_bootstrap.cc:492] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:16.910274  2400 raft_consensus.cc:3060] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.910382  2692 tablet_bootstrap.cc:492] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:16.910661  2689 ts_tablet_manager.cc:1403] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.081s	user 0.039s	sys 0.039s
I20260709 12:24:16.911131  2688 ts_tablet_manager.cc:1434] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:24:16.913738  2689 raft_consensus.cc:359] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.914471  2689 raft_consensus.cc:385] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.914776  2689 raft_consensus.cc:740] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.915613  2689 consensus_queue.cc:260] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.917443  2692 tablet_bootstrap.cc:654] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.917974  2689 ts_tablet_manager.cc:1434] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:16.919123  2689 tablet_bootstrap.cc:492] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
W20260709 12:24:16.920967  2444 leader_election.cc:343] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:16.921855  2690 raft_consensus.cc:493] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.922417  2690 raft_consensus.cc:515] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.926635  2689 tablet_bootstrap.cc:654] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.927971  2690 leader_election.cc:290] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:16.928762  2549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824a47f60dcb4a13927ea2c67d65f16d" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:16.941983  2549 raft_consensus.cc:2468] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 0.
I20260709 12:24:16.928879  2688 tablet_bootstrap.cc:492] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:16.930193  2477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824a47f60dcb4a13927ea2c67d65f16d" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:16.943955  2689 tablet_bootstrap.cc:492] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:16.944561  2689 ts_tablet_manager.cc:1403] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.001s
I20260709 12:24:16.944516  2369 leader_election.cc:304] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:16.945128  2693 leader_election.cc:290] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:16.940784  2692 tablet_bootstrap.cc:492] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:16.946007  2692 ts_tablet_manager.cc:1403] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.016s
W20260709 12:24:16.947288  2368 leader_election.cc:343] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:16.947736  2401 raft_consensus.cc:2468] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:16.941236  2400 raft_consensus.cc:2468] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:16.948115  2689 raft_consensus.cc:359] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.948741  2549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935539cb010b4b83bf378e5809b0b185" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:16.949069  2689 raft_consensus.cc:385] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.949386  2692 raft_consensus.cc:359] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.949903  2443 leader_election.cc:304] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:16.950240  2692 raft_consensus.cc:385] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.949401  2549 raft_consensus.cc:3060] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.950614  2692 raft_consensus.cc:740] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.951058  2443 leader_election.cc:304] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 89bec6b331e948f8887a900fd6e2f2a2
I20260709 12:24:16.951992  2635 raft_consensus.cc:2804] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:16.951767  2692 consensus_queue.cc:260] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.952435  2693 raft_consensus.cc:2804] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:16.952546  2635 raft_consensus.cc:697] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:16.953063  2693 raft_consensus.cc:697] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:16.953539  2690 raft_consensus.cc:2804] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:16.953946  2693 consensus_queue.cc:237] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.959599  2688 tablet_bootstrap.cc:654] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.959676  2549 raft_consensus.cc:2468] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:16.960567  2603 raft_consensus.cc:493] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.961037  2603 raft_consensus.cc:515] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.959877  2690 raft_consensus.cc:493] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.962877  2690 raft_consensus.cc:3060] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.965019  2603 leader_election.cc:290] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:16.949406  2689 raft_consensus.cc:740] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.966208  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935539cb010b4b83bf378e5809b0b185" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:16.966367  2689 consensus_queue.cc:260] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.966936  2400 raft_consensus.cc:2468] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 1.
I20260709 12:24:16.966786  2477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935539cb010b4b83bf378e5809b0b185" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:16.953758  2635 consensus_queue.cc:237] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.969406  2689 ts_tablet_manager.cc:1434] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:24:16.970494  2689 tablet_bootstrap.cc:492] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:16.970628  2517 leader_election.cc:304] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:16.972054  2603 raft_consensus.cc:2804] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.972501  2603 raft_consensus.cc:493] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.972898  2603 raft_consensus.cc:3060] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.977962  2689 tablet_bootstrap.cc:654] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.990208  2689 tablet_bootstrap.cc:492] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:16.990810  2689 ts_tablet_manager.cc:1403] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 12:24:16.992441  2688 tablet_bootstrap.cc:492] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:16.993822  2689 raft_consensus.cc:359] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.994453  2688 ts_tablet_manager.cc:1403] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.011s
I20260709 12:24:16.995302  2689 raft_consensus.cc:385] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.995774  2689 raft_consensus.cc:740] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.996623  2689 consensus_queue.cc:260] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.000912  2688 raft_consensus.cc:359] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:16.997427  2603 raft_consensus.cc:515] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.003146  2689 ts_tablet_manager.cc:1434] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:24:17.002835  2690 raft_consensus.cc:515] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.004335  2689 tablet_bootstrap.cc:492] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:17.004379  2688 raft_consensus.cc:385] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:17.005141  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935539cb010b4b83bf378e5809b0b185" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:17.009738  2688 raft_consensus.cc:740] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:17.009930  2400 raft_consensus.cc:3060] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.010752  2688 consensus_queue.cc:260] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.012617  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824a47f60dcb4a13927ea2c67d65f16d" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:17.013588  2478 raft_consensus.cc:3060] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.016281  2688 ts_tablet_manager.cc:1434] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 12:24:17.017578  2688 tablet_bootstrap.cc:492] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:17.021061  2400 raft_consensus.cc:2468] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 2.
I20260709 12:24:17.007690  2477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935539cb010b4b83bf378e5809b0b185" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:17.007573  2299 catalog_manager.cc:5697] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.030977  2517 leader_election.cc:304] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:17.032040  2692 ts_tablet_manager.cc:1434] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.086s	user 0.017s	sys 0.036s
I20260709 12:24:17.032354  2708 raft_consensus.cc:2804] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:17.024425  2688 tablet_bootstrap.cc:654] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:17.007076  2603 leader_election.cc:290] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 2 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:17.031857  2549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824a47f60dcb4a13927ea2c67d65f16d" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:17.033860  2549 raft_consensus.cc:3060] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.035681  2692 tablet_bootstrap.cc:492] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:17.026551  2689 tablet_bootstrap.cc:654] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:17.044268  2708 raft_consensus.cc:697] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 LEADER]: Becoming Leader. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Running, Role: LEADER
I20260709 12:24:17.045356  2708 consensus_queue.cc:237] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.050722  2688 tablet_bootstrap.cc:492] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:17.051467  2688 ts_tablet_manager.cc:1403] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.006s
I20260709 12:24:17.056267  2478 raft_consensus.cc:2468] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 1.
I20260709 12:24:17.057339  2692 tablet_bootstrap.cc:654] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:17.057963  2368 leader_election.cc:304] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:17.059235  2606 raft_consensus.cc:2804] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:17.060453  2690 leader_election.cc:290] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Requested vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.061443  2549 raft_consensus.cc:2468] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 1.
I20260709 12:24:17.069123  2688 raft_consensus.cc:359] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.069978  2688 raft_consensus.cc:385] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:17.070302  2688 raft_consensus.cc:740] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:17.073670  2606 raft_consensus.cc:697] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Becoming Leader. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:17.076617  2606 consensus_queue.cc:237] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.077268  2688 consensus_queue.cc:260] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.080093  2688 ts_tablet_manager.cc:1434] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 12:24:17.081171  2688 tablet_bootstrap.cc:492] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:17.088156  2688 tablet_bootstrap.cc:654] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:17.088176  2689 tablet_bootstrap.cc:492] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:17.088930  2689 ts_tablet_manager.cc:1403] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.085s	user 0.023s	sys 0.012s
I20260709 12:24:17.090901  2301 catalog_manager.cc:5697] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.091946  2692 tablet_bootstrap.cc:492] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:17.092470  2692 ts_tablet_manager.cc:1403] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.001s
I20260709 12:24:17.096067  2689 raft_consensus.cc:359] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.097270  2689 raft_consensus.cc:385] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:17.097733  2689 raft_consensus.cc:740] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:17.098884  2689 consensus_queue.cc:260] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.102252  2689 ts_tablet_manager.cc:1434] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:24:17.101753  2692 raft_consensus.cc:359] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.102974  2692 raft_consensus.cc:385] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:17.103390  2692 raft_consensus.cc:740] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:17.104022  2689 tablet_bootstrap.cc:492] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:17.104559  2692 consensus_queue.cc:260] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.108443  2692 ts_tablet_manager.cc:1434] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 12:24:17.109990  2692 tablet_bootstrap.cc:492] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:17.114315  2689 tablet_bootstrap.cc:654] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:17.117219  2688 tablet_bootstrap.cc:492] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:17.117846  2688 ts_tablet_manager.cc:1403] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.037s	user 0.027s	sys 0.007s
I20260709 12:24:17.121415  2688 raft_consensus.cc:359] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.122359  2688 raft_consensus.cc:385] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:17.122712  2688 raft_consensus.cc:740] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:17.123584  2688 consensus_queue.cc:260] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.126350  2692 tablet_bootstrap.cc:654] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:17.126438  2688 ts_tablet_manager.cc:1434] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:24:17.129675  2300 catalog_manager.cc:5697] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 reported cstate change: term changed from 1 to 2, leader changed from 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194) to 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195). New cstate: current_term: 2 leader_uuid: "89bec6b331e948f8887a900fd6e2f2a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:17.137049  2708 raft_consensus.cc:493] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.137666  2708 raft_consensus.cc:515] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.138473  2688 tablet_bootstrap.cc:492] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3: Bootstrap starting.
I20260709 12:24:17.139869  2689 tablet_bootstrap.cc:492] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:17.140391  2689 ts_tablet_manager.cc:1403] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.016s
I20260709 12:24:17.140607  2708 leader_election.cc:290] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:17.143081  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c019c3264cc4e79aa6922758acf533c" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:17.143678  2689 raft_consensus.cc:359] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.150864  2689 raft_consensus.cc:385] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:17.151160  2689 raft_consensus.cc:740] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:17.143937  2400 raft_consensus.cc:2393] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89bec6b331e948f8887a900fd6e2f2a2 in current term 1: Already voted for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in this term.
I20260709 12:24:17.151964  2689 consensus_queue.cc:260] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.146083  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c019c3264cc4e79aa6922758acf533c" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:17.154181  2689 ts_tablet_manager.cc:1434] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:24:17.149411  2301 catalog_manager.cc:5697] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.155164  2689 tablet_bootstrap.cc:492] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48: Bootstrap starting.
I20260709 12:24:17.155308  2517 leader_election.cc:304] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89bec6b331e948f8887a900fd6e2f2a2; no voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:17.156474  2708 raft_consensus.cc:3060] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.160336  2689 tablet_bootstrap.cc:654] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:17.164167  2708 raft_consensus.cc:2749] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:17.165959  2693 raft_consensus.cc:493] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.166513  2693 raft_consensus.cc:515] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.168849  2688 tablet_bootstrap.cc:654] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:17.174010  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ceb8e78aced4beeae0131227449c8ff" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:17.174728  2400 raft_consensus.cc:2468] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:17.176154  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ceb8e78aced4beeae0131227449c8ff" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
W20260709 12:24:17.177603  2444 leader_election.cc:343] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:17.178751  2693 leader_election.cc:290] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.179443  2443 leader_election.cc:304] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 89bec6b331e948f8887a900fd6e2f2a2
I20260709 12:24:17.180672  2693 raft_consensus.cc:2804] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:17.181035  2693 raft_consensus.cc:493] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.181367  2693 raft_consensus.cc:3060] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.186802  2693 raft_consensus.cc:515] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.188493  2692 tablet_bootstrap.cc:492] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:17.189118  2692 ts_tablet_manager.cc:1403] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.079s	user 0.001s	sys 0.012s
I20260709 12:24:17.190138  2689 tablet_bootstrap.cc:492] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48: No bootstrap required, opened a new log
I20260709 12:24:17.189878  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ceb8e78aced4beeae0131227449c8ff" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:17.190253  2688 tablet_bootstrap.cc:492] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3: No bootstrap required, opened a new log
I20260709 12:24:17.190647  2689 ts_tablet_manager.cc:1403] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.007s
I20260709 12:24:17.190599  2400 raft_consensus.cc:3060] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.191300  2688 ts_tablet_manager.cc:1403] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.008s
I20260709 12:24:17.192292  2692 raft_consensus.cc:359] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.193060  2692 raft_consensus.cc:385] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:17.193353  2692 raft_consensus.cc:740] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:17.194152  2692 consensus_queue.cc:260] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.194352  2688 raft_consensus.cc:359] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.195458  2688 raft_consensus.cc:385] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:17.195788  2688 raft_consensus.cc:740] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Initialized, Role: FOLLOWER
I20260709 12:24:17.196516  2688 consensus_queue.cc:260] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.198575  2688 ts_tablet_manager.cc:1434] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:17.194610  2606 raft_consensus.cc:493] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.190737  2635 raft_consensus.cc:493] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.199321  2606 raft_consensus.cc:515] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.199617  2635 raft_consensus.cc:515] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.201560  2606 leader_election.cc:290] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.201821  2635 leader_election.cc:290] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.193634  2689 raft_consensus.cc:359] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.197227  2692 ts_tablet_manager.cc:1434] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:24:17.203291  2689 raft_consensus.cc:385] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:17.203715  2689 raft_consensus.cc:740] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Initialized, Role: FOLLOWER
I20260709 12:24:17.203315  2693 leader_election.cc:290] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.204653  2549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db54a1e320346578df152c8180c521a" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:17.204483  2689 consensus_queue.cc:260] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.204746  2692 tablet_bootstrap.cc:492] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
W20260709 12:24:17.206097  2369 leader_election.cc:343] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:17.206722  2689 ts_tablet_manager.cc:1434] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:24:17.206614  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd5513dc2504c068f6bf49b626d02fb" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:17.207335  2551 raft_consensus.cc:2468] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:17.208853  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db54a1e320346578df152c8180c521a" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:17.209442  2478 raft_consensus.cc:2468] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 0.
I20260709 12:24:17.210824  2368 leader_election.cc:304] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 89bec6b331e948f8887a900fd6e2f2a2
I20260709 12:24:17.212000  2606 raft_consensus.cc:2804] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:17.212374  2606 raft_consensus.cc:493] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.212751  2606 raft_consensus.cc:3060] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.212535  2444 leader_election.cc:304] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:17.213850  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ceb8e78aced4beeae0131227449c8ff" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
W20260709 12:24:17.215310  2444 leader_election.cc:343] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:17.215890  2692 tablet_bootstrap.cc:654] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:17.215739  2400 raft_consensus.cc:2468] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:17.209348  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd5513dc2504c068f6bf49b626d02fb" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:17.220647  2606 raft_consensus.cc:515] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.221139  2443 leader_election.cc:304] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 89bec6b331e948f8887a900fd6e2f2a2
I20260709 12:24:17.222011  2692 tablet_bootstrap.cc:492] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:17.222446  2635 raft_consensus.cc:2804] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:17.222921  2635 raft_consensus.cc:493] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.223450  2635 raft_consensus.cc:3060] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.223567  2606 leader_election.cc:290] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Requested vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.225656  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db54a1e320346578df152c8180c521a" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:17.220697  2401 raft_consensus.cc:2468] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 0.
I20260709 12:24:17.226671  2693 raft_consensus.cc:2804] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:24:17.227064  2369 leader_election.cc:343] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:17.227228  2693 raft_consensus.cc:697] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:17.228122  2693 consensus_queue.cc:237] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.222564  2692 ts_tablet_manager.cc:1403] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:24:17.233161  2635 raft_consensus.cc:515] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.234130  2692 raft_consensus.cc:359] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.235261  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db54a1e320346578df152c8180c521a" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:17.235914  2478 raft_consensus.cc:3060] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.236954  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd5513dc2504c068f6bf49b626d02fb" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:17.237694  2551 raft_consensus.cc:3060] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.236735  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd5513dc2504c068f6bf49b626d02fb" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:17.239245  2401 raft_consensus.cc:3060] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.235502  2635 leader_election.cc:290] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.243556  2300 catalog_manager.cc:5697] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.244884  2478 raft_consensus.cc:2468] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 1.
I20260709 12:24:17.245946  2551 raft_consensus.cc:2468] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:17.235316  2692 raft_consensus.cc:385] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:17.246693  2692 raft_consensus.cc:740] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:17.246820  2368 leader_election.cc:304] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 89bec6b331e948f8887a900fd6e2f2a2
I20260709 12:24:17.247295  2444 leader_election.cc:304] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:17.247704  2401 raft_consensus.cc:2468] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 1.
I20260709 12:24:17.247524  2692 consensus_queue.cc:260] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.248320  2635 raft_consensus.cc:2804] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:17.248802  2635 raft_consensus.cc:697] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:17.249323  2606 raft_consensus.cc:2804] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:17.250061  2692 ts_tablet_manager.cc:1434] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:24:17.249629  2635 consensus_queue.cc:237] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.250705  2606 raft_consensus.cc:697] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Becoming Leader. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:17.251128  2692 tablet_bootstrap.cc:492] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:17.251705  2606 consensus_queue.cc:237] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.253119  2718 raft_consensus.cc:493] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.253599  2718 raft_consensus.cc:515] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.256803  2718 leader_election.cc:290] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.258610  2692 tablet_bootstrap.cc:654] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:17.260494  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a98d48a27ce4466adbf463c69a34a6c" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:17.261574  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a98d48a27ce4466adbf463c69a34a6c" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2" is_pre_election: true
I20260709 12:24:17.262269  2478 raft_consensus.cc:2468] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 0.
I20260709 12:24:17.263877  2368 leader_election.cc:304] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:17.265043  2718 raft_consensus.cc:2804] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:17.265506  2718 raft_consensus.cc:493] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.265937  2718 raft_consensus.cc:3060] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.273468  2692 tablet_bootstrap.cc:492] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:17.274180  2708 raft_consensus.cc:493] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.274225  2692 ts_tablet_manager.cc:1403] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.011s
I20260709 12:24:17.274766  2708 raft_consensus.cc:515] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.277118  2708 leader_election.cc:290] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:17.262346  2551 raft_consensus.cc:2468] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 0.
I20260709 12:24:17.274505  2718 raft_consensus.cc:515] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.278618  2299 catalog_manager.cc:5697] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.280169  2692 raft_consensus.cc:359] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.280876  2692 raft_consensus.cc:385] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:17.281155  2692 raft_consensus.cc:740] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:17.282006  2692 consensus_queue.cc:260] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.284840  2692 ts_tablet_manager.cc:1434] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 12:24:17.286962  2692 tablet_bootstrap.cc:492] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2: Bootstrap starting.
I20260709 12:24:17.282968  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a98d48a27ce4466adbf463c69a34a6c" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:17.288458  2477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a98d48a27ce4466adbf463c69a34a6c" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:17.289022  2551 raft_consensus.cc:3060] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.292970  2692 tablet_bootstrap.cc:654] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:17.289201  2477 raft_consensus.cc:3060] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.294559  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61835c7ef64498da226d783703e02ef" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:17.295250  2401 raft_consensus.cc:2468] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 0.
I20260709 12:24:17.296597  2517 leader_election.cc:304] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:17.289511  2718 leader_election.cc:290] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Requested vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.297384  2708 raft_consensus.cc:2804] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:17.297804  2708 raft_consensus.cc:493] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.280418  2300 catalog_manager.cc:5697] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 1 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.298168  2708 raft_consensus.cc:3060] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.301156  2551 raft_consensus.cc:2468] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 1.
I20260709 12:24:17.302732  2369 leader_election.cc:304] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:17.303978  2718 raft_consensus.cc:2804] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:17.304586  2718 raft_consensus.cc:697] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Becoming Leader. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:17.305704  2708 raft_consensus.cc:515] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.305670  2718 consensus_queue.cc:237] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.308548  2692 tablet_bootstrap.cc:492] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2: No bootstrap required, opened a new log
I20260709 12:24:17.308820  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61835c7ef64498da226d783703e02ef" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:17.309134  2692 ts_tablet_manager.cc:1403] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.008s
I20260709 12:24:17.309470  2401 raft_consensus.cc:3060] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.312577  2692 raft_consensus.cc:359] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.313565  2692 raft_consensus.cc:385] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:17.313902  2692 raft_consensus.cc:740] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Initialized, Role: FOLLOWER
I20260709 12:24:17.315132  2692 consensus_queue.cc:260] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.317332  2401 raft_consensus.cc:2468] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 1.
I20260709 12:24:17.318648  2517 leader_election.cc:304] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:17.319523  2714 raft_consensus.cc:2804] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:17.320039  2714 raft_consensus.cc:697] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 LEADER]: Becoming Leader. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Running, Role: LEADER
I20260709 12:24:17.320878  2714 consensus_queue.cc:237] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.322485  2692 ts_tablet_manager.cc:1434] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:24:17.326610  2477 raft_consensus.cc:2468] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 1.
I20260709 12:24:17.326896  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61835c7ef64498da226d783703e02ef" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:17.327548  2476 raft_consensus.cc:3060] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.328217  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61835c7ef64498da226d783703e02ef" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:17.330374  2708 leader_election.cc:290] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:17.333837  2476 raft_consensus.cc:2468] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 1.
I20260709 12:24:17.343086  2300 catalog_manager.cc:5697] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "89bec6b331e948f8887a900fd6e2f2a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:17.344720  2301 catalog_manager.cc:5697] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193). New cstate: current_term: 1 leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.356233  2401 raft_consensus.cc:1240] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Rejecting Update request from peer 61018e6aad40475ea3d9ce1c4ec8bd48 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:17.357560  2635 consensus_queue.cc:1059] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.358295  2693 raft_consensus.cc:3055] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:17.358598  2693 raft_consensus.cc:740] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:17.359283  2693 consensus_queue.cc:260] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.360185  2693 raft_consensus.cc:3060] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.406725  2714 raft_consensus.cc:493] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.407297  2714 raft_consensus.cc:515] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.409178  2714 leader_election.cc:290] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:17.409881  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db54a1e320346578df152c8180c521a" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:17.410285  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db54a1e320346578df152c8180c521a" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:17.411154  2476 raft_consensus.cc:2393] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89bec6b331e948f8887a900fd6e2f2a2 in current term 1: Already voted for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in this term.
I20260709 12:24:17.412103  2517 leader_election.cc:304] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89bec6b331e948f8887a900fd6e2f2a2; no voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:17.412935  2714 raft_consensus.cc:3060] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.418175  2714 raft_consensus.cc:2749] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:17.444952  2714 raft_consensus.cc:493] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.445509  2714 raft_consensus.cc:515] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.447176  2714 leader_election.cc:290] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:17.448053  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fac7a1824d04cfca38581b65273e283" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" is_pre_election: true
I20260709 12:24:17.448278  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fac7a1824d04cfca38581b65273e283" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" is_pre_election: true
I20260709 12:24:17.448698  2401 raft_consensus.cc:2468] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 0.
I20260709 12:24:17.448948  2478 raft_consensus.cc:2468] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 0.
I20260709 12:24:17.449911  2517 leader_election.cc:304] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:17.450892  2708 raft_consensus.cc:2804] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:17.451277  2708 raft_consensus.cc:493] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.451642  2708 raft_consensus.cc:3060] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.457929  2708 raft_consensus.cc:515] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.459751  2708 leader_election.cc:290] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:17.460776  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fac7a1824d04cfca38581b65273e283" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:17.460620  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fac7a1824d04cfca38581b65273e283" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:17.461432  2478 raft_consensus.cc:3060] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.461504  2401 raft_consensus.cc:3060] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.468832  2478 raft_consensus.cc:2468] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 1.
I20260709 12:24:17.468834  2401 raft_consensus.cc:2468] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 1.
I20260709 12:24:17.470157  2517 leader_election.cc:304] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:17.470794  2708 raft_consensus.cc:2804] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:17.471261  2708 raft_consensus.cc:697] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 LEADER]: Becoming Leader. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Running, Role: LEADER
I20260709 12:24:17.471901  2708 consensus_queue.cc:237] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.479260  2693 consensus_queue.cc:1048] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.480021  2301 catalog_manager.cc:5697] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195). New cstate: current_term: 1 leader_uuid: "89bec6b331e948f8887a900fd6e2f2a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:17.493614  2694 consensus_queue.cc:1048] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:17.515564  2401 raft_consensus.cc:1275] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Refusing update from remote peer 89bec6b331e948f8887a900fd6e2f2a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:17.515606  2478 raft_consensus.cc:1275] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Refusing update from remote peer 89bec6b331e948f8887a900fd6e2f2a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:24:17.516180  2478 pending_rounds.cc:85] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48: Aborting all ops after (but not including) 0
I20260709 12:24:17.516417  2478 pending_rounds.cc:107] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:24:17.516708  2478 raft_consensus.cc:2889] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:17.517518  2708 consensus_queue.cc:1048] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.518734  2714 consensus_queue.cc:1048] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.518819  2478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c019c3264cc4e79aa6922758acf533c"
dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
mode: GRACEFUL
new_leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
 from {username='slave'} at 127.0.0.1:58612
I20260709 12:24:17.519513  2478 raft_consensus.cc:606] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Received request to transfer leadership to TS 13e53d4d46f44702bdf15f3f2be8cca3
I20260709 12:24:17.526712  2551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "935539cb010b4b83bf378e5809b0b185"
dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
mode: GRACEFUL
new_leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
 from {username='slave'} at 127.0.0.1:54164
I20260709 12:24:17.527328  2551 raft_consensus.cc:606] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 LEADER]: Received request to transfer leadership to TS 13e53d4d46f44702bdf15f3f2be8cca3
I20260709 12:24:17.535175  2603 raft_consensus.cc:993] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2: : Instructing follower 13e53d4d46f44702bdf15f3f2be8cca3 to start an election
I20260709 12:24:17.535651  2603 raft_consensus.cc:1081] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 LEADER]: Signalling peer 13e53d4d46f44702bdf15f3f2be8cca3 to start an election
I20260709 12:24:17.536234  2478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccd5513dc2504c068f6bf49b626d02fb"
dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
mode: GRACEFUL
new_leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
 from {username='slave'} at 127.0.0.1:58612
I20260709 12:24:17.536962  2478 raft_consensus.cc:606] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Received request to transfer leadership to TS 13e53d4d46f44702bdf15f3f2be8cca3
I20260709 12:24:17.538549  2401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "935539cb010b4b83bf378e5809b0b185"
dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
 from {username='slave'} at 127.0.0.1:57798
I20260709 12:24:17.539243  2401 raft_consensus.cc:493] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:17.539676  2401 raft_consensus.cc:3060] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.547490  2401 raft_consensus.cc:515] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.548149  2400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a98d48a27ce4466adbf463c69a34a6c"
dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
mode: GRACEFUL
new_leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
 from {username='slave'} at 127.0.0.1:57800
I20260709 12:24:17.548848  2400 raft_consensus.cc:606] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Received request to transfer leadership to TS 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:17.552599  2401 leader_election.cc:290] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 3 election: Requested vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.553318  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935539cb010b4b83bf378e5809b0b185" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:17.553666  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935539cb010b4b83bf378e5809b0b185" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:17.554004  2478 raft_consensus.cc:3060] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.554302  2551 raft_consensus.cc:3055] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:17.554625  2551 raft_consensus.cc:740] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Running, Role: LEADER
I20260709 12:24:17.555444  2551 consensus_queue.cc:260] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.556555  2551 raft_consensus.cc:3060] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.562707  2478 raft_consensus.cc:2468] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 3.
I20260709 12:24:17.563695  2606 consensus_queue.cc:1048] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.563926  2368 leader_election.cc:304] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:17.558645  2400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7db54a1e320346578df152c8180c521a"
dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
mode: GRACEFUL
new_leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
 from {username='slave'} at 127.0.0.1:57800
I20260709 12:24:17.564785  2718 raft_consensus.cc:2804] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:17.565307  2400 raft_consensus.cc:606] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Received request to transfer leadership to TS 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:17.565425  2718 raft_consensus.cc:697] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 LEADER]: Becoming Leader. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:17.566712  2718 consensus_queue.cc:237] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.567756  2551 raft_consensus.cc:2468] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 3.
I20260709 12:24:17.574301  2551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a61835c7ef64498da226d783703e02ef"
dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
mode: GRACEFUL
new_leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
 from {username='slave'} at 127.0.0.1:54164
I20260709 12:24:17.574898  2551 raft_consensus.cc:606] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 LEADER]: Received request to transfer leadership to TS 61018e6aad40475ea3d9ce1c4ec8bd48
I20260709 12:24:17.576846  2718 consensus_queue.cc:1048] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.582587  2300 catalog_manager.cc:5697] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 reported cstate change: term changed from 2 to 3, leader changed from 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195) to 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193). New cstate: current_term: 3 leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.646584  2694 consensus_queue.cc:1048] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.655966  2551 raft_consensus.cc:3060] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:17.664898  2693 consensus_queue.cc:1048] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.665458  2718 consensus_queue.cc:1048] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.679330  2606 raft_consensus.cc:993] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3: : Instructing follower 61018e6aad40475ea3d9ce1c4ec8bd48 to start an election
I20260709 12:24:17.679813  2606 raft_consensus.cc:1081] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Signalling peer 61018e6aad40475ea3d9ce1c4ec8bd48 to start an election
I20260709 12:24:17.681353  2478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7db54a1e320346578df152c8180c521a"
dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
 from {username='slave'} at 127.0.0.1:58588
I20260709 12:24:17.685300  2745 consensus_queue.cc:1048] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:24:17.687920  2478 raft_consensus.cc:493] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:17.688374  2478 raft_consensus.cc:3060] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.697186  2478 raft_consensus.cc:515] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.699854  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db54a1e320346578df152c8180c521a" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:17.699915  2478 leader_election.cc:290] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 2 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.700132  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db54a1e320346578df152c8180c521a" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:17.700723  2551 raft_consensus.cc:3060] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.700944  2400 raft_consensus.cc:3055] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:17.701407  2400 raft_consensus.cc:740] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:17.702231  2400 consensus_queue.cc:260] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.703441  2400 raft_consensus.cc:3060] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.706089  2551 raft_consensus.cc:2468] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 2.
I20260709 12:24:17.707309  2444 leader_election.cc:304] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:17.708242  2693 raft_consensus.cc:2804] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:17.708739  2693 raft_consensus.cc:697] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:17.709461  2400 raft_consensus.cc:2468] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 2.
I20260709 12:24:17.709465  2693 consensus_queue.cc:237] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.717149  2299 catalog_manager.cc:5697] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 1 to 2, leader changed from 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193) to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.760764  2635 consensus_queue.cc:1048] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.762782  2635 consensus_queue.cc:1048] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.768420  2694 raft_consensus.cc:993] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48: : Instructing follower 13e53d4d46f44702bdf15f3f2be8cca3 to start an election
I20260709 12:24:17.768899  2694 raft_consensus.cc:1081] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Signalling peer 13e53d4d46f44702bdf15f3f2be8cca3 to start an election
I20260709 12:24:17.774540  2400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccd5513dc2504c068f6bf49b626d02fb"
dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
 from {username='slave'} at 127.0.0.1:57786
I20260709 12:24:17.775264  2400 raft_consensus.cc:493] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:17.775660  2400 raft_consensus.cc:3060] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.783331  2400 raft_consensus.cc:515] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.785701  2478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd5513dc2504c068f6bf49b626d02fb" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:17.785890  2400 leader_election.cc:290] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 2 election: Requested vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.786453  2478 raft_consensus.cc:3055] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:17.786872  2478 raft_consensus.cc:740] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:17.786954  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd5513dc2504c068f6bf49b626d02fb" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:17.787743  2551 raft_consensus.cc:3060] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.787811  2478 consensus_queue.cc:260] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.789108  2478 raft_consensus.cc:3060] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.792869  2551 raft_consensus.cc:2468] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 2.
I20260709 12:24:17.793952  2369 leader_election.cc:304] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:17.794464  2478 raft_consensus.cc:2468] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 2.
I20260709 12:24:17.794786  2745 raft_consensus.cc:2804] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:17.795305  2745 raft_consensus.cc:697] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Becoming Leader. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:17.796221  2745 consensus_queue.cc:237] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.802613  2299 catalog_manager.cc:5697] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 reported cstate change: term changed from 1 to 2, leader changed from 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194) to 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.814646  2745 consensus_queue.cc:1048] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.824407  2718 consensus_queue.cc:1048] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.832337  2606 raft_consensus.cc:993] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3: : Instructing follower 61018e6aad40475ea3d9ce1c4ec8bd48 to start an election
I20260709 12:24:17.832854  2718 raft_consensus.cc:1081] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Signalling peer 61018e6aad40475ea3d9ce1c4ec8bd48 to start an election
I20260709 12:24:17.834527  2476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a98d48a27ce4466adbf463c69a34a6c"
dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
 from {username='slave'} at 127.0.0.1:58588
I20260709 12:24:17.835002  2476 raft_consensus.cc:493] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:17.835301  2476 raft_consensus.cc:3060] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.841753  2476 raft_consensus.cc:515] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.843897  2476 leader_election.cc:290] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 2 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.844521  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a98d48a27ce4466adbf463c69a34a6c" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:17.844877  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a98d48a27ce4466adbf463c69a34a6c" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:17.845183  2400 raft_consensus.cc:3055] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:17.845456  2551 raft_consensus.cc:3060] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.845520  2400 raft_consensus.cc:740] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:17.846367  2400 consensus_queue.cc:260] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.847499  2400 raft_consensus.cc:3060] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.852336  2551 raft_consensus.cc:2468] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 2.
I20260709 12:24:17.853497  2444 leader_election.cc:304] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:17.853868  2400 raft_consensus.cc:2468] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 2.
I20260709 12:24:17.854312  2693 raft_consensus.cc:2804] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:17.854947  2693 raft_consensus.cc:697] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:17.855789  2693 consensus_queue.cc:237] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.861825  2301 catalog_manager.cc:5697] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 1 to 2, leader changed from 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193) to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.891994  2708 consensus_queue.cc:1048] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.899542  2714 raft_consensus.cc:993] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2: : Instructing follower 61018e6aad40475ea3d9ce1c4ec8bd48 to start an election
I20260709 12:24:17.899999  2714 raft_consensus.cc:1081] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 LEADER]: Signalling peer 61018e6aad40475ea3d9ce1c4ec8bd48 to start an election
I20260709 12:24:17.901854  2478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a61835c7ef64498da226d783703e02ef"
dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
 from {username='slave'} at 127.0.0.1:58598
I20260709 12:24:17.902460  2478 raft_consensus.cc:493] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:17.902848  2478 raft_consensus.cc:3060] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.905802  2603 consensus_queue.cc:1048] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.910390  2478 raft_consensus.cc:515] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.911593  2476 raft_consensus.cc:1240] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Rejecting Update request from peer 89bec6b331e948f8887a900fd6e2f2a2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:17.914882  2603 consensus_queue.cc:1059] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.915690  2603 raft_consensus.cc:3055] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:17.915992  2603 raft_consensus.cc:740] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Running, Role: LEADER
I20260709 12:24:17.916661  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61835c7ef64498da226d783703e02ef" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:17.917155  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61835c7ef64498da226d783703e02ef" candidate_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:17.916930  2603 consensus_queue.cc:260] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.917671  2400 raft_consensus.cc:3060] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.918181  2603 raft_consensus.cc:3060] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.915934  2478 leader_election.cc:290] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 2 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:17.927610  2400 raft_consensus.cc:2468] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 2.
I20260709 12:24:17.928719  2443 leader_election.cc:304] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 61018e6aad40475ea3d9ce1c4ec8bd48; no voters: 
I20260709 12:24:17.929425  2635 raft_consensus.cc:2804] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:17.929817  2635 raft_consensus.cc:697] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Becoming Leader. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:17.930595  2635 consensus_queue.cc:237] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:17.931653  2551 raft_consensus.cc:2468] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61018e6aad40475ea3d9ce1c4ec8bd48 in term 2.
I20260709 12:24:17.939110  2299 catalog_manager.cc:5697] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 reported cstate change: term changed from 1 to 2, leader changed from 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195) to 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194). New cstate: current_term: 2 leader_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.975262  2603 consensus_queue.cc:1048] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.986100  2603 consensus_queue.cc:1048] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:18.011088  2551 raft_consensus.cc:1275] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 FOLLOWER]: Refusing update from remote peer 13e53d4d46f44702bdf15f3f2be8cca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:18.012178  2718 consensus_queue.cc:1048] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:18.020180  2478 raft_consensus.cc:1275] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 3 FOLLOWER]: Refusing update from remote peer 13e53d4d46f44702bdf15f3f2be8cca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:18.021852  2606 consensus_queue.cc:1048] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:18.108131  2635 raft_consensus.cc:993] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48: : Instructing follower 13e53d4d46f44702bdf15f3f2be8cca3 to start an election
I20260709 12:24:18.108574  2693 raft_consensus.cc:1081] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Signalling peer 13e53d4d46f44702bdf15f3f2be8cca3 to start an election
I20260709 12:24:18.109896  2401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c019c3264cc4e79aa6922758acf533c"
dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
 from {username='slave'} at 127.0.0.1:57786
I20260709 12:24:18.110488  2401 raft_consensus.cc:493] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:18.110884  2401 raft_consensus.cc:3060] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.116544  2401 raft_consensus.cc:515] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:18.118885  2401 leader_election.cc:290] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 2 election: Requested vote from peers 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397), 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195:37271)
I20260709 12:24:18.119468  2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c019c3264cc4e79aa6922758acf533c" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
I20260709 12:24:18.119050  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c019c3264cc4e79aa6922758acf533c" candidate_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:18.120072  2551 raft_consensus.cc:3060] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.120244  2476 raft_consensus.cc:3055] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:18.120632  2476 raft_consensus.cc:740] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:18.121454  2476 consensus_queue.cc:260] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:18.122717  2476 raft_consensus.cc:3060] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.127128  2551 raft_consensus.cc:2468] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 2.
I20260709 12:24:18.128437  2369 leader_election.cc:304] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:18.129146  2606 raft_consensus.cc:2804] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:18.129442  2476 raft_consensus.cc:2468] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e53d4d46f44702bdf15f3f2be8cca3 in term 2.
I20260709 12:24:18.129583  2606 raft_consensus.cc:697] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Becoming Leader. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:18.130707  2606 consensus_queue.cc:237] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:18.137276  2299 catalog_manager.cc:5697] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 reported cstate change: term changed from 1 to 2, leader changed from 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194) to 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193). New cstate: current_term: 2 leader_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.215273  2551 raft_consensus.cc:1275] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Refusing update from remote peer 61018e6aad40475ea3d9ce1c4ec8bd48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:18.216547  2693 consensus_queue.cc:1048] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:18.224026  2401 raft_consensus.cc:1275] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Refusing update from remote peer 61018e6aad40475ea3d9ce1c4ec8bd48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:18.225607  2693 consensus_queue.cc:1048] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:18.228391  2476 raft_consensus.cc:1275] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Refusing update from remote peer 13e53d4d46f44702bdf15f3f2be8cca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:18.230149  2745 consensus_queue.cc:1048] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:18.239430  2551 raft_consensus.cc:1275] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Refusing update from remote peer 13e53d4d46f44702bdf15f3f2be8cca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:18.241000  2745 consensus_queue.cc:1048] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:18.262122  2551 raft_consensus.cc:1275] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Refusing update from remote peer 61018e6aad40475ea3d9ce1c4ec8bd48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:18.263381  2635 consensus_queue.cc:1048] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:18.271230  2401 raft_consensus.cc:1275] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Refusing update from remote peer 61018e6aad40475ea3d9ce1c4ec8bd48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:18.272994  2693 consensus_queue.cc:1048] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:18.386752  2551 raft_consensus.cc:1275] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Refusing update from remote peer 61018e6aad40475ea3d9ce1c4ec8bd48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:18.389521  2759 consensus_queue.cc:1048] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:18.410401  2401 raft_consensus.cc:1275] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Refusing update from remote peer 61018e6aad40475ea3d9ce1c4ec8bd48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:18.412984  2759 consensus_queue.cc:1048] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:18.601207  2551 raft_consensus.cc:1275] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Refusing update from remote peer 13e53d4d46f44702bdf15f3f2be8cca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:18.602799  2718 consensus_queue.cc:1048] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:18.615855  2476 raft_consensus.cc:1275] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Refusing update from remote peer 13e53d4d46f44702bdf15f3f2be8cca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:18.618342  2718 consensus_queue.cc:1048] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:20.588778  2300 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50950:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:24:20.612816  2300 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50950:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:24:20.637238 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:20.814505  2804 tablet.cc:1724] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:20.815531  2805 tablet.cc:1724] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:20.851998  2807 tablet.cc:1724] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:20.889156  2476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b3b288fb92c4a78b7dd1d7e5e100970"
dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
mode: GRACEFUL
new_leader_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
 from {username='slave'} at 127.0.0.1:42416
I20260709 12:24:20.890731  2476 raft_consensus.cc:606] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Received request to transfer leadership to TS 89bec6b331e948f8887a900fd6e2f2a2
W20260709 12:24:20.899525  2800 log.cc:927] Time spent T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:24:20.901532  2795 log.cc:927] Time spent T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2: Append to log took a long time: real 0.088s	user 0.000s	sys 0.004s
I20260709 12:24:20.951666  2815 tablet.cc:1724] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:20.962541  2444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.81.195:37271, user_credentials={real_user=slave}} blocked reactor thread for 57584.7us
I20260709 12:24:20.962944  2824 tablet.cc:1724] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:20.980782  2801 log.cc:927] Time spent T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
I20260709 12:24:21.044297  2828 tablet.cc:1724] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.051484  2823 tablet.cc:1724] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.055214  2807 tablet.cc:1724] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.058929  2827 tablet.cc:1724] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.072669  2804 tablet.cc:1724] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.096830  2829 tablet.cc:1724] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.096675  2805 tablet.cc:1724] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.107100  2833 tablet.cc:1724] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.107934  2830 tablet.cc:1724] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.113791  2832 tablet.cc:1724] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.127658  2823 tablet.cc:1724] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.155035  2805 tablet.cc:1724] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.159332  2807 tablet.cc:1724] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.159675  2828 tablet.cc:1724] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.157028  2832 tablet.cc:1724] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.180917  2819 raft_consensus.cc:993] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48: : Instructing follower 89bec6b331e948f8887a900fd6e2f2a2 to start an election
I20260709 12:24:21.183527  2819 raft_consensus.cc:1081] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Signalling peer 89bec6b331e948f8887a900fd6e2f2a2 to start an election
I20260709 12:24:21.183348  2805 tablet.cc:1724] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.185952  2546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b3b288fb92c4a78b7dd1d7e5e100970"
dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
 from {username='slave'} at 127.0.0.1:54156
I20260709 12:24:21.186690  2546 raft_consensus.cc:493] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.187108  2546 raft_consensus.cc:3060] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.197952  2546 raft_consensus.cc:515] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:21.208659  2828 tablet.cc:1724] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.211524  2399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3b288fb92c4a78b7dd1d7e5e100970" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:21.212270  2399 raft_consensus.cc:3060] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.149354  2824 tablet.cc:1724] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.201627  2400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f"
dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
mode: GRACEFUL
new_leader_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
 from {username='slave'} at 127.0.0.1:47470
I20260709 12:24:21.218906  2400 raft_consensus.cc:606] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Received request to transfer leadership to TS 89bec6b331e948f8887a900fd6e2f2a2
I20260709 12:24:21.220865 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:21.221506 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:21.202291  2829 tablet.cc:1724] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.222570  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3b288fb92c4a78b7dd1d7e5e100970" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:21.223352  2474 raft_consensus.cc:3055] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:21.223701  2474 raft_consensus.cc:740] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61018e6aad40475ea3d9ce1c4ec8bd48, State: Running, Role: LEADER
I20260709 12:24:21.224716  2474 consensus_queue.cc:260] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:21.226121  2474 raft_consensus.cc:3060] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.228581  2399 raft_consensus.cc:2468] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 3.
I20260709 12:24:21.206732  2815 tablet.cc:1724] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.136976  2827 tablet.cc:1724] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.230366  2517 leader_election.cc:304] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e53d4d46f44702bdf15f3f2be8cca3, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:21.218865  2546 leader_election.cc:290] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 3 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:21.231544  2826 raft_consensus.cc:2804] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:21.232043  2826 raft_consensus.cc:697] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 LEADER]: Becoming Leader. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Running, Role: LEADER
I20260709 12:24:21.233031  2826 consensus_queue.cc:237] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:21.204967  2833 tablet.cc:1724] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:21.258661  2474 raft_consensus.cc:2468] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 3.
I20260709 12:24:21.267858  2300 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694: soft_deleted_table [id=572e0b9f83a348498c706f524039caa7] alter complete (version 1)
I20260709 12:24:21.277175  2299 catalog_manager.cc:5697] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 reported cstate change: term changed from 2 to 3, leader changed from 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194) to 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "89bec6b331e948f8887a900fd6e2f2a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.307825  2765 raft_consensus.cc:993] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3: : Instructing follower 89bec6b331e948f8887a900fd6e2f2a2 to start an election
I20260709 12:24:21.308377  2810 raft_consensus.cc:1081] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Signalling peer 89bec6b331e948f8887a900fd6e2f2a2 to start an election
I20260709 12:24:21.309831  2546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f"
dest_uuid: "89bec6b331e948f8887a900fd6e2f2a2"
 from {username='slave'} at 127.0.0.1:54152
I20260709 12:24:21.310366  2546 raft_consensus.cc:493] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.310626  2546 raft_consensus.cc:3060] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.316860  2546 raft_consensus.cc:515] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:21.318557  2546 leader_election.cc:290] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 3 election: Requested vote from peers 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369), 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397)
I20260709 12:24:21.319258  2399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13e53d4d46f44702bdf15f3f2be8cca3"
I20260709 12:24:21.319461  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa2e843c74b9d8e75db6561e7647f" candidate_uuid: "89bec6b331e948f8887a900fd6e2f2a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48"
I20260709 12:24:21.320004  2399 raft_consensus.cc:3055] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:21.320042  2474 raft_consensus.cc:3060] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.320338  2399 raft_consensus.cc:740] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 13e53d4d46f44702bdf15f3f2be8cca3, State: Running, Role: LEADER
I20260709 12:24:21.321184  2399 consensus_queue.cc:260] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:21.322255  2399 raft_consensus.cc:3060] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.325518  2474 raft_consensus.cc:2468] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 3.
I20260709 12:24:21.326778  2517 leader_election.cc:304] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61018e6aad40475ea3d9ce1c4ec8bd48, 89bec6b331e948f8887a900fd6e2f2a2; no voters: 
I20260709 12:24:21.327345  2399 raft_consensus.cc:2468] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89bec6b331e948f8887a900fd6e2f2a2 in term 3.
I20260709 12:24:21.327456  2826 raft_consensus.cc:2804] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:21.328040  2826 raft_consensus.cc:697] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 LEADER]: Becoming Leader. State: Replica: 89bec6b331e948f8887a900fd6e2f2a2, State: Running, Role: LEADER
I20260709 12:24:21.328994  2826 consensus_queue.cc:237] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } }
I20260709 12:24:21.336966  2299 catalog_manager.cc:5697] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 reported cstate change: term changed from 2 to 3, leader changed from 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193) to 89bec6b331e948f8887a900fd6e2f2a2 (127.23.81.195). New cstate: current_term: 3 leader_uuid: "89bec6b331e948f8887a900fd6e2f2a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89bec6b331e948f8887a900fd6e2f2a2" member_type: VOTER last_known_addr { host: "127.23.81.195" port: 37271 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.625447  2399 raft_consensus.cc:1275] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 FOLLOWER]: Refusing update from remote peer 89bec6b331e948f8887a900fd6e2f2a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:21.626878  2826 consensus_queue.cc:1048] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:21.637843  2474 raft_consensus.cc:1275] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 3 FOLLOWER]: Refusing update from remote peer 89bec6b331e948f8887a900fd6e2f2a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:21.640304  2826 consensus_queue.cc:1048] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:21.805526  2399 raft_consensus.cc:1275] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 FOLLOWER]: Refusing update from remote peer 89bec6b331e948f8887a900fd6e2f2a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:21.806888  2826 consensus_queue.cc:1048] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e53d4d46f44702bdf15f3f2be8cca3" member_type: VOTER last_known_addr { host: "127.23.81.193" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:21.818498  2474 raft_consensus.cc:1275] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 3 FOLLOWER]: Refusing update from remote peer 89bec6b331e948f8887a900fd6e2f2a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:21.820003  2812 consensus_queue.cc:1048] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61018e6aad40475ea3d9ce1c4ec8bd48" member_type: VOTER last_known_addr { host: "127.23.81.194" port: 41397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:22.222723 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:22.228396 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:22.228823 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:23.229785 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:23.235085 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:23.235518 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:24.236724 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:24.243882 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:24.244604 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:25.245801 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:25.251173 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:25.251652 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:26.252703 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:26.257762 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:26.258237 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:27.259240 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:27.264356 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:27.264822 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:28.265787 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:28.271040 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:28.271505 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:29.272756 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:29.278312 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:29.278779 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:30.279959 23879 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:30.286113 23879 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:30.286628 23879 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:31.347765 23879 tablet_server.cc:179] TabletServer@127.23.81.193:0 shutting down...
I20260709 12:24:31.387254 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:31.388093 23879 tablet_replica.cc:333] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.389110 23879 raft_consensus.cc:2243] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.389935 23879 raft_consensus.cc:2272] T a61835c7ef64498da226d783703e02ef P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.392884 23879 tablet_replica.cc:333] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.393616 23879 raft_consensus.cc:2243] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.394289 23879 raft_consensus.cc:2272] T 7db54a1e320346578df152c8180c521a P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.396930 23879 tablet_replica.cc:333] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.397614 23879 raft_consensus.cc:2243] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.398278 23879 raft_consensus.cc:2272] T 1ceb8e78aced4beeae0131227449c8ff P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.400811 23879 tablet_replica.cc:333] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.401413 23879 raft_consensus.cc:2243] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.401939 23879 raft_consensus.cc:2272] T 37092d742c0b4647add3a5ee5cb37a21 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.404783 23879 tablet_replica.cc:333] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.405504 23879 raft_consensus.cc:2243] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.406842 23879 raft_consensus.cc:2272] T 3c019c3264cc4e79aa6922758acf533c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.410374 23879 tablet_replica.cc:333] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.410969 23879 raft_consensus.cc:2243] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.411854 23879 raft_consensus.cc:2272] T 824a47f60dcb4a13927ea2c67d65f16d P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.414341 23879 tablet_replica.cc:333] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.414960 23879 raft_consensus.cc:2243] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.415416 23879 raft_consensus.cc:2272] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.417770 23879 tablet_replica.cc:333] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.418380 23879 raft_consensus.cc:2243] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.418844 23879 raft_consensus.cc:2272] T 9c1e7d759e47415cbb2d3aca0b65857c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.421175 23879 tablet_replica.cc:333] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.421659 23879 raft_consensus.cc:2243] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.422577 23879 raft_consensus.cc:2272] T ccd5513dc2504c068f6bf49b626d02fb P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.425014 23879 tablet_replica.cc:333] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.425489 23879 raft_consensus.cc:2243] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.425972 23879 raft_consensus.cc:2272] T 36cd355e7fcd404f963a5eb70e70db65 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.428362 23879 tablet_replica.cc:333] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.428877 23879 raft_consensus.cc:2243] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.429394 23879 raft_consensus.cc:2272] T 4a98d48a27ce4466adbf463c69a34a6c P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.431694 23879 tablet_replica.cc:333] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.432237 23879 raft_consensus.cc:2243] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.433465 23879 raft_consensus.cc:2272] T 935539cb010b4b83bf378e5809b0b185 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.435843 23879 tablet_replica.cc:333] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.436347 23879 raft_consensus.cc:2243] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.436839 23879 raft_consensus.cc:2272] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.439239 23879 tablet_replica.cc:333] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.439941 23879 raft_consensus.cc:2243] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.440801 23879 raft_consensus.cc:2272] T e7b926463d414499a35891b198c473b4 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.443440 23879 tablet_replica.cc:333] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.443996 23879 raft_consensus.cc:2243] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.444552 23879 raft_consensus.cc:2272] T bd3fa2e843c74b9d8e75db6561e7647f P 13e53d4d46f44702bdf15f3f2be8cca3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.446902 23879 tablet_replica.cc:333] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.447402 23879 raft_consensus.cc:2243] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.448253 23879 raft_consensus.cc:2272] T e0e7206dcbb7483081bd72c656d730bd P 13e53d4d46f44702bdf15f3f2be8cca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.450901 23879 tablet_replica.cc:333] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.451584 23879 raft_consensus.cc:2243] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.452256 23879 raft_consensus.cc:2272] T 6fac7a1824d04cfca38581b65273e283 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.455860 23879 tablet_replica.cc:333] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3: stopping tablet replica
I20260709 12:24:31.456569 23879 raft_consensus.cc:2243] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.457499 23879 raft_consensus.cc:2272] T 5180abfc159d43548a5b72463e7c3669 P 13e53d4d46f44702bdf15f3f2be8cca3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:31.477433  2443 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 12:24:31.481076  2443 consensus_peers.cc:597] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 -> Peer 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369): Couldn't send request to peer 13e53d4d46f44702bdf15f3f2be8cca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:31.490803  2517 consensus_peers.cc:597] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 -> Peer 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369): Couldn't send request to peer 13e53d4d46f44702bdf15f3f2be8cca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:31.502173  2517 consensus_peers.cc:597] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 -> Peer 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369): Couldn't send request to peer 13e53d4d46f44702bdf15f3f2be8cca3. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:40369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:31.511205 23879 tablet_server.cc:196] TabletServer@127.23.81.193:0 shutdown complete.
I20260709 12:24:31.560485 23879 tablet_server.cc:179] TabletServer@127.23.81.194:0 shutting down...
W20260709 12:24:31.590175  2443 consensus_peers.cc:597] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 -> Peer 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369): Couldn't send request to peer 13e53d4d46f44702bdf15f3f2be8cca3. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:40369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:31.593257 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:31.594308 23879 tablet_replica.cc:333] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.595745 23879 raft_consensus.cc:2243] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.596987 23879 raft_consensus.cc:2272] T a61835c7ef64498da226d783703e02ef P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:31.600091  2517 consensus_peers.cc:597] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 -> Peer 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369): Couldn't send request to peer 13e53d4d46f44702bdf15f3f2be8cca3. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:40369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:31.600561 23879 tablet_replica.cc:333] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.601521 23879 raft_consensus.cc:2243] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.602298 23879 raft_consensus.cc:2272] T 824a47f60dcb4a13927ea2c67d65f16d P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:31.605263  2443 consensus_peers.cc:597] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 -> Peer 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369): Couldn't send request to peer 13e53d4d46f44702bdf15f3f2be8cca3. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:40369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:31.605669 23879 tablet_replica.cc:333] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.606462 23879 raft_consensus.cc:2243] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.607358 23879 raft_consensus.cc:2272] T 7db54a1e320346578df152c8180c521a P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.609834 23879 tablet_replica.cc:333] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.610530 23879 raft_consensus.cc:2243] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.611364 23879 raft_consensus.cc:2272] T 1ceb8e78aced4beeae0131227449c8ff P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.614362 23879 tablet_replica.cc:333] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.615391 23879 raft_consensus.cc:2243] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.616302 23879 raft_consensus.cc:2272] T 4a98d48a27ce4466adbf463c69a34a6c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.618888 23879 tablet_replica.cc:333] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.619426 23879 raft_consensus.cc:2243] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.619928 23879 raft_consensus.cc:2272] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.622539 23879 tablet_replica.cc:333] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.623108 23879 raft_consensus.cc:2243] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.623713 23879 raft_consensus.cc:2272] T 935539cb010b4b83bf378e5809b0b185 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.626117 23879 tablet_replica.cc:333] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.626645 23879 raft_consensus.cc:2243] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.627535 23879 raft_consensus.cc:2272] T 37092d742c0b4647add3a5ee5cb37a21 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.629838 23879 tablet_replica.cc:333] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.630446 23879 raft_consensus.cc:2243] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.631028 23879 raft_consensus.cc:2272] T 3c019c3264cc4e79aa6922758acf533c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.633592 23879 tablet_replica.cc:333] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.634145 23879 raft_consensus.cc:2243] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.635020 23879 raft_consensus.cc:2272] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.637605 23879 tablet_replica.cc:333] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.638314 23879 raft_consensus.cc:2243] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.638979 23879 raft_consensus.cc:2272] T bd3fa2e843c74b9d8e75db6561e7647f P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.641846 23879 tablet_replica.cc:333] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.642467 23879 raft_consensus.cc:2243] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.643388 23879 raft_consensus.cc:2272] T 9c1e7d759e47415cbb2d3aca0b65857c P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.646322 23879 tablet_replica.cc:333] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.646926 23879 raft_consensus.cc:2243] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.647462 23879 raft_consensus.cc:2272] T e7b926463d414499a35891b198c473b4 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.649794 23879 tablet_replica.cc:333] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.650509 23879 raft_consensus.cc:2243] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.651168 23879 raft_consensus.cc:2272] T ccd5513dc2504c068f6bf49b626d02fb P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.653317 23879 tablet_replica.cc:333] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.653949 23879 raft_consensus.cc:2243] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.654507 23879 raft_consensus.cc:2272] T 36cd355e7fcd404f963a5eb70e70db65 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.656844 23879 tablet_replica.cc:333] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.657382 23879 raft_consensus.cc:2243] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.657938 23879 raft_consensus.cc:2272] T 6fac7a1824d04cfca38581b65273e283 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.660185 23879 tablet_replica.cc:333] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.660734 23879 raft_consensus.cc:2243] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.661190 23879 raft_consensus.cc:2272] T 5180abfc159d43548a5b72463e7c3669 P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.663381 23879 tablet_replica.cc:333] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48: stopping tablet replica
I20260709 12:24:31.663877 23879 raft_consensus.cc:2243] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.664400 23879 raft_consensus.cc:2272] T e0e7206dcbb7483081bd72c656d730bd P 61018e6aad40475ea3d9ce1c4ec8bd48 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:31.707583  2517 consensus_peers.cc:597] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 -> Peer 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397): Couldn't send request to peer 61018e6aad40475ea3d9ce1c4ec8bd48. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:41397: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:31.708997 23879 tablet_server.cc:196] TabletServer@127.23.81.194:0 shutdown complete.
I20260709 12:24:31.749871 23879 tablet_server.cc:179] TabletServer@127.23.81.195:0 shutting down...
W20260709 12:24:31.772086  2517 consensus_peers.cc:597] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 -> Peer 13e53d4d46f44702bdf15f3f2be8cca3 (127.23.81.193:40369): Couldn't send request to peer 13e53d4d46f44702bdf15f3f2be8cca3. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.193:40369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:31.785269 23879 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:31.786254 23879 tablet_replica.cc:333] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.787168 23879 raft_consensus.cc:2243] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.787724 23879 raft_consensus.cc:2272] T 7db54a1e320346578df152c8180c521a P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.789979 23879 tablet_replica.cc:333] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.790688 23879 raft_consensus.cc:2243] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.791147 23879 raft_consensus.cc:2272] T 1ceb8e78aced4beeae0131227449c8ff P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.793535 23879 tablet_replica.cc:333] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.794160 23879 raft_consensus.cc:2243] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.794641 23879 raft_consensus.cc:2272] T a61835c7ef64498da226d783703e02ef P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.796681 23879 tablet_replica.cc:333] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.797204 23879 raft_consensus.cc:2243] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.797725 23879 raft_consensus.cc:2272] T 824a47f60dcb4a13927ea2c67d65f16d P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.800860 23879 tablet_replica.cc:333] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.801749 23879 raft_consensus.cc:2243] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.802397 23879 raft_consensus.cc:2272] T cbb697b1aa1d4a8f801036a36ab7bbc0 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:31.803972  2517 consensus_peers.cc:597] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 -> Peer 61018e6aad40475ea3d9ce1c4ec8bd48 (127.23.81.194:41397): Couldn't send request to peer 61018e6aad40475ea3d9ce1c4ec8bd48. Status: Network error: Client connection negotiation failed: client connection to 127.23.81.194:41397: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:31.805382 23879 tablet_replica.cc:333] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.805971 23879 raft_consensus.cc:2243] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.806869 23879 raft_consensus.cc:2272] T bd3fa2e843c74b9d8e75db6561e7647f P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.809175 23879 tablet_replica.cc:333] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.809811 23879 raft_consensus.cc:2243] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.810427 23879 raft_consensus.cc:2272] T 4a98d48a27ce4466adbf463c69a34a6c P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.812659 23879 tablet_replica.cc:333] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.813184 23879 raft_consensus.cc:2243] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.813745 23879 raft_consensus.cc:2272] T 935539cb010b4b83bf378e5809b0b185 P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.816161 23879 tablet_replica.cc:333] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.816716 23879 raft_consensus.cc:2243] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.817510 23879 raft_consensus.cc:2272] T 9b3b288fb92c4a78b7dd1d7e5e100970 P 89bec6b331e948f8887a900fd6e2f2a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.819600 23879 tablet_replica.cc:333] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.820158 23879 raft_consensus.cc:2243] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.820685 23879 raft_consensus.cc:2272] T ccd5513dc2504c068f6bf49b626d02fb P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.822930 23879 tablet_replica.cc:333] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.823465 23879 raft_consensus.cc:2243] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.824433 23879 raft_consensus.cc:2272] T 36cd355e7fcd404f963a5eb70e70db65 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.826824 23879 tablet_replica.cc:333] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.827396 23879 raft_consensus.cc:2243] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.827939 23879 raft_consensus.cc:2272] T 3c019c3264cc4e79aa6922758acf533c P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.830164 23879 tablet_replica.cc:333] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.830722 23879 raft_consensus.cc:2243] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.831197 23879 raft_consensus.cc:2272] T 37092d742c0b4647add3a5ee5cb37a21 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.833262 23879 tablet_replica.cc:333] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.833866 23879 raft_consensus.cc:2243] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.834367 23879 raft_consensus.cc:2272] T 9c1e7d759e47415cbb2d3aca0b65857c P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.836374 23879 tablet_replica.cc:333] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.836920 23879 raft_consensus.cc:2243] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.838284 23879 raft_consensus.cc:2272] T 6fac7a1824d04cfca38581b65273e283 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.840834 23879 tablet_replica.cc:333] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.841403 23879 raft_consensus.cc:2243] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.841938 23879 raft_consensus.cc:2272] T 5180abfc159d43548a5b72463e7c3669 P 89bec6b331e948f8887a900fd6e2f2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.844165 23879 tablet_replica.cc:333] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.844801 23879 raft_consensus.cc:2243] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.845294 23879 raft_consensus.cc:2272] T e0e7206dcbb7483081bd72c656d730bd P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.847654 23879 tablet_replica.cc:333] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2: stopping tablet replica
I20260709 12:24:31.848133 23879 raft_consensus.cc:2243] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.848619 23879 raft_consensus.cc:2272] T e7b926463d414499a35891b198c473b4 P 89bec6b331e948f8887a900fd6e2f2a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.889999 23879 tablet_server.cc:196] TabletServer@127.23.81.195:0 shutdown complete.
I20260709 12:24:31.927470 23879 master.cc:562] Master@127.23.81.254:40391 shutting down...
I20260709 12:24:31.950173 23879 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.950871 23879 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.951242 23879 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1e73b82b4cb444938def94c3da7d0694: stopping tablet replica
I20260709 12:24:31.972016 23879 master.cc:584] Master@127.23.81.254:40391 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20618 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41704 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (403508 ms total)
[  PASSED  ] 8 tests.
I20260709 12:24:32.033381 23879 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2233 messages since previous log ~32 seconds ago
I20260709 12:24:32.033664 23879 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2233 messages since previous log ~32 seconds ago
I20260709 12:24:32.033855 23879 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2232 messages since previous log ~32 seconds ago
I20260709 12:24:32.034103 23879 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:24:32.034286 23879 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:24:32.034433 23879 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~93 seconds ago
I20260709 12:24:32.034591 23879 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~165 seconds ago
I20260709 12:24:32.034730 23879 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 1 messages since previous log ~153 seconds ago
I20260709 12:24:32.034933 23879 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 12:24:32.035189 23879 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~19 seconds ago
